As a Research Scientist on the Agent Flywheel team, you will build the context layer for recursive self-improvement and autofix loops for agents, turning raw production session traces from Databricks’ data agents into online signals agents can optimize against. You will research how to convert real customer interactions into deterministic metrics, calibrated LLM judges, and failure clusters, then close the loop so those signals drive training and agent improvement. You will join a collaborative team of researchers and encode findings into products customers rely on. The role focuses on production session traces from Genie Code and Genie One, reliable model feedback, datasets and reward signals for post-training, benchmarks and RL environments based on customer workloads, and evaluation research for agents that act. You will keep up with developments in deep learning and create techniques that go beyond the state of the art.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed