As a Research Scientist on Databricks’ Agent Flywheel team, you will build the context layer for recursive self-improvement and autofix loops for agents. This involves turning raw production session traces from Databricks data agents into online signals that agents can optimize against. You will research ways to convert real customer interactions into deterministic metrics, calibrated LLM judges, and failure clusters, and connect those signals to training and agent improvement. You will work collaboratively with researchers from diverse backgrounds and encode research findings into products customers rely on. The work spans evaluation and measurement for agents, including feedback signals, post-training datasets, benchmarks, and reinforcement-learning environments based on real customer workloads.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed