Applied AI Engineer, Evals
About The Position
Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call. The role involves translating what makes a good performance into clear, defensible signals, and using those signals to improve Aidan. This role involves carrying out evaluations of agents on a broad range of areas on the frontier including voice, vision, and browser use, and using the findings to optimize the agent, context, and models.
Requirements
- Engineer with statistics and/or applied machine learning experience
- Comfortable in a production codebase
Nice To Haves
- Prior experience with evaluations
- Prior experience with voice, realtime, or browser use/computer use agents.
Responsibilities
- Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models
- Build and maintain our internal benchmarks and simulations
- Work on systems to score customer-specific scenarios and identify gaps in current capabilities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
