AI Engineer, Internal Systems

Wispr Flow • San Francisco, CA

15d • $220,000 - $300,000

About The Position

Our agents already write code and respond to incidents around the clock, but they can't yet tell when they're done, so every loop still ends with a human checking. You'd be the first to build the verification and evaluation layer that lets them finish with confidence.

Requirements

• You've built internal tools that other engineers adopted, and you can explain how you measured their impact
• You use agentic coding tools deeply and have specific opinions about where they succeed and fail
• You've built evaluation or verification infrastructure such as test harnesses, CI systems, eval pipelines, or benchmarks
• You can work hands-on across application code, infrastructure, and unfamiliar systems
• You are empirical about your own work, attentive to subtle failure modes, and comfortable owning ambiguous problems

Nice To Haves

• Prior experience in voice, model training, or our product domains is not required.

Responsibilities

• Build end-to-end verification loops that let agents determine when their work is actually complete
• Create fast, reliable testing environments and turn failures and human feedback into durable evaluation signals
• Improve how context, instructions, skills, and memory are delivered to agents—and measure what makes them perform better
• Operate the agent fleet as a production system and measure its quality, adoption, and impact

Benefits

• We sponsor H1B, O1, EB1, L1, STEM OPT, and more. We can't guarantee sponsorship for every role, but if we make you an offer we'll make every reasonable effort, with help from our immigration law firm.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Education Level: No Education Listed