AI / Eval Engineer

Vera Health•San Francisco, CA

1d•Hybrid

About The Position

Vera is the fastest-growing clinical app for healthcare professionals in the world. We are building the founding team, and the people who join now will define how this company operates for the next decade and shape the future of healthcare. We move at a pace that feels unreasonable to most, and completely natural to the right people. The role involves understanding and optimizing a complex search and reasoning engine, pushing its performance by optimizing every part of it, down to the smallest parameter. This is about going a step further, understanding how the system behaves across specialties, clinical contexts, and edge cases, and improving it so that answers hold up no matter the setting. The goal is to make the system better for every question, every specialty, and every clinical setting.

Requirements

You don’t trust outputs you can’t explain
You care about being right, not just being close
You like working in messy spaces where there’s no obvious path
You move fast, but you don’t compromise when the stakes are high
You have strong technical depth in LLMs, search, or similar systems
You’re excited to work at the edge of what’s currently being done

Responsibilities

Optimize every layer of the system, from model behavior to retrieval to ranking to the smallest parameters
Take a system with thousands of moving parts and figure out which ones actually drive better answers
Push performance forward by testing, breaking, and refining how outputs are generated
Go deep on failures, not just what went wrong, but what pattern it reveals
Tune how the system behaves across different specialties, question types, and edge cases
Work directly with the founders on the highest-leverage improvements
Work with leading healthcare institutions to validate how the system performs in practice