Concurrence is hiring a Software Engineer, Voice Evaluation to build and own the system that determines whether its voice agents are ready for patients. The role is responsible for realistic audio testing, scoring, and the release gate, including the authority to block releases that fail established criteria. Evaluations should detect failures that may not appear in transcripts, such as mishandled interruptions, missed clinical information, or failure to hand off to a person. The engineer will build simulated callers and call-replay tests that exercise the production voice path with real audio; test scenarios such as phone trees, hold queues, interruptions, conflicting clinical information, and escalation; develop and calibrate scoring systems; and assess whether simulation results predict behavior on real calls. The role also defines release criteria with model, runtime, product, and clinical colleagues, turns production failures into regression tests, verifies fixes, monitors post-release behavior, and maintains held-out evaluation sets. The position is based on site in New York City or San Francisco. Concurrence builds a platform for healthcare organizations to create clinical AI agents, backed by a Health World Model that unifies health-system data into an event-level patient-care record. The company reports that its agents have supported more than 10 million patient encounters and that it has about 35 people working in person in New York and San Francisco.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed