Staff Software Engineer, AI Phone Assistant

Zocdoc•New York, NY

12h•Hybrid

About The Position

Help shape the future of healthcare communication by building Zocdoc’s AI Phone Assistant Zo, an intelligent voice agent that answers inbound calls for hospitals and doctor’s offices. This is a high-impact, high-growth initiative where you’ll help design, build, and scale AI systems that are redefining how patients and providers connect. This team builds with emerging tools and approaches, continuously researching, experimenting, and evaluating how AI systems behave in production. Our focus is on designing intelligent flows, orchestration, and decision-making — not just individual model calls. Engineers on this team take ideas from early exploration through production and continue evolving them based on real usage.

Requirements

7+ years of professional software development experience, with at least 2+ years building or integrating AI/ML systems in production environments
Strong proficiency in C#, and experience with distributed systems and microservices architectures
Experience working with large language models (LLMs), prompt engineering, or AI-powered conversational interfaces
Proven ability to design, build, and scale complex, reliable, and high-performance systems
A deep understanding of data structures, algorithms, and software design principles
A track record of technical leadership and ownership over major systems or product areas
Strong collaboration and communication skills — able to partner across disciplines to deliver results
A passion for leveraging AI to build products that make a real difference in people’s lives

Responsibilities

Architect, build, and maintain high-quality, scalable software systems that power Zocdoc’s AI Phone Assistant.
Design and implement AI-driven workflows, integrating large language models (LLMs) and conversational AI into production systems.
Lead prompt engineering, model integration, and system optimization to improve accuracy, responsiveness, and reliability.
Collaborate cross-functionally with product, design, and data science teams to deliver production-grade AI capabilities.
Drive the evolution of our AI platform — from experimentation and rapid prototyping to scalable, reliable systems in production.
Ensure system scalability, observability, and performance as the product grows rapidly.
Stay ahead of the curve on emerging GenAI tools and technologies, and apply them to solve real-world user problems.