Agent Product Manager (Remote - US East Coast)

Quadrivia•New York, NY

1d•Remote

About The Position

Quadrivia is seeking an Agent Product Manager to own the development and performance of AI agents within real healthcare system accounts. This role involves working directly with customers on-site to configure, test, deploy, and continuously improve agents that handle routine clinical tasks. The goal is to free up clinical staff to focus on patient care by leveraging AI for repetitive processes. This is a forward-deployed product ownership role, emphasizing accountability for agent performance and outcomes. The company is pioneering a new way to run a business by automating internal processes with AI agents, starting with healthcare. This position is crucial for scaling Quadrivia's agent-based solutions across numerous health systems. While implementation and commercial relationships are handled by separate roles, the Agent Product Manager is responsible for the automation's success. The role is expected to evolve as tooling improves, with an emphasis on building reusable components and driving towards self-service for customers. This is an opportunity to be at the forefront of AI implementation in healthcare, shaping the future of how AI agents interact with patients and clinical workflows.

Requirements

Deep understanding of US healthcare systems from an internal perspective, including provider organizations, scheduling, referrals, front desk operations, call centers, EHR workflows, eligibility, and prior authorization.
Ability to understand how health systems actually operate on a day-to-day basis, beyond stated wants.
US-based on the East Coast (Eastern timezone) with the ability to travel regularly to customer sites.
3-6 years of experience in roles requiring rapid mastery of unfamiliar technical domains in customer-facing settings (e.g., forward-deployed engineering, solutions engineering, technical product management, top-tier consulting, early-stage company problem-solving).
Demonstrated practical fluency with LLM systems, including prompt design, structured extraction, evaluation, and understanding of agent failure modes.
Experience shipping production-level AI/LLM systems.
Comfort reading and reasoning from system telemetry, including logs, dashboards, traces, and configuration files.
Proficiency in SQL and scripting; writing production code is not required but is welcome.
Exceptional written communication skills for creating specifications, test cases, root-cause analyses, and customer reports.
Rigorous approach to correctness, especially in clinical contexts, understanding the responsibility of working with systems that interact with patients.
Ability to hold one's own in discussions with health system practice managers, clinical leads, and executives.

Nice To Haves

Hands-on experience with EHR systems like Epic, Cerner/Oracle Health, athenahealth.
Experience with contact center telephony.
Experience with enterprise customers and stakeholder management.
Conversational AI or voice stack experience (ASR/TTS, LiveKit, Twilio, or equivalent).
Experience building evaluation or regression-testing systems for non-deterministic software.
A second working language, particularly Spanish or Mandarin.

Responsibilities

Deploy agents on customer sites, observing actual workflows and translating them into agent behavior.
Integrate agents into customer environments, including EHR, phone systems, scheduling platforms, and clinical protocols, working with integration engineers.
Serve as the AI and technical expert for customers during deployment and for Sales in demos and scoping.
Configure agents within the Cortex platform, including conversation graphs, prompts, extraction, and logic.
Build and maintain agent orchestration journeys, including scheduling, retries, and escalation paths.
Define key performance indicators (KPIs) to measure customer outcomes and goals.
Collaborate with the broader product team to improve the platform and adapt tools for new markets.
Author regression test suites in Starfish to ensure agent behavior is correct and robust.
Reproduce production failures, test fixes, and ensure regression gates are met before deployment.
Work with Clinical and Quality teams to ensure agent behavior meets clinical safety standards.
Own the end-to-end performance of agents on assigned accounts, diagnosing and fixing issues.
Report on automation performance metrics (containment, resolution, escalation rates) to customers.
Differentiate between agent misconfigurations and platform bugs, escalating the latter with evidence.
Build hundreds of agents, identifying patterns to create reusable templates, test suites, and tooling requirements.
Contribute to the development of agent quality standards and definitions of done for the company.