About The Position

Invoca is hiring an Engineering Manager to lead its new Agentic Assurance Platform team. The team builds a shared platform that gives Invoca and its customers evidence-based confidence that agent deployments continue to work as systems change. Its scope includes APIs and policy engines for CI release gates, simulated conversations across voice, messaging, web, agents, scorers and LLM judges, live production quality signals, and checks that verify outcomes in customer systems. The manager will lead and grow the engineering team and own the platform’s delivery, operational health, and development. Reporting to AI Engineering leadership, this person will work alongside an architect and tech lead, providing technical leadership in design reviews across distributed systems, APIs, data pipelines, and AI evaluation while staying close to code, traces, and data. The role combines people management with platform product ownership: establishing adoption and outcome goals, making the platform self-serve, and ensuring agent-affecting changes are evaluated and monitored with trustworthy evidence. The role also owns delivery predictability, operational rigor, and platform trust. This includes measuring delivery with DORA-style metrics, calibrating evaluation tools, building isolated production-like test environments, establishing SLOs and incident practices, and partnering with Security on access control, auditability, and privacy. The manager will champion AI-assisted engineering and use agents within the platform under the same assurance gates. This is a remote-first role for candidates based within approximately a two-hour drive of the listed U.S. metro areas: Greater Los Angeles (including Santa Barbara and San Diego), San Francisco Bay Area, Denver, Austin, Chicago, Greater New York City, or Seattle. Occasional business travel may be required. U.S. health benefits begin on the first day of employment. Compensation includes a base salary of $195,000–$275,000, with bonus and/or commission eligibility where applicable, and stock options. Actual compensation depends on experience, skills, and location.

Requirements

  • At least 8 years of software engineering experience, including meaningful hands-on experience building backend, distributed, data, or platform systems.
  • At least 3 years of experience managing engineers.
  • Experience leading a platform, infrastructure, or developer-experience team serving internal engineers, with a record of driving measurable adoption.
  • Working fluency with modern AI systems and their evaluation, including LLM APIs and agents, tool calling with MCP or similar protocols, simulation, LLM-as-judge failure modes, tracing, and telemetry.
  • Sufficient technical depth to maintain a high bar in design reviews; research experience is not required.
  • Statistical judgment, including comfort with sampling, confidence intervals, and comparing a candidate system against the live system.
  • Systems thinking and experience debugging failures across services, third-party APIs, data pipelines, and configuration.
  • Data-driven delivery management experience using DORA metrics or equivalent to identify and address bottlenecks, with an understanding of flow.
  • Operational and security mindset, including ownership of production services and incident response, and treating auditability and customer-conversation privacy as design requirements.
  • Demonstrated success hiring and retaining senior engineers.
  • Direct, calibrated communication with engineers and executives, including surfacing risks early and clearly distinguishing what is known from what is uncertain.
  • High ownership in ambiguous, fast-moving environments.
  • Must be based within approximately a two-hour drive of one of the listed U.S. hiring areas: Greater Los Angeles Area (including Santa Barbara and San Diego), SF Bay Area, Denver Metro, Austin Metro, Chicago Metro, Greater NYC Area, or Seattle.

Nice To Haves

  • Experience building evaluation, testing, or reliability infrastructure as a shared platform.
  • Experience with voice or conversational AI, telephony or contact-center systems, or regulated industries such as healthcare or financial services.

Responsibilities

  • Manage, coach, and develop engineers; set clear expectations, provide feedback, and support career growth.
  • Hire senior engineers and provide a strong candidate experience with efficient interviews and timely decisions.
  • Build a culture of ownership and craft in which engineers build for users, measure outcomes, and use the tools they create.
  • Run the platform as a product for internal users, setting and measuring adoption and outcome goals such as failures caught by automation, time to detect, and time to restore.
  • Partner with Product, agent platform and product teams, customer-facing agent deployment teams, and architects on roadmap, priorities, R&D planning, and launch readiness.
  • Make the platform self-serve through APIs, SDKs, CI integrations, shared scenario and policy formats, and reference implementations.
  • Build assurance for all ways agent behavior can change, including prompts, templates, model routes, tool contracts, configuration, and partner systems.
  • Ship new release gates in shadow mode and establish evidence-based policies for when gates can block releases.
  • Design risk-based policies that tailor evidence, sample sizes, and rollout requirements to the nature of a change.
  • Keep the platform core small and stable, with contracts, policy, and evidence separated from pluggable simulation, scoring, and observability engines.
  • Own delivery health using DORA-style metrics and flow analysis; manage work in progress, improve predictability, surface risks, and automate concentrated toil.
  • Ensure evaluation instruments—including judges, simulators, fixtures, monitors, and gates—are calibrated and health-checked.
  • Make verdicts trustworthy by using confidence intervals, measuring judge accuracy against human labels, and recording uncertainty; treat missing evidence as insufficient rather than a pass.
  • Build isolated test environments and realistic simulations that keep test traffic separate from customer data.
  • Establish platform SLOs, actionable alerts, healthy on-call practices, honest postmortems, and a process that turns incidents into regression scenarios.
  • Partner with Security to maintain appropriate access control, auditability, and privacy protections.
  • Make the team a reference implementation for AI-assisted engineering, including agentic coding workflows, automated review gates, and AI in the software development lifecycle.
  • Use agents within the platform to generate scenarios, triage failures, and identify coverage gaps under the same gates as other changes.

Benefits

  • Medical, dental, and vision coverage beginning on the first day of employment for U.S.-based teammates.
  • Mental wellbeing support and an Employee Assistance Program.
  • Wellness subsidy reimbursable toward gym memberships, fitness classes, and more.
  • Flexible paid time off.
  • 20 U.S. paid holidays, including a winter break.
  • Up to 12 weeks of 100% paid family leave for baby bonding, adoption, and caring for family members.
  • Up to 12 weeks of 100% paid medical leave for childbirth and medical needs.
  • Access to enterprise-grade AI tools, including leading LLMs and agentic AI workflow solutions.
  • Up to $1,000 annual professional development reimbursement for learning, certifications, conferences, and other opportunities.
  • 401(k) plan through Fidelity with company match up to 4%.
  • Company-wide and team recognition programs, including President's Club and quarterly and departmental awards.
  • Sabbatical after seven years of service.
  • Bonus and/or commission eligibility, where applicable.
  • Stock option program for employees.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service