Manager, Software Engineering - Agentic Assurance Platform

Invoca•Los Angeles, CA
•$195,000 - $275,000•Remote

About The Position

Invoca is hiring an Engineering Manager to lead its new Agentic Assurance Platform team. The role owns the platform’s delivery, operational health, and growth, and manages a growing team of engineers. Reporting to AI Engineering leadership, the manager will shape both the platform and the team and make assurance a default part of how Invoca’s agent teams develop and deploy products. The platform is intended to give Invoca and its customers evidence-backed confidence that agent deployments continue to work as systems change. It will provide APIs and policy-based release gates, orchestration for simulated conversations, scoring and evaluation, production quality signals, and checks that verify outcomes in customer systems. The platform charter covers voice and messaging agents as well as future agentic products. This is a hands-on technical management role. The manager will work with an architect and tech lead, providing technical direction and maintaining a high bar in design reviews involving distributed systems, APIs, data pipelines, and AI evaluation. The role requires staying close to code, traces, and data while making sound decisions about evidence, sampling, and evaluation reliability. The position is remote-first and open to candidates based within approximately a two-hour drive of the listed U.S. metropolitan areas: Greater Los Angeles (including Santa Barbara and San Diego), San Francisco Bay Area, Denver, Austin, Chicago, Greater New York City, or Seattle. Occasional business travel may be required.

Requirements

  • At least 8 years of software engineering experience, including meaningful hands-on experience building backend, distributed, data, or platform systems.
  • At least 3 years of experience managing engineers.
  • Experience leading a platform, infrastructure, or developer-experience team serving internal engineers, with a track record of driving measurable adoption.
  • Working fluency in modern AI systems and their evaluation, including LLM APIs and agents, tool calling with MCP or similar protocols, simulation, LLM-as-judge failure modes, tracing, and telemetry.
  • Sufficient technical depth to maintain a high bar in design reviews; research experience is not required.
  • Statistical judgment, including comfort with sampling, confidence intervals, and comparisons against live systems.
  • Systems-thinking experience debugging failures across services, third-party APIs, data pipelines, and configuration.
  • Data-driven delivery management experience using DORA metrics or equivalent to identify and address bottlenecks, with an understanding of flow.
  • Experience owning production services and running incident response.
  • An operational and security mindset, including treating auditability and customer-conversation privacy as design requirements.
  • Demonstrated success hiring and retaining senior engineers.
  • Direct, calibrated communication with engineers and executives, including surfacing risks early and clearly communicating what is known and unknown.
  • High ownership in ambiguous, fast-moving environments.
  • Must be based within approximately a two-hour drive of one of the listed hiring areas; occasional business travel may be required.

Nice To Haves

  • Experience building evaluation, testing, or reliability infrastructure as a shared platform.
  • Experience with voice or conversational AI, telephony, contact-center systems, or regulated industries such as healthcare or financial services.

Responsibilities

  • Manage, coach, develop, hire, and retain engineers on the Agentic Assurance Platform team; set clear expectations and support career growth.
  • Build a culture of ownership and engineering craft, focused on users, measurable outcomes, and effective use of agentic tools.
  • Run the platform as a product for internal users; set and measure adoption and outcome goals, including failures caught by automation, time to detect, and time to restore.
  • Partner with Product, agent platform and product teams, customer-deploying teams, and architects on roadmap priorities; represent the platform in R&D planning and launch readiness.
  • Make the platform self-serve through APIs, SDKs, CI integrations, shared scenario and policy formats, and reference implementations.
  • Build assurance for changes to agent behavior across code, prompts, templates, model routes, tool contracts, configuration, and partner systems.
  • Introduce new release gates in shadow mode and establish evidence for when they can block releases.
  • Design risk-based policies that assign appropriate evidence, sample sizes, and rollout approaches to different types of changes.
  • Keep the platform core small and stable, with contracts, policy, and evidence separated from pluggable simulation, scoring, and observability engines.
  • Own delivery health using DORA-style metrics or equivalent and flow analysis; manage work in progress and make delivery predictable.
  • Identify and automate repetitive, high-volume work.
  • Build calibration and health checks for judges, simulators, test fixtures, monitors, and release gates; treat missing evidence as insufficient rather than a pass.
  • Make platform metrics trustworthy by reporting confidence intervals, judge accuracy against human labels, and uncertainties alongside verdicts.
  • Provide isolated production-like test environments and realistic simulations that keep test traffic separate from customer data.
  • Establish operational rigor through platform SLOs, owner-routed alerts, on-call health, postmortems, and a process that turns incidents into regression scenarios.
  • Partner with Security to ensure access control, auditability, and customer-conversation privacy keep pace with platform capabilities.
  • Make the team a reference implementation for AI-assisted engineering, including agentic coding workflows, automated review gates, and AI use in the SDLC.
  • Use agents within the platform to generate scenarios, triage failures, and identify coverage gaps, subject to the same gates as other changes.

Benefits

  • U.S. health benefits begin on the first day of employment, including medical, dental, and vision coverage.
  • Mental wellbeing support and an Employee Assistance Program.
  • Wellness subsidy reimbursable toward gym memberships, fitness classes, and other wellness expenses.
  • Flexible paid time off.
  • 20 U.S. paid holidays, including a winter break.
  • Up to 12 weeks of 100% paid family leave for baby bonding, adoption, and caring for family members.
  • Up to 12 weeks of 100% paid medical leave for childbirth and medical needs.
  • Access to enterprise-grade AI tools, including leading LLMs and agentic AI workflow solutions.
  • Up to $1,000 per fiscal year for professional development, learning, certifications, conferences, and related opportunities.
  • 401(k) plan through Fidelity with a company match of up to 4%.
  • Company-wide and team recognition programs, including President's Club and quarterly and departmental awards.
  • Sabbatical after seven years of service.
  • Stock option program for all employees.
  • Bonus and/or commission eligibility, where applicable.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service