Lead Architect, AI Quality and Reliability Engineering

Vizient•Chicago, IL
•$135,200 - $236,600

About The Position

The Lead Architect, AI Quality and Reliability Engineering leads quality engineering strategy and execution across the product. The role establishes test automation, validation standards, and measurable quality goals, and designs scalable automated testing frameworks across data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications. The position develops data validation and reconciliation practices to protect the accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics. It also creates automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation. The role drives end-to-end product validation and partners with Product, Engineering, and domain experts to ensure production readiness. It champions shift-left quality engineering, mentors engineers, and continually improves automation, testing practices, and product reliability.

Nice To Haves

  • Develop reusable testing tools and automation frameworks leveraging Palantir Foundry, AIP, and modern AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies to improve testing efficiency, coverage, and reliability.

Responsibilities

  • Lead quality engineering strategy and execution, establishing test automation, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks for data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish data validation and reconciliation practices to ensure the accuracy, completeness, consistency, and integrity of healthcare data and calculated metrics.
  • Develop automated testing approaches for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain automated regression suites, test datasets, CI/CD quality gates, and monitoring capabilities to detect defects early and prevent regressions.
  • Drive end-to-end product validation, including integration, functional, performance, and reliability testing across complex data and application workflows.
  • Partner with Product, Engineering, and domain experts to define acceptance criteria, investigate defects, and ensure production readiness.
  • Champion shift-left quality engineering, mentor engineers, and drive continuous improvement in automation, testing practices, and product reliability.

Benefits

  • Comprehensive benefits plan (details provided via the company careers benefits page).
  • Incentive eligible.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service