Quality Assurance Engineer (Remote)

MRIoA•Salt Lake, UT
•Remote

About The Position

The Quality Assurance Engineer is a corporate function within the Engineering organization, responsible for the quality, reliability, and release-readiness of software products built on modern technologies, including cloud-native applications hosted on Microsoft Azure and AI/ML-enabled features. The role primarily tests software applications created or updated by the Application Development team and conducts structured peer and code reviews of test artifacts to ensure standards and best practices are followed. The engineer designs, creates, and maintains realistic, compliant test data—including synthetic, PHI-safe healthcare scenarios—and develops validation strategies for AI/ML and Retrieval-Augmented Generation (RAG) features. This includes evaluating model quality, grounding, safety, retrieval accuracy, output quality, bias, hallucinations, and drift. The position also develops automated tests and evaluation harnesses, validates data and application behavior across systems and environments, and supports release readiness and production stability. This is a remote, work-from-home position. The role requires the ability to sit at a desk and use a computer, telephone, and other basic office equipment. Applicants must pass a background screen; newly hired employees must take a drug screen and comply with applicable HIPAA requirements and company confidentiality, privacy, and security policies.

Requirements

  • At least 5 years of experience in automated software testing.
  • At least 5 years of experience in manual software testing.
  • At least 5 years of experience in component-level testing.
  • At least 5 years of experience in end-to-end testing.
  • Proficiency in SQL.
  • Proficiency in React.
  • Proficiency in Node.js.
  • Proficiency in Python source code in GitLab.
  • Proficiency in testing and evaluating artificial intelligence (AI).
  • Proficiency in testing and evaluating machine learning (ML).
  • Proficiency in testing Retrieval-Augmented Generation (RAG).
  • Proficiency in testing generative AI features.
  • Proficiency in testing workloads on Microsoft Azure.
  • High school diploma required.
  • Ability to sit at a desk and use a computer, telephone, and other basic office equipment.
  • Must pass a background screen before beginning employment; newly hired employees must also take a drug screen.
  • Must adhere to applicable HIPAA regulations and company policies and procedures regarding sensitive health information.

Nice To Haves

  • Bachelor’s degree.

Responsibilities

  • Participate in the test management lifecycle, including test planning, execution tracking, defect management, and reporting.
  • Provide input to Engineering and Product stakeholders on release-readiness criteria.
  • Maintain the regression suite after every release.
  • Develop and maintain automated test suites in Python (e.g., pytest) and JavaScript/Node.js, integrated into CI/CD pipelines.
  • Write and review complex SQL queries, joins, and aggregations to validate data accuracy, completeness, and reconciliation across systems.
  • Validate data flows across source systems, transformation layers, and reporting or consumption layers.
  • Ensure test data supports functional automation and AI/ML and RAG evaluation needs.
  • Design and execute test strategies for AI/ML, RAG pipelines, and AI-assisted features, including retrieval accuracy, grounding, hallucination, output quality, bias and safety, and drift or regression checks.
  • Build and maintain automated evaluation harnesses and datasets for AI/ML features, including prompt/response scoring and metric tracking.
  • Validate applications, APIs, and test environments deployed in an on-premises data center and on Microsoft Azure, including Azure-hosted services, data stores, and CI/CD pipelines.
  • Read and interpret React, Node.js, Python, and ColdFusion source code, pull requests, and technical designs to identify testable conditions, edge cases, and regression risk.
  • Write detailed test cases and test plans that trace to code paths, business rules, and acceptance criteria.
  • Partner with developers during code review to identify insufficient test coverage, untested branches, and high-risk changes before merge.
  • Perform post-deployment validation to confirm application, API, and AI-feature stability in production.
  • Investigate production defects and data issues, perform root cause analysis, and drive resolution with Engineering.
  • Conduct structured peer and code reviews of test artifacts.
  • Design, create, and maintain realistic, compliant test datasets, including synthetic PHI-safe healthcare scenarios.

Benefits

  • Competitive compensation package.
  • Healthcare insurance.
  • Vision insurance.
  • Dental insurance.
  • Generous 401(k) match.
  • Paid vacation, PTO, and holidays.
  • Growth and training opportunities.
  • Award-winning remote work environment.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service