AI Automation QA Engineer

Twin Health • Menlo Park, CA

2d • Hybrid

About The Position

Twin Health is seeking an AI Automation QA Engineer with extensive manual testing and AI-driven test automation experience. The ideal candidate will have worked in a fast-paced enterprise or start-up environment, delivering comprehensive regression test coverage of complex web and mobile applications, with strong back-end expertise. Twin Health empowers people to improve and prevent chronic metabolic diseases, like type 2 diabetes and obesity, with a new standard of care, using AI Digital Twin technology. The company is scaling rapidly across the U.S. and globally, backed by leading venture firms.

Requirements

• Experience testing both web UIʼs and mobile applications (iOS, Android and Flutter) for consumer-facing or other high-scale applications
• Experience developing AI-driven regression automation via Claude or other recent models
• Strong verbal and written communication skills
• High-order analytical and critical thinking approach
• Bachelorʼs degree in Computer Science or a related field
• 3+ years of overall experience in QA engineering focused on test automation
• Strong programming experience in Java, Python or JavaScript
• Experience with automation tools such as Playwright, Maestro, Appium or Selenium
• Experience with SQL databases
• Experience with test data generation
• Experience testing REST API backends for consumer-facing or other high-scale applications
• Experience with automated performance testing tools such as jMeter or locust
• Candidates must be authorized to work for any employer in the U.S.; we are unable to sponsor or take over sponsorship of an employment visa at this time.

Nice To Haves

• Experience building and maintaining evaluations for internal models is a plus, but not required
• Experience validating text and voice conversational agents via tools such as Cekura is a plus, but not required
• Domain experience in healthcare, biosensors, or related areas would be a plus, but is not required

Responsibilities

• Via collaboration with stakeholders derive comprehensive end-to-end regression test cases and test plans covering critical application behavior
• Design, implement and maintain robust, AI-driven, end-to-end automated regression test coverage of our web and mobile applications
• Contribute to evaluation coverage of internally developed models
• Derive AI-driven automated testing strategy - evolving our test infrastructure to take advantage of agentic AI for rapid prompt-driven test generation and test healing
• Design and develop automated data generation to support automated testing scenarios
• Work with Developers, PM and UX designers to release an outstanding user experience for our integrated ecosystem of applications
• Other duties as assigned

Benefits

• A competitive compensation package in line with leading technology companies
• A remote and accomplished global team
• Opportunity for equity participation
• Unlimited vacation with manager approval
• 16 weeks of 100% paid parental leave for delivering parents
• 8 weeks of 100% paid parental leave for non-delivering parents
• 100% Employer sponsored healthcare, dental, and vision for you, and 80% coverage for your family
• Health Savings Account and Flexible Spending Account options
• 401k retirement savings plan

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level