Test Engineering Leader - Evinova

AstraZeneca • Gaithersburg, MD

1d • $165,657 - $217,425 • Hybrid

About The Position

Evinova is building AI-native products that are reshaping how clinical trials are designed, documented, and delivered. Our AI-native product suite include Study Designer, Study Document Assistant, AI Document Authoring, and Pipeline Management and put large language models, intelligent automation, and human-centered design directly into the hands of clinical researchers and life-sciences professionals. We’re looking for a Test Engineering Leader who is equal parts strategist and practitioner—someone who can define how we validate AI-powered software at scale, then roll up their sleeves and prove it works. You’ll own quality across multiple products, shape the testing culture for cross-functional squads, and pioneer approaches to challenges that simply didn’t exist a few years ago: evaluating LLM outputs, validating RAG pipelines, and ensuring AI-generated content meets regulatory expectations in a GxP environment. If you’ve been waiting for a role where deep test engineering craft meets the frontier of AI—and where your work genuinely improves patient outcomes—this is it.

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).
• 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
• Proven ability to lead test strategy and mentor other test engineers—whether through formal management or technical leadership.
• Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.
• Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.
• A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.

Nice To Haves

• Experience testing AI/ML-powered products—especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.
• Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.
• Background in life sciences, health-tech, or clinical-trial technology.
• Experience working with geographically distributed teams and external vendor squads.

Responsibilities

• Shape Testing Strategy for AI-Native Products Design and own end-to-end test strategies—automated and manual—for products that integrate LLMs, generative AI, and complex data pipelines.
• Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.
• Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.
• Drive a measurable shift from manual to automated testing, with clear metrics to track progress.
• Own Quality and Release Readiness Be the single point of accountability for testing across all releases of your two products.
• Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.
• Analyse test results, spot trends, and turn data into actionable improvements—not just reports.
• Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.
• Lead, Coach, and Build Culture Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.
• Lead external contract test engineering squads by influence—setting standards, mentoring team members, and modelling engineering excellence.
• Champion a quality-engineering mindset: everyone ships quality, not just the test team.
• Stay hands-on—write test cases, debug failures, and pair with engineers when the situation calls for it.

Benefits

• qualified retirement program [401(k) plan]
• paid vacation and holidays
• paid leaves
• health benefits including medical, prescription drug, dental, and vision coverage

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees