Test Engineering Leader - Evinova

AstraZeneca • Gaithersburg, MD

9d • $165,657 - $217,425 • Hybrid

About The Position

Evinova is a health-tech business focused on accelerating better health outcomes by advancing digital transformation across the life sciences sector. By combining science-based expertise, evidence-led rigor, and deep human insight, we design digital solutions that enable healthcare to work better for everyone. Operating at the intersection of healthcare, technology, data, and analytics, we are helping unlock the full potential of digital health, transforming how clinical research is conducted, how care is delivered, and how patients experience healthcare. Our solutions are built to scale, driving efficiency, improving decision-making, and ultimately delivering better outcomes for patients worldwide.
At Evinova, we are driven by a shared purpose to transform health through data and digital innovation. Our teams collaborate across disciplines to solve complex challenges, continuously learning and evolving in a fast-paced, high-impact environment.
We also recognize the importance of flexibility and balance. Our ways of working support both individual needs and team collaboration. To foster connection and collaboration, employees are expected to work from the office three days per week, creating opportunities for in-person teamwork, innovation, and meaningful connection.
Evinova is building AI-native products that are reshaping how clinical trials are designed, documented, and delivered. Our AI-native product suite include Study Designer, Study Document Assistant, AI Document Authoring, and Pipeline Management and put large language models, intelligent automation, and human-centered design directly into the hands of clinical researchers and life-sciences professionals.
We’re looking for a Test Engineering Leader who is equal parts strategist and practitioner—someone who can define how we validate AI-powered software at scale, then roll up their sleeves and prove it works. You’ll own quality across multiple products, shape the testing culture for cross-functional squads, and pioneer approaches to challenges that simply didn’t exist a few years ago: evaluating LLM outputs, validating RAG pipelines, and ensuring AI-generated content meets regulatory expectations in a GxP environment.
If you’ve been waiting for a role where deep test engineering craft meets the frontier of AI—and where your work genuinely improves patient outcomes—this is it.

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).
• 10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
• Proven ability to lead test strategy and mentor other test engineers—whether through formal management or technical leadership.
• Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.
• Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.
• A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.

Nice To Haves

• Experience testing AI/ML-powered products—especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.
• Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.
• Background in life sciences, health-tech, or clinical-trial technology.
• Experience working with geographically distributed teams and external vendor squads.

Responsibilities

• Shape Testing Strategy for AI-Native Products: Design and own end-to-end test strategies—automated and manual—for products that integrate LLMs, generative AI, and complex data pipelines.
• Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.
• Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.
• Drive a measurable shift from manual to automated testing, with clear metrics to track progress.
• Own Quality and Release Readiness: Be the single point of accountability for testing across all releases of your two products.
• Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.
• Analyse test results, spot trends, and turn data into actionable improvements—not just reports.
• Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.
• Lead, Coach, and Build Culture: Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.
• Lead external contract test engineering squads by influence—setting standards, mentoring team members, and modelling engineering excellence.
• Champion a quality-engineering mindset: everyone ships quality, not just the test team.
• Stay hands-on—write test cases, debug failures, and pair with engineers when the situation calls for it.

Benefits

• short-term incentive bonus opportunity
• equity-based long-term incentive program
• qualified retirement program [401(k) plan]
• paid vacation and holidays
• paid leaves
• health benefits including medical, prescription drug, dental, and vision coverage

What This Job Offers

• Job Type: Full-time
• Career Level: Senior