Sr. QA Lead

Evolver•Palo Alto, CA

About The Position

Evolver builds enterprise AI that works inside some of the most demanding functions in large organizations, including tax, finance, and procurement. Our customers make real decisions based on what our platform produces, so quality here is not a final checkpoint. It is part of the product. We are seeking a hands-on Senior QA Lead to define how Evolver tests, measures, and ships with confidence. You will lead our QA team in India, currently two engineers, and help grow it to five over the coming months. You will partner closely with GenAI Engineering, Product, and our Forward Deployed Engineers to build a quality practice that covers traditional application testing as well as the harder questions that come with AI: consistency, accuracy, regressions in model behavior, and how a system performs on messy, real customer data. This role is well suited for an experienced QA leader who still enjoys writing tests, wants to shape a function rather than inherit one, and is curious about what quality engineering looks like for AI products.

Requirements

8+ years of experience in software quality assurance or quality engineering.
Experience leading, mentoring, or managing QA engineers, including setting standards and reviewing their work.
Strong hands-on experience building test automation frameworks (for example, Pytest, Playwright, Selenium, Cypress, or similar).
Proficiency in Python or another modern programming language.
Experience testing APIs, backend services, and data heavy applications.
Experience integrating testing into CI/CD pipelines.
Experience working with distributed or offshore teams across time zones.

Nice To Haves

Experience at a startup or high growth company where you built QA processes from an early stage.
Experience testing enterprise B2B software, especially in regulated or data sensitive domains such as finance, tax, or compliance.
Familiarity with cloud environments, particularly Azure.
Experience with performance, security, or data quality testing.
Exposure to testing AI, ML, or LLM based products is a strong plus.

Responsibilities

Own Evolver's end to end quality strategy across our enterprise AI platform and customer deployments.
Define test plans, release criteria, and quality standards for new features, integrations, and model updates.
Decide what gets automated, what gets tested manually, and what gets monitored in production.
Serve as the clear voice on release readiness, including when something is not ready to ship.
Design approaches for testing LLM powered features where outputs are not fully deterministic.
Partner with GenAI Engineers to build evaluation sets, regression suites, and benchmarks that catch changes in model behavior.
Validate system performance on realistic enterprise data, including edge cases, incomplete inputs, and domain specific scenarios from customer engagements.
Help define how accuracy, consistency, and reliability are measured and reported.
Build and maintain test automation frameworks for APIs, backend services, data pipelines, and user facing applications.
Integrate automated testing into CI/CD so quality checks run on every meaningful change.
Improve test coverage, reliability, and speed so engineering can ship often without fear.
Write tests yourself. This is a hands-on leadership role.
Lead and mentor our QA team in India, currently two engineers.
Partner with the hiring team to grow the team to five, including defining roles, interviewing, and onboarding.
Set clear expectations, review work, and build a team culture of ownership and attention to detail.
Create processes that work across U.S. and India time zones.
Work closely with Engineering, Product, and Forward Deployed Engineers to bring quality into the process from the start, not just the end.
Translate customer issues and field feedback into test cases and preventive improvements.
Communicate quality status, risks, and tradeoffs clearly to technical and non-technical stakeholders.