Senior Quality Engineering Architect

CFA Institute•Charlottesville, VA

6d•$92,500 - $123,300•Remote

About The Position

Help redefine how quality is engineered. We're looking for a Senior Quality Engineering Architect to lead the next generation of test automation and AI-enabled quality engineering. In this role, you'll help shape technical strategy, evaluate emerging technologies, and build scalable solutions that elevate software quality across our platforms while advancing engineering excellence across CFA Institute. The Senior Quality Engineering Architect serves as a technical authority for test automation and AI-led quality engineering across one or more platform portfolios. This role designs and governs scalable Playwright/TypeScript automation frameworks, leads proof-of-concepts for native AI in quality engineering, and serves as a senior technical resource and mentor across the Quality Engineering function. Operating with significant autonomy on framework architecture, the Senior QE Architect evaluates tooling and patterns, makes build-vs-buy recommendations, and influences technical direction across teams. While primarily an individual-contributor role, the Senior QE Architect provides technical oversight to a mix of full-time engineers and managed-service contractors and is accountable for the quality of automation work delivered across both staffing models.

Requirements

Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
10+ years of experience in software quality engineering, with deep technical individual-contributor track experience.
Proven framework architect with a track record of designing and shipping enterprise-grade Playwright/TypeScript or comparable automation frameworks adopted by multiple teams.
Hands-on technical depth across UI, API, mobile, intelligent test execution, performance, and accessibility testing — writes code daily.
Strong AI fluency — LLM-assisted test generation, AI model quality evaluation, prompt engineering, agentic workflows, RAG and MCP concepts; experience with LLM evaluation tooling (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard) preferred.
Demonstrated experience providing technical oversight to a mix of full-time engineers and managed-service contractors.
Track record mentoring engineers across all levels with measurable impact on team capability.
Comfort with ambiguity, a builder mindset, and the ability to translate experiments into production patterns.

Nice To Haves

experience with LLM evaluation tooling (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard) preferred.

Responsibilities

Design and govern enterprise-grade Playwright/TypeScript automation frameworks — page objects, fixtures, reporters, CI integration, and intelligent test execution.
Evaluate test automation frameworks, tools, and patterns; make build-vs-buy recommendations and drive consistency across teams.
Lead proof-of-concepts for AI-driven test generation, autonomous test maintenance, intelligent defect triage, and agentic testing; translate experiments into production-grade adoption playbooks.
Design AI integration points across the QE stack — self-healing locators, prompt-driven test generation, LLM evaluation pipelines (e.g., Ragas, DeepEval, Promptfoo, LangSmith, Giskard), and RAG/MCP for test data and tooling.
Serve as the senior technical voice that engineers escalate to for framework, architecture, and tooling decisions; resolve technical debt at the architectural level.
Mentor automation engineers across all levels; run technical brown bags, code reviews, and capability-building sessions.
Provide technical oversight and quality assurance for work delivered by a mix of full-time engineers and managed-service contractors.
Partner with engineering, DevSecOps, platform, and product teams to embed quality at the architectural layer.
Establish responsible AI governance for AI-led QE practices, including evaluation standards, prompt-quality criteria, and model-output reliability.