Principal Quality Automation Architect

Accordion•Boston, MA

20h•Hybrid

About The Position

The Principal Quality Automation Architect designs and scales Accordion's automated quality framework across products, services, and AI-enabled workflows. This impactful role will be critical in owning the architecture behind automated validation, test harnesses, evaluation pipelines, test data strategy, and cross-pod tooling standards. This position will ideally be based in one of our US offices and is a hybrid role with the flexibility to work remotely 2 days per week (also eligible for remote candidates). This position is not eligible for immigration sponsorship.

Requirements

7+ years of experience in QA automation, SDET, or quality engineering roles, with a focus on scale, repeatability, and leverage
Strong experience with test automation frameworks, API testing, CI/CD, and integration validation – you are systems-minded and deeply technical
Strong scripting or coding skills
Experience working with data-intensive or workflow-heavy applications
Exposure to AI or LLM validation tooling or strong interest in building in that space
Ability to design frameworks, not just individual tests, and comfortability setting standards that others adopt
Commitment to balancing sophistication with delivery pace
Bachelor's degree preferred

Nice To Haves

Excited to be part of a growing team, with a focus on driving future growth
Passionate about delivering exceptional client service
Knowledgeable about the relationship between Private Equity sponsors and their portfolio companies, particularly within the office of the CFO
Willing to get your hands dirty in the details of a project while simultaneously seeing the whole picture
Comfortable managing projects with multiple complex workstreams while also focused on your single workstream (you are managing and doing)
A self-starter with a strong work ethic
Full of entrepreneurial spirit and comfortable in a flat organization
Able to effectively communicate complex issues and solutions, and raise issues to senior team members when necessary
A team player, able to work with team members across all levels
Someone who enjoys mentoring others and doing meaningful work
A leader of others; you lead by example

Responsibilities

Design and implement the core automation framework for functional, API, integration, regression, and workflow testing
Define standards for reusable test assets, environment usage, data setup, and evidence capture
Create scalable approaches to testing complex, multi-system workflows
Build and maintain regression harnesses for AI-enabled features, including prompt and workflow comparisons, scored evaluation runs, and benchmark execution
Partner with AI quality analysts to support rubric-based testing and measurable release criteria
Define approaches for test data, synthetic data, masked data, and scenario generation
Improve reliability and repeatability of validation environments
Work closely with software engineers to improve testability, observability, CI/CD integration, and defect prevention
Help pods move quality checks earlier in the development lifecycle