Staff Quality Engineer
About The Position
StackAdapt is seeking a talented Staff Quality Engineer to join the Automation and Intelligence Pillar pod, the group building StackAdapt's AI and agentic products. As the most senior quality engineer on the team, you will set the technical direction for how we test, evaluate, and ship intelligent systems, working across LLM-powered features, agentic workflows, and the data and tooling that support them. This is a hands-on, individual-contributor leadership role: you will lead the effort to design quality strategy for non-deterministic AI systems, build the frameworks and harnesses that make those systems testable, and raise the quality bar across a fast-moving, cross-functional agile environment. Your work will directly affect the success of product releases, accelerate our defect detection and prevention capabilities, and help define what quality means for AI at StackAdapt.
Requirements
- 7+ years of professional, hands-on software quality and test automation experience, with a track record of setting technical direction on complex systems
- Deep, hands-on experience with API & UI test automation frameworks such as Playwright, Cypress, Jest, or Junit
- Fluency in at least one of TypeScript, JavaScript, Python, or Java with preference for TypeScript
- Experience testing AI/agentic systems (evals, prompt/regression testing, output validation) and using AI to scale automation (test generation, self-healing tests, failure triage) with technologies such as OpenAI, Anthropic
- Experience with CI/CD tools like Jenkins, Github Actions, or CircleCI
- Strong understanding of scalable system design for web-based APIs and backend processing systems
- In-depth understanding of QA methodologies in a software company with fast release cycles
- Proven ability to define test case design standards and coverage strategy such as edge/negative, compatibility, performance and concurrency scenarios and to own a test case management practice (e.g. TestRail) that others build on
- Knowledge of React, including but not limited to adding data-testids
- Ability to explore a codebase and use technical tools to gain an understanding of technical implementation
- Experience coaching and influencing cross-functional teams on tooling, testing plans and strategies, and guiding them through execution
Responsibilities
- Own and drive the end-to-end quality strategy for the Automation and Intelligence Pillar pod's AI such as our Ivy product, from test architecture through release readiness
- Design and build evaluation frameworks for non-deterministic systems, including LLM output quality, agent behaviour, regression detection, and guardrail/safety testing
- Develop reliable, scalable automated test suites and tooling that address functional, system, API, integration, UI, and regression testing, and integrate them into our CI/CD pipeline
- Establish quality metrics and benchmarks (accuracy, latency, cost, hallucination/failure rates) that give the team confidence to ship and inform data-driven decisions
- Partner closely with Engineering Managers, Product Managers, Designers, ML/Data Science, and other engineering teams to align requirements, priorities, and definitions of done
- Act as a technical mentor and force multiplier across the QE org, promoting QE best practices, driving process improvements, and levelling up testing for AI systems company-wide
- Participate in technical planning, code review, and architectural decision-making, advocating for testability and reliability from the design stage
- Provide timely, actionable test result feedback to the Automation and Intelligence Pillar pod, the QA team, and other relevant stakeholders
Benefits
- Highly competitive salary
- Retirement/ 401K/ Pension Savings globally
- Competitive Paid time off packages including birthday's off!
- Access to a comprehensive mental health care program
- Health benefits from day one of employment
- Work from home reimbursements
- Optional global WeWork membership for those who want a change from their home office and hubs in London and Toronto
- Robust training and onboarding program
- Coverage and support of personal development initiatives (conferences, courses, books etc)
- Access to StackAdapt programmatic courses and certifications to support continuous learning
- An awesome parental leave program
- A friendly, welcoming, and supportive culture
- Our social and team events!
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
