Software Engineer II, Test Frameworks & Tooling

Klaviyo•Boston, MA

1d•$116,000 - $174,000

About The Position

Engineering confidence is our primary product. We are not testers, but rather infrastructure engineers building the sophisticated automation and CI/CD frameworks that make deploying to production a non-event. Our mission is to architect the systems, repository standards, and automated guardrails that empower every engineer in the company to ship at terminal velocity with total confidence. By building the foundational tools that guarantee production readiness, you will play a direct role in driving Sev-1 incidents toward zero and ensuring that our organization can move fast without the fear of breaking things.

Requirements

2+ years of software engineering experience with a focus on writing clean, maintainable code.
Excel at debugging complex issues and performing root-cause analysis, using those learnings to implement systemic improvements that prevent future regressions.
Understand that testing is a fundamental part of the development lifecycle, not an afterthought.
Comfortable working across the stack. Whether it is debugging a React component in an E2E test or optimizing a Python integration test, you are ready to dive in.
Excited about the intersection of AI and Software Quality. You are eager to help us leverage AI to automate test generation, identify flaky patterns, and accelerate the overall development lifecycle.
Look for ways to make things better. You take pride in owning a project from the initial PR to its successful deployment and monitoring.
Experience with, or a strong desire to learn, CI/CD tools and understand how automated testing fits into a modern deployment pipeline.

Responsibilities

Own and Enhance Frameworks: Take ownership of our integration and E2E testing frameworks across both backend and frontend stacks. You will ensure they are fast, reliable, and easy for other teams to adopt.
CI/CD Integration: Contribute to how we execute tests within our CI system. You will focus on optimizing feedback loops so engineers know exactly where they stand in minutes.
Establish Standards: Help define and implement general rules for our repositories, ensuring consistency in how unit tests are written and how code quality is measured.
Scalable Feature & Coverage Contribution: Actively develop new tools that simplify complex testing scenarios while identifying and backfilling critical testing gaps at scale. You will build systems for data mocking and service isolation that ensure high-fidelity coverage across our most complex application flows.
AI-Driven Quality Innovation: Help lead the charge in leveraging AI to accelerate our testing lifecycle. You will explore and implement AI-powered tools for automated regression detection, flaky test analysis, and intelligent test generation to decrease time-to-completion for features.
Collaborative Problem Solving: Partner with feature teams to troubleshoot flaky tests and identify gaps in our current coverage, making proactive suggestions to improve our overall safety net.
Operational Excellence: Monitor the health of our test suites and CI pipelines, taking pride in maintaining a stable and performant environment for the entire engineering organization.