Lead Software Engineer - Test Frameworks and Tooling Team

Klaviyo•Boston, MA

About The Position

At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements. If you’re a close but not exact match with the description, we hope you’ll still consider applying. Want to learn more about life at Klaviyo? Visit careers.klaviyo.com to see how we empower creators to own their own destiny. Why You Should Join the Test Frameworks and Tooling Team Engineering confidence is our primary product. We are not testers, but rather infrastructure architects building the sophisticated automation and CI/CD frameworks that make deploying to production a non-event. As the Lead for this team, you will define the technical roadmap for our automated guardrails and repository standards, empowering every engineer in the company to ship at terminal velocity with total confidence. By architecting the foundational tools that guarantee production readiness, you will play a pivotal role in driving Sev-1 incidents toward zero and ensuring our organization can move fast without the fear of breaking things.

Requirements

Seasoned Technical Leader: You have 7+ years of software engineering experience with a history of leading complex, high-impact technical projects. You are a hands-on lead who stays close to the code while steering the broader vision.
Master of Root-Cause Analysis: You don't just fix symptoms; you hunt down systemic failures. You excel at debugging deep-stack issues and transforming those lessons into automated preventions.
Full-Stack Architect: You are comfortable designing systems across the stack. Whether it is a React-based quality dashboard or a Python service for data seeding, you understand how to build for scale.
AI Visionary: You are passionate about the intersection of AI and Software Quality. You have a clear perspective on how AI can automate the mundane parts of testing and accelerate the SDLC.
Extreme Ownership: You take pride in the end-to-end health of the platform. You are proactive in identifying technical debt and are a relentless advocate for engineering excellence.
CI/CD Expert: You have deep experience with modern CI/CD tools and a sophisticated understanding of how to integrate automated testing into high-frequency deployment pipelines.

Responsibilities

Define Architectural Vision: Lead the long-term strategy for our integration and E2E testing frameworks across both backend and frontend stacks. You will ensure these systems are not just reliable, but world-class in their ease of adoption.
CI/CD Strategy: Architect how we execute tests within our CI system. You will focus on radically optimizing feedback loops so that engineers receive actionable, high-fidelity results in minutes.
Set Engineering Standards: Establish the "golden paths" for our repositories. You will define the benchmarks for unit testing, code quality metrics, and systemic reliability that all teams will follow.
Scalable Tooling & Coverage: Design and build the next generation of tools that simplify complex testing scenarios. You will lead efforts to backfill testing gaps at scale through advanced data mocking and service isolation.
AI-Driven Quality Strategy: Spearhead our efforts to leverage AI within the testing lifecycle. You will identify and implement AI-powered solutions for automated regression detection, flaky test analysis, and intelligent test generation.
Cross-Functional Leadership: Act as a consultant to feature teams to solve their most complex stability challenges. You will use root-cause analysis from major incidents to propose and implement pillar-wide safety improvements.
Operational Excellence: Oversee the health and performance of our entire CI/CD pipeline, taking ultimate responsibility for the stability of the environment that hundreds of engineers rely on daily.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume