Senior Software Engineer - Test

Boulevard

13d•$117,600 - $175,200•Remote

About The Position

Boulevard is building an enterprise-grade quality program, and the Senior SDET will be a foundational hire. This role will own the health of our CI/CD pipelines and the engineering patterns that make automated testing fast, reliable, and trusted across our Elixir and TypeScript codebases. You’ll partner closely with the Engineering leadership and engineering teams across our frontend and backend systems to turn CI from a source of friction into a source of signal. The work will range from diagnosing and killing flaky tests, to shaving real time off pipeline runtime, to establishing the integration testing patterns our Elixir engineers will rely on for years. As the program matures, you’ll also help bring AI-assisted test generation and spec-driven development into our day-to-day workflow. This will be a high-ownership, high-leverage IC role. Your work will be felt by every engineer at Boulevard, every day.

Requirements

5+ Significant time as an SDET, test infrastructure engineer, or software engineer with a deep testing focus — enough to walk into a CI system you’ve never seen and start making it better within a week.
Strong hands-on experience with CI/CD systems such as CircleCI and GitHub Actions, including pipeline design, caching strategies, parallelization, and debugging the weird failures that only happen at 2 a.m.
Production-level proficiency in at least one backend language, ideally Elixir. If not Elixir, a demonstrated history of picking up new language ecosystems quickly and writing idiomatic test code in them.
You don’t just retry failing tests — you understand why they fail and fix the root cause, whether that’s shared state, timing, test data, or infrastructure.
Fluency with unit and integration testing patterns, especially at service boundaries. You know the difference between a test that gives confidence and a test that gives false comfort.
Experience building internal tooling or dashboards that other engineers actually use. Bonus points if you’ve built out test ownership models or flake detection systems from scratch.
Strong written communication. Much of the leverage of this role will come from documentation, patterns, and proposals that scale your influence beyond what you personally touch.

Nice To Haves

Hands-on experience with AI-assisted development tools such as Claude or Cursor, and a point of view on where they work well, where they don’t, and how to incorporate them into a testing workflow responsibly.

Responsibilities

Own the stability and performance of CI across our frontend and backend repositories. You’ll drive success rates up, runtimes down, and help establish “no merge on red” as a cultural default rather than a negotiation.
Hunt down flakiness. You’ll identify, triage, and fix the top sources of non-determinism in our test suites, and build the tooling that will make flake visible and attributable before it becomes noise.
Establish Elixir unit and integration testing patterns. You’ll partner with backend engineers to define how we test service boundaries, write the reference implementations, and document the patterns so they scale beyond you.
Optimize pipeline performance. You’ll improve parallelization, caching, and test ordering to deliver meaningful reductions in CI runtime across both frontend and backend pipelines.
Build developer-facing tooling and dashboards that will surface CI health, test ownership, flake rate, coverage trends, and pipeline duration — making quality signal actionable for every team.
Contribute to release readiness. You’ll help define lightweight, durable criteria for what “ready to ship” looks like, and wire those criteria into the pipeline.
Bring AI-assisted test generation and spec-driven development workflows into our Elixir framework, starting with one service area and expanding based on what we learn.
Partner with the QA Engineer (E2E coverage) and the QA Lead to integrate end-to-end tests into pre-deployment pipelines without sacrificing speed.