Software Quality & Reliability Engineer (Founding Role)

Subscript

2d • Remote

About The Position

We're looking for our first Quality & Reliability Engineer who thinks about quality as a system, not a phase at the end of development.
You'll own quality and reliability across the stack—from test infrastructure to production monitoring to LLM evals. This is a founding role: you'll assess what we need, prioritize ruthlessly, and build the foundations that let us ship fast without breaking things.
This is not a traditional QA role. You may review some pull requests and help write e2e tests, but you will ALSO own the monitoring side and build guardrails that scale—all with the goal of preventing and catching issues before customers do.
This role combines elements of software engineering, traditional QA, reliability engineering, and devops.

Requirements

• You're an excellent engineer—you can solve hard problems, you're AI Native, and ship quickly
• Experience with observability tooling (Datadog, Sentry, or similar)
• Strong testing background (unit, integration, e2e; automation frameworks) both writing, as well as architecting
• Familiarity with LLM-based features and eval approaches (or willingness to learn quickly)
• Great communicator via writing and recorded video
• Comfortable working in ambiguous, fast-changing environments
• Excited about working on a globally-distributed, diverse team where autonomy, accountability, and ownership matter as much as your skillset

Responsibilities

• Design and implement monitoring, alerting, and dashboards so we understand system health at a glance
• Own observability for our data pipelines external integrations, and AI workflows
• Make sure we know about failures before customers tell us
• Make sure tests consistently run fast and green means green
• Maintain staging and test environments that are useful
• Help review code with a focus on reliability, edge cases, and failure handling
• Build and maintain integration and end-to-end test suites
• Close gaps in test coverage by writing tests yourself
• Monitor AI workflow correctness and audit individual workflows to catch regressions
• Design and maintain eval suites for LLM features
• Build a repeatable process for validating prompt changes before they ship

Benefits

• Unlimited vacation
• Completely flexible work schedule—work literally anytime (and anywhere) you want
• Benefits appropriate to your location (health/dental/vision in the USA)
• Company-wide retreats multiple times per year
• Market-rate compensation including benefits—we're scrappy, but not scrappy on compensation

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed