Senior Software Engineer - New Products

Baseten • San Francisco, CA

1d

About The Position

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.
THE ROLE:
You’ll join a small team building new products at Baseten. This role is for an infrastructure-leaning, product-minded engineer who likes owning ambiguous problems end-to-end: from shaping an API and system design, to operating it in production with clear SLOs.
You’ll build core platform capabilities that power how researchers, developers and partners ship and operate AI products at scale: API gateways, auth/keys, quotas and metering, multi-tenant isolation, observability, and the workflows around deploying and managing model-backed services.

EXAMPLE INITIATIVES:
Model APIs for frontier models
Model training built for production inference

Requirements

• 5+ years of experience building and operating backend systems, distributed systems, or large-scale APIs.
• Proven track record owning low-latency, reliable services (auth, rate limiting, quotas, usage metering, migrations).
• Strong infrastructure instincts: observability, incident response, SLOs, and capacity management.
• Comfort working across the stack when needed (backend-first, but willing to dive into frontend/CLI to unblock the product).
• Strong written communication, including clear design docs and effective cross-functional collaboration.
• Interest in AI/ML infrastructure and willingness to learn (ML expertise not required).

Nice To Haves

• Experience with API gateways, service meshes, Kubernetes, or distributed scheduling.
• Experience building developer platforms: SDKs, CLIs, APIs, and self-serve workflows.
• Experience with inference platforms, LLM runtimes, or performance-sensitive systems.
• Familiarity with multi-tenant isolation patterns (fair queuing, noisy-neighbor controls, admission control).
• Frontend experience (React/TypeScript) or strong product UX instincts for developer tools.

Responsibilities

• Own and lead projects and product areas end-to-end, including architecture, implementation, rollout, and long-term operations.
• Design ergonomic, developer-friendly APIs and abstractions for infrastructure capabilities.
• Build and operate reliable backend services (rate limiting, auth, quotas, metering, migrations) with clear SLOs.
• Drive performance and reliability improvements through profiling, tracing, load testing, and capacity planning.
• Mentor teammates through code reviews, design docs, and technical leadership.

Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Company-facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed