Product Platform: Backend Engineer
About The Position
Baseten is hiring a backend/distributed systems engineer for its Product Platform team. The team builds the inference platform that developers and large companies use to run AI in production. Work may focus on commercialization, billing and partnerships; developer productivity and agentic development; or the observability platform. The role includes designing and building scalable telemetry ingestion and storage pipelines for metrics, logs, and traces across multi-cloud infrastructure; evolving core observability platforms; developing commercialization and billing systems and strategic partnership integrations; and creating internal infrastructure and tooling for developer velocity, CI/CD, and deployment safety. The engineer will also own the internal AI agent platform and testing strategy, improve reliability and production-debugging workflows, lead technical design for cross-team projects, collaborate across infrastructure, model performance, and product teams, and contribute through code review, mentorship, and technical writing.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 5+ years of relevant industry experience focused on building scalable backend systems and platforms.
- Experience building or operating observability systems (logging, metrics, tracing) or internal infrastructure at scale.
- Proficiency in Python, Go, Rust, or a similar backend language.
- Strong understanding of quality and engineering principles, including both what to do and why.
- Systems-level thinking and understanding of how distributed-system components interact and how data flows through them.
- A platform mindset: build for adoption and self-service, treat internal engineers as customers, and favor good defaults over style guides.
- Excellent written and verbal communication skills.
Responsibilities
- Design and build scalable telemetry ingestion and storage pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructure.
- Own and evolve core observability platforms, including migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growth.
- Build commercialization and billing systems.
- Develop strategic partnership integrations.
- Develop internal infrastructure and tooling that improves developer velocity, CI/CD, and deployment safety.
- Own the internal AI agent platform end to end, including its architecture, build, rollout, operation, and measurement.
- Own the testing strategy end to end by defining standards, tiers, and tooling for engineering teams.
- Drive adoption through developer experience, including good defaults, clear documentation, and low-friction workflows.
- Improve platform reliability through better alerting, incident tooling, and production-debugging workflows.
- Lead technical design for cross-team projects and make tradeoffs among speed, quality, and long-term maintainability.
- Partner with infrastructure, model performance, and product teams to understand their needs and help them see and ship faster.
- Raise the engineering bar through code review, mentorship, and clear technical writing.
Benefits
- Competitive compensation, including meaningful equity.
- For U.S. employees: 100% coverage of medical, dental, and vision insurance for employees and dependents.
- Flexible PTO policy, including a company-wide Winter Break when offices are closed from Christmas Eve to New Year’s Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- For U.S. employees: company-facilitated 401(k).
- Exposure to a variety of ML startups, offering learning and networking opportunities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
