Product Manager, Inference Experience

Baseten•San Francisco, CA
•$200,000 - $400,000

About The Position

Baseten is hiring a Product Manager to own the experience of building on its AI inference platform, from discovering and evaluating models to deploying, optimizing, and operating them in production. The role focuses on making AI inference effortless for developers and shaping products including Model APIs, Dedicated Inference, Model Evaluations, and the Model Library. The Product Manager will work closely with engineering, research, and go-to-market teams to translate advances in inference performance into useful customer-facing products. This high-impact role sits at the intersection of AI infrastructure, developer experience, and product strategy, with responsibility for delivering developer adoption and business impact.

Requirements

  • 10+ years building and shipping AI/ML products or platforms.
  • Technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
  • Direct experience building or deploying models using technologies such as PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar frameworks.
  • Strong understanding of model serving, GPU economics, and tradeoffs between quality, latency, throughput, and cost.
  • Exceptional developer product instincts and ability to make complex technology approachable without sacrificing power.
  • Track record of leading cross-functional product initiatives and turning technical capabilities into measurable adoption or revenue growth.

Nice To Haves

  • Experience deploying models, building infrastructure products, building ML infrastructure, or designing tools used from both a terminal and a console.
  • Past experience as a software developer.

Responsibilities

  • Own product strategy and roadmap across Baseten's inference offerings, focusing on developer adoption and business impact.
  • Improve how developers discover, evaluate, deploy, and manage AI models through APIs, SDKs, CLI, and console.
  • Work with inference engineers and researchers to turn technical advances into compelling customer-facing capabilities.
  • Help prioritize models, workloads, and customer needs.
  • Partner with go-to-market teams and leadership on pricing, packaging, launches, and commercialization.
  • Engage with developers and customers to understand what works, what is frustrating, and what to build next.

Benefits

  • Competitive compensation, including meaningful equity.
  • For U.S. employees and dependents: 100% coverage of medical, dental, and vision insurance.
  • Flexible PTO policy, including company-wide Winter Break when offices are closed from Christmas Eve to New Year's Day.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot.
  • For U.S. employees: company-facilitated 401(k).
  • Exposure to a variety of ML startups, offering learning and networking opportunities.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service