Global Capacity Manager - TPU Focus

Baseten • San Francisco, CA

1d • $185,000 - $250,000

About The Position

Baseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F. The role of Global Capacity Manager focused on TPUs at Baseten involves leading the "engine room" for our non-NVIDIA accelerator fleet, architecting, securing, and optimizing Google Cloud TPU (and broader emerging accelerator) capacity that powers customer AI workloads. This role owns the end-to-end journey of capacity management for this fleet, from securing large-scale TPU pod allocations to building automation for reliable uptime across multi-cloud environments. It is suited for entrepreneurial engineers who want to bridge the gap between high-finance asset management and deep infrastructure engineering, with a specific focus on the TPU ecosystem. The individual will act as the fleet orchestrator for Google's TPU architecture, ensuring Baseten never experiences a capacity outage while maintaining elite unit economics as we diversify beyond NVIDIA. This is a high-stakes engineering role involving hands-on Kubernetes orchestration and leading specialized pods focused on the latest generation of TPU hardware, like Google's Trillium (v6e) architecture, and partnering with the Model Performance (MP) team to ensure workloads are tuned for TPU-specific execution.

Requirements

• Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or a related field
• 5+ years of professional work experience in a high-growth environment, preferably at a hyperscaler (GCP, AWS, Azure) or a specialized accelerator provider
• Hands-on experience with Google Cloud TPUs — pod slicing, ICI (Inter-Chip Interconnect) topology, JAX/XLA, and TPU-specific scheduling and fault handling
• Deep expertise in Kubernetes, including hands-on experience with taints, cordons, node draining, and custom operators
• Demonstrated experience with Go or Python in a production-level environment
• Strong financial literacy and the ability to model complex trade-offs between capacity reliability and cost
• High tenacity and collaborative mindset

Nice To Haves

• Experience with additional non-NVIDIA accelerators, such as AWS Trainium/Inferentia (Neuron SDK) or AMD Instinct (ROCm)
• Familiarity with multi-accelerator scheduling and cost/performance tradeoff modeling across GPU, TPU, and other platforms
• Prior experience partnering with model performance or ML systems teams to optimize workloads for a specific accelerator

Responsibilities

• Lead Specialized Pods: Act as the lead for TPU pod fleets managing the full lifecycle of acquisition, allocation, and maintenance for those assets
• Advanced Orchestration: Execute complex workload migrations and "sticky" deployment drains across TPU topologies, ensuring deployment scheduling rules meet strict regional and compliance requirements
• Build for Scalability: Design and implement the "next version" of Baseten's capacity management system to handle significant growth in TPU volume alongside our existing GPU fleet
• Financial Modeling: Leverage your understanding of unit economics to build ROI models comparing TPU, GPU, and other accelerator options, ensuring Baseten scales profitably
• Cross-Team Collaboration: Partner closely with MP, SRE, Infra, and FDE teams to ensure workloads are properly tuned for TPU execution and to verify "last mile" follow-through on infrastructure changes
• Incident Response: Lead capacity-crunch response by rapidly reallocating and re-coordinating TPU workloads during high-pressure outages

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree