Anthropic-posted 3 months ago
$290,000 - $365,000/Yr
Full-time • Mid Level
San Francisco, CA
Publishing Industries

As a Technical Program Manager for Inference, you'll be the critical bridge between our inference systems and the broader organization. You'll drive strategic initiatives around inference infrastructure adoption, capacity management, and deployment processes while ensuring seamless coordination across research, engineering, and product teams. This role is essential for scaling our inference infrastructure to meet growing demand while maintaining operational excellence.

  • Lead cross-functional initiatives for new infrastructure integration, establishing clear ownership, timelines, and communication channels between teams.
  • Drive end-to-end planning for major infrastructure transitions including platform modernization and new tech adoption.
  • Develop and maintain processes for inference capacity planning and optimization.
  • Partner with engineering teams to track utilization metrics, identify bottlenecks, and coordinate with capacity teams on resource allocation and model deprecation strategies.
  • Establish and enforce governance for deployment processes, defining clear policies for self-service versus managed deployments.
  • Create and maintain service level agreements for different deployment types and ensure smooth launches across teams.
  • Own and prioritize the inference deployment roadmap, working closely with engineering leadership to prioritize initiatives and manage dependencies.
  • Provide visibility into upcoming changes and their organizational impact.
  • Build strong relationships across research, engineering, and product teams to understand requirements and constraints.
  • Translate technical complexities into clear updates for leadership and ensure alignment on priorities and timelines.
  • Identify inefficiencies in current workflows and drive systematic improvements.
  • Establish metrics and dashboards to track infrastructure health, capacity utilization, and deployment success rates.
  • Several years of experience in technical program management, with proven success delivering complex infrastructure programs, preferably in ML/AI systems or large-scale distributed systems.
  • Deep technical understanding of inference systems, or cloud infrastructure - enough to engage substantively with engineers and identify technical risks.
  • Excel at creating structure and processes in ambiguous environments, bringing clarity to complex cross-team initiatives.
  • Strong stakeholder management skills and can build trust with both technical and non-technical partners.
  • Comfortable navigating competing priorities and using data to drive technical decisions.
  • Experience with infrastructure scaling initiatives, hardware integrations, or deployment governance.
  • Thrive in fast-paced environments and can balance strategic planning with tactical execution.
  • Passionate about AI infrastructure and understand the unique challenges of deploying and scaling large language models.
  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Lovely office space for collaboration
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service