Senior Technical Program Manager, AI Inference

NVIDIA•Santa Clara, CA
•$168,000 - $322,000

About The Position

NVIDIA’s AI Platform Inference team builds inference technology that powers AI applications worldwide. The Senior Technical Program Manager leads critical programs across software, hardware, and tooling, helping engineering teams move from roadmap to delivery. The role owns the full program lifecycle, from initial planning through execution, and works in technically complex environments.

Requirements

  • BS degree in Computer Science, Artificial Intelligence, or equivalent experience.
  • 10 years of experience leading global technical programs.
  • Solid knowledge of software engineering standard methodologies, hardware bring-up processes, and enterprise quality standards.
  • Proficiency with Scaled Agile frameworks and program tracking tools.
  • Demonstrated ability to resolve resource conflicts, unblock teams, and drive alignment at every level of the organization.
  • Clear, compelling communication skills across technical and business audiences.

Nice To Haves

  • Proven experience in machine learning, deep learning, GPU technology, or AI infrastructure.
  • Experience shipping production AI software or co-managing software-hardware programs end to end.
  • A record of building scalable program management practices in growing engineering organizations.
  • Mentorship instincts and a commitment to investing in teams.
  • Familiarity with open-source inference frameworks or model optimization tooling.

Responsibilities

  • Drive planning, scheduling, dependency tracking, and executive reporting across multiple concurrent inference programs.
  • Partner with hardware and software engineering leads to align library development with new and upcoming hardware timelines.
  • Coach teams on agile practices and run the rituals that keep programs on track.
  • Build and maintain metrics that surface risks early and support data-driven decisions.
  • Communicate program status and technical context clearly to engineering teams and senior leadership.
  • Align global, cross-disciplinary teams spanning hardware, software, and product.
  • Identify process gaps and implement improvements that increase delivery quality and team efficiency.
  • Moderate complex technical discussions and drive them to clear, documented conclusions.

Benefits

  • Equity
  • Benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service