Director, Rack Scale Software Architecture

NVIDIA•Durham, NC
•$320,000 - $488,750

About The Position

NVIDIA is seeking a highly technical, motivated manager to lead the team responsible for rack-scale system software architecture. NVIDIA's data center platform and node designs range from single-node HGX/DGX systems to large multi-node NVLink domain rack architectures, combining NVIDIA GPUs, NVLink, InfiniBand networking, Grace CPUs, and an optimized AI and HPC software stack. The role spans software architecture for firmware, kernel drivers, operating systems, networking, fabrics, user-mode drivers, and manageability software. The Director will work with internal component leads and engage with hyperscalers and cloud service providers to bring products to market.

Requirements

  • Bachelor's or master's degree in Computer Engineering, Computer Science, or a related field, or equivalent experience.
  • 15+ years of overall experience in system architecture and design, including 8+ years of proven management experience.
  • Deep experience designing architecture for scalable, performant server systems, particularly at the software/hardware interface.
  • Proven leadership skills and strong ownership on past projects involving a large-scale, sophisticated codebase.
  • Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs.
  • Strong managerial, problem-solving, and critical-thinking skills.
  • Ability to operate comfortably in highly matrixed organizations while holding a leadership position.
  • Strong interactive, verbal, and written communication skills.

Nice To Haves

  • Knowledge of large-scale cloud and cluster-level deployment and management systems.
  • Experience designing robust, resilient, and performant scale-up fabrics.
  • A demonstrated track record of leading data center products across the entire lifecycle, from inception and pre-silicon development through post-silicon bring-up, manufacturing, and deployment.
  • Strong understanding of networking technologies and protocols such as Ethernet and InfiniBand.
  • Familiarity with CXL, UCIE, and other chip-to-chip (C2C) technology architectures.
  • Knowledge of storage and networking technologies.

Responsibilities

  • Drive the end-to-end software architecture for NVIDIA rack-scale products.
  • Maintain a deep understanding of the product portfolio and roadmap, translating forward-looking plans into clear, formal software requirements that anchor organizational execution.
  • Ensure high-quality, reliable software and serve as a trusted architectural partner to teams requiring guidance or oversight.
  • Work directly with major customers to understand their requirements and align their roadmaps with NVIDIA's roadmap.
  • Present the team vision to senior NVIDIA leaders and external leaders.
  • Provide technical leadership and career mentorship to the team.
  • Make key technical decisions in ambiguous situations.

Benefits

  • Equity
  • Benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service