Distinguished Engineer - Rack Scale Architecture

NVIDIA•Santa Clara, CA
•$320,000 - $488,750

About The Position

NVIDIA is seeking a highly motivated technical leader to drive the engineering roadmap and innovation for rack-system software architecture. The role covers firmware, kernel drivers, operating systems, networking, fabrics, user-mode drivers, and manageability software. The engineer will work with internal component leads and engage with hyperscalers and cloud service providers to bring NVIDIA rack-scale products to market. These products span single-node HGX/DGX systems through multi-node NVLink-domain rack architectures, combining NVIDIA GPUs, NVLink, InfiniBand networking, Grace CPUs, and an optimized AI and HPC software stack. The position drives end-to-end software architecture for rack-scale products, translates product plans into formal software requirements, and provides architectural guidance to teams. It also involves working with major customers and business partners, developing and adopting new technologies and protocols, making technical decisions amid ambiguity, and mentoring architects and engineering teams.

Requirements

  • BS or MS degree in Computer Engineering, Computer Science, or a related field, or equivalent experience.
  • 15+ years of experience in system architecture and design.
  • Deep experience designing architecture for scalable, performant server systems, particularly at the software/hardware interface.
  • Strong understanding of networking technologies and protocols, such as Ethernet and InfiniBand.
  • Previous experience with complex system software for accelerators such as GPUs, DPUs, or FPGAs.
  • Expertise in out-of-band and in-band management architectures.
  • Knowledge of system management protocols such as Redfish and IPMI.
  • Experience working with platform security experts to define tradeoffs between security and ease of use.
  • Demonstrable experience implementing a left-shift strategy to de-risk program execution.
  • Excellent written and verbal communication skills.

Nice To Haves

  • Knowledge of large-scale cloud and cluster-level deployment and management systems.
  • Experience designing robust, resilient, and performant scale-up fabrics.
  • A demonstrated track record of leading data center products across their lifecycle, from inception and pre-silicon development through post-silicon bring-up, manufacturing, and deployment.
  • Familiarity with CXL, UCIE, and other C2C technology architectures.
  • Knowledge of storage and networking technologies.

Responsibilities

  • Drive end-to-end software architecture for NVIDIA rack-scale products.
  • Maintain a deep understanding of the product portfolio and roadmap, translating forward-looking plans into clear, formal software requirements that anchor execution across the organization.
  • Ensure high-quality, reliable software and serve as a trusted architectural partner to teams requiring guidance or oversight.
  • Work directly with major customers to understand their requirements and align their roadmaps with NVIDIA’s roadmap.
  • Work with business partners and vendors to shape their products to meet NVIDIA’s needs.
  • Develop a roadmap of new technologies and protocols and drive their design and adoption.
  • Mentor architects and engineering teams to help develop future leaders.
  • Make key technical decisions in ambiguous situations.

Benefits

  • Eligible for equity and benefits.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service