Senior Software Developer, AI Networking

NVIDIA•Us, CA

About The Position

NVIDIA is seeking a Senior Software Developer for its AI Networking Software Development and Codesign team. This role involves working with the latest NVIDIA hardware and technologies to perform full-stack benchmarking for AI training/inference data center scale systems and lower-level benchmarks. The team focuses on automation, developing in-house tools, adopting community practices, and contributing to public GitHub repositories. The primary goal is to ensure large-scale systems achieve expected performance by identifying bottlenecks and driving improvements.

Requirements

B.Sc., M.Sc degree in Computer Science / Software engineering or equivalent experience.
5+ years of experience.
Professional Python development experience.
Build maintainable, long-lived tools.
Solid Linux expertise and extensive command-line environment experience.
Ability to work across a broad and evolving stack, with a strong drive to learn from hardware and networking up to large-scale AI systems.

Nice To Haves

Knowledge and/or experience with modern AI ecosystem: PyTorch, LLMs, inference and training.
Familiarity with cluster orchestration systems such as Slurm or Kubernetes.
Knowledge in MPI and HPC, InfiniBand, Ethernet and Networking.
Experience in performance optimizations.

Responsibilities

Developing AI networking communication frameworks and applications for large-scale supercomputers and data centers.
Developing production tools and benchmarks for internal and external NVIDIA teams.
Enabling new AI models within the benchmarking infrastructure and providing insights through end-to-end analysis of large-scale workloads.
Designing and implementing automation systems, including large-scale parameter search for optimal configurations.
Collaborating with networking and hardware teams on co-designing new features and software interfaces.