About The Position

For over 25 years, NVIDIA has pioneered computer graphics and accelerated computing, fueled by innovative technology and talent. We are now leveraging AI to define the next era of computing, where GPUs power everything from robots to self-driving cars. Our NVIDIA Cloud Partner Enablement Team is looking for a hardworking Solution Architect to help bring these emerging technologies to the field. In this role, you will guide partners in adopting Reference Architectures to achieve elite performance, reliability, and security. We ensure partner success through regular collaboration, problem-solving, and accelerating their "time to first tokens" in production. You will also scale your expertise by creating training materials and sharing knowledge with internal teams. Join us in a diverse, supportive environment where you can make a lasting global impact. Together, we will do what’s never been done before. What you'll be doing:

Requirements

  • Strong foundational expertise, from a BS, MS, or Ph.D. degree in Engineering, Mathematics, Physics, Computer Science, Data Science (or equivalent experience)
  • 5+ years of proven experience with one or more Cloud Service Providers (AWS, Azure, GCP or OCI), NCPs (CoreWeave, Lambda Labs, Crusoe, etc) and cloud-native architectures and software.
  • Experience leading joint debugging and optimization sessions with partners, driving the resolution of distributed training bottlenecks and fabric anomalies.
  • Expertise in performance tuning of RDMA-enabled GPU clusters including running performance benchmarks and diagnosing performance issue with compute and network tracing tools.
  • Strong coding and outstanding debugging skills.
  • Proven expertise in the following areas: LLM training and inference workloads, Slurm, Kubernetes, MPI, NCCL.
  • Linux-based configuration, management, monitoring, and system administration with proficiency in problem-solving in both bare metal and virtual environments
  • Understanding of networking fundamentals (e.g. router, firewall, load balancer, DNS, VPN) for high performance infrastructure

Nice To Haves

  • Ability to perform root cause analysis on distributed training failures using Nsight Systems and NCCL-tests, applying a detailed divide-and-conquer approach to isolate network/fabric issues
  • Experience running LLM Benchmarks, NCCL-tests, and automating RDMA diagnostic tools.
  • Background with deploying and configuring observability tooling including Grafana, Prometheus, W&B, Nagios, Zabbix
  • Ability to take ownership when resolving cluster downtime or degraded performance with customers

Responsibilities

  • Work closely with NVIDIA Cloud Partners (NCP), as a compute and networking performance specialist, ensuring they are reaching high standards for performance and accomplishing their business goals.
  • Enable NCPs to achieve Exemplar Cloud status through demonstration of performance capabilities with respect to reference benchmarks.
  • Accelerate NCP onboarding time by resolving deviations from reference performance targets.
  • Improve NVIDIA Cloud Partner cluster manageability, and reliability by advising customers on application of available solutions.
  • Scale knowledge, reach, and opportunities by educating internal teams and communities on NVIDIA Reference Architectures and Exemplar Cloud program.
  • Communicate feedback from the field to teams creating and maintaining Reference Architectures.

Benefits

  • NVIDIA offers highly competitive salaries and a comprehensive benefits package.
  • You will also be eligible for equity and benefits.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

Ph.D. or professional degree

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service