Senior Systems Software Engineer - NV Cloud Functions
About The Position
NVIDIA is seeking a Senior Systems Software Engineer for NVIDIA Cloud Functions (NVCF), an open-source platform that links workloads to GPUs and enables teams to deploy, manage, and serve GPU-accelerated containerized applications across regions and clusters. NVCF routes inference, streaming, and batch workloads across distributed GPU clusters, supporting endpoints hosted on-premises or in the cloud. The role focuses on improving performance, reliability, and scaling for systems that route AI workloads across distributed GPU fleets. The platform is polyglot and open source, with control-plane and edge deployments. The engineer will work on a distributed team and collaborate across NVIDIA to make GPU- and DPU-accelerated applications easier to develop, deploy, and monitor on NVIDIA hardware. The work involves rapidly shifting priorities and calls for insight, focus, execution, and a willingness to learn and grow.
Requirements
- Bachelor’s or Master’s degree in Computer Science, or equivalent experience.
- At least 3 years of hands-on software engineering experience.
- Expert-level knowledge of a systems programming language such as Go, C, or Rust.
- Proven understanding of data structures, algorithms, and distributed software architecture.
- Strong understanding of Kubernetes and container technologies, with hands-on automation experience using continuous integration frameworks such as GitLab and ArgoCD.
- Expertise in a scripting language such as Bash or Python.
- Knowledge and experience with the system internals of Unix or Unix-like kernels, such as Linux.
- Understanding of performance, security, and reliability in complex distributed systems.
Nice To Haves
- Background with pub-sub models and message queues.
- Experience optimizing high-throughput network paths and understanding unary, streaming, and bidirectional protocols across HTTP/2 and gRPC.
- Experience developing Kubernetes Custom Resources and Operators deployed in Cloud Service Providers.
Responsibilities
- Design and ship services in Java, Go, and Rust in a public open-source repository.
- Contribute commits, design proposals, and code reviews transparently to the community.
- Automate and optimize build, test, integration, and release processes for cloud-native software.
- Partner with NVIDIA engineering teams to integrate the platform with technologies including KAI Scheduler, NVIDIA NIM, Grove, and Dynamo.
- Help steward the open-source project by triaging community issues and pull requests and writing documentation for contributors.
- Improve the performance, reliability, and scaling behavior of systems routing AI workloads across distributed GPU fleets.
Benefits
- Equity.
- Benefits package.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
