Solutions Architect, AI and ML

Nvidia • Santa Clara, CA

67d • $120,000 - $235,750

About The Position

NVIDIA is building the world's leading AI company, and we are looking for an experienced Cloud Solution Architect to help assist customers with adoption of GPU hardware and Software, as well as building and deploying Machine Learning (ML), Deep Learning (DL), data analytics solutions on various Cloud Computing Platforms. As part of the Solutions Architecture team, we work with some of the most exciting computing hardware and software technologies including the latest breakthroughs in machine learning and data science. A Solutions Architect is the first line of technical expertise between NVIDIA and our customers so you will engage directly with developers, researchers, and data scientists with some of NVIDIA's most strategic technology customers as well as work directly with business and engineering teams on product strategy. We are looking for a Solutions Architect to help drive end-to-end technology solutions applying NVIDIA's full set of technologies based on business needs of customers. Join us in this exciting endeavor!

Requirements

• BS/MS/PhD in Electrical/Computer Engineering, Computer Science, Statistics, Physics, or other Engineering fields or equivalent experience.
• 3+ Years in Solutions Architecture with a proven track record of moving AI inference from POC to production in cloud computing environments including AWS, GCP, or Azure.
• 3+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow.
• Excellent knowledge of the theory and practice of LLM and DL inference.
• Strong fundamentals in programming, optimizations, and software design, especially in Python.
• Experience with containerization and orchestration technologies like Docker and Kubernetes, monitoring, and observability solutions for AI deployments.
• Knowledge of Inference technologies - NVIDIA NIM, TensorRT-LLM, Dynamo, Triton Inference Server, vLLM, etc.
• Proficiency in problem-solving and debugging skills in GPU environments.
• Excellent presentation, communication and collaboration skills.

Nice To Haves

• AWS, GCP or Azure Professional Solution Architect Certification.
• Experience optimizing and deploying large MoE LLMs at scale.
• Active contributions to open-source AI inference projects (e.g., vLLM, TensorRT-LLM Dynamo, SGLang, Triton or similar).
• Experience with Multi-GPU Multi-node Inference technologies like Tensor Parallelism/Expert Parallelism, Disaggregated Serving, LWS, MPI, EFA/Infiniband, NVLink/PCIe, etc.
• Experience in developing and integrating monitoring and alerting solutions using Prometheus, Grafana, and NVIDIA DCGM and GPU performance Analysis and tools like NVIDIA Nsight Systems.

Responsibilities

• Help cloud customers craft, deploy, and maintain scalable, GPU-accelerated inference pipelines on cloud ML services and Kubernetes for large language models (LLMs) and generative AI workloads.
• Enhance performance tuning using TensorRT/TensorRT-LLM, vLLM, Dynamo, and Triton Inference Server to improve GPU utilization and model efficiency.
• Collaborate with multi-functional teams (engineering, product) and offer technical mentorship to cloud customers implementing AI inference at scale.
• Build custom PoCs for solution that address customer's critical business needs applying NVIDIA hardware and software technology.
• Partner with Sales Account Managers or Developer Relations Managers to identify and secure new business opportunities for NVIDIA products and solutions for ML/DL and other software solutions.
• Prepare and deliver technical content to customers including presentations about purpose-built solutions, workshops about NVIDIA products and solutions, etc.
• Conduct regular technical customer meetings for project/product roadmap, feature discussions, and intro to new technologies. Establish close technical ties to the customer to facilitate rapid resolution of customer issues.

Benefits

• Base salary range is 120,000 USD - 189,750 USD for Level 2, and 148,000 USD - 235,750 USD for Level 3.
• Eligible for equity and benefits.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Computer and Electronic Product Manufacturing
• Education Level: Master's degree
• Number of Employees: 5,001-10,000 employees