Director, System Software Engineering - Metropolis Accelerated and Inferencing Software

NVIDIA • Santa Clara, CA

5d

About The Position

NVIDIA is a world leader in physical AI, powering self-driving cars, humanoid robots, intelligent environments, medical devices, and more. Our software platforms are at the core of this mission, enabling innovators to build world-changing products that save lives, improve working conditions, and elevate standards of living across the globe. NVIDIA is looking for an engineering leader who is hands-on with deep learning—comfortable reading/modeling code, not just running it. You bring strong intuition for modern architectures (e.g., transformers, diffusion, VLMs etc), deep experience tuning for NVIDIA GPUs (kernels, memory, latency/efficiency trade-offs) / SOCs, and a proven record delivering robust, low-latency inference at scale. You have led teams that turn Accelerated Computing pipelines into reliable, measurable business impact for embedded and Enterprise platforms. You will work with a cohesive, high-performing team that’s been built and refined over the past nine years. An individual well aligned to experts in the industry is a great fit for this role!

Requirements

• Masters in Computer Science/Electrical Engineering or equivalent experience.
• A minimum of 8 years of meaningful involvement in machine learning/deep learning research or practical experience, coupled with 7+ years of leadership background and overall 15+ years of industry experience.
• Over 10 years of validated expertise in the embedded software sector, holding technical leadership positions accountable for delivering outstanding production software within a multifaceted setting.
• Deep Knowledge of GPU, CPU and dedicated deep learning architecture fundamentals and low-level performance optimizations using heterogeneous computing.
• Hands-on experience with VLMs, LLMs, or multimodal AI systems applied to perception, data triage, or automated labeling.
• Strong expertise in large-scale data processing, systems build, or machine learning pipelines.
• Strong communication, careful planning, and technical leadership capabilities.

Nice To Haves

• We welcome candidates with a PhD or equivalent experience in a relevant field
• Leadership role in production deployment of Smart Spaces, Physical AI with a deep understanding of constraints and advancements of sensing, computing, and model architecture evolutions.
• Ability to lead and drive global teams across multiple continents and time zones
• Deep experience with CV, LLMs, VLMs, GenAI Models, and standards.

Responsibilities

• Lead, encourage, and develop world-class engineering and data teams distributed across Europe, Asia and the United States.
• Architect and operationalize NVIDIA’s end-to-end data Inference Acceleration strategy, powering Inferencing and continuous performance improvements.
• Drive Strategic Implementations of TensorRT, VLLM and other accelerated frameworks for inference solutions for Edge and Enterprise devices: Lead Accelerated Computing efforts and solutions for key Metropolis verticals. Set up Proofs of Readiness (PORs) and guide their implementations.
• Leading customer solutions: Collaborate with major Metropolis OEMs and Partners to architect highly accelerated and optimized custom deep learning models and inference pipelines for their specific requirements. Offer direct customer support, including debugging, technical education, and handling customer inquiries for our Metropolis partner and customers. Responsible for drafting and finalizing SOWs with internal customers and partners.
• Performance Benchmarking: Orchestrate efforts to achieve leading performance results on industry benchmarks like MLPerf on various edge and Enterprise devices.
• Technical Leadership & Influence: Function as a technical leader for deep learning across multiple teams, giving oversight and build support. Apply customer insights to influence the composition and structure of upcoming SOC / GPU deep learning hardware.
• Scaling the team: Strategically hiring to meet new demands while also mentoring and adjusting existing teams to new deep learning challenges.
• Representing Nvidia Deep learning solutions in webinars, conferences and partner events

What This Job Offers

• Job Type: Full-time
• Career Level: Director