Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA•Santa Clara, CA

11d•$184,000 - $356,500

About The Position

NVIDIA is seeking a Product Architect to design and shape architectures that connect large AI clusters. The role turns product ideas into functional solutions, balancing technical feasibility with user needs and market demands, and oversees the development of AI solutions from conception through their lifecycle. The position focuses on AI infrastructure, agentic AI, and datacenter-scale systems.

Requirements

At least 8 years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent.
Bachelor's degree in computer science or a related field, or equivalent experience.
Strong background in technologies for large-scale management of complex systems, networks, and storage.
Extensive experience with DevOps solutions, including Python, Ansible, container runtimes, Kubernetes, and datacenter deployments.
Familiarity with AI workloads, including agentic and RAG-based workflows, inference at scale, large-scale training and fine-tuning, and model evaluation.
Exceptional communication skills and ability to explain complex technical details to diverse audiences.
Passion for keeping up with technological advancements in AI and related fields.

Nice To Haves

First-hand experience building large-scale AI infrastructure.
Advanced certifications or publications in AI, deep learning, or related fields.
Experience leading high-impact projects or initiatives in cutting-edge technology domains.

Responsibilities

Monitor technology trends in AI infrastructure and agentic AI and propose new product concepts.
Define product architectures, including performance, scalability, interoperability, and datacenter deployment requirements.
Lead prototyping and testing to validate designs, diagnose bottlenecks, and improve performance at scale.
Refine designs based on feedback, test results, and evolving requirements.
Collaborate with hardware, software, security, and systems teams to integrate networking, compute, and storage ecosystems.
Work with partners and customers to conceptualize solutions and build proof-of-concepts and minimum viable products.
Document product designs, including technical specifications and user guides.
Develop content such as whitepapers, blogs, and curriculum for customers, partners, and users.