Senior System Software Engineer, AI Solutions Engineering

NVIDIA • Santa Clara, CA

71d • $148,000 - $287,500

About The Position

NVIDIA is hiring senior system software engineers in its Infrastructure, Planning and Process Team (IPP), to accelerate AI adoption across various engineering workflows within the company. IPP is a global organization within NVIDIA. The group works with various other teams within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on five thousand servers helping with the productivity of thousands of NVIDIA’s software developers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra processors. Are you passionate about infrastructure and looking for complex meaningful issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them? We are excited to have a fun-loving person like you join our team! As a Senior Software Engineer, you will be responsible for building industry insights into AI tools and technologies, collaborating with AI product vendors, and evaluating AI based product features. You will accelerate the evaluation of tools by developing robust testing environments, with a strong focus on efficiency and quality metrics. Additionally, you will design and implement tools and software solutions that leverage Large Language Models and agentic AI to automate workflows and enhance the productivity of engineers across software development, DevOps, and Site Reliability Engineering (SRE) activities.

Requirements

• BS (MS preferred) or equivalent experience in EE/CS with 5+ years of work experience.
• Well versed with Large Language Model (LLM), Machine Learning (ML), Agentic AI techniques.
• Hands-on experience in leveraging large language models (LLMs) and implementing agentic AI for various workflows.
• Expert programming ability in Python, Go or Java.
• Experience in working with SQL/NoSQL database systems such as MySQL, MongoDB or Elasticsearch.
• Good understanding of distributed systems, understanding of microservice architecture and REST APIs.
• Excellent knowledge and working experience with Docker containers.
• Consistent track record in developing large scale distributed applications.
• Ability to effectively work across organizational boundaries to enhance alignment and productivity between teams.
• Open to take on SRE or program management responsibilities if the need arises.

Nice To Haves

• Proactively track AI tool and technology trends, build insights, and collaborate with vendors early to address feature gaps before NVIDIA adoption.
• Expertise in leveraging large language models (LLMs) and Agentic AI to automate complex workflows, with knowledge of retrieval-augmented generation (RAG) and fine-tuning LLMs on enterprise data.
• Prior development of a large software project using service oriented architecture operating with real time constraints.

Responsibilities

• Responsible for building industry insights into AI tools, collaborating with vendors, and evaluating AI based product features.
• To accelerate the evaluation of AI tools by developing robust testing environments, with a strong focus on functionality requirement coverage and efficiency.
• Responsible for implementing AI/ML use cases to improve efficiency in software development, DevOps and SRE workflows.
• Work with software architects and developers in internal and external development teams.

Benefits

• Base salary range is 148,000 USD - 235,750 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.
• Eligible for equity and benefits.

What This Job Offers

• Career Level: Senior
• Education Level: Bachelor's degree
• Number of Employees: 5,001-10,000 employees