Senior Software Engineer, Agentic Systems

NVIDIA•Santa Clara, WA

21h•$184,000 - $356,500

About The Position

NVIDIA is hiring a Senior Software Engineer to help build NeMo Platform, a product for developing, evaluating, deploying, and operating AI systems at scale. The role focuses on NeMo Evaluator, which helps teams determine whether changes to AI agents improve their performance. As AI systems become more autonomous and integrated into workflows, the platform provides infrastructure for observing behavior, measuring progress, detecting regressions, and iterating with confidence. The roadmap emphasizes agentic development and automated agent improvement, including infrastructure for comparing versions, understanding behavior, and making empirically grounded improvements. The engineer will develop reusable capabilities across agent runtimes and developer workflows, improve the reliability and performance of the platform, and provide technical leadership across cross-component work.

Requirements

BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field.
At least 5 years of professional software engineering experience building production systems.
Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design.
Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.
Experience with distributed systems, cloud-native services, containers, Kubernetes, or job orchestration.
Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure.
Experience with structured data modeling and validation systems such as Pydantic, typed schemas, event/trace models, or SDK-generated types.
Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries.
Clear communication skills and a track record of collaborating with engineering, product, research, or customer-facing teams.

Nice To Haves

Experience building, deploying, and iterating on production agentic AI systems where evaluation measured and improved real product outcomes.
Experience designing evaluation workflows for heterogeneous agents, including tool-using agents, RAG agents, workflow agents, coding agents, or long-running autonomous systems.
Experience integrating evaluation capabilities across multiple products, runtimes, or internal platforms, especially through Python SDKs, plugins, or shared developer tooling.
Ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency.
Experience with enterprise AI systems requiring measurement, regression testing, observability, governance, and continuous improvement for production deployment.

Responsibilities

Design and implement Python-first APIs, SDK workflows, and plugin interfaces for building, measuring, and improving agents across multiple runtimes and product surfaces.
Build reusable systems to observe behavior, measure progress, detect regressions, and turn runtime evidence into product decisions.
Build systems for ingesting, normalizing, validating, and analyzing agent execution data and evaluation datasets.
Partner with research, product, platform, and infrastructure teams to integrate agentic capabilities across NVIDIA agent runtimes and developer workflows.
Turn emerging agent development and improvement techniques into reliable, reusable product capabilities.
Improve reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and developer workflows.
Build test coverage across unit, integration, end-to-end, Docker, and Kubernetes workflows.
Drive fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints.
Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems.