Senior Software Engineer, Agentic AI

NVIDIA•Durham, NC
•$187,500 - $442,000

About The Position

NVIDIA is seeking an experienced Software Engineer to develop core libraries for agentic applications. The role focuses on building foundational technology, scalable agent capabilities, reusable building blocks, and high-quality libraries that improve developer productivity and agent quality while accelerating and optimizing performant, efficient agents. The engineer will work with a community of engineers on technologies for autonomous agents. The position involves tracking evolving agent development patterns across NVIDIA and the broader ecosystem, developing open-source libraries and tools, benchmarking agents to identify and address bottlenecks, and collaborating with teams working on data pipelines, RAG systems, vector databases, and GPU-optimized training and inference. The engineer will also identify friction in agent architectures and turn those findings into tools supported by evaluations, benchmarking, and feedback loops.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience.
  • 8+ years of experience in at least one of Rust, Python, Go, or Node.js, and working familiarity with at least one additional language from this list.
  • Solid understanding of asynchronous programming, callbacks, request lifecycles, and event-driven systems.
  • Hands-on experience with evolving agent architectures, multiple agent frameworks, and agent harnesses.
  • Proficiency in LLM applications, agent workflows, tool calls, and model-provider APIs.
  • Ability to design or extend cross-language APIs with attention to consistency, usability, stability, and backwards compatibility.
  • Systems-level debugging and performance intuition, including the ability to trace execution through runtime internals, language bindings, callbacks, serialization, and event emission to understand overhead and optimize hot paths.
  • Strong interpersonal skills for direct contact and effective collaboration with the open-source community.

Nice To Haves

  • Experience building evaluation or benchmarking systems for agent workflows, including metrics, regression, and feedback loops.
  • Rust systems experience, especially async Rust, Tokio, serde, API design, or runtime state management; and/or Python native extension experience with PyO3, maturin, or Python/Rust bindings.
  • Experience instrumenting third-party frameworks without changing user-visible behavior; knowledge of OpenTelemetry, tracing, structured events, exporters, or observability pipelines.
  • Experience with middleware, plugin systems, guardrails, policy engines, request/response interception, or maintaining open-source libraries, SDKs, or internal developer platforms.
  • Experience profiling or optimizing runtime/library overhead across language boundaries, async execution, native bindings, serialization, tracing, or middleware pipelines.

Responsibilities

  • Track evolving agent development patterns across NVIDIA and the broader ecosystem, staying current with research and commercial products.
  • Develop open-source libraries and tools to accelerate and optimize agent harnesses and frameworks for performance, accuracy, quality, and stability.
  • Benchmark agents to identify bottlenecks and develop solutions that increase performance, reduce cost, and improve latency.
  • Collaborate with teams building high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows.
  • Identify gaps and friction in agent architectures and create tools that improve developer velocity and agent quality, supported by evaluations, benchmarking, and feedback loops.

Benefits

  • Equity
  • Benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service