Senior Data Scientist – Enterprise AI Systems

NVIDIA•Santa Clara, CA

About The Position

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. We are seeking a Senior Data Scientist to join our Platform Engineering Team in Santa Clara, CA. This team drives the development of intelligent agentic workflows that power next-generation AI experiences on our platform. In this role, you will design, build, and optimize systems that enable agents to reason, plan, and collaborate across dynamic environments. You’ll work at the intersection of applied machine learning, data infrastructure, and the ServiceNow Platform helping us unlock new capabilities in adaptive, data driven AI systems.

Requirements

8+ years of professional software engineering experience, with deep expertise in Python, APIs, and distributed systems.
BS, MS, or PhD in Computer Science, Data Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience)
Hands-on experience building and deploying LLM-powered or AI/ML systems in production.
Strong understanding of LLM design patterns, including tool calling, prompt engineering, structured outputs, and RAG.
Experience with agent frameworks or orchestration systems such as LangGraph, LangChain, OpenAI Agents SDK, or similar.
Proven track record of delivering reliable, observable, and scalable production systems.
Strong data skills, including work with large datasets, embeddings, vector search, and analytics.
Ability to evaluate, monitor, and continuously improve AI system quality and behavior in real-world deployments.

Nice To Haves

Experience designing multi-agent systems and complex workflow orchestration engines.
Hands-on experience with vector databases and retrieval infrastructure.
Familiarity with evaluation frameworks, MLOps pipelines, and AI observability tooling.
Experience working with cloud platforms and modern AI infrastructure.
Background in enterprise or regulated environments, where trust, safety, and compliance are critical.

Responsibilities

Architect, build, and operate enterprise-grade generative AI systems supporting leadership, operations, and business workflows
Design and implement AI agents capable of reasoning, planning, multi-step execution, and collaboration across tools and services.
Build end-to-end automations integrating enterprise platforms such as ITSM, HRSD, Finance, SAP, Coupa, and Workday.
Develop robust tool/function-calling and orchestration layers using APIs, queues, and workflow engines.
Implement retrieval-augmented generation (RAG) pipelines and enterprise context systems to ensure accuracy, grounding, and relevance.
Design and operate production guardrails, including evaluations, domain logic, observability, monitoring, and safety controls.
Optimize systems for latency, cost, reliability, and measurable business impact.
Apply strong software engineering practices: clean architecture, automated testing, CI/CD, telemetry, and operational readiness.

Benefits

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
The base salary range is 168,000 USD - 264,500 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.
You will also be eligible for equity and benefits.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume