AI/ML Applied Data Scientist - Generative AI
SAP•Newport Beach, CA
•$90,000 - $198,500•Hybrid
About The Position
We're hiring an experienced AI/ML Scientist to join our newly formed Foundation Model team in Newport Beach. This team sits at the forefront of SAP's cloud transformation, building specialized foundation models and AI agents that accelerate our customers' data transformation journeys. We own the full stack: continued pretraining on SAP data, fine-tuning for domain-specific tasks, and the agentic workflows that bring these models into SAP products. You'll partner closely with our pretraining and fine-tuning leads, teams in Europe and India, and early-adopter customers.
Requirements
- BS, MS, in Computer Science, ML, Data Science, or a related field.
- 3+ years of experience in data science, with at least 1 year hands-on with LLMs and agents in production or near-production settings.
- Strong Python; solid software engineering fundamentals: testing, version control, modularity, async.
- Deep learning frameworks: PyTorch (primary) and familiarity with fine-tuning and PEFT methods (LoRA, QLoRA).
- LLM application development: prompting, structured outputs, function and tool calling, context management.
- Experience with LangGraph, Langfuse, MLFlow/W&B etc.
Nice To Haves
- Familiarity with continued pretraining, fine-tuning pipelines (SFT, DPO, RLHF), or inference optimization (vLLM, TensorRT-LLM, quantization).
- Experience running human-in-the-loop annotation workflows
Responsibilities
- Oversee the development, fine-tuning, and integration of foundation models into SAP solutions to streamline cloud transformation journeys.
- Design multi-step, tool-using agents (single-agent and multi-agent) that solve real SAP business problems, planning, tool calling, memory, reflection, and human-in-the-loop patterns.
- Build offline and online evaluation harnesses, task success, trajectory quality, tool-call accuracy, groundedness, and regression testing. Turn production failures into eval cases that gate deployment.
- Instrument agents with tracing, session and span capture, and automated scoring. Close the loop between production signals and development (trace → eval → fix).
- Engage with stakeholders in different teams at SAP as well as early adopter customers and research collaborations.
Benefits
- Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.
- SAP North America Benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
