Principal Generative AI Engineer

SAP•Palo Alto, CA

28d•Hybrid

About The Position

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging - but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. With over 3.6 million connected companies, the SAP Business Network powers global commerce. We are moving beyond simple automation to build autonomous supply chain agents capable of reasoning, planning, and exception handling. This is a high-impact role for a technical leader to design the architecture that bridges unstructured data with structured business logic using the latest advancements in Generative AI.

Requirements

Bachelor's degree in Computer Science, Engineering or a related technical field
10+ years of professional experience in software development
5+ years of experience in designing and architecting large-scale distributed systems or cloud-native applications (e.g. on AWS, GCP, Azure, or SAP BTP)
5+ years of technical leadership (e.g. Staff Engineer, Tech Lead, or Architect roles) driving technical decisions
5+ years of applied AI experience (e.g. NLP, Machine Learning) including 1+ years of experience with Generative AI techniques like Large Language Models, RAG, Agentic Workflows

Nice To Haves

Master's degree or PhD in Computer Science, Artificial Intelligence, or a related field
Advanced AI Concepts: Deep understanding of Neurosymbolic AI, Reasoning Engines, and the ability to ground LLM outputs using formal logic or constraints
Graph Technology: Experience designing and implementing Knowledge Graphs (RDF, Property Graphs) to power retrieval (GraphRAG) and reasoning systems
Agentic Frameworks: Hands-on experience with agentic tools (e.g. LangChain, LangGraph), prompt engineering, and context management
Domain Knowledge: Familiarity with Supply Chain Management, procurement processes, or logistics data models

Responsibilities

System Architecture: Lead the technical architecture for high-scale AI applications
Build Agentic Systems: Design and implement multi-agent systems capable of autonomous reasoning, planning and execution.
Hands-On Coding: Actively contribute to the codebase of critical components and complex architectural patterns. You will build greenfield Proofs of Concept (PoCs) and guide them to production, setting the standard for code quality and MLOps best practices.
Cross-Functional Collaboration: Partner with Product Management to assess technical feasibility and translate complex business requirements into robust technical designs.
Technical Leadership: Mentor Senior and Specialist developers, conduct design and code reviews and foster a culture of engineering excellence.

Benefits

SAP's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone - regardless of background - feels included and can run at their best.
At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential.
We ultimately believe in unleashing all talent and creating a better world.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume