Distinguished AI Architect, oCTO Industry AI

SAP•Palo Alto, CA

1d•$274,300 - $609,200•Hybrid

About The Position

The Office of the CTO (oCTO) for IndustryAI sits at the intersection of the SAP Business AI Platform (BAIP), Industry Product & Engineering, the LoB application teams, and FDE engagements with strategic customers. The Architecture team inside oCTO does not own architecture strategy for any single industry or LoB — that lives with the product and engineering organizations. What we own is the AI-native and agentic architecture strategy for IndustryAI: the long-term architectural vision, the standards that govern how systems are designed and governed at scale, and the leadership required to ensure that IndustryAI's engineering capabilities compound over time. As Distinguished AI Architect, you define the strategic architectural direction and long-term vision for AI-native systems and enterprise ML platforms across IndustryAI. You operate at organizational scope — setting the standard for how large-scale AI-native systems are architected, governing cross-organizational architecture reviews, and representing SAP's architectural capabilities with executives, partners, and strategic customers. You are expected to drive multi-year transformational programs, mentor principal and senior architects, and ensure that IndustryAI's architectural foundation is secure, scalable, and aligned with the responsible adoption of technologies that are still evolving.

Requirements

A distinguished record of defining enterprise-wide AI-native and ML architecture strategy, guiding multi-team engineering initiatives, and driving scalable, secure, and responsible adoption across complex product portfolios.
Proven experience architecting and delivering enterprise-scale ML platforms and agentic AI systems: cloud-native infrastructure, distributed systems, multi-agent orchestration, semantic retrieval, knowledge graph platforms, and evaluation harness engineering.
Demonstrated ability to set long-term architectural direction and influence global engineering practices — including governance frameworks, standardization programs, and organizational change at scale.
Executive-level credibility to represent architectural decisions with senior stakeholders, technology partners, and strategic customers.
Deep knowledge of cloud-native MLOps at scale: infrastructure as code, observability stacks, CI/CD pipelines, responsible AI frameworks, and regulatory compliance across global cloud environments.
Strong business acumen: the ability to connect architectural decisions to product and commercial outcomes, and to defend those connections rigorously.
Experience leading multi-year architectural transformation programs across large engineering organizations — including stakeholder alignment, program governance, and execution at scale.
Demonstrated track record of building architecture capability: mentoring senior and principal architects, establishing review standards, and growing technical leadership depth.
12+ years of professional experience in software architecture, platform engineering, or AI/ML systems roles, with significant time at enterprise scale in cloud or SaaS.
Bachelor's degree in Computer Science, Software Engineering, or a related discipline; advanced degree is a plus.
Domain fluency in one or more SAP-relevant areas (supply chain, manufacturing, asset management, procurement) is a strong plus.

Responsibilities

Define the strategic architectural direction and multi-year vision for AI-native systems and enterprise ML platforms across IndustryAI — steering platformization at scale and aligning architecture with product strategy and business objectives.
Set and enforce architectural standards and governance across IndustryAI engineering organizations — MLOps, observability, security, responsible AI, and compliance with global regulatory requirements.
Oversee cross-organizational architecture reviews, evaluate major technical decisions before commitment, and ensure that architectural debt is tracked and addressed systematically.
Lead multi-year transformational programs: decompose complex, organization-wide architectural challenges into executable programs and drive them to completion across engineering, platform, and product organizations.
Evaluate emerging technologies — LLMs, agentic orchestration, RAG, multi-agent systems, knowledge graphs, edge AI — for responsible adoption at enterprise scale, and translate those evaluations into concrete architectural direction.
Represent IndustryAI architecture with executives, strategic customers, and technology partners — communicate long-term architectural strategy with credibility and precision, and shape partner relationships around architectural alignment.
Contribute organizational-level architectural requirements to BAIP: define what the platform must deliver over a multi-year horizon to support IndustryAI's strategic architectural direction.
Build and develop SAP's architecture capability within IndustryAI: mentor principal and senior architects, establish architectural review standards and documentation practices, and grow the next generation of architectural leadership.
Ensure compliance with global security, privacy, and data governance requirements across IndustryAI systems, and proactively identify architectural risks with regulatory or business-continuity implications.
Partner with SAP's CTO office, platform leadership, and external technology organizations to ensure IndustryAI's architectural direction is coherent with SAP's broader AI strategy.