SAP Agent Architect

Parloa • New York, NY

3d

About The Position

As a SAP Agent Architect at Parloa, you will help transform customer service with AI agents in enterprise SAP environments. In this customer-facing role, you will support implementations where Parloa’s conversational AI platform must work reliably with SAP data, processes, and integration constraints -from design through testing and go-live readiness.

You combine LLM and agent design (prompt engineering, conversational structure, quality, and operational readiness) with hands-on SAP integration literacy: you understand how Parloa agents should read from and write to SAP systems safely and predictably, and you partner with Forward Deployed Engineering and customer SAP teams to make that path buildable, testable, and production-grade.

You will design, prototype, validate, and refine conversational solutions and agent workflows that depend on SAP-backed use cases (for example order management, customer data, case management, and transactional queries), while ensuring the integration layer between Parloa and SAP is reflected accurately in agent behavior, tools, and guardrails.

Requirements

• 4+ years in enterprise customer-facing roles with proven expertise in conversation design and AI agent development for implementation settings (not only concept work)
• Exposure to SAP AI Core, SAP Agent Builder, or similar AI extensions within SAP
• Experience with conversational AI / contact center / CX technology in an SAP context
• Demonstrable SAP integration experience in live enterprise delivery contexts, including comfort operating across SAP BTP, S/4HANA, ECC, Service Cloud, CRM, and/or adjacent SAP CX stacks as they relate to agent-connected use cases
• Solid understanding of SAP APIs and data access patterns across one or more relevant surfaces: OData v2/v4, REST/SOAP, and authentication patterns including OAuth2 and SAP IAS/XSUAA
• Strong prompt engineering and LLM workflow design skills: you can analyze requirements and craft prompts/instructions for reliable, user-aligned behavior under enterprise constraints
• Analytical and structured communicator: explicit trade-offs, decisions, next steps; strong stakeholder and milestone discipline
• Proficiency with JSON/XML, API testing tools (e.g. Postman), and reading enterprise API documentation

Nice To Haves

• Experience working with or for SAP system integrators in delivery or presales-adjacent engineering roles
• Familiarity with cloud landing zones commonly paired with SAP integrations (e.g., Microsoft Azure), Kubernetes concepts, and/or TypeScript/Node.js tooling for integration-heavy delivery
• Git-based collaboration and CI/CD exposure

Responsibilities

• Scope and implement AI Agent deployments, providing strategic advice and execution support to customers and partners with a focus on programs where SAP-backed systems and processes are in scope (for example SAP Service Cloud / CRM, and related enterprise SAP landscapes)
• Leverage your knowledge of LLMs (e.g., embeddings) to analyze customer requirements and design precise prompts for reliable, user-aligned behavior, including cases where agent actions depend on SAP-sourced data and SAP business rules
• Simplify complex workflows and processes into digestible conversational components, enabling LLMs to handle challenging tasks effectively
• Fine-tune conversational flows and voice output (e.g., SSML, Lexicons, Regex) to align with customer brand standards
• Build and configure integrations between customers’ systems and Parloa’s platform, connecting external tools (e.g., CRMs, ERPs, ticketing systems, contact center platforms, including SAP CX / SAP ERP surfaces where applicable) via integration platforms and APIs to deliver end-to-end enterprise solutions
• Collaborate with Forward Deployed Engineers on complex or custom integration scenarios that go beyond standard integration capabilities, including SAP-specific connectivity, authentication, and data-access patterns (e.g., OData, REST/SOAP, OAuth2 / SAP IAS / XSUAA) where they materially affect agent behavior and reliability
• Identify and solve blockers together with other departments at Parloa (e.g., Product, Forward Deployed Engineering or Sales) and the customer, including coordination with customer SAP teams and SAP partner engineers when required to unblock delivery
• Apply structured testing approaches to validate AI agent behaviour, quality, and performance under real-world conditions — with explicit coverage for integration-dependent paths common in SAP environments (partial responses, authorization failures, latency, and transactional correctness)
• Document best practices, how-to guides, and product capabilities for internal and external audiences, representing the expertise of the Agent Architect team

Benefits

• On-Target Earnings (OTE), consisting of a base salary and performance-based variable component
• Equity package
• Commitment to upholding the highest data protection standards for clients' and employees' data
• Ensuring utmost care, GDPR, and ISO compliance, including ISO 27001, in handling sensitive information

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed