Sr. AI Platform Engineer

TalentOla • Chicago, IL

5d • Hybrid

About The Position

We are seeking a highly skilled AI Agent Platform Engineer to design and build an enterprise-grade AI agent platform. This platform will enable scalable multi-agent orchestration, agentic workflows, model gateways, observability, governance, security, and automated evaluation frameworks to support production-ready autonomous AI solutions across multiple business domains. The platform should enable teams to build, deploy, and operate AI agents using a variety of development approaches and frameworks while providing a standardized enterprise foundation for orchestration, integration, governance, security, and observability. A key responsibility will be establishing enterprise-grade observability across the platform, including centralized instrumentation, tracing, operational metrics, performance monitoring, error tracking, and visibility into agent execution and behaviour. The platform should also provide a centralized gateway for AI model interactions, agent tools, and external services, ensuring consistent security, governance, authentication and authorization, access control, throttling, monitoring, and policy enforcement. The ideal engineer will have experience building scalable, extensible, and technology-agnostic AI platforms that allow different teams and business domains to develop agents independently while adhering to common enterprise standards for interoperability, security, governance, reliability, and operational management. The role should also focus on building production-grade AI engineering capabilities, including Agent Harness Engineering, automated and closed-loop evaluation, feedback loops, prompt and model evaluation, observability, guardrails, resiliency, and continuous improvement mechanisms. The goal is to create a reusable platform where multiple business domains can build, deploy, monitor, and operate autonomous agents using standardized enterprise patterns rather than creating isolated agent solutions.

Requirements

• 8+ Years of experience
• Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.
• Experience designing agentic workflows and multi-agent orchestration, including both event-driven and workflow-based patterns.
• Experience with scalable communication and coordination between agents, enterprise systems, tools, APIs, and diverse data sources.
• Experience establishing enterprise-grade observability across a platform, including centralized instrumentation, tracing, operational metrics, performance monitoring, error tracking, and visibility into agent execution and behaviour.
• Experience providing a centralized gateway for AI model interactions, agent tools, and external services, ensuring consistent security, governance, authentication and authorization, access control, throttling, monitoring, and policy enforcement.
• Experience building scalable, extensible, and technology-agnostic AI platforms.
• Experience building production-grade AI engineering capabilities, including Agent Harness Engineering, automated and closed-loop evaluation, feedback loops, prompt and model evaluation, observability, guardrails, resiliency, and continuous improvement mechanisms.
• RAG Pipeline
• LLM
• Enterprise Applications
• AgenticAI
• Python
• Azure

Nice To Haves

• Technical certification in multiple technologies is desirable.

Responsibilities

• Design and build an enterprise-grade AI agent platform enabling scalable multi-agent orchestration, agentic workflows, model gateways, observability, governance, security, and automated evaluation frameworks.
• Enable teams to build, deploy, and operate AI agents using a variety of development approaches and frameworks while providing a standardized enterprise foundation for orchestration, integration, governance, security, and observability.
• Design agentic workflows and multi-agent orchestration, including both event-driven and workflow-based patterns.
• Support scalable communication and coordination between agents, enterprise systems, tools, APIs, and diverse data sources.
• Establish enterprise-grade observability across the platform, including centralized instrumentation, tracing, operational metrics, performance monitoring, error tracking, and visibility into agent execution and behaviour.
• Provide a centralized gateway for AI model interactions, agent tools, and external services, ensuring consistent security, governance, authentication and authorization, access control, throttling, monitoring, and policy enforcement.
• Build scalable, extensible, and technology-agnostic AI platforms that allow different teams and business domains to develop agents independently while adhering to common enterprise standards for interoperability, security, governance, reliability, and operational management.
• Focus on building production-grade AI engineering capabilities, including Agent Harness Engineering, automated and closed-loop evaluation, feedback loops, prompt and model evaluation, observability, guardrails, resiliency, and continuous improvement mechanisms.
• Create a reusable platform where multiple business domains can build, deploy, monitor, and operate autonomous agents using standardized enterprise patterns.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed