AI Platform Engineer

INFOSYS NOVA HOLDINGS•Irvine, CA

About The Position

As an AI Platform Engineer, you will design, build, and operate foundational components of an enterprise AI platform to enable secure, scalable, and responsible development and deployment of advanced AI and agentic solutions. The role spans the AI platform stack, including data ingestion, vector databases, retrieval systems, orchestration frameworks, agent platforms, and developer-facing APIs. You will collaborate with security, FinOps, platform engineering, data engineering, and application teams to deliver secure, observable, and cost-efficient enterprise AI capabilities. The position includes establishing enterprise standards for model access, agent execution, governance, observability, and cost optimization. You will work with cloud-native AI services, agentic architectures, orchestration frameworks, responsible AI guardrails, Model Context Protocol (MCP), enterprise AI Gateway patterns, Amazon Bedrock, AWS AgentCore, and AI Gateway technologies such as Kong AI Gateway. You will also develop reusable platform capabilities and support teams adopting AI across the organization.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical field, or equivalent practical experience.
  • 7+ years of experience designing, building, and operating distributed platform technologies or cloud-native systems.
  • 3+ years of experience building, operating, or supporting AI/ML platforms and services.
  • Hands-on experience with Amazon Bedrock and enterprise foundation model platforms.
  • Experience designing and implementing RAG architectures using vector databases, embeddings, and enterprise knowledge sources.
  • Experience building or operating agentic AI systems using AWS AgentCore or comparable agent frameworks.
  • Experience designing and implementing solutions based on Model Context Protocol (MCP).
  • Experience implementing AI Gateway solutions, such as Kong AI Gateway or equivalent, for AI governance, traffic management, observability, and security.
  • Familiarity with agent orchestration frameworks, agent-to-agent communication patterns, and multi-agent architectures.
  • Strong understanding of LLM operations, including prompt engineering, model evaluation, guardrails, governance, and token optimization.
  • Proficiency in Python and/or other languages commonly used for AI and platform engineering.
  • Experience with AWS cloud services, containerization, Kubernetes, and modern CI/CD practices.
  • Understanding of observability, monitoring, and operational support for AI and agent-based systems.
  • Experience implementing security, privacy, governance, and compliance controls in AI environments.

Nice To Haves

  • Experience in financial services or other highly regulated industries.
  • AWS certifications related to AI, Machine Learning, Cloud Architecture, or Platform Engineering.
  • Experience with Amazon Bedrock Knowledge Bases, Bedrock Guardrails, Agents for Bedrock, and AWS AgentCore services.
  • Experience with Kong AI Gateway or comparable API and AI Gateway technologies.
  • Experience implementing MCP servers, tool catalogs, and secure tool execution frameworks.
  • Experience with enterprise multi-model strategies spanning Anthropic Claude, Amazon Nova, OpenAI, Google Gemini, and other foundation models.
  • Familiarity with AI-specific observability and monitoring platforms.
  • Experience implementing Responsible AI frameworks, guardrails, explainability, and model governance processes.
  • Experience with FinOps practices and cost optimization for Generative AI workloads.
  • Familiarity with Agile, DevSecOps, and platform engineering practices.
  • Experience building enterprise self-service AI platforms and developer enablement capabilities.

Responsibilities

  • Design, build, and operate enterprise AI platform capabilities for Generative AI, Retrieval-Augmented Generation (RAG), and agentic workloads.
  • Develop scalable data ingestion pipelines, knowledge ingestion workflows, and AI data services.
  • Integrate vector databases, embeddings, knowledge graphs, and enterprise knowledge repositories with governance controls.
  • Design and implement retrieval frameworks for enterprise search, semantic search, and RAG.
  • Build and operate AI services using Amazon Bedrock, including foundation model integrations, Bedrock Knowledge Bases, Guardrails, and inference capabilities.
  • Design and support agentic architectures using AWS AgentCore and other enterprise agent platforms.
  • Implement model-serving infrastructure for real-time and batch inference workloads.
  • Enable secure agentic workflows through MCP, tool orchestration frameworks, and agent-to-agent communication patterns.
  • Design and implement AI Gateway capabilities, such as Kong AI Gateway, for centralized authentication, routing, governance, observability, rate limiting, and policy enforcement.
  • Develop APIs, SDKs, reusable platform services, and self-service capabilities that accelerate AI adoption across engineering teams.
  • Monitor model performance, application behavior, agent execution, and service reliability.
  • Implement logging, tracing, alerting, rollback, and operational recovery mechanisms.
  • Monitor AI usage patterns, token consumption, latency, throughput, and AI Gateway telemetry.
  • Implement observability that provides visibility into prompts, responses, model behavior, agent interactions, and platform health.
  • Apply explainability, fairness, governance, and compliance guardrails consistent with Responsible AI principles.
  • Support model evaluation, benchmarking, experimentation, and lifecycle management.
  • Design and implement secure AI platform architectures using cloud-native security controls.
  • Integrate encryption, IAM, secrets management, and audit logging capabilities.
  • Implement secure AI Gateway access patterns, including authorization, policy enforcement, prompt security controls, and data protection measures.
  • Support regulatory and internal governance requirements, including privacy, security, and Responsible AI requirements.
  • Partner with Information Security, Risk, Compliance, and Data Governance teams to ensure safe and compliant use of enterprise data and AI services.
  • Enable governance for models, agents, prompts, tools, and enterprise knowledge sources.
  • Apply Site Reliability Engineering practices to improve reliability, scalability, and operational maturity.
  • Apply FinOps principles to optimize AI platform utilization, model consumption, and cloud spending.
  • Automate infrastructure provisioning and management using Infrastructure as Code.
  • Establish operational standards, platform runbooks, SLA/SLO metrics, and support procedures.
  • Continuously improve platform security, performance, resiliency, and developer experience.
  • Partner with software engineers, platform engineers, architects, and product teams to deliver enterprise AI solutions.
  • Consult with application teams on AI platform integration patterns and best practices.
  • Create reference architectures, reusable patterns, and implementation guidance.
  • Develop documentation, runbooks, architectural diagrams, and operational standards.
  • Mentor team members and promote adoption of enterprise AI platform capabilities.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service