Senior Agentic AI Infrastructure Engineer I - Core Platforms

American Express•New York, NY
•$123,000 - $215,250

About The Position

The AI Infrastructure Engineer collaborates with application and platform teams to design, implement, and optimize secure, scalable infrastructure solutions for AI-enabled workloads. The role resolves complex technical issues, ensures system performance, reliability, and security, and leads infrastructure initiatives aligned with business objectives and platform strategy. The position supports AI-enabled infrastructure across cloud and hybrid environments, including GPU- and accelerator-enabled compute platforms, model training and inference, and agentic workloads. It builds reusable platform capabilities using Kubernetes, containers, infrastructure as code, and automated delivery pipelines, while engineering high-performance storage, networking, and data movement. The role also establishes observability, FinOps, security, reliability, and operational-readiness practices for multi-tenant AI infrastructure, and mentors engineers in responsible use of AI-enabled operational tools. The role requires at least five years of experience in infrastructure engineering, cloud engineering, DevOps, or a related technical field, including at least two years supporting AI-enabled infrastructure, AI automation, or agentic AI technologies. A bachelor's degree in a relevant field or comparable experience is required; an advanced degree is preferred. Employment eligibility to work in the United States is required; American Express will not pursue visa sponsorship.

Requirements

  • At least 5 years of experience in infrastructure engineering, cloud engineering, DevOps, or a related technical field, including at least 2 years of hands-on experience supporting AI-enabled infrastructure, AI automation, or agentic AI technologies.
  • Experience designing infrastructure for AI agents, including agent runtimes, orchestration frameworks, tool integrations, asynchronous execution, and stateful workflows; examples include LangGraph and Semantic Kernel.
  • Experience applying agentic AI tools to infrastructure engineering, platform support, or cloud operations, including reviewing AI-generated operational insights.
  • Experience validating AI-generated operational outputs and incorporating AI-enabled practices into infrastructure workflows, including human review and approval of AI-assisted recommendations.
  • Experience with Kubernetes-based AI platforms, containers, workload schedulers, and GPU or accelerator orchestration in cloud or hybrid environments.
  • Experience operating model-serving or inference platforms and optimizing throughput, latency, availability, and cost for production AI workloads.
  • Experience with distributed training or inference infrastructure, high-performance networking and storage, accelerator telemetry, and capacity planning.
  • Experience implementing security, reliability engineering, observability, and FinOps practices for multi-tenant AI infrastructure.
  • Experience with programming languages and DevOps tools such as Ansible, Puppet, Terraform, Python, shell scripting, and PowerShell, and their infrastructure applications.
  • Experience with infrastructure components such as servers, storage, networking, and virtualization technologies.
  • Experience with network protocols and networking fundamentals.
  • Experience with databases.
  • Experience with tools used to plan, analyze, craft, build, test, configure, and maintain applications.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience with monitoring technologies such as Prometheus, Elasticsearch, and Grafana.
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or comparable experience.
  • Knowledge of application infrastructure and standards.
  • Knowledge of storage management design and support, such as SAN and NAS.
  • Knowledge of middleware technologies.
  • Knowledge of software-defined networking, automation, and orchestration and their applications.
  • Knowledge of platform delivery methodologies such as Agile, Scrum, Agile XP, Best in Class Development, and Waterfall.
  • Knowledge of scripting and automation, such as PowerShell, Bash, and Python.
  • Knowledge of DevOps practices and tools, including CI/CD pipelines, Docker, and Kubernetes.
  • Knowledge of cloud technologies and Windows and Linux administration.
  • Working knowledge of AI-assisted infrastructure automation, observability, deployment support, and infrastructure services used for AI-enabled workloads.
  • Working knowledge of AI use cases in configuration management, incident analysis, infrastructure operations, and AI-assisted workflows incorporating human oversight and approval controls.
  • Eligibility to work in the United States; the company will not pursue visa sponsorship.

Nice To Haves

  • Advanced degree preferred.

Responsibilities

  • Mentor junior Infrastructure Engineers and cross-functional colleagues, supporting professional growth and fostering excellence and innovation.
  • Lead projects with multiple cross-functional teams, managing budget and schedule, resolving issues promptly, and maintaining standards for design, implementation, testing, and compliance.
  • Guide stakeholders in aligning processes with industry best practices and business objectives.
  • Collaborate with application teams to translate business needs into infrastructure solutions aligned with business objectives and the platform roadmap.
  • Lead infrastructure design and selection to meet customer needs and strategic goals.
  • Diagnose and resolve complex infrastructure issues and provide outage support to minimize disruption.
  • Monitor and address capacity and availability issues; conduct performance and security assessments; and support certification and accreditation processes.
  • Define and maintain processes, documentation, and engineering diagrams for technical and operational support.
  • Embed AI-assisted observability, automation, and documentation into workflows to improve deployment efficiency, issue detection, analysis, troubleshooting, production support, readiness, and operational support for specialized AI compute environments.
  • Use ML-powered AIOps and custom anomaly detection with metrics, logs, and traces to detect anomalies, predict failures, and correlate incidents across distributed systems.
  • Incorporate AI-assisted infrastructure-as-code development and review tools, such as GitHub Copilot, Claude Code, and Cursor, into engineering workflows.
  • Support infrastructure hosting AI workloads, including cloud LLM platforms such as AWS Bedrock, Azure AI Foundry/Azure OpenAI, and Google Vertex AI; mentor engineers on responsible AI-tool use, prompt engineering, runbook generation, incident troubleshooting, postmortem summarization, analysis, validation, oversight, and GPU/TPU infrastructure readiness.
  • Design and operate GPU- and accelerator-enabled compute platforms, including cluster scheduling, workload placement, capacity management, quota and reservation controls, and utilization optimization.
  • Build reusable platform capabilities for model training, fine-tuning, inference, and agentic workloads using Kubernetes, containers, infrastructure as code, and automated delivery pipelines.
  • Engineer high-performance storage, networking, and data-movement patterns for distributed AI workloads, with measurable availability, latency, throughput, and recovery objectives.
  • Implement end-to-end observability and FinOps controls for AI infrastructure, including workload telemetry, accelerator utilization, cost attribution, anomaly detection, performance tuning, and capacity forecasting.
  • Partner with AI engineering, security, risk, and platform teams to establish secure multi-tenant isolation, identity and access controls, secrets management, software supply-chain controls, and operational readiness.

Benefits

  • Competitive base salaries
  • Bonus incentives
  • 6% company match on retirement savings plan
  • Free financial coaching and financial well-being support
  • Comprehensive medical, dental, vision, life insurance, and disability benefits
  • Flexible working model, with hybrid, onsite, or virtual arrangements depending on role and business need
  • 20+ weeks of paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption, or surrogacy
  • Free access to global on-site wellness centers staffed with nurses and doctors, depending on location
  • Free and confidential counseling support through the Healthy Minds program
  • Career development and training opportunities
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service