Sr Agentic AI Engineer - Core Platforms

American Express•New York, NY

3d•$123,000 - $215,250

About The Position

The Inference Engineer independently designs, optimizes, and operates scalable production inference services that enable enterprise AI and machine-learning solutions. The role partners with stakeholders to translate business and technical requirements into reliable model-serving capabilities, build efficient integration patterns and data pipelines, and ensure solutions meet enterprise architecture standards for performance, reliability, observability, compliance, and production readiness. The position works across platform, infrastructure, security, evaluation, application, product, and business teams to build and operate production AI systems. It also mentors junior engineers and promotes best practices in scalable, safe, observable, and compliant AI engineering.

Requirements

Bachelor's degree in Computer Science, Machine Learning, Data Science, or comparable experience.
Advanced knowledge of machine-learning techniques and performance optimization.
Strong understanding of AI system architectures, including LLM ecosystems, retrieval systems, orchestration frameworks, and evaluation methodologies.
Strong knowledge of production model serving, inference optimization, GPU fundamentals, Kubernetes, APIs, and distributed systems.
Ability to evaluate technical alternatives and make sound service-level design decisions within established architecture.
5+ years of software development experience, including hands-on experience in machine learning, AI technologies, and Agentic AI solutions.
Experience working with LLMs, especially GPT-3.5/4 or similar models.
Experience with languages such as Python, R, Java, or C++.
Experience deploying AI models and pipelines using machine-learning operations tools.
Experience with machine-learning algorithms and applying them to real-world problems.
Experience with CI/CD pipelines and containerized deployments.
Experience delivering end-to-end AI systems in production, including design and operational ownership.
Experience with distributed-systems design, scalable APIs, and cloud-native AI infrastructure, including monitoring and optimization.
Advanced expertise in a technical domain and moderate expertise in a different technical domain.
Demonstrated experience independently building and operating production inference services.
Experience with model-serving frameworks, containerized GPU workloads, and performance or reliability optimization.
Must be eligible to work in the United States; American Express will not pursue visa sponsorship.

Nice To Haves

An advanced degree is preferred.

Responsibilities

Mentors junior AI engineers and cross-functional colleagues, fostering excellence and innovation.
Integrates AI models into production systems in collaboration with cross-functional teams.
Maintains adherence to model governance, security, and compliance standards.
Collaborates with engineers to deliver scalable AI solutions that meet technical and business requirements.
Translates business requirements into AI-driven technical solutions, models, and algorithms.
Creates end-to-end machine-learning operations pipelines for scalable model deployment, monitoring, and maintenance.
Collaborates with product and business teams to align technology initiatives with business objectives.
Designs and operates scalable production AI systems integrating ML models, LLMs, and intelligent services across multiple components.
Ensures AI systems meet enterprise standards for reliability, safety, explainability, observability, and compliance, and mentors others on best practices.
Designs and operates scalable inference services, ensuring performance, reliability, observability, and production readiness.
Evaluates serving approaches and optimizes latency, throughput, accelerator utilization, and cost for assigned workloads.
Partners with platform, infrastructure, security, evaluation, and application teams, and mentors less-experienced engineers.

Benefits

Competitive base salaries
Bonus incentives
6% company match on retirement savings plan
Free financial coaching and financial well-being support
Comprehensive medical, dental, vision, life insurance, and disability benefits
Flexible working model, with hybrid, onsite, or virtual arrangements depending on role and business need
20+ weeks of paid parental leave for all parents, including for pregnancy, adoption, or surrogacy
Free access to global onsite wellness centers staffed with nurses and doctors, depending on location
Free and confidential counseling support through the Healthy Minds program
Career development and training opportunities