Senior Manager - AI Infrastructure & GPU Engineering

Ernst & Young LLP • Alpharetta, GA

64d • $144,000 - $329,100 • Hybrid

About The Position

We're seeking a seasoned Senior Manager to architect and lead the development of GPU-based infrastructure for scalable AI workloads. This role is ideal for a technical leader with deep expertise in infrastructure and DevOps, who thrives in high-performance environments and is passionate about enabling reliable, production-grade AI systems.

Requirements

• 8-12+ years of experience in infrastructure or platform engineering.
• Strong knowledge of the NVIDIA GPU ecosystem, including MIG, Run.ai, and Kubernetes operators.
• Experience with Terraform, Ansible, Helm, and monitoring stacks such as Prometheus and Grafana.
• Familiarity with hybrid cloud environments (Azure, AWS, GCP) for GPU workloads.

Nice To Haves

• Experience deploying and scaling AI infrastructure in enterprise settings.
• Knowledge of security and compliance considerations for AI platforms.
• Excellent communication and stakeholder engagement skills.

Responsibilities

• Architect and manage GPU infrastructure to support scalable AI workloads.
• Lead implementation of NVIDIA enterprise software including CUDA, Triton Inference Server, and NIM/NCP services.
• Provide DevOps and AIOps leadership across CI/CD, observability, and reliability engineering practices.
• Mentor infrastructure-focused Managers on system performance optimization and best practices.
• Embrace emerging technologies and digital tools to enhance collaboration, streamline workflows, and improve service delivery.
• Promote a culture of continuous learning and adaptability in a hybrid work environment.
• Lead with insight and analytical vigor.
• Apply complex problem-solving and critical thinking to evaluate data, identify trends, and make informed decisions.
• Translate insights into actionable strategies that drive measurable outcomes.

Benefits

• comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business
• medical and dental coverage
• pension and 401(k) plans
• a wide range of paid time off options
• flexible vacation policy
• time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Professional, Scientific, and Technical Services
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees