Vice President, AI / Machine Learning Software Engineer

BNY Mellon•Lake Mary, FL

19h

About The Position

BNY is seeking a Vice President, AI Infrastructure Support Engineer to join its AI Infrastructure Support team in Lake Mary, Florida; New York, New York; or Pittsburgh, Pennsylvania. The role supports AI infrastructure, GPU platforms, and production services, helping maintain reliable, high-performing AI/ML workloads across distributed environments. The engineer works with NVIDIA GPU systems and container orchestration platforms, and uses automation and DevOps practices to improve operational efficiency and reliability. The role partners with engineering, platform, and operations teams to troubleshoot infrastructure issues, manage service and change workflows, and maintain documentation. It includes participation in a rotating on-call support model with occasional weekend coverage.

Requirements

Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
Strong experience supporting AI infrastructure, GPU platforms, or high-performance computing environments in enterprise or production settings.
Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
Proficiency in Ansible, Python, and Shell scripting for automation, tooling, and operational support tasks.
Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
Understanding of identity and access management, including secure access controls such as Azure AD.
Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
Effective written and verbal communication skills, including the ability to document processes and collaborate across technical and non-technical teams.
Willingness to participate in on-call rotations and provide occasional weekend support as needed.

Responsibilities

Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
Support deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
Support provisioning, utilization, performance tuning, and ongoing operations of NVIDIA GPU infrastructure, including A100, H100, and B200 nodes.
Build, maintain, and optimize automation scripts and tools using Ansible, Python, and Shell scripting.
Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
Partner with engineering, platform, and operations teams to implement DevOps practices, including GitLab CI/CD, containerized deployments, and secure access management through Azure AD.
Create and maintain technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance computing workloads.
Participate in a rotating on-call support model, including occasional weekend coverage.