Vice President, AI / Machine Learning Software Engineer

BNY • Lake Mary, FL

1d • $83,000 - $178,000

About The Position

BNY is seeking a Vice President, AI Infrastructure Support Engineer to join its AI Infrastructure Support team in Lake Mary, Florida; New York, New York; or Pittsburgh, Pennsylvania. The role provides operational support for AI infrastructure, GPU platforms, and related production services, helping maintain reliable, high-performing distributed AI/ML environments.

The position supports deployment, orchestration, monitoring, and troubleshooting of workloads using Kubernetes and Docker, and involves hands-on operation of NVIDIA GPU infrastructure, including A100, H100, and B200 systems. The engineer uses Ansible, Python, and Shell scripting to automate and improve platform operations; manages incidents, service requests, and changes; and partners with engineering, platform, and operations teams on DevOps practices and secure access management. The role also creates and maintains technical documentation and diagnoses networking, storage, and system performance issues. Participation in a rotating on-call schedule, including occasional weekend coverage, is required.

BNY describes its compensation and benefits as competitive, with wellbeing programs, paid leaves that include paid volunteer time, and potential eligibility for incentive awards and benefits plans. Eligibility and benefits depend on the position and applicable plan terms.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
• Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
• Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
• Proficiency in Ansible, Python, and Shell scripting for automation, tooling, and operational support tasks.
• Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
• Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
• Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
• Understanding of identity and access management, including secure access controls such as Azure AD.
• Strong problem-solving skills, attention to detail, and ability to manage multiple priorities in a fast-paced environment.
• Effective written and verbal communication skills, including documenting processes and collaborating across technical and non-technical teams.
• Willingness to participate in on-call rotations and provide occasional weekend support as needed.

Responsibilities

• Deliver operational support and resolve issues for AI infrastructure, GPU platforms, and associated production services.
• Support deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
• Support provisioning, utilization, performance tuning, and ongoing operations of NVIDIA GPU infrastructure, including A100, H100, and B200 nodes.
• Build, maintain, and optimize automation scripts and tooling using Ansible, Python, and Shell scripting.
• Manage incidents, service requests, and change activity using enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
• Partner with engineering, platform, and operations teams to implement DevOps practices, including GitLab CI/CD, containerized deployment models, and secure access management through Azure AD.
• Create and maintain technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
• Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
• Participate in a rotating on-call support model, including occasional weekend coverage.

Benefits

• Competitive compensation
• Wellbeing programs
• Paid leaves, including paid volunteer time
• Potential eligibility for an annual discretionary incentive award
• Potential eligibility to enroll in a 401(k) plan
• Potential eligibility to participate in company-sponsored medical, dental, vision, and basic life insurance plans

What This Job Offers

• Job Type: Full-time
• Career Level: Senior