Senior Cloud Engineer - GenAI Platform Engineering
About The Position
The Senior Cloud Engineer will define and lead engineering approaches for complex features, deliver end-to-end solutions, and provide technical thought leadership for Bank of America’s Global Markets GenAI platform. The platform supports a growing set of generative AI use cases, using proprietary and open-source large language models and large structured and unstructured datasets to generate insights for Global Markets and its clients. The role collaborates with Global Markets Sales & Trading, Quantitative Strategies & Data Group, and platform teams. The engineer will build and operate the cloud infrastructure layer across AWS, Azure, and GCP, enabling secure and scalable deployment of agent-based applications, APIs, and model-serving workloads. Responsibilities include designing and managing Kubernetes-based container environments, engineering scalable cloud architectures, and developing deployment and release pipelines. The role also drives engineering standards, CI/CD practices, automation, performance, reliability, and delivery of complex features across teams.
Requirements
- At least 7 years of experience in cloud engineering, platform engineering, or DevOps/SRE roles.
- Hands-on experience with AWS, Azure, and/or GCP; multi-cloud experience is preferred.
- Experience with container platforms such as Kubernetes, EKS, AKS, or GKE.
- Experience with infrastructure as code and CI/CD pipelines.
- Demonstrated experience designing and operating highly scalable distributed systems.
- Demonstrated experience operating containerized workloads in production cloud environments.
- Expertise in autoscaling, load balancing, horizontal scaling, performance tuning, and system optimization.
- Expertise in cloud-native architectures and microservices.
- Experience with observability tools for metrics, logging, and distributed tracing.
- Experience with reliability engineering, including high availability, fault tolerance, and disaster recovery.
- Bachelor’s degree or equivalent professional experience.
Nice To Haves
- Experience supporting AI/ML or GenAI workloads, including model inference endpoints and API gateways.
- Experience with high-throughput, low-latency serving systems.
- Familiarity with vector databases, data pipelines, or retrieval-based architectures.
- Familiarity with scaling patterns for compute-intensive workloads.
- Experience in regulated enterprise environments, preferably financial services.
- Experience with shared, multi-tenant platform environments supporting multiple teams.
Responsibilities
- Ensure design and engineering approaches for complex features align with the broader portfolio solution.
- Define the solution technology tool stack and evaluate or adopt testing tools, frameworks, and practices.
- Enable teams and applications with CI/CD capabilities and coordinate with technical stakeholders to keep CI/CD pipelines functioning efficiently.
- Guide teams on design and high-performance coding practices, including pairing and code reviews.
- Deliver complex features end to end, including automation, for one or multiple teams at program level.
- Conduct research, prototype designs, and evaluate toolsets and components for release management, CI/CD, and product features.
- Work with stakeholders to establish high-level solution needs and with architects to define technical requirements.
- Build and operate cloud infrastructure for the GenAI platform across AWS, Azure, and GCP.
- Enable secure and scalable deployment of agent-based applications, APIs, and model-serving workloads.
- Design, implement, and manage containerized environments using Kubernetes and managed services such as EKS, AKS, and GKE.
- Develop and maintain scalable deployment and release pipelines.
- Engineer highly scalable cloud architectures.
Benefits
- Industry-leading benefits.
- Access to paid time off.
- Resources and support for employees’ physical, emotional, and financial wellness.
- Eligibility to participate in an annual discretionary incentive plan.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
