Platform Engineer - AI Observability & Governance (OpenShift)
About The Position
The Platform Engineer engineers and operates enterprise vendor platforms in Bank of America’s on-premises Red Hat OpenShift environment. The role owns deployment, configuration, reliability, and day-to-day support of a self-hosted AI observability platform that provides tracing, monitoring, and evaluation for GenAI applications across the bank. The platform consists of containerized services backed by stateful data stores, making experience operating databases and storage on OpenShift or Kubernetes central to the position. This is a platform and systems engineering role rather than a model development role. The focus is keeping a business-critical third-party platform secure, stable, performant, and compliant as trace volumes and adoption grow. The engineer works closely with the vendor, OpenShift platform teams, information security, data governance, and application teams that consume the service. AI tooling exposure is helpful, while production enterprise platform experience, hands-on ownership of production issues, quick learning, and cross-functional leadership are emphasized.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, MIS, a related field, or equivalent experience.
- 10+ years of software, systems, or platform engineering experience supporting production applications.
- Hands-on experience deploying and operating workloads on Red Hat OpenShift or Kubernetes in production.
- Experience running stateful services on OpenShift or Kubernetes, such as PostgreSQL, Redis, or analytical databases, including storage, backup, and recovery.
- Experience supporting third-party/vendor enterprise platforms end to end, including installs, upgrades, patching, and vendor escalations.
- Strong Linux (RHEL) administration and troubleshooting skills.
- Experience with Helm, container registries, and CI/CD pipelines.
- Scripting and automation experience with Python, Bash, or similar.
- Experience with infrastructure and application observability tools such as Splunk, Dynatrace, Prometheus, or Grafana.
- Working knowledge of enterprise security controls, including TLS certificates and trust stores, secrets management, encryption, SSO/OAuth, and role-based access.
- Experience working in Agile environments.
- Demonstrated technical leadership and stakeholder influence.
Nice To Haves
- Experience delivering technology solutions in large, complex, regulated organizations, preferably financial services.
- Experience operating ClickHouse or other high-volume analytical/time-series data stores.
- Experience supporting technology risk, audit, or data governance requirements for production platforms.
- Experience supporting platforms used by GenAI/LLM applications, or familiarity with LLM tracing, evaluation, or AI observability tools.
- Familiarity with LLM application frameworks such as LangChain or OpenAI-compatible APIs.
- Experience with configuration management or infrastructure-as-code tooling.
- Strong collaboration skills and ability to quickly learn emerging technologies.
Responsibilities
- Deploy, configure, upgrade, and support vendor applications on on-premises OpenShift using Helm and CI/CD pipelines.
- Manage OpenShift namespaces, resource quotas, storage classes, networking, routes, and network policies.
- Deploy and operate stateful backing services such as PostgreSQL, Redis, ClickHouse, and object storage, including persistent storage, replication, backup and restore, and encryption at rest.
- Plan capacity and manage data retention and storage growth for high-volume trace and telemetry data.
- Onboard vendor container images and Helm charts into internal registries and drive remediation of image vulnerability findings.
- Build and maintain infrastructure and application monitoring, logging, and alerting using tools such as Splunk, Dynatrace, Prometheus, and Grafana.
- Lead production incident response, root cause analysis, and permanent fixes; manage vendor escalations through resolution.
- Implement and maintain security controls, including TLS certificates, secrets management, SSO/OAuth integration, and access management workflows.
- Support governance and control requirements, including audit logging, data documentation, access reviews, and evidence for technology risk reviews.
- Design, document, and test high availability, backup, and disaster recovery/contingency procedures.
- Automate environment builds, deployments, and code promotion across development, test, and production; create and maintain runbooks.
- Support application teams onboarding to the platform and troubleshoot integration issues involving APIs, authentication, and connectivity.
- Mentor engineers and drive engineering standards across internal, offshore, and vendor teams.
Benefits
- Industry-leading benefits.
- Access to paid time off.
- Resources and support for employees.
- Eligibility to participate in an annual discretionary incentive plan, with awards based on individual performance and behaviors, business contributions, and overall company success.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
