Senior Engineer – AI-Enabled Development & Observability

Bank of America • Jersey City, NJ

1d • $122,000 - $200,000 • Onsite

About The Position

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day. Being a Great Place to Work is core to how we drive Responsible Growth. This includes our commitment to being an inclusive workplace, attracting and developing exceptional talent, supporting our teammates’ physical, emotional, and financial wellness, recognizing and rewarding performance, and how we make an impact in the communities we serve. Bank of America is committed to an in-office culture with specific requirements for office-based attendance and which allows for an appropriate level of flexibility for our teammates and businesses based on role-specific considerations. At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us! Role Overview: We are seeking a highly skilled Senior Engineer – AI-Enabled Development and Observability to design, build, test, and operate end-to-end solutions supporting monitoring, observability, and AI-enabled platforms within a large, complex banking environment. This role is intentionally designed as an elite individual contributor ("army of one") — a technologist who owns solutions from idea to production and leverages modern AI platforms such as OpenAI and Anthropic as force multipliers to accelerate delivery speed, quality, and operational effectiveness. You will independently deliver production-grade systems—from concept to runtime—while shaping the organization’s approach to AI-enabled monitoring, observability, and intelligent operations in a regulated financial services environment.

Requirements

• 8+ years of experience in software engineering, platform engineering, or SRE roles within large-scale, complex environments
• Strong proficiency in Python, Java, Go, or similar languages, with hands-on experience delivering and maintaining production code
• Strong software engineering fundamentals, including API design, data structures, version control, testing, and debugging
• Demonstrated ability to leverage AI-assisted development to materially improve delivery speed, quality, and outcomes
• Hands-on experience with LLMs, embeddings, retrieval-augmented generation (RAG), and model orchestration patterns
• Practical experience with vector databases and semantic search platforms, including Weaviate, Pinecone, or equivalent technologies
• Proven expertise in structured output and reliable extraction, including function calling, JSON schema enforcement, and tool-use patterns
• Strong discipline in prompt and context engineering as a practice, including prompt versioning, A/B testing, dynamic few-shot selection, and system prompt and chain-of-thought architecture
• Experience implementing CI/CD pipelines for AI systems, including evaluation-gated deployments and regression testing across model changes
• Solid understanding of data privacy, security, and Responsible AI principles in enterprise environments
• Excellent communication skills, with the ability to influence technical and non-technical stakeholders, including senior leaders
• Proven ability to operate independently

Nice To Haves

• Experience in financial services or other highly regulated enterprise environments
• Familiarity with AI telemetry and observability, including model‑adjacent and evaluation platforms
• Experience with graph‑based retrieval, including Graph RAG and hybrid graph + vector approaches
• Experience with agent memory and state management for long‑running or multi‑step workflows
• Comfort navigating enterprise governance, including model risk management, production readiness, and information security reviews
• Proven success as a senior individual contributor, operating autonomously with minimal oversight

Responsibilities

• Design, develop, test, deploy, and operate monitoring and observability solutions for distributed systems and AI-enabled platforms supporting Splunk, Dynatrace, Datadog, Grafana/Prometheus and Open Telemetry
• Leverage AI platforms such as OpenAI and Anthropic to accelerate development, testing, troubleshooting, and documentation
• Architect and implement agentic AI workflows, production RAG systems, multi-model orchestration, and AI-specific observability
• Build AI evaluation pipelines, hallucination detection, guardrails, and Responsible AI controls
• Own solutions end-to-end, ensuring security, compliance, reliability, and performance
• Partner with SRE, production support, platform teams, and governance stakeholders

Benefits

• This role is eligible to participate in the annual discretionary plan. Employees are eligible for an annual discretionary award based on their overall individual performance results and behaviors, the performance and contributions of their line of business and/or group; and the overall success of the Company.
• This role is currently benefits eligible.
• We provide industry-leading benefits, access to paid time off, resources and support to our employees so they can make a genuine impact and contribute to the sustainable growth of our business and the communities we serve.
• Bank of America is committed to help employees through the transition period when they’re displaced as a result of a workforce reduction, realignment or similar measure.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed