Director of Infrastructure Engineering - AI
About The Position
The Director of Infrastructure Engineering at JPMorganChase leads one large technical area or multiple smaller areas within the Core Engineering Solutions and Architecture group. The role requires advanced technical knowledge and independent judgment to address complex issues, while setting direction within general guidelines and parameters. The position sets the multi-year strategy and roadmap for AI infrastructure across Consumer & Community Banking, aligned with business priorities and the firm’s technology direction. It leads infrastructure engineering teams and managers, drives complex initiatives through delivery, and ensures production use cases achieve measurable cost savings and reliability improvements. The Director also establishes standards for enterprise-authorized AI adoption and AI-assisted workflows, with appropriate human review, data handling, traceability, security, resiliency, and auditability. The role manages senior stakeholder relationships, budgets, staffing, and relevant profit and loss. It represents business needs to firm-wide technology and platform teams, shapes shared roadmaps and priorities, and ensures delivery meets business requirements, service levels, compliance, risk, and security standards. JPMorganChase offers a competitive total rewards package and benefits based on eligibility; further details are provided during the hiring process.
Requirements
- Formal training or certification in infrastructure engineering concepts and 10+ years of applied experience.
- Experience managing cross-functional infrastructure engineering teams, with a demonstrated record of setting technical strategy and delivering measurable outcomes.
- Experience leading teams in the safe use of enterprise-authorized AI capabilities for infrastructure engineering workflows, including validation habits and awareness of data sensitivity.
- Ability to define review and approval expectations for AI-assisted recommendations and ensure outcomes meet resiliency, security, and auditability expectations.
- Experience hiring, developing, and recognizing talent and creating a culture of ownership and engineering excellence.
- Extensive knowledge of infrastructure engineering hardware, with a deep background in cloud infrastructure, platform, or site reliability engineering and hands-on depth on at least one major cloud provider.
- Experience turning business needs into technical roadmaps and influencing central or shared technology teams not directly managed; strong collaboration across engineering, product, security, risk, and finance.
- Excellent stakeholder management and executive communication skills, including presenting to senior leadership; budget and vendor management experience and ability to make investment and cost trade-off decisions.
- Experience running ML or GenAI workloads in production, such as hosted model APIs behind API gateways with authentication, rate limiting, and resilience, and building AI skills, plugins, and agents.
- Experience with Kubernetes, including GPU scheduling and autoscaling; infrastructure as code with Terraform or equivalent; and CI/CD for infrastructure.
- Python and automation fluency to convert manual efforts into automated solutions, together with observability expertise using tools such as Splunk, Datadog, Prometheus/Grafana, or OpenTelemetry.
Nice To Haves
- Experience with GPU compute orchestration, scheduling, and reclaim policies.
- Model serving and optimization experience with AI gateways, vLLM, Triton, TensorRT, batching, quantization, latency, and throughput.
- Distributed training experience with PyTorch FSDP, DeepSpeed, or Megatron-LM, and high-speed GPU interconnects such as NVLink or InfiniBand.
- Experience with RAG and vector databases such as OpenSearch, pgvector, or Pinecone, and agent frameworks such as LangChain or LlamaIndex.
- GPU capacity planning and FinOps for AI workloads, including cost allocation, chargeback, and reserved capacity.
- Experience leading an LLM gateway, AI platform, or ML platform organization.
- Leadership experience in financial services, including work with risk, compliance, and audit teams.
Responsibilities
- Manage technical area(s) within infrastructure engineering and collaborate across technical areas, anticipating the needs of multiple disciplines.
- Set the multi-year strategy and roadmap for AI infrastructure across Consumer & Community Banking, aligned with business priorities and the firm's technology direction.
- Set reuse-first expectations for enterprise-authorized AI adoption in the work environment, including human-in-the-loop validation and appropriate handling of sensitive data.
- Manage and implement corporate and divisional operational plans; develop and execute function objectives; provide direction to teams, team leads, and supervisors and remain accountable for outcomes.
- Build, lead, and grow a high-performing organization of engineers and engineering managers through hiring, coaching, performance management, and succession planning.
- Manage senior stakeholders and ensure teams meet compliance, risk, security, service-level, and business requirements.
- Partner with business and product leaders to translate AI use cases into infrastructure requirements prioritized by value and risk.
- Represent business needs to firm-wide technology and platform teams, shape roadmaps, negotiate priorities and timelines, and escalate when commitments slip.
- Drive multiple large, complex projects, processes, and initiatives to delivered outcomes, including production use cases, measurable cost savings, and improved reliability.
- Manage staffing, budgets, and relevant profit and loss, including developing and managing budgets.
- Establish governance standards for AI-assisted workflows used in delivery and operational routines, ensuring traceability, auditability, and alignment with resiliency, security, and risk expectations.
Benefits
- Comprehensive health care coverage
- On-site health and wellness centers
- Retirement savings plan
- Backup childcare
- Tuition reimbursement
- Mental health support
- Financial coaching
- Competitive total rewards package, including base salary and, for eligible roles, commission-based pay and/or discretionary incentive compensation in cash and/or forfeitable equity
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Director
Education Level
No Education Listed
