Senior Lead Software Engineer - AI/ML Engineering, GPU ML Serving

JPMorgan Chase & Co. • Palo Alto, CA

1d • $156,750 - $215,000

About The Position

As a Lead Software Engineer on JPMorgan Chase’s Commercial and Investment Banking team, you will contribute to an agile team designing and delivering secure, stable, and scalable technology products. You will implement critical technology solutions across technical areas in support of the firm’s business objectives, with a focus on AI/ML engineering and GPU ML serving. The role includes developing production software and ML systems, producing architecture and design artifacts, using enterprise-authorized AI-assisted development tools responsibly, and improving software quality and system architecture through analysis of data and patterns.

Requirements

• Formal training or certification in software engineering concepts and at least 5 years of applied experience.
• Professional software development experience, with an emphasis on ML systems.
• Hands-on experience with enterprise-authorized AI-assisted software development tools, and the ability to evaluate and refine generated outputs for correctness, performance, and security.
• Ability to use AI responsibly in engineering workflows, considering data sensitivity, secure handling of inputs and outputs, resiliency, and security expectations, and to guide peers in safe and effective practices.
• Experience contributing to the design and development of scalable systems and services, such as web services and APIs.
• Proficiency in Python and experience with ML frameworks such as TensorFlow, PyTorch, or similar.
• Experience with cloud-native technologies such as Docker and Kubernetes.
• Experience with one or more public cloud platforms, such as AWS or GCP.
• Experience with system design fundamentals, including reliability, scalability, and performance tradeoffs.
• Experience with distributed systems concepts, microservices architectures, and Cassandra or an equivalent NoSQL database.
• Mentorship and technical leadership experience, including setting engineering standards and elevating team quality.

Nice To Haves

• Working knowledge of additional programming languages such as Java and/or C++.
• Exposure to deploying or operating GPU workloads in Kubernetes environments.
• Exposure to ML model serving frameworks such as TorchServe, TensorFlow Serving, or Triton Inference Server.
• Familiarity with distributed training and inference systems.
• Awareness of model compression techniques and edge deployment concepts.
• Familiarity with API management concepts, Domain-Driven Design (DDD), and Agile development environments.

Responsibilities

• Execute software design, development, and technical troubleshooting, applying approaches beyond routine methods to build solutions and break down technical problems.
• Create secure, high-quality production code and maintain algorithms that run synchronously with appropriate systems.
• Use enterprise-authorized AI coding-assistance tools to improve code quality, delivery speed, and productivity; validate outputs through peer review, automated testing, and secure coding standards, and share reusable patterns and learnings.
• Apply software development lifecycle toolchain capabilities, including authorized AI-assisted development and automation, to improve the value of automation.
• Produce architecture and design artifacts for complex applications and ensure software development meets design constraints.
• Gather, analyze, synthesize, and visualize large, diverse data sets to support continuous improvement of software applications and systems.
• Identify hidden problems and patterns in data and use insights to improve coding hygiene and system architecture.
• Provide technical mentorship and leadership, including setting engineering standards and improving overall team quality.

Benefits

• Competitive total rewards package, including base salary and, for eligible roles, commission-based pay and/or discretionary incentive compensation in cash and/or forfeitable equity.
• Comprehensive health care coverage.
• On-site health and wellness centers.
• Retirement savings plan.
• Backup childcare.
• Tuition reimbursement.
• Mental health support.
• Financial coaching.
• Additional benefits and programs based on eligibility.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed