Software Engineer III-Gen AI/RAG/Python

JPMorgan Chase & Co. • Jersey City, NJ

1d • $137,750 - $185,000

About The Position

As a Software Engineer III in JPMorgan Chase’s Consumer & Community Banking – Wealth Management organization, you will join a small, fast-moving AI pod building and deploying generative and agentic AI solutions in partnership with business users. The role involves hands-on work with large and small language models, agentic frameworks, and AWS, with exposure to autonomous AI and agent-to-agent systems. Solutions are developed from prototype through production and are intended to be delivered quickly for use by business teams.

You will develop agentic workflows, orchestration and retrieval-augmented generation (RAG) pipelines, and integrations with internal systems. You will evaluate models and agents, process large datasets, and build components for concurrent, multi-user, real-time applications. The role also involves writing secure production code, deploying through CI/CD, using enterprise-authorized AI-assisted development tools responsibly, and collecting business-user feedback to improve solutions. The position contributes to engineering communities of practice and supports a culture of diversity, opportunity, inclusion, and respect.

Requirements

• Formal training or certification in software engineering concepts and at least 3 years of applied experience.
• Strong Python skills and hands-on experience with generative AI and AI/ML frameworks.
• Hands-on experience using enterprise-authorized AI-assisted software development tools for activities such as coding, test creation, troubleshooting, or documentation, and ability to evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
• Understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resiliency and security expectations; ability to guide peers on safe and effective use.
• Hands-on experience with agent frameworks such as LangGraph, Google ADK, or similar.
• Practical experience building LLM-based applications using prompt engineering, skill and tool development, and RAG.
• Experience evaluating and benchmarking models or LLM-based applications.
• Experience working with large datasets.
• Understanding of concurrent, multi-user, and real-time application design.
• Experience with AWS or another major cloud platform.
• Strong understanding of the SDLC and agile practices, including CI/CD, application resiliency, and security.
• Bias for action and comfort working to tight timelines.

Nice To Haves

• Exposure to SLMs, LRMs, and model fine-tuning.
• Hands-on AI projects, hackathons, or personal builds.
• Familiarity with vector databases and streaming architectures.
• Front-end experience for AI user experiences.

Responsibilities

• Build and ship generative AI and agentic AI applications from prototype to production.
• Develop agentic workflows, including tool-using agents and multi-agent collaboration.
• Contribute to autonomous AI capabilities with appropriate guardrails and controls.
• Implement orchestration and RAG pipelines, integrating AI solutions with internal systems.
• Build and run model and agent evaluations to maintain high-quality outcomes.
• Use enterprise-authorized AI coding-assistance tools to improve code quality, delivery speed, and productivity; validate outputs through peer review, automated testing, and secure coding standards, and share reusable patterns and learnings.
• Apply knowledge of SDLC tools, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
• Process and analyze large datasets that support AI solutions.
• Develop components for concurrent, multi-user, and real-time applications.
• Write secure, high-quality production code and deploy on AWS using CI/CD.
• Partner with business users to gather feedback and iterate quickly.
• Contribute to engineering communities of practice and foster a culture of diversity, opportunity, inclusion, and respect.

Benefits

• Competitive total rewards package, including base salary; eligible roles may receive commission-based pay and/or discretionary incentive compensation in cash and/or forfeitable equity.
• Comprehensive health care coverage.
• On-site health and wellness centers.
• Retirement savings plan.
• Backup childcare.
• Tuition reimbursement.
• Mental health support.
• Financial coaching.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed