Software Engineer III - LLM

JPMorganChase • Wilmington, NC

2d

About The Position

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. Serve as an emerging member of an agile team to design and deliver market-leading technology products in a secure and scalable way. Join an agile Corporate Technology team at JPMorganChase to design AI‑enabled platforms with modern Python services on AWS, integrating LLMs and agentic patterns to solve real enterprise problems. Work with advanced technologies, ship to production at scale, and drive resiliency and security across mission‑critical systems. As a Software Engineer III with JPMorganChase within the Corporate Sector – AIML Data Platforms LLM Team, you will play a crucial role in the LLM Suite, tackling some of the most pressing challenges in the financial services sector to create meaningful impact for the organization. Your responsibilities will include transforming early-stage code into production-ready solutions and contributing to the continuous improvement of our technology platforms.

Requirements

• Formal training or certification in software engineering concepts with 3+ years of applied experience
• Hands-on experience in system design, application development, testing, and operational stability
• Proficiency in Python (FastAPI), Microservices, APIs, LLMs, and AWS services (EC2, ECS, EKS, Lambda, SQS, SNS, RDS Aurora MySQL & Postgres, DynamoDB, EMR, Kinesis)
• Experience developing, debugging, and maintaining code in a large corporate environment using modern programming and database querying languages
• Strong understanding of the Software Development Life Cycle
• Solid grasp of agile methodologies including CI/CD, Application Resiliency, and Security
• Knowledge of cloud, AI, ML, and mobile technologies.
• Experience with agent-to-agent communication, Model Context Protocol (MCP), AI skills, personal AI assistants, agentic orchestrators, AI coding assistants (e.g., GitHub Copilot), and spec-driven frameworks (Speckit, BMAD)

Nice To Haves

• Familiarity with modern front-end technologies
• Exposure to cloud technologies
• Background in machine learning, deep learning, and neural networks
• Experience with state-of-the-art GenAI services leveraging Azure OpenAI models and AWS Bedrock

Responsibilities

• Designs, develops, and troubleshoots software solutions with a creative mindset, going beyond conventional approaches to solve complex technical challenges
• Writes secure, high-quality production code and maintain algorithms that integrate seamlessly with existing systems
• Creates architecture and design artifacts for complex applications, ensuring all design constraints are met throughout the development process
• Analyzes and synthesize large, diverse data sets to develop visualizations and reports that drive continuous improvement of applications and systems
• Builds innovative AI/ML solutions and agentic systems for the LLM Suite platform using public cloud architecture (Azure, AWS) and modern AI Agentic frameworks
• Implements cutting-edge GenAI services leveraging Azure OpenAI models and AWS Bedrock
• Identifies hidden problems and patterns in data proactively, using insights to improve coding standards and system architecture
• Participates in software engineering communities of practice and events focused on emerging technologies
• Fosters a team culture built on opportunity, collaboration, and respect

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed