Senior Lead Software Engineer - Data & AI Platform Engineer

JPMorgan Chase & Co. • Jersey City, NJ

3d • $156,750 - $215,000

About The Position

As a Lead Software Engineer on JPMorgan Chase’s Commercial & Investment Banking Payments Technology team, you will build a Data & AI Platform that powers analytics and automation at scale. You will design and implement modern data pipelines and platform capabilities using a cutting-edge technology stack, with governance across data cataloging, lineage, and quality. You will also lead an Agentic AI initiative to automate and optimize platform engineering and architecture, partnering with product and analytics teams to deliver production-grade solutions.

Requirements

• Formal training or certification in software engineering concepts and at least 5 years of applied experience.
• Hands-on experience delivering system design, application development, testing, and operational stability.
• Professional experience focused on software engineering or data platform development.
• Advanced proficiency in one or more programming languages, including Python, Java, or SQL.
• Hands-on experience with distributed data processing frameworks such as Apache Spark and Flink.
• Understanding of data modeling techniques such as star and snowflake schemas, and query optimization.
• Experience designing and operating data pipelines on Databricks using orchestration tools such as Apache Airflow.
• Proficiency with cloud data services such as AWS S3, Glue, Redshift, Athena, EMR, or Lake Formation, or equivalent services.
• Experience engineering production-grade data platforms on Kubernetes with open catalog integration, such as Apache Iceberg, Unity Catalog, or OpenMetadata, for data discovery, lineage, and governance.
• Advanced understanding of agile methodologies, CI/CD, application resiliency, and security.
• Experience developing Agentic AI, LLMs, RAG architectures, MCP, vector databases, and embedding-based retrieval systems.

Nice To Haves

• Hands-on familiarity with data platform and transformation framework development.
• Experience with data mesh or data product architectures.
• Proficiency with Infrastructure as Code tools such as Terraform and containerized deployments using Docker and Kubernetes.
• Experience with data observability, quality, and metadata management tools.
• Experience with semantic layers, metrics stores, or BI platforms such as Tableau or dbt Metrics.

Responsibilities

• Execute creative software solutions through design, development, and technical troubleshooting, including approaches beyond conventional methods.
• Design, build, and maintain scalable batch and real-time data pipelines and ETL/ELT workflows using Spark, Airflow, Kafka, and Flink.
• Develop data platform components, including data cataloging, data quality frameworks, and semantic or metrics layers with governance, lineage, and compliance standards.
• Implement data modeling strategies, including fact and dimensional models and wide tables, for analytics, reporting, and downstream use.
• Partner with analytics teams, product managers, and business stakeholders to turn data requirements into production-grade solutions.
• Develop secure, high-quality production code and review and debug code written by others.
• Identify recurring issues and opportunities to automate remediation to improve software and systems stability.
• Lead evaluation sessions with external vendors, startups, and internal teams to assess architectural designs, technical credentials, and suitability for existing systems and information architecture.
• Lead development of the Agentic Autonomous Lakehouse capability, automating governed self-service pipeline provisioning and lakehouse health, cost, performance, and best-practice operations.
• Lead Software Engineering communities of practice to promote awareness and use of new and leading-edge technologies.
• Contribute to a team culture of diversity, opportunity, inclusion, and respect.

Benefits

• Competitive total rewards package, including base salary determined by role, experience, skill set, and location.
• Eligible roles may receive commission-based pay and/or discretionary incentive compensation in cash and/or forfeitable equity.
• Comprehensive health care coverage.
• On-site health and wellness centers.
• Retirement savings plan.
• Backup childcare.
• Tuition reimbursement.
• Mental health support.
• Financial coaching.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed