Lead Software Engineer - Big Data(Data Engineer), Python, and AWS

JPMorganChase • Plano, TX

2d

About The Position

As a Lead Software Engineer at JPMorganChase within the CIB, you will be an integral part of an agile team enhancing, building, and delivering trusted market-leading technology data products in a secure, stable, and scalable way. As a core technical contributor, you will maintain critical data pipelines and architectures across multiple technical areas and business functions in support of the firm’s business objectives. The role focuses on building and operating data platforms and products, developing secure production code, and applying enterprise-authorized AI capabilities responsibly in data engineering workflows.

Requirements

• Formal training or certification in data engineering concepts and at least 5 years of applied experience.
• Proficiency processing and analyzing large datasets using Big Data technologies, including Apache Spark, across platforms such as Redshift, SQL databases, RDS, and Databricks.
• Experience designing, developing, and implementing scalable data pipelines and data-matching solutions on AWS using Python.
• Strong experience setting up and configuring AWS services such as S3, Step Functions, EMR, Glue, Lambda, RDS, EventBridge, and API Gateway for scripting, automation, and data workflow orchestration.
• Strong hands-on experience with Databricks and distributed data processing technologies.
• Understanding of data architecture, data modeling, data integration, and data product principles.
• Experience designing and operating large-scale data platforms and data products in complex enterprise environments.
• Experience developing a semantic layer for data consumption using Iceberg tables and APIs.
• Experience implementing continuous deployment and integration processes using infrastructure-as-code tools, including Terraform.
• Demonstrated experience using enterprise-authorized AI capabilities for data engineering workflows, with strong validation habits and awareness of data sensitivity.
• Working experience with relational and NoSQL databases.
• Advanced proficiency in one or more programming languages.
• Advanced understanding of agile methodologies, including CI/CD, application resiliency, and security.

Nice To Haves

• Experience working with modern enterprise data platforms and cloud-native data architectures.
• Experience supporting real-time, analytical, or AI/ML-oriented data use cases.
• Databricks, Snowflake, AWS cloud, or data engineering certifications.

Responsibilities

• Execute creative software solutions, including design, development, and technical troubleshooting, using approaches beyond routine solutions to address technical problems.
• Deliver secure, stable, and scalable data collection, storage, access, and analytics platform solutions.
• Use enterprise-authorized AI capabilities to support data product and model design, analysis, and documentation; validate outputs and handle data according to sensitivity and security requirements.
• Evaluate and report on access control processes to determine the effectiveness of data asset security.
• Apply reuse-first, AI-assisted practices to delivery and operational routines, including backup and recovery validation and access control review support, while ensuring traceability, auditability, resiliency, and security alignment.
• Develop secure, high-quality production code and review and debug code written by others.
• Identify opportunities to eliminate or automate recurring issue remediation to improve application and system operational stability.
• Troubleshoot and resolve issues related to application code and data workflows.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed