Lead Data Engineer [Multiple Positions Available]

JPMorgan Chase & Co.•Jersey City, NJ

6d•Onsite

About The Position

This role involves building and deploying AWS components using industry-leading automation tools. The Lead Data Engineer will analyze, design, develop, and deliver software solutions in cloud and on-premises environments, solving complex problems across multiple services and cross-functional teams. The position requires applying continuous integration and test automation patterns for delivering high-quality artifacts to production. A key aspect of this role is guiding and mentoring junior team members in defining, designing, and developing procedures and solutions that meet business requirements, as well as on development practices and coding guidelines. The Lead Data Engineer will collaborate with product partners to drive prioritization decisions and trade-offs, automate and simplify all aspects of software delivery and development, and undertake technical reviews of code across applications and their dependencies to identify anti-patterns and promote continuous refactoring.

Requirements

Bachelor's degree in Electronic Engineering, Computer Science, Computer Engineering, Computer Information Systems, or related field of study plus 7 years of experience in the job offered or as Lead Data Engineer, Data Engineer, Software Engineer/Developer, Consultant (IT), IT Lead, or related occupation.
Designing scalable serverless cloud-native applications to ingest and transform data using AWS cloud runtime environments including EC2 and Lambda, and big data runtime environments including EMR and Glue.
Architecting and implementing large scale data migration from big data systems including Hadoop and Hive.
Using AWS components including S3, Redshift, and Lambda for scalable data storage and processing.
Leading Agile SDLC projects to design and develop software applications using Python, Java, and Scala, focusing on data processing and analysis.
Deploying and managing applications on AWS cloud infrastructure.
Configuring Jenkins pipelines for continuous integration and deployment.
Implementing comprehensive testing strategies, including automated, functional, performance, and unit testing.
Managing code repositories using GIT.
Working with product partners to drive prioritization decisions and trade-offs.
Building automation to improve software delivery and development.
Performing technical review of code across applications and their dependencies to look for antipatterns and promote continuous refactoring.

Nice To Haves

Master's Degree in Electronic Engineering, Computer Science, Computer Engineering, Computer Information Systems, or related field of study plus 5 years of experience in the job offered or as Lead Data Engineer, Data Engineer, Software Engineer/Developer, Consultant (IT), IT Lead, or related occupation.

Responsibilities

Build and deploy AWS components using industry leading automation tools.
Analyze, design, develop and deliver software solutions in cloud and on premises.
Solve complex problems across multiple services and cross-functional teams.
Apply continuous integration and test automation patterns for delivering high-quality artifacts to production.
Guide junior team members in defining, designing, and developing procedures and solutions that meet the business requirements.
Mentor junior team members on development practices and coding guidelines using the industry leading continuous integration and testing automation practices.
Work with product partners to drive prioritization decisions and trade-offs.
Automate and simplify all aspects of software delivery and development.
Undertake a technical review of code across applications and their dependencies to look for anti-patterns and promote continuous refactoring.