Data Engineer [Multiple Positions Available]

JPMorgan Chase & Co.•Plano, TX

6d•Onsite

About The Position

JPMorgan Chase is seeking Data Engineers to join their team. This role involves identifying, analyzing, and interpreting trends in complex datasets, extracting, transforming, and loading data, and enforcing data quality guidelines. The position will also focus on migrating infrastructure, data, and applications from legacy data centers to cloud and hybrid environments. Key responsibilities include designing and implementing data pipelines, developing and maintaining data processing and transformation scripts, and building and maintaining data warehouses and data lakes. The role requires delivering work products on time and on budget while adhering to quality assurance best practices.

Requirements

Master's degree in Management Information Systems, Computer Science, Data Analytics, Business Analytics, or related field of study
3 years (36 months) of experience in the job offered or as Data Engineer, Systems Engineer, Software Engineer, Data Analyst, or related occupation
Conducting data engineering, automation, orchestration, and full-stack integration across on-premise and cloud environments
Designing, developing, and maintaining scalable ETL and data-pipeline frameworks using AWS including Glue, EMR, Lambda, S3, Redshift, and CloudFormation and Databricks for large-scale analytical and streaming workloads
Leveraging Apache Spark, Kafka, Hadoop, Hive, and Airflow for batch and real-time data ingestion, transformation, and scheduling
Using Python, SQL, Java, PL/SQL, and Unix shell scripting to build reusable frameworks for data validation, testing, automation, and performance tuning
Infrastructure provisioning and configuration management using Ansible
Continuous integration/deployment through Jenkins, Spinnaker, Jules, and Terraform (TFE)
Implementing data masking, lineage, and entitlement governance via Immuta
Orchestrating workloads with Kubernetes
Integrating datasets through RESTful APIs to downstream systems and applications
Supporting the development of automation dashboards, monitoring utilities, and data-driven microservices using ReactJS, Redux, Node.js, and JavaScript frameworks
Ensuring data reliability and SLA compliance through production job monitoring, incident resolution, and ticket management using ServiceNow and JIRA
Preparing curated datasets for reporting and visualization
Optimizing data models across Redshift, Oracle, PostgreSQL, MySQL, and Cassandra
Operating under Agile SDLC methodology, ensuring automation, scalability, governance, and continuous improvement of data engineering processes and infrastructure

Responsibilities

Identify, analyze, and interpret trends/patterns in complex data sets acquired from various data sources
Extract, transform, and load data
Enforce guidelines to ensure consistency, quality, and completeness of data assets
Work on the migration of infrastructure, data, and applications out of legacy data centers into cloud and hybrid environments
Design and implement data pipelines
Develop and maintain data processing and transformation scripts
Build and maintain data warehouses and data lakes
Deliver work products on time and on budget while applying quality assurances best practices