Senior Data Engineer

Qode • Ohio, OH

11h

About The Position

We are seeking a highly skilled Senior Data Engineer with 8-10 years of experience in Data Engineering and Data Analysis. The ideal candidate will have strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization, as well as advanced skills in PySpark for large-scale data processing, transformation, and analytics. A solid understanding of the Hadoop ecosystem (HDFS, Hive, Sqoop, MapReduce), proficiency in Python and Kafka for streaming and batch data pipelines, and a strong grasp of database concepts, data design, data modeling, and ETL workflows are essential. The role requires experience in analyzing, designing, and coding ETL programs, including data extraction, ingestion, quality checks, normalization, and loading. Additionally, hands-on experience with Agile methodology and Jira for project delivery, along with proven client-facing abilities and strong communication and leadership skills to coordinate across the SDLC, are expected.

Requirements

• 8-10 years of experience in Data Engineering and Data Analysis.
• Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization.
• Advanced skills in PySpark for large-scale data processing, transformation, and analytics.
• Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce).
• Proficiency in Python and Kafka for streaming and batch data pipelines.
• Strong understanding of database concepts, data design, data modeling, and ETL workflows.
• Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading.
• Hands-on experience with Agile methodology and Jira for project delivery.
• Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC.
• Master’s or Bachelor’s degree in Computer Science or related field.
• Strong problem-solving skills.
• Ability to work in cross-functional teams.

Nice To Haves

• Exposure to AWS data components and analytics.
• Familiarity with machine learning models and AI concepts.
• Experience with data modeling tools such as Erwin.

Responsibilities

• Design, develop, and optimize ETL processes using Informatica PowerCenter/IDQ.
• Develop and implement large-scale data processing, transformation, and analytics solutions using PySpark.
• Utilize Hadoop technologies (HDFS, Hive, Sqoop, MapReduce) for data management.
• Build streaming and batch data pipelines using Python and Kafka.
• Analyze, design, and code ETL programs, including data extraction, ingestion, quality checks, normalization, and loading.
• Work within an Agile methodology and utilize Jira for project delivery.
• Interact with clients, communicate effectively, and demonstrate leadership skills to coordinate across the SDLC.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior