Senior Data Engineer

Qode

5h•Hybrid

About The Position

This position is for a Senior Data Engineer specializing in Informatica and PySpark. The role requires extensive experience in data engineering and analysis, focusing on ETL design, development, and optimization using Informatica PowerCenter/IDQ. Candidates must possess advanced skills in PySpark for large-scale data processing, transformation, and analytics, along with solid knowledge of Hadoop technologies. Proficiency in Python and Kafka for data pipelines is essential. The role also demands a strong understanding of database concepts, data modeling, and the entire ETL lifecycle, including data extraction, ingestion, quality checks, normalization, and loading. Experience with Agile methodology and Jira for project delivery, as well as strong client-facing communication and leadership skills, are required. The position is based in Cleveland, OH or Pittsburgh, PA, with a hybrid work model requiring 3 days onsite.

Requirements

8–10 years in Data Engineering and Data Analysis
Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization
Advanced skills in PySpark for large-scale data processing, transformation, and analytics
Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce)
Proficiency in Python and Kafka for streaming and batch data pipelines
Strong understanding of database concepts, data design, data modeling, and ETL workflows
Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading
Hands-on experience with Agile methodology and Jira for project delivery
Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC
Master’s or Bachelor’s degree in Computer Science or related field
Strong problem-solving skills
Ability to work in cross-functional teams