Senior Data Engineer

Qode

5d

About The Position

We are seeking a Senior Data Engineer with expertise in Informatica and PySpark to join our team. This role involves designing, developing, and optimizing data pipelines, ensuring data quality, and collaborating with clients and cross-functional teams. The ideal candidate will have a strong background in data engineering, data analysis, and the Hadoop ecosystem, with a proven ability to deliver solutions using Agile methodologies.

Requirements

• 8–10 years in Data Engineering and Data Analysis.
• Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization.
• Advanced skills in PySpark for large-scale data processing, transformation, and analytics.
• Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce).
• Proficiency in Python and Kafka for streaming and batch data pipelines.
• Strong understanding of database concepts, data design, data modeling, and ETL workflows.
• Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading.
• Hands-on experience with Agile methodology and Jira for project delivery.
• Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC.
• Master’s or Bachelor’s degree in Computer Science or related field.
• Strong problem-solving skills and ability to work in cross-functional teams.

Nice To Haves

• Exposure to AWS data components and analytics.
• Familiarity with machine learning models and AI concepts.
• Experience with data modeling tools such as Erwin.

Responsibilities

• Design, develop, and optimize ETL processes using Informatica PowerCenter/IDQ.
• Develop and implement large-scale data processing and transformation solutions using PySpark.
• Work with Hadoop technologies including HDFS, Hive, Sqoop, and MapReduce.
• Build and maintain streaming and batch data pipelines using Python and Kafka.
• Analyze, design, and code ETL programs, including data extraction, ingestion, quality checks, normalization, and loading.
• Collaborate with clients in client-facing roles, demonstrating strong communication and leadership skills.
• Coordinate across the Software Development Life Cycle (SDLC).
• Deliver projects using Agile methodology and Jira.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior