Big Data Lead

HEXAWARE • United States,

2d

About The Position

The Big Data Lead will be responsible for designing and implementing data ingestion and data lakes-based solutions using Big Data Technologies. This role requires high proficiency in Big Data/Open-Source Technologies and standard techniques of Data Integration and Data Manipulation. The Tech Lead will design and develop cost-efficient and performant data pipelines in the cloud platform, create data environments to support data analytics, reporting, and data science teams, and integrate data from multiple sources. Key responsibilities include understanding various Data Pipeline techniques and frameworks, and performance optimization through monitoring and infrastructure adjustments to speed up query execution. Efficient data ingestion involves discovering patterns with data mining techniques and using different data ingestion APIs to inject data into the data lake as needed.

Requirements

• Highly proficient in the use of Big Data / Open-Source Technologies.
• Proficient in standard techniques of Data Integration.
• Proficient in Data Manipulation.
• Knowledge of various Data Pipeline techniques and frameworks.

Responsibilities

• Design & Implement Data ingestion and Data lakes-based solutions using Big Data Technologies.
• Design and develop cost efficient and performant data pipelines in the cloud platform.
• Create data environment to support our data analytics, reporting and data science teams.
• Experience with integration of data from multiple data sources.
• Performance optimization - monitor the complete process and apply necessary infrastructure changes to speed up the query execution.
• Efficient data ingestion - Discovering patterns in data sets with data mining techniques and using different data ingestion APIs and inject data into the data lake as per need.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed