Lead Data Engineer

Blend360

1d•Hybrid

About The Position

The Data Products Team builds and certifies the data products that power outage management and reliability reporting. The team owns the full data lifecycle, from raw source feeds to validated, stakeholder-ready outputs. We’re looking for a hands-on Data Engineer to build and maintain ETL pipelines, implement data quality validations, and support the delivery of certified, versioned data products. You will work closely with the team and operational stakeholders to ensure data accuracy, reliability, and readiness for downstream reporting and business use.

Requirements

Strong proficiency in SQL , including window functions (LAG, PARTITION BY), grouping sets, null handling, and Athena-specific query patterns.
Experience with Python for scripting, automation, and data validation.
Hands-on experience with AWS data services, particularly Glue, Athena, S3, EMR, and Step Functions .
Experience using Spark for large-scale data processing, preferably on EMR.
Strong understanding of data quality and the ability to investigate anomalies, identify root causes, and determine when data does not look correct.
Experience validating data pipelines and ensuring data accuracy and consistency before downstream consumption.
Strong written communication skills, with the ability to document technical methodologies and coordinate effectively with teammates and stakeholders.

Nice To Haves

Experience working with telecommunications or network operations data , including modem telemetry, outage records, or IPDR-style data feeds.

Responsibilities

Build and maintain scalable ETL pipelines using AWS Glue, Spark, and Athena to process modem telemetry, outage events, and customer impact data.
Develop and manage daily data quality checks, including SQL validations, threshold-based alerts, and row-count monitoring.
Investigate data anomalies such as nulls, duplicates, missing intervals, and unexpected data distributions, resolving issues before they affect downstream systems.
Integrate data from multiple upstream systems, including AOM, IPDR, Scope, CARS, IRIS, and Gisual , to produce unified, validated datasets.
Support data product certification by validating outputs and ensuring they meet established quality standards before stakeholder delivery.
Coordinate versioned data product releases, including test case development, release notes, go/no-go decisions with end users, and patches through a structured release process.
Document data validation methodologies, pipeline behavior, and release processes.
Collaborate with data engineering teammates and BI and operational stakeholders throughout the data delivery lifecycle.

Benefits

Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.
Access to AI learning paths to stay up to date with the latest technologies.
Study plans, courses, and additional certifications tailored to your role.
Access to Udemy Business, offering thousands of courses to boost your technical and soft skills.
English lessons to support your professional communication.
Travel opportunities to attend industry conferences and meet clients.
Career development plans and mentorship programs to help shape your path.
Special day rewards to celebrate birthdays, work anniversays, and other personal milestones.
Company-provided equipment.
Flexible working options to help you strike the right balance.