Senior Data Engineer – Enterprise Data Hub (AWS + Snowflake + DBT + PySpark + CI/CD)

Ness Digital Engineering

11d

About The Position

We are looking for an experienced Senior Data Engineer to join the EDH team. This role will serve as a technical resource responsible for designing, developing, supporting, and enhancing modern data pipelines built using AWS, Snowflake, and DBT. The ideal candidate should have strong hands-on experience building enterprise-scale data platforms, working with AWS, Snowflake cloud-based data engineering solutions, and supporting complex data integration and transformation processes. The candidate should be comfortable working independently, collaborating with offshore teams, and providing technical guidance.

Requirements

10+ years of data engineering experience
Strong hands-on experience building enterprise-scale data platforms
Strong hands-on experience working with AWS, Snowflake cloud-based data engineering solutions
Comfortable working independently, collaborating with offshore teams, and providing technical guidance
AWS: Strong hands-on data engineering experience with AWS data services
Snowflake: Strong hands-on experience with Snowflake architecture, development, transformation, and optimization in cloud-based data platforms.
Designing data warehouse solutions using Snowflake.
DBT: Strong hands-on experience with DBT development
PySpark: Experience developing PySpark applications for data ingestion and cleansing.
DevOps-CI/CD: Experience with deployment automation, release management, and environment promotion processes.
Data Modeling: Experience designing dimensional data models (Facts, Dimensions).
SQL: Strong SQL skills including complex queries, performance tuning, and optimization.

Responsibilities

Design, develop, and support enterprise data pipelines using AWS, Snowflake, and DBT.
Develop and enhance metadata-driven data ingestion and transformation frameworks.
Work with AWS services to build scalable data ingestion solutions.
Implement enterprise-scale solutions using Snowflake, including database design, data loading, data transformation, security, performance optimization, and operational support.
Build dimensional models, star schema, snowflake schema, fact and dimension tables, and data structures optimized for analytics and reporting.
Develop DBT models, macros, tests, and deployment configurations.
Troubleshoot and debug data pipeline issues across AWS, Snowflake, dbt, and PySpark, perform root cause analysis, and implement solutions.
Support EDH production deployments, monitoring, and issue resolution.
Collaborate with offshore engineering teams and provide technical guidance and code reviews.
Participate in architecture discussions and recommend improvements to platform design.
Work with DevOps teams on CI/CD processes, Git-based development, deployment automation, and release management.
Implement data quality checks, validation frameworks, logging, and operational monitoring.