Senior Data Engineer - Contract

KAYGEN•Remote with travel to Indianapolis, IN

1d•Remote

About The Position

KAYGEN is seeking a Senior Data Engineer for a contract role lasting through 4/30/27. The position is remote, with 50% travel to Indianapolis, Indiana; travel expenses are permitted. The Senior Data Engineer will design, build, and maintain data pipelines that extract data from source systems, transform it through medallion architecture layers, and prepare it for analytics. The role works closely with a Power BI Developer to ensure data is properly structured, documented, and accessible for reporting and analytics. The engineer will establish an AWS S3 data lake structure for Bronze, Silver, and Gold zones in accordance with EDB standards and Red CCI security controls. They will develop and extend pipelines for SaaS-based HSE systems, EDB Asset-related data products and digital solutions, a Manufacturing Execution System, SaaS tools, and LabVantage LIMS. The work includes transformations, data catalog configuration and classification, enterprise reference data integration, data quality checks, orchestration workflows, and support for Power BI connectivity to the Gold zone.

Requirements

At least 8 years of experience as a Data Engineer.
Python.
SQL.
AWS S3 and data lake architecture.
PySpark and AWS Glue.
Delta Lake and Parquet.
AWS Lambda.
AWS DMS and CDC patterns.
REST API integration.
Git and version control.
Databricks.
Microsoft Fabric.
Data products.

Responsibilities

Design, build, and maintain data pipelines that extract data from source systems, transform data through medallion architecture layers, and prepare data for analytics.
Coordinate with the Power BI Developer to ensure data is structured, documented, and accessible for reporting and analytics.
Design and establish an AWS S3 data lake bucket structure with Bronze, Silver, and Gold zones, following EDB standards and Red CCI security controls.
Build data pipelines to extract data from selected SaaS-based HSE systems.
Enhance and extend data pipelines using datasets from AWS EDB Asset-related data products and digital solutions.
Build a Lambda-based REST API extraction pipeline for the Manufacturing Execution System.
Develop pipelines to integrate SaaS-based tools into the data warehouse.
Implement a CDC pipeline for LabVantage LIMS using AWS DMS from an Oracle database or Azure Data Factory.
Develop Bronze-to-Silver transformations using AWS Glue or Azure Data Factory, depending on data domains.
Configure AWS Glue Data Catalog with appropriate metadata and Red CCI classification tags.
Connect to the EDB marketplace for enterprise reference data.
Implement Silver-to-Gold transformations to create batch-centric data products.
Develop data quality checks and monitoring dashboards.
Develop orchestration workflows using AWS Step Functions.
Support the Power BI Developer in validating OneLake shortcut connectivity to the Gold zone.