Senior Data Engineer (W2 Only / No C2C Available)

TEKsystems•New York, NY

7d•$90 - $90•Hybrid

About The Position

The Cloud Engineer will be responsible for the overall design, migration, and support of DNA ARC applications cloud infrastructure within AWS. This individual will ensure solutions are efficient, scalable, reliable, secure, and aligned with cloud best practices. The role requires leveraging deep AWS expertise to help move strategic applications into a modern, cloud-supported model. (Databricks / EMR / Glue) Focus: cloud data engineering, Spark workloads, Databricks expansion, data pipeline modernization

Requirements

Strong experience in data engineering on AWS, with hands-on knowledge of Databricks on AWS, EMR, and Glue
Solid development skills in Spark / PySpark / Spark SQL / Python, with experience building and optimizing large-scale batch data pipelines
Good understanding of Spark performance tuning, including partitioning, shuffle optimization, memory tuning, caching, and skew handling
Familiarity with Databricks clusters, jobs, notebooks, workflows, and deployment practices in production environments
Experience working with data lake architectures on S3, including data organization, file formats, partitioning, and lifecycle considerations
Knowledge of Delta Lake / transactional data processing concepts and modern cloud-native data engineering patterns

Responsibilities

Designing and supporting ETL/ELT workflows for high-volume data movement and transformation
Integrating and orchestrating workloads across Glue, EMR, Databricks, and S3 depending on use case and cost/performance trade-offs
Performing data quality checks, schema evolution, reconciliation, and operational support for critical reporting pipelines
Understanding job scheduling, monitoring, recovery, and production support for business-critical Spark workloads