Data Engineer - Apache Spark / Databricks

Genesis10•Jersey City, NJ

9d•Onsite

About The Position

Genesis10 is seeking a Data Engineer for a contract position with a Global Financial Institution in Jersey City, NJ. This role is heavily focused on building and expanding the organization's Apache Spark ecosystem as they migrate a large-scale data platform from Vertica to Databricks. The team processes enormous volumes of data and is modernizing its ingestion and analytics architecture within AWS. The ideal candidate will have strong large-scale Data Engineering experience and deep expertise with Apache Spark and Databricks.

Requirements

Strong Apache Spark expertise (most important skill)
Databricks experience
Large-scale Data Engineering background
Python and/or Java development experience
Strong Object-Oriented Programming fundamentals
SQL expertise
Experience building enterprise data pipelines
AWS environment experience

Nice To Haves

Apache Iceberg
Parquet
Kafka
Vertica migration experience
Financial services or highly regulated environments
Experience supporting large-scale data modernization initiatives

Responsibilities

Design, build, and optimize large-scale data pipelines
Lead and support the migration of approximately 100TB of data from Vertica to Databricks
Expand Apache Spark capabilities across multiple enterprise systems
Improve data ingestion, transformation, and processing frameworks
Partner with development teams to enhance data flow and pipeline performance
Implement scalable solutions leveraging Databricks, Spark, Kafka, and AWS technologies
Build modern data architectures that improve performance, maintainability, and scalability
Support the evolution of Kafka-based data processing by leveraging Spark for advanced transformation and analytics workloads

Benefits

Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF, and Illinois)