Senior Big Data / Hadoop Developer

Genesis10•Pennington, NJ

1d•Onsite

About The Position

Genesis10 is currently seeking a Senior Big Data / Hadoop Developer for a contract position with a Global Financial Institution located in Pennington, NJ. This is a 12+ month contract opportunity. We are looking for a highly skilled Hadoop Developer to join a data engineering team. You will be responsible for building, optimizing, and maintaining scalable data pipelines within the Hadoop ecosystem. The ideal candidate will have extensive experience in ETL processing, data warehousing concepts, and optimizing large-scale distributed data architectures.

Requirements

Strong hands-on experience with Hive, Spark, HDFS, and Oozie or Airflow
Deep experience in designing end-to-end ETL processes using Python, Scala, or Java, and SQL
Proficiency in processing large datasets (Petabyte scale) and understanding partition strategies, file formats (Parquet, Avro, ORC), and compression techniques
Expert-level knowledge of complex SQL queries, window functions, and performance tuning

Nice To Haves

Experience with Starburst (Trino) for high-performance distributed SQL queries and federated query engines is a significant plus
Familiarity with migrating or running Hadoop workloads on cloud platforms (AWS EMR, Databricks, or Google Dataproc)
Knowledge of tools like Ranger, Atlas, or similar metadata management tools

Responsibilities

Design, develop, and maintain robust data processing jobs using Hadoop (HDFS, MapReduce, Hive, Spark)
Architect and implement complex ETL/ELT pipelines to ingest, transform, and load large-scale structured and unstructured data
Fine-tune performance for distributed queries and data processing tasks to ensure high efficiency in a multi-tenant environment
Translate business requirements into logical and physical data models suitable for big data analytics
Implement data validation and reconciliation processes to ensure high data integrity and reliability
Troubleshoot production data issues, resolve pipeline bottlenecks, and manage system upgrades within the Hadoop stack
Mentor junior developers and enforce coding standards and best practices for big data development

Benefits

Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF, and Illinois)