Data Engineer - Hadoop Big data Stack

Capgemini Holding IncAtlanta, GA
31d$85,000 - $96,900

About The Position

We are seeking a highly skilled and motivated Data Engineer with strong hands-on experience in the Hadoop Big Data ecosystem. The ideal candidate will have deep expertise in big data technologies and frameworks, and a passion for building scalable data solutions that drive business insights.

Requirements

  • Strong hands-on experience as a Hadoop Developer or Big Data Engineer.
  • Advanced knowledge of the Hadoop ecosystem and its components.
  • In-depth expertise in Scala, Spark, and similar frameworks.
  • Proficient in HBase, SOLR, Hive, Gremlin, and Pig.
  • Experience with data modeling, performance tuning, and distributed computing.

Nice To Haves

  • Experience with Spark Streaming, Flume, or Apache NiFi.
  • Exposure to Azure Data Engineering stack, including:
  • Azure Synapse Analytics
  • Azure Data Factory (ADF)
  • Azure Databricks

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Hadoop and related technologies.
  • Work with large-scale datasets using tools such as Spark, Scala, Hive, Pig, and HBase.
  • Implement and optimize data workflows and ETL processes.
  • Collaborate with data scientists, analysts, and other engineering teams to support data needs.
  • Ensure data quality, integrity, and governance across platforms.
  • Troubleshoot and resolve issues related to data processing and performance.

Benefits

  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Industry

Professional, Scientific, and Technical Services

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service