Hadoop Data Engineer
About The Position
The Hadoop Data Engineer will design, build, maintain, and optimize scalable data-processing solutions using Java 8 or above, Spring Boot, Spark, and Scala. The role supports batch and real-time data pipelines and uses distributed systems and Hadoop ecosystem components to process large-scale data. The engineer will collaborate with cross-functional teams to translate business requirements into technical solutions and will troubleshoot performance, scalability, and data-reliability issues. The position is listed in Dallas, Texas, for a duration of 6+ months. It requires 8–12 years of hands-on Java experience, with the role overview also stating 10+ years of experience.
Requirements
- 8–12 years of hands-on experience in Java version 8 or above; the position overview also specifies 10+ years.
- Strong expertise in Spring Boot 2.
- Excellent proficiency in Spark.
- Strong experience with Hive, SQL optimization, Hadoop MapReduce, and Kafka Messaging Bus.
- Solid understanding of REST web services.
- Experience with version control systems such as GitLab.
- Hands-on experience with Maven and/or Gradle.
- Strong understanding of distributed systems and big-data architecture.
- Experience with streaming frameworks such as Spark Streaming and Kafka Messaging Bus.
- Experience working in large-scale JD Edwards EnterpriseOne.
Nice To Haves
- Knowledge of CI/CD and DevOps.
- Exposure to performance tuning and SAP PMO capacity planning for big-data systems.
Responsibilities
- Design, develop, and maintain scalable data-processing applications using Java 8 or above and Spring Boot.
- Build and optimize large-scale big-data pipelines using Spark and Scala.
- Develop and consume RESTful web services for data integration and platform interoperability.
- Implement and manage batch and streaming data pipelines using Spark Streaming and Kafka.
- Write optimized Hive queries and SQL with a focus on performance and scalability.
- Work with distributed data platforms that use Hadoop ecosystem components.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Ensure code quality through code reviews, version control, and CI/CD practices.
- Troubleshoot and resolve performance, scalability, and data-reliability issues.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
