Senior Big Data Engineer

Agama Solutions • Plano, TX

4d

About The Position

We are seeking a Senior Big Data Engineer with a strong software engineering background. The ideal candidate will have extensive experience working with large datasets, ETL processes, and applications involved in high-volume data collection. Proficiency in Java or Python is essential, along with experience in large-scale data processing frameworks like Spark. Cloud experience, particularly with AWS services such as S3, EMR, and Glue, is required. Familiarity with RDBMS and SQL is also necessary.

Requirements

• Very strong Java or Python coding skills.
• True software engineering skill set.
• Experience working with large data sets.
• Experience with ETL processes.
• Experience with applications that do high-volume data collection.
• Experience with Spark or other large scale data processing tools.
• AWS experience, including S3, EMR, and/or Glue.
• RDBMS experience.
• SQL proficiency.

Nice To Haves

• AWS Certification (expected for a 603 level candidate).

Responsibilities

• Develop and maintain robust ETL pipelines for large datasets.
• Design and implement applications for high-volume data collection.
• Utilize Spark or similar frameworks for large-scale data processing.
• Leverage AWS services including S3, EMR, and Glue for data engineering tasks.
• Write efficient and maintainable code in Java or Python.
• Work with RDBMS and SQL for data management and querying.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed