Data Engineer (Python)

NucleusTeq

116d

About The Position

We are seeking a Data Engineer with a strong background in Python and Spark to join our team in NYC for a duration of 12+ months. The ideal candidate will have extensive experience in big data engineering and will be responsible for designing and implementing large-scale data processing solutions. You will work with large volumes of data and be expected to demonstrate your skills during the interview process.

Requirements

• Strong experience with Spark and Data Frames
• Proficient in Python and SQL
• 6+ years of experience working as a big data engineer
• Knowledge of PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce
• Experience in AWS or GCP
• Experience in SQL
• Large scale data engineering and business intelligence delivery experience
• Design of large-scale enterprise level big data platforms
• Experience working with and performing analysis using large data sets
• Proven experience working with or on a mature, self-organized agile team

Nice To Haves

• Big Query background with data processing for large volumes is a plus

What This Job Offers

• Career Level: Mid Level
• Education Level: Bachelor's degree
• Number of Employees: 11-50 employees