GCP Data Engineer

NucleusTeq • Phoenix, AZ

1d • Onsite

About The Position

We are seeking a skilled GCP Data Engineer with 5-7 years of experience to join our team in Phoenix, AZ. This role involves working with large-scale data processing on Google Cloud Platform (GCP), utilizing tools like GCS, DataProc, BigQuery, and Composer/Airflow. The ideal candidate will have strong experience in Big Data technologies, particularly PySpark and Spark, along with proficiency in Python. A background in BigQuery for processing large data volumes is essential. Experience with NoSQL databases such as Spanner DB & Graph DB is a significant plus.

Requirements

• 5-7 years of experience as a big data engineer.
• Strong experience with Spark, Data Frames.
• Proficiency in PySpark, Spark, and Python.
• Experience with GCP Cloud services: GCS, DataProc, BigQuery, Composer/Airflow.
• Big Query background with data processing for large volumes.
• Experience in SQL.
• Large scale data engineering and business intelligence delivery experience.
• Design of large-scale enterprise level big data platforms.
• Experience working with and performing analysis using large data sets.
• Proven and demonstrated experience working with or on a mature, self-organized agile team.
• Ability to articulate use cases supported and outcomes driven.
• Knowledge of PySpark, Spark, Python, Scala, Hive, Pig, and MapReduce.
• Experience in GCP.

Nice To Haves

• Experience with another NoSQL DB like Spanner DB & Graph DB.

Responsibilities

• Design and implement large-scale enterprise-level big data platforms on GCP.
• Process large volumes of data using BigQuery.
• Develop and optimize data pipelines using PySpark, Spark, and Python.
• Utilize GCP services including GCS, DataProc, and Composer/Airflow.
• Perform analysis using large datasets.
• Work within a mature, self-organized agile team environment.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Associate degree