Senior GCP Data Engineer

ALIQAN Technologies
Hybrid

About The Position

We are seeking a Senior GCP Data Engineer to design and build scalable, cloud-native data platforms. This role involves developing robust data pipelines and enabling advanced analytics and AI use cases for enterprise clients.

Requirements

  • Strong hands-on experience with Google Cloud Platform (GCP)
  • Expertise in: BigQuery, Cloud SQL, Pub/Sub and Vertex AI
  • Proficiency in Python and PySpark
  • Experience building pipelines using Dataflow and Dataproc
  • Strong knowledge of Apache Airflow for workflow orchestration
  • Experience in designing production-grade data architectures

Responsibilities

  • Design, develop, and maintain data pipelines on GCP
  • Build scalable data solutions using BigQuery, Cloud SQL, and Pub/Sub
  • Develop and optimise data processing workflows using Python and PySpark
  • Implement orchestration using Apache Airflow
  • Work with both batch and real-time data processing (Dataflow, Dataproc)
  • Enable data platforms for analytics and AI workloads via Vertex AI
  • Collaborate with data scientists, architects, and business teams
  • Ensure data quality, reliability, scalability, and performance
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service