Senior Data Platform Engineer

Eitacies IncAustin, TX
Onsite

About The Position

We are hiring a Senior Data Platform Engineer for an onsite role in Austin, TX. This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.

Requirements

  • 9+ years of data engineering experience
  • Strong Python programming skills
  • Production experience with Apache Spark PySpark
  • Experience with Airflow DAG development
  • Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
  • Experience building APIs using FastAPI
  • Strong SQL and data modeling knowledge
  • Experience implementing data quality checks (schema validation, row count checks, anomaly detection)

Responsibilities

  • Design and maintain Airflow DAGs for production data workflows
  • Develop and optimize Spark / PySpark jobs on Dataproc
  • Build and optimize complex SQL transformations
  • Develop REST APIs using FastAPI Python to support data services
  • Implement robust data quality and validation frameworks
  • Monitor pipeline performance, retries, and SLA compliance

Benefits

  • 401(k)
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service