Senior Data Engineer

aKubeCalabasas, CA
3dOnsite

About The Position

Design and build scalable batch and real -time data pipelines. Develop data ingestion, processing, and analytical workflows. Build data products and intelligent APIs. Ensure data quality, reliability, and performance. Collaborate with cross -functional teams to translate business needs into data solutions. Support cloud -based data architecture for BI and AI/ML use cases. Participate in code reviews and CI/CD practices.

Requirements

  • Databricks
  • Python
  • Azure
  • API development
  • ETL pipelines
  • DevOps and CI/CD
  • Bachelor’s degree in a related technical field required.
  • 8+ years of data engineering experience.
  • Strong experience with Databricks, Spark, and cloud platforms.
  • Proficiency in Python and SQL.
  • Hands -on experience with Azure data services.
  • Experience with REST APIs and DevOps practices.
  • Agile development experience.

Responsibilities

  • Design and build scalable batch and real -time data pipelines.
  • Develop data ingestion, processing, and analytical workflows.
  • Build data products and intelligent APIs.
  • Ensure data quality, reliability, and performance.
  • Collaborate with cross -functional teams to translate business needs into data solutions.
  • Support cloud -based data architecture for BI and AI/ML use cases.
  • Participate in code reviews and CI/CD practices.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service