About The Position

Assess and improve an existing data platform by refactoring pipelines, optimizing performance, and improving code quality, or design a new end-to-end data solution from the ground up when appropriate. Design, build, and maintain scalable data pipelines that support downstream application and analytics use cases. Implement and manage data ingestion, transformation, and storage patterns using Databricks and Snowflake. Partner with architects and stakeholders to define data models and schemas that enable reliable application development. Ensure data quality, reliability, observability, and governance across the data lifecycle. Optimize workloads for cost, performance, and scalability in a cloud-native Azure environment. Contribute to and enforce engineering standards, including documentation, testing, version control, and CI/CD practices. Support downstream consumers, including application developers, analytics teams, and data science teams, by delivering trusted, well-structured data assets.

Requirements

  • Strong experience as a Data Engineer building and maintaining production-grade data platforms.
  • Proficiency with Databricks, including Spark, Delta Lake, and notebooks.
  • Proficiency with Airflow.
  • Proficiency with Snowflake.
  • Experience building data solutions in Microsoft Azure.
  • Proficiency in SQL.
  • Proficiency with Python.
  • Solid understanding of data modeling, ETL/ELT patterns, and distributed data processing.
  • Experience improving existing codebases through refactoring, standardization, and optimization.
  • Strong collaboration and communication skills, with the ability to partner with architects and developers across teams.
  • Experience using AI-assisted automation tools to improve efficiency and productivity.

Nice To Haves

  • Familiarity with data governance, metadata management, or data quality frameworks.
  • Experience supporting application-centric data use cases, not just analytics.
  • Exposure to DevOps or DataOps practices, including CI/CD, infrastructure as code, and monitoring.
  • Experience working in large, regulated, or enterprise-scale environments.
  • Experience working with data that contains PHI.

Responsibilities

  • Assess and improve existing data platforms through pipeline refactoring, performance optimization, and code-quality improvements, or design new end-to-end data solutions when appropriate.
  • Design, build, and maintain scalable data pipelines for downstream application and analytics use cases.
  • Implement and manage data ingestion, transformation, and storage patterns using Databricks and Snowflake.
  • Partner with architects and stakeholders to define data models and schemas for reliable application development.
  • Ensure data quality, reliability, observability, and governance across the data lifecycle.
  • Optimize workloads for cost, performance, and scalability in Azure.
  • Contribute to and enforce engineering standards for documentation, testing, version control, and CI/CD.
  • Deliver trusted, well-structured data assets and support application developers, analytics teams, and data science teams.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service