Sr. Data Engineer

DataSpring
•$140,000 - $155,000•Remote

About The Position

The Sr. Data Engineer builds and owns the production pipelines and data models behind DataSpring’s provider data platform and ProView suite. The role focuses on writing production code in Azure Databricks and Azure SQL to ingest provider data from internal and third-party sources, model it with history and lineage, and establish rules for resolving conflicts among sources. The position also owns data modeling standards and the automation that enforces them, and reviews data model work from internal engineers and vendor delivery teams. This is a full-time, remote, exempt position reporting to the Senior Director, Data Engineering & Architecture. The role provides technical direction to internal engineers and vendor delivery teams but has no direct reports. It partners with Data Science, product, billing, and application teams to translate business requirements into data models and data contracts, while protecting PHI and supporting HIPAA, HITRUST, and SOC 2 compliance.

Requirements

  • Expert SQL and strong PySpark and Python skills, with a track record of building and operating production pipelines.
  • Deep relational and dimensional modeling skills, including history (SCD), entity resolution, and judgment about when each approach is appropriate.
  • Hands-on Azure Databricks experience, including Delta Lake, Unity Catalog, medallion architecture, job orchestration, and performance tuning.
  • Experience with Git-based workflows and CI/CD in Azure DevOps or an equivalent platform, including database deployment automation with gated promotion across environments.
  • Experience with data quality testing and pipeline observability.
  • Ability to explain design decisions to engineers, product owners, and leadership, and to maintain a technical position with vendor teams while sustaining productive relationships.
  • At least 8 years of data engineering experience, including at least 4 years designing data models that reached production at scale.
  • Recent, hands-on production engineering experience; the role requires writing and shipping code, not only reviewing it.
  • Demonstrated experience building master data management, entity resolution, or survivorship logic across multiple data sources.
  • Experience defining data modeling standards and automating their enforcement.
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.

Nice To Haves

  • Healthcare data experience, especially provider data, credentialing, or member eligibility data.
  • Experience reviewing or directing the work of vendor or offshore delivery teams.
  • Experience with data quality platforms such as Ataccama and data modeling tools such as ER/Studio.
  • Experience using AI-assisted development tools to build engineering automation.

Responsibilities

  • Design, build, and operate production pipelines on Azure Databricks and Azure SQL to ingest, integrate, and publish provider data from internal and third-party sources.
  • Design integration and master-data models, including history (SCD Type 2), source lineage, and field-level survivorship rules.
  • Write production-grade SQL, PySpark, Python, and DDL, and tune performance and cost on large datasets.
  • Build data quality checks, reconciliation, monitoring, and alerting to identify problems before they affect customers.
  • Own data modeling and naming standards for SQL Server, Azure SQL, and Databricks, including Delta Lake and Unity Catalog.
  • Build automated modeling-standard checks in Azure DevOps CI/CD pipelines.
  • Review data models, schema changes, and pull requests from internal engineers and vendor teams, and record modeling decisions for traceability.
  • Maintain source-to-target mappings, data dictionaries, and ERDs, generating them from systems wherever possible to keep them current.
  • Partner with Data Science, product, billing, and application teams to turn business requirements into data models and clear data contracts.
  • Protect PHI, including classifying sensitive columns, and maintain compliance with HIPAA, HITRUST, and SOC 2 audit requirements.
  • Set technical direction for internal engineers and vendor delivery teams without direct reports.

Benefits

  • Medical coverage
  • Dental coverage
  • Vision coverage
  • 401(k) with company contributions and matching
  • Paid parental leave
  • Tuition assistance
  • Generous paid time off
  • Competitive compensation
  • Comprehensive benefits package for full-time employees
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service