About The Position

The Senior Data Engineer - Databricks & Data Modeling develops, deploys, and maintains production data pipelines and reusable data models within Winsupply’s Databricks lakehouse on Google Cloud. This hands-on role combines Databricks engineering with relational and dimensional modeling to turn complex source data into trusted Silver- and Gold-layer data products. Working on the Data Architecture & Engineering team, the engineer implements approved architectural standards and collaborates with business stakeholders, Data Governance, and IT. The role owns reliable and efficient delivery from source ingestion through production support, including data quality, performance, documentation, troubleshooting, and ongoing operations.

Requirements

  • 7+ years of related professional experience in data engineering, data warehousing, analytics engineering, or comparable roles.
  • 3+ years of hands-on Databricks production experience with Delta Lake, Unity Catalog, Spark/PySpark, and Databricks SQL.
  • 3+ years of meaningful relational or dimensional data modeling experience, including personally designing and deploying fact/dimension or integrated business models.
  • Foundational understanding of core business processes and entities, such as Customer, Product, Vendor, Purchasing, Inventory, Sales, and Pricing, and ability to validate relationships with stakeholders and apply that context to modeling and governance decisions.
  • Experience building production ETL/ELT pipelines, implementing incremental processing, and supporting operational data quality and monitoring.
  • Strong SQL and Python/PySpark skills.
  • Hands-on experience with Git, testing, code review, and CI/CD practices.
  • Associate degree in Computer Science, Information Systems, or a related field; equivalent professional experience or relevant technical certifications may be considered.

Nice To Haves

  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related discipline.
  • Databricks Certified Data Engineer Professional certification or comparable Databricks certification.
  • Experience with Databricks on Google Cloud, Lakeflow pipelines/jobs, Auto Loader, CDC, and Declarative Automation Bundles.
  • Kimball dimensional modeling, enterprise data governance, semantic modeling for Looker, or advanced Spark performance optimization experience.
  • Experience integrating IBM/mainframe, DB2, distribution/supply-chain, financial, or pricing data.

Responsibilities

  • Build, test, deploy, and support production ingestion and transformation pipelines using Databricks, Delta Lake, Unity Catalog, Apache Spark, Python/PySpark, and Databricks SQL.
  • Design and implement relational and dimensional data models for assigned data products, including fact tables, conformed dimensions, star schemas, and slowly changing dimensions (SCD Type 1/2).
  • Translate business processes and relationships among Customer, Product, Vendor, Purchasing, Inventory, Sales, and Pricing entities into Silver-layer structures and reusable Gold-layer data products; consult Data Architecture leadership on complex model decisions.
  • Ingest and integrate batch and streaming data from ERP, relational, legacy/mainframe, fixed-width or delimited files, APIs, and cloud storage; handle schema changes, incremental loads, and CDC as appropriate.
  • Implement business keys, table grain, joins, deduplication, history handling, and source-to-target mappings to produce repeatable, traceable results.
  • Create and automate data quality checks, reconciliation, pipeline monitoring, alerting, exception handling, and recovery procedures for production operations.
  • Tune Spark workloads, Databricks SQL queries, Delta table layouts, job configuration, and compute usage to improve performance, reliability, and cost efficiency.
  • Develop reusable, maintainable code using Git, peer reviews, unit and integration tests, CI/CD, and repeatable Databricks deployment practices.
  • Partner with business process owners and Data Governance to understand workflows, validate entity definitions and business rules, and inform data modeling, quality, lineage, and access decisions.
  • Document pipelines, models, transformation logic, dependencies, and runbooks for team maintenance and support.
  • Troubleshoot data defects and pipeline failures, identify root causes, and drive production fixes with appropriate communication and ownership.
  • Collaborate with the architecture team, DaaS, IT, and delivery partners; contribute practical recommendations and mentor peers while supporting approved technical direction.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service