Sr. Data Engineer

Tavant Technologies•Santa Monica, CA

About The Position

The Sr. Data Engineer contributes to the Company’s success by building and maintaining ETL/ELT pipelines for acquisition reporting and supporting the migration of Snowflake SQL scripts and transformations to Databricks Unity Catalog. The role also contributes to ingestion processes for marketing vendor data, including parsing, normalization, and basic quality validation. The engineer implements foundational data quality checks, monitoring alerts, and issue-triage workflows; assists with SLA monitoring and incident troubleshooting; and supports performance tuning, logging improvements, and pipeline reliability. The role collaborates with analytics and marketing partners to ensure datasets used in dashboards and reporting are accurate, and participates in code reviews, documentation, and shared engineering frameworks and tools.

Requirements

  • At least 4 years of experience as a Data Engineer or in a similar role.
  • Strong proficiency in SQL, including analytical SQL, complex joins, and window functions.
  • Hands-on production experience with PySpark and/or Spark SQL.
  • Good understanding of data modeling, ETL/ELT design patterns, and distributed data processing.
  • Experience building pipelines in Databricks, including Delta Lake, Unity Catalog, data governance, and Lakehouse patterns.
  • Experience with AWS services such as S3, IAM, EC2, Glue, Lambda, or related services.
  • Experience with Airflow or similar orchestration tools.
  • Experience building robust ingestion pipelines and working with semi-structured formats such as JSON, Parquet, and CSV.
  • Experience with Git/GitHub, CI/CD, and modern DevOps practices.
  • Excellent communication skills and ability to work with cross-functional partners.

Responsibilities

  • Assist in building and maintaining acquisition-reporting ETL/ELT pipelines using Databricks, PySpark, SQL, and Unity Catalog, under the guidance of senior engineers.
  • Support migration of Snowflake SQL scripts and transformations to Databricks Unity Catalog by updating queries, validating outputs, and helping implement governance best practices.
  • Contribute to ingestion processes for marketing vendor data, including parsing, normalization, and basic quality validations.
  • Implement and maintain foundational data quality checks, monitoring alerts, and issue-triage workflows using Databricks, Snowflake, Airflow, and internal tooling.
  • Partner with the Data Reliability Engineering team to assist with SLA monitoring, simple incident troubleshooting, and logging improvements.
  • Collaborate with analytics and marketing partners to understand data requirements and ensure dataset accuracy for dashboards and reporting.
  • Support performance tuning, logging improvements, and general pipeline reliability work.
  • Participate in engineering best practices, including code reviews, documentation, and contributions to shared frameworks and tools.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service