Senior Data Engineer

Thumbtack•San Francisco, CA

About The Position

Thumbtack's Data Engineering organization is divided into three groups: Core Data Engineering, Data Platform, and Embedded Data Engineering. This role is within the Embedded Data Engineering team, which is integrated into various business units. This specific position will focus on the commercial operations side of the business, collaborating with engineers, analysts, data scientists, and machine learning engineers. The primary goal is to design and curate data sets from both internal and third-party sources to meet current and future needs. Over the next year, this role will contribute to building a more cohesive data warehouse and will also work upstream to embed data best practices into the full software development lifecycle (SDLC). The challenge involves addressing the complexities of managing Terabytes of data across multiple teams at Thumbtack, each with unique data cleaning and organization requirements. The Senior Data Engineer will work with various stakeholders to understand their needs and build datasets to overcome these challenges.

Requirements

4+ years of experience designing and building data sets and warehouses.
Excellent ability to understand the needs of and collaborate with stakeholders in other functions, especially Analytics, and identify opportunities for process improvements across teams.
Expertise in SQL for analytics/reporting/business intelligence and also for building SQL- and Python-based transforms inside an ETL pipeline, or similar.
Experience designing, architecting, and maintaining a data warehouse and data marts that seamlessly stitches together data from production databases, clickstream data, and external APIs to serve multiple stakeholders.
Experience building the above with a modern data stack based on a cloud-native data warehouse, in our case we use BigQuery, dbt, and Apache Airflow, but a similar stack is fine.
Experience using AI to generate design plans, code and documentation as well as applying AI-enabled workflows to accelerate development velocity and improve data engineering practices.
Strong sense of ownership and pride in your work, from ideation and requirements-gathering to project completion and maintenance.

Responsibilities

Collaboratively refine and evangelize a comprehensive framework for integrating data-thinking into the software development lifecycle for product teams.
Design, architect, and maintain core operations datasets, data marts, and feature stores that support a blend of mature products and features with a rapidly evolving product line, in partnership with analytics, data science, and machine learning.
Integrate deeply with our cross functional partners to understand their data needs, and help design datasets with the same engineering rigor as any other software we design.
Drive data quality and best practices across different business areas.
Help build the next generation data products at Thumbtack, leveraging AI models for code generation and incorporating agents into our workflows.