Senior Data Engineer

Thumbtack

27d

About The Position

Thumbtack's Data Engineering organization is divided into three groups: Core Data Engineering, Data Platform, and Embedded Data Engineering. This role is within the Embedded Data Engineering team, which is further segmented into multiple business units where data engineers are integrated. This specific position will focus on the commercial operations side of the business, collaborating closely with engineers, analysts, data scientists, and machine learning engineers. The primary goal is to design and curate data sets from both internal and third-party sources to address current and future needs. Over the next year, this role will build upon previous successes in developing a more unified data warehouse and will begin to work further upstream to embed data best practices throughout the entire software development lifecycle (SDLC). The challenge lies in managing Terabytes of data across various teams at Thumbtack, each with unique difficulties in cleaning and organizing data for performance measurement. In this role, you will partner with Engineers, Data Scientists, Managers, and others to understand their requirements and actively build datasets to overcome these challenges.

Requirements

• 4+ years of experience designing and building data sets and warehouses.
• Excellent ability to understand the needs of and collaborate with stakeholders in other functions, especially Analytics, and identify opportunities for process improvements across teams.
• Expertise in SQL for analytics/reporting/business intelligence and also for building SQL- and Python-based transforms inside an ETL pipeline, or similar.
• Experience designing, architecting, and maintaining a data warehouse and data marts that seamlessly stitches together data from production databases, clickstream data, and external APIs to serve multiple stakeholders.
• Experience building the above with a modern data stack based on a cloud-native data warehouse, in our case we use BigQuery, dbt, and Apache Airflow, but a similar stack is fine.
• Experience using AI to generate design plans, code and documentation as well as applying AI-enabled workflows to accelerate development velocity and improve data engineering practices.
• Strong sense of ownership and pride in your work, from ideation and requirements-gathering to project completion and maintenance.

Responsibilities

• Collaboratively refine and evangelize a comprehensive framework for integrating data-thinking into the software development lifecycle for product teams.
• Design, architect, and maintain core operations datasets, data marts, and feature stores that support a blend of mature products and features with a rapidly evolving product line, in partnership with analytics, data science, and machine learning.
• Integrate deeply with our cross functional partners to understand their data needs, and help design datasets with the same engineering rigor as any other software we design.
• Drive data quality and best practices across different business areas.
• Help build the next generation data products at Thumbtack, leveraging AI models for code generation and incorporating agents into our workflows.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed