Staff Software Engineer, AI/ML Infrastructure

Thumbtack

18h

About The Position

Thumbtack is seeking a Staff Software Engineer for the Machine Learning Infrastructure Team. This team is central to Thumbtack's AI/ML infrastructure, supporting various product areas like search, recommendations, pricing, and content generation. The role involves setting technical direction for the AI/ML platform (LLM gateway, model training/serving, feature/data workflows, orchestration, observability) and the AI evaluation platform (trace ingestion, scorer infrastructure, LLM-as-judge calibration, pre-deploy regression gates, self-serve evaluation tooling). This is a hands-on role where the engineer will design, build, and ship significant systems, while also mentoring other engineers. The position requires close collaboration with applied scientists, product engineering teams, and engineering leadership to define roadmaps, make build/buy/adopt decisions, and ensure platform scalability.

Requirements

10+ years of professional software engineering experience.
Track record of technical leadership at staff level or equivalent scope, setting direction for systems spanning multiple teams, driving alignment across teams, and seeing them through to production.
3+ years building AI/ML infrastructure in production including model serving, feature platforms, training or orchestration systems, or ML observability.
Hands-on experience with LLM-powered systems in production, including at least some of the following: LLM gateways or proxies, prompt and model lifecycle management, RAG or agentic architectures, and cost optimization for LLM workloads.
Experience building or operating AI evaluation systems: offline eval pipelines, LLM-as-judge approaches and their calibration against human judgment, regression testing for model or prompt changes, or A/B measurement of AI features.
Deep experience designing, building, and operating reliable distributed systems, including ownership of production services at meaningful scale, on-call responsibility, and incident leadership.
Demonstrated ability to use AI coding tools in day-to-day workflows and to validate, critique, and refine AI-generated output.

Responsibilities

Build and evolve core AI platform capabilities that enable teams to develop, run, and scale GenAI-powered applications across Thumbtack.
Contribute to the design, development, and deployment of scalable tools and infrastructure to support applied scientists, including traditional ML model training and serving systems, feature and data workflows, CI/CD, orchestration, deployment, and evaluation tooling.
Work hands-on across the stack, from backend services and execution infrastructure to integrations with AI models and tooling.
Partner with senior engineers to evaluate next-generation AI infrastructure frameworks and tools that help product teams harness advances in AI.
Drive projects to completion with a strong focus on business impact and measurable outcomes.
Solve complex technical problems and stay up to date with advances in this rapidly evolving space.