Senior AI Development Lead

Airbnb
•$157,000 - $171,000•Remote

About The Position

The Senior AI Development Lead will work with teams across Airbnb to identify business processes and product features that AI can take on, then design, build, evaluate, and launch reliable AI workflows. The role begins by understanding how work is currently performed, developing an AI-based workflow, and testing its results against defined quality standards. The successful candidate will work closely with engineering, product, business partners, Legal, Policy, and subject matter experts to deliver measurable outcomes and support go/no-go decisions for AI features. This is a hands-on role involving workflow design, prompt and pipeline setup, tooling, quality monitoring, evaluation framework development, and human-verified data labeling. The lead will prioritize work by business impact, establish measurement plans, manage scaled labeling operations, and create reusable components and documentation that help teams move future AI projects into production more quickly. The role’s projects and methods will evolve as AI models, tools, and policies change. The position is US remote eligible, with possible occasional work at an Airbnb office or attendance at offsites as agreed with the manager. Employees must reside in a state where Airbnb, Inc. has a registered entity. The role may be eligible for bonus, equity, benefits, and Employee Travel Credits. The listed base pay range is $157,000–$171,000 USD.

Requirements

  • At least 8 years of experience in product or program management, analytics, consulting, or applied AI.
  • Proven ability to take technical programs from idea to production and own outcomes such as backlog, cycle time, or launch speed.
  • Strong SQL skills and knowledge of quality statistics, including accuracy, precision, recall, sampling, and reviewer agreement.
  • Experience independently pulling and analyzing data.
  • Experience shipping an AI-based workflow, agent, or automation that others rely on, with measurable before-and-after results and an understanding of failures and subsequent changes.
  • Technical fluency sufficient to assess engineering estimates, understand how prompts, pipelines, and evaluations work together, and identify when a workaround is appropriate.
  • Ability to understand and measure complex processes, including exceptions, and define success in business outcomes.
  • Sound judgment in interpreting qualitative feedback and reviewer disagreements to identify meaningful improvements.
  • Clear writing and ability to collaborate across sales, operations, product management, and engineering, including influencing people who do not report to you.
  • Comfort being the first person to tackle a problem and trying solutions directly.

Nice To Haves

  • Hands-on Python and API experience, such as scripting data pulls, calling model APIs, or building small automations.
  • Experience with LLM evaluation, including building test sets, calibrating LLM judges, or fine-tuning models.
  • Experience with experimentation and measurement, such as A/B tests, metric design, and dashboards.
  • Experience in trust and safety, content moderation, customer support automation, annotation operations, or other large-scale human-in-the-loop work.
  • Background in a two-sided marketplace, travel, or another operations-heavy business.

Responsibilities

  • Drive supported AI workflows and features from design through launch, defining quality standards and measurement plans with engineering, product, and business partners.
  • Prioritize projects based on business impact and make trade-offs with the manager and relevant business and product leads.
  • Map existing work processes with the teams that own them and determine how AI can perform the work and where human judgment is needed.
  • Design and build AI workflows, including prompts, pipelines, and tooling, and monitor live quality and drift.
  • Build evaluation frameworks, including test sets, accuracy and agreement metrics, and calibration of LLM judges against human reviewers.
  • Collaborate with engineers on architecture and tooling decisions and assess estimates and project scope.
  • Turn unclear guidelines into consistent, usable criteria in collaboration with product, Legal, and Policy.
  • Work with subject matter experts to create labeling guidelines and produce human-verified labels on real data.
  • Manage large-scale labeling with vendor teams and review their work using agreement metrics and spot checks.
  • Align with product teams on launch quality standards for AI features and provide evidence and recommendations for go/no-go decisions.
  • Build reusable evaluation and workflow components, document findings, and help other teams adopt them.
  • Keep methods current as models, tools, and policies change, and recommend retiring methods that no longer work.

Benefits

  • The role may be eligible for bonus, equity, benefits, and Employee Travel Credits.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service