Delivery Lead

HumanSignal • San Francisco, CA

4d

About The Position

HumanSignal is a human data partner for companies building AI models and products. It creates datasets, recruits and manages domain experts, and provides data labeling and evaluation through its Label Studio platform and services. The company supports operationally complex data collection, multimodal pipelines, and multi-step workflows for advanced AI and ML teams.

The Delivery Lead is responsible for the operational delivery of high-stakes AI data programs, ensuring clients receive high-quality data on schedule. The role leads Strategic Project Leads across multiple projects and manages end-to-end delivery amid changing requirements, demanding quality standards, and tight timelines. It involves building and improving operational playbooks and systems while balancing workforce management, quality, delivery, and customer needs. The role is based in San Francisco, California, and is designated at the Manager level.

Requirements

• At least 5 years of experience in operationally intensive roles such as marketplace, data operations, or logistics.
• At least 1 year of people management experience with clear impact on team performance.
• Metrics-driven approach and systems-thinking approach to operations.
• Experience owning delivery outcomes across multi-stakeholder, high-velocity projects.
• Hands-on operating approach and willingness to participate directly in execution when needed.
• Proficiency using LLMs in everyday work, including building scripting logic and working with large datasets with LLM assistance.

Nice To Haves

• At least 1 year of experience in AI data operations, such as RLHF, annotation, or model evaluation.
• STEM background or strong technical fluency.
• Working knowledge of Python and React.
• Experience managing distributed contributor workforces at scale.
• Background in management consulting, investment banking, or high-growth startups.

Responsibilities

• Lead and manage a team of Strategic Project Leads across multiple high-stakes AI data projects simultaneously.
• Own delivery outcomes, including throughput, quality, SLA performance, cost efficiency, and customer satisfaction.
• Drive delivery across custom data pipelines and expert labeling workflows, translating researcher requirements into operational plans.
• Collaborate with AI lab researchers and procurement partners to define data strategies, scope programs, and resolve escalations.
• Improve systems by standardizing playbooks, improving tooling, and building infrastructure to make the team faster and more reliable at scale.
• Coach and develop Strategic Project Leads, support a high-quality AI Trainer experience, and strengthen contributor retention.
• Partner with Product and Engineering to evolve internal tooling, automation, and operational systems.
• Manage multiple programs and their contributors, quality standards, and customer expectations; make decisions with incomplete information and hold contributors and vendors accountable.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed