Delivery Lead

HumanSignal • San Francisco, CA

4d • $110,000 - $140,000

About The Position

HumanSignal is hiring a Delivery Lead to oversee high-stakes AI data programs at the operational core of its services delivery engine. The role leads multiple projects involving complex, multimodal data collection and annotation, expert workforces, and custom data pipelines. Delivery spans work such as RLHF, evaluations, red-teaming, and multimodal data creation, supported by Label Studio Enterprise and quality, ethical-sourcing, and data-security workflows.

The Delivery Lead owns project outcomes from scoping and operational planning through final delivery, balancing quality, throughput, service-level performance, cost efficiency, timelines, and customer satisfaction. The role manages and develops Strategic Project Leads, works with AI lab researchers and procurement partners, and partners with Product and Engineering to improve systems, tooling, automation, and operational processes. The work is described as fast-paced and demanding, requiring hands-on execution, sound decisions with incomplete information, and accountability for delivery.

Requirements

• At least 5 years of experience in operationally intensive roles, such as marketplace, data operations, or logistics.
• At least 1 year of people-management experience with clear impact on team performance.
• Metrics-driven approach and systems-thinking ability in operations.
• Experience owning delivery outcomes across multi-stakeholder, high-velocity projects.
• Willingness to work hands-on in execution when needed.
• Proficiency using LLMs in everyday work, including building scripting logic and working with large datasets with LLM assistance.

Nice To Haves

• At least 1 year of experience in AI data operations, such as RLHF, annotation, or model evaluation.
• STEM background or strong technical fluency.
• Working knowledge of Python and React.
• Experience managing distributed contributor workforces at scale.
• Background in management consulting, investment banking, or high-growth startups.

Responsibilities

• Lead and manage a team of Strategic Project Leads across multiple high-stakes AI data projects simultaneously.
• Own delivery outcomes, including throughput, quality, SLA performance, cost efficiency, and customer satisfaction.
• Drive delivery across custom data pipelines and expert labeling workflows, translating researcher requirements into clear operational plans.
• Collaborate with AI lab researchers and procurement partners to define data strategies, scope programs, and resolve escalations.
• Standardize playbooks, improve tooling, and build infrastructure to make the team faster and more reliable at scale.
• Coach and develop Strategic Project Leads.
• Ensure a high-quality AI Trainer experience and strong contributor retention.
• Partner with Product and Engineering to evolve internal tooling, automation, and operational systems.
• Dive into project execution when needed and hold contributors and vendors accountable.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed