Delivery Lead

HumanSignal • Columbus, OH

2d • Onsite

About The Position

HumanSignal specializes in operationally complex, multimodal data collection and annotation — delivering the datasets that frontier AI research requires and remote workforce marketplaces can't. We own projects end-to-end, from scoping and protocol design through final delivery, running on-site and distributed expert workforces across 50+ knowledge domains, 30+ languages, and 75+ countries. Our work spans RLHF, evals, red-teaming, and custom multimodal data creation, all powered by Label Studio Enterprise and built on a foundation of rigorous quality workflows, ethical sourcing, and full data security. This role sits at the operational core of that delivery engine — responsible for ensuring our clients get the highest-quality data on time, every time. This role is not for everyone. HumanSignal Services operates at the intersection of frontier AI research and large-scale human data delivery — and the work is fast, demanding, and unforgiving of dropped balls. You'll own complex, high-stakes data programs end-to-end, managing expert workforces, navigating shifting customer requirements, and holding quality and delivery timelines simultaneously. There is no playbook handed to you. You will build it, break it, and rebuild it better. If you thrive under pressure, take personal pride in operational excellence, and don't quit when a project gets hard — this is the role for you

Requirements

• 5+ years in operationally intensive roles (marketplace, data ops, logistics, or similar)
• 1+ year of people management with clear impact on team performance
• Metrics-driven with a systems-thinking approach to operations
• Experience owning delivery outcomes across multi-stakeholder, high-velocity projects
• Hands-on operator willing to dive into execution when needed
• Must be proficient in using LLMs in your every day work, including building scripting logic and working with large datasets with LLM assistance

Nice To Haves

• 1+ year in AI data operations (RLHF, annotation, model evaluation)
• STEM background or strong technical fluency
• Python & REACT working knowledge
• Experience managing distributed contributor workforces at scale
• Background in management consulting, investment banking, or high-growth startups

Responsibilities

• Lead and manage a team of Strategic Project Leads (SPLs) across multiple high-stakes AI data projects simultaneously
• Own delivery outcomes for your projects: throughput, quality, SLA performance, cost efficiency, and customer satisfaction
• Drive delivery across custom data pipelines and expert labeling workflows, translating researcher requirements into clear operational plans
• Collaborate with AI lab researchers and procurement partners to define data strategies, scope programs, and resolve escalations
• Drive systems-level improvements — standardize playbooks, improve tooling, and build infrastructure that makes the team faster and more reliable at scale
• Coach and develop SPLs; ensure high-quality AI Trainer experience and strong contributor retention
• Partner with Product and Engineering to evolve internal tooling, automation, and operational systems

Benefits

• We celebrate diversity and are committed to creating an inclusive environment for all employees.
• HumanSignal does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, genetic information, or any other characteristic protected by applicable federal, state, or local law.
• We are committed to working with and providing reasonable accommodations to individuals with disabilities.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed