AI Quality Program Manager

Zoomph

4d•$76,000 - $82,000

About The Position

Zoomph operates Computer Vision workloads for sponsorship tracking. To ensure accuracy and data quality, human workforce programs support the AI pipeline to review missed logos and false positives from Computer Vision, and to manage human-in-the-loop labeling jobs. This role is responsible for managing such workstreams end-to-end. This includes interfacing with internal stakeholders to understand data labeling priorities, translating those priorities into actionable tasks for the workforce, and ensuring timely, high-quality output.

Requirements

Bachelor's degree in Business, Data Science, Artificial Intelligence, Computer Science, or a related technical field; equivalent work experience will be considered
3-5 years of experience in AI Operations, data management, or program management roles with a focus on AI model training, deployment, or workload management.
Experience managing remote workforces or offshore operations
Strong project coordination skills: ability to juggle multiple workstreams and priorities simultaneously
Clear, professional written communication for both internal stakeholders and workforce teams
Familiarity with data labeling concepts, annotation workflows, and quality assurance processes
Comfort working with cloud platforms or willingness to learn

Nice To Haves

Hands-on experience with AWS Ground Truth or similar labeling platforms (Scale AI, Labelbox, etc.)
Background in computer vision, media monitoring, or sports/sponsorship analytics
Experience working with Eastern European teams or across time zones
Understanding of AI/ML pipelines and where human review fits within them

Responsibilities

Work closely with the Zoomph Account Management and Customer Success teams to identify and prioritize data labeling needs across clients and campaigns.
Gather requirements from Account Management and CS to understand which clients, brands, and campaigns require prioritized labeling effort.
Define the scope of each work effort: identify which tasks need to be completed, which brands are in scope, and what the acceptance criteria are.
Use internal agents and on-demand tools to analyze client workloads
Translate business-level requirements into clear, actionable task briefs for the moderation and HITL workforces.
Communicate scope, priorities, and timelines to the manual moderation team, ensuring alignment before work begins.
Provide status updates and estimated completion timelines back to Account Management and CS stakeholders.
Serve as the primary point of contact for workforce-related questions from internal teams; answer clarifying questions and manage expectation-setting.
Oversee the day-to-day operation of the moderation team responsible for reviewing false positives and missed detections that may impact client reporting.
Assign moderation tasks to the team based on priority, capacity, and client urgency.
Ensure the team understands the context and requirements of each task before beginning work.
Monitor progress and track completion rates against committed timelines.
Review output quality and provide feedback or clarification when the team encounters ambiguous cases.
Identify bottlenecks or capacity constraints and escalate or resolve as needed.
Maintain clear documentation of task assignments, completion status, and any issues encountered.
Provide regular reporting to internal stakeholders on workforce throughput and task status.
Own the end-to-end lifecycle of Human-in-the-Loop (HITL) jobs submitted for blank label resolution.
Create new HITL projects as labeling needs arise.
Configure HITL task submissions on a per-client basis, including task instructions, labeling schema, quality thresholds, and workforce routing.
Monitor the backlog of submitted tasks and track completion rates and throughput against SLAs and client expectations.
Review task output for quality and flag or remediate errors as needed.
Respond to questions from the HITL workforce, providing clarifications on labeling instructions or edge cases.
Scale workforce headcount up or down in coordination with workload demands and budget constraints.
Provide timelines and completion estimates to stakeholders for active and upcoming HITL jobs.