Quality Lead Contract

Careerflow.ai • ,

1d

About The Position

Lead QA reviewers to ensure annotated data is accurate, consistent, and delivered on time. The role involves managing review queues, identifying errors, providing feedback, and supporting annotators in a fast-paced environment with tight turnaround times.

Requirements

• 3–5 years of overall experience, including 1+ year leading or mentoring reviewers.
• Strong attention to detail and ability to follow complex guidelines.
• Clear communication and feedback skills.
• Experience in QA, annotation, data labeling, or AI training data is preferred.

Responsibilities

• Lead QA reviewers and manage audit and review queues.
• Spot-check annotated data and reviewer decisions.
• Provide clear, actionable, and consistent feedback.
• Conduct office hours and clarify guidelines for annotators.
• Track quality scores, error trends, and reviewer performance.
• Train new reviewers on guidelines, tools, and review processes.
• Escalate recurring issues and unclear guidelines to the Senior QA Lead.

Benefits

• This is a project-based role involving a defined number of evaluation tasks.
• Each task will involve comparing multiple chatbots and providing a final assessment.

What This Job Offers

• Career Level: Mid Level
• Education Level: No Education Listed