Quality Analyst - US

Turing•Chicago, IL

11h•Remote

About The Position

Turing is hiring a detail-oriented Quality Analyst to evaluate and compare responses generated by multiple chatbots. The analyst reviews chatbot outputs against defined guidelines, identifies inaccuracies and quality issues, and provides a clear final assessment for each evaluation task. This project-based role involves a defined number of tasks, each requiring comparison of multiple chatbots and a final assessment. The stated duration is 16 weeks. The work schedule is five working days per week, including weekends as required, with two weekdays off. The role is described as freelance and offers a fully remote, flexible work environment.

Requirements

Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role.
Strong analytical, critical-thinking, and problem-solving skills.
Excellent written and verbal communication skills.
High attention to detail and ability to identify subtle errors.
Comfortable working with AI tools, chatbots, and online platforms.

Nice To Haves

Prior experience with chatbot evaluation, LLM testing, or data-quality projects.

Responsibilities

Evaluate and compare responses generated by multiple chatbots.
Assess responses for accuracy, relevance, completeness, clarity, and adherence to guidelines.
Identify errors, inconsistencies, missing information, and potential quality issues.
Provide structured feedback and final assessments for each task.
Follow evaluation guidelines and maintain consistency across reviews.
Document findings clearly and accurately.
Collaborate with project and quality teams to resolve queries.
Meet assigned productivity, quality, and turnaround-time targets.
Escalate complex or ambiguous cases when necessary.