Data Annotation Specialist

Aston Carter•Dearborn, MI
•$38 - $38•Hybrid

About The Position

The Data Annotation Specialist improves chatbot response quality by reviewing AI-generated conversations and applying structured feedback. The role evaluates chatbot interactions against detailed guidelines, labels key attributes, and supports continuous improvement in conversational AI performance. It involves working with both voice and text data and ensuring accuracy, safety, and policy compliance across varied use cases. The position is a contract role based in Dearborn, Michigan, with a hybrid schedule of four onsite days and one work-from-home day per week. The standard schedule is 9:00 AM to 5:00 PM, Monday through Friday. The pay range is $38.00 per hour. Individual compensation depends on factors including qualifications, skills, relevant experience, job knowledge, geographic location, and internal equity. Benefit eligibility may depend on job classification and length of employment; benefits available for eligible temporary-role workers may include medical, dental, and vision coverage; critical illness, accident, and hospital coverage; a 401(k) retirement plan; life insurance; short- and long-term disability; a Health Spending Account; transportation benefits; an Employee Assistance Program; and time off or leave.

Requirements

  • Hands-on experience labeling conversational AI data, including text and audio.
  • Professional fluency in English, with strong reading comprehension and written communication skills.
  • Ability to interpret and consistently apply detailed guidelines, taxonomies, and decision rules.
  • Strong analytical judgment and attention to detail, including identifying factual errors, incomplete responses, unsupported claims, policy concerns, and ambiguous cases.
  • Ability to document labeling decisions and provide clear, concise rationales for each annotation.
  • Ability to work accurately on repetitive tasks while meeting defined quality, productivity, and turnaround expectations.
  • Ability to participate in calibration sessions, incorporate feedback, and adjust decisions as guidelines evolve.
  • Ability to prepare clear weekly reports summarizing labeling volume, productivity, quality results, progress, and open issues.
  • Research and analysis skills focused on data integrity and data annotation.
  • Strong analytical and communication skills relevant to data annotation for both voice and text.
  • Experience working with data annotation processes for voice and text interactions.
  • Comfort working with structured taxonomies and decision frameworks.
  • Ability to collaborate effectively with cross-functional teams during training, calibration, and adjudication sessions.

Nice To Haves

  • Prior experience in the automotive industry is preferred.
  • A background as a Data Annotator or Data Analyst is beneficial.

Responsibilities

  • Review chatbot conversations and related artifacts, including individual turns, model responses, retrieved content, citations, and metadata, using approved tools.
  • Apply approved labeling guidelines, taxonomies, and decision rules, completing required labels, rationales, confidence assessments, and ambiguity indicators for each conversation.
  • Evaluate chatbot performance for intent, task completion, correctness, completeness, relevance, groundedness, source attribution, response quality, safety, policy compliance, escalation need, and failure category.
  • Identify ambiguous, sensitive, safety-relevant, out-of-guideline, or subject-matter-expert-review cases and escalate them appropriately.
  • Follow existing standards and guidance without inferring or creating new standards where approved guidance does not exist.
  • Participate in onboarding, calibration, refresher training, quality reviews, and adjudication sessions to maintain consistent labeling decisions.
  • Conduct first-level quality checks, identify errors, and correct issues raised through internal or external quality reviews.
  • Maintain accurate records of completed annotations, quality results, exceptions, escalations, and open issues in designated systems.
  • Prepare weekly reports covering completed volume, productivity, quality results, backlog, open questions, risks, guideline gaps, and required actions.
  • Recommend and document potential improvements to annotation guidelines and taxonomy based on recurring ambiguities, labeling patterns, and adjudication outcomes; implement changes only after formal approval.

Benefits

  • Medical insurance
  • Dental insurance
  • Vision insurance
  • Critical illness coverage
  • Accident coverage
  • Hospital coverage
  • 401(k) retirement plan with pre-tax and Roth post-tax contributions
  • Voluntary life and AD&D insurance for the employee and dependents
  • Short-term disability
  • Long-term disability
  • Health Spending Account (HSA)
  • Transportation benefits
  • Employee Assistance Program
  • Time off or leave, including PTO, vacation, or sick leave
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service