Data Labeling Associate - English Speakers (UK, Canadian and/ or Australian variants)

Welo Data•Oakland, CA

1d•Onsite

About The Position

Welo Data is seeking detail-oriented individuals to join their team as Data Quality Associates. This role involves working directly with AI systems to evaluate outputs, identify gaps, and improve system behavior in real-world scenarios. The position requires a blend of data quality, model evaluation, and human judgment, emphasizing critical thinking and adherence to guidelines. The ideal candidate will be curious about AI, comfortable forming opinions, and confident in contributing to discussions with teammates, leads, and stakeholders.

Requirements

Native-level English proficiency (UK, CA, AU) and a university degree (Bachelor’s or higher).
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines

Nice To Haves

Experience in data quality, QA, annotation, or analysis is helpful — but not required

Responsibilities

Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way

Benefits

Paid Sick Time & Paid Holiday (combined): 15 days
Paid Holidays: Memorial Day and Labor Day
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.