Project Perseus | Data Quality Analyst - Multilingual (English + Additional Languages) - (Human-in-the-Loop AI)

Welo Global•Los Angeles, CA

2d•Onsite

About The Position

Project Perseus is seeking a Data Quality Analyst with multilingual capabilities to support quality and execution across Data Labeling and Annotation (DLA) teams. This role is crucial for ensuring that work meets defined standards at scale and plays a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed. The position is a 1-year contract with the possibility of extension, requiring full-time commitment (40 hours per week) and is a 100% onsite role in one of the specified target cities.

Requirements

Fluency in English plus two or more additional languages: Primary Language (Must have at least one): French, Italian, Spanish, or German. Secondary Language (Must have at least one): French, Italian, Spanish, German, Hindi, Portuguese, Russian, Polish, Turkish, or Vietnamese.
University degree (Bachelor’s or higher)
2–4 years of experience in data annotation, content quality, QA, or related fields
Strong ability to interpret and apply complex guidelines with consistency
Excellent attention to detail with a high bar for quality
Ability to stay consistent while working with evolving guidelines and priorities
Experience in AI/ML data workflows or human-in-the-loop evaluation environments
Prior experience auditing or reviewing the work of others
Familiarity with safety, compliance, or policy-driven content evaluation
Must be authorized to work in the U.S. (no visa sponsorship)
Candidates must be located in or able to commute to one of the target cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston.

Responsibilities

Support quality and execution across DLA teams, ensuring work meets defined standards at scale
Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency
Act as the first line of support for DLAs — answering questions and helping interpret guidelines
Help DLAs navigate ambiguity and apply evolving instructions effectively
Support onboarding and training of new DLAs through hands-on guidance and coaching
Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads
Identify patterns, recurring issues, and edge cases in both human and model outputs
Participate in calibrations, team discussions, and stakeholder syncs
Contribute to improving guidelines, processes, and overall team performance
Document findings and feedback in a clear, concise, and actionable way

Benefits

Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.