Project Perseus | Data Quality Analyst - Multilingual (English + Additional Languages) - (Human-in-the-Loop AI)

Welo Global • Washington, DC

1d • Onsite

About The Position

This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed. As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them.

Requirements

• Fluency in English plus two or more additional languages: Primary Language (Must have at least one): French, Italian, Spanish, or German. Secondary Language (Must have at least one): French, Italian, Spanish, German, Hindi, Portuguese, Russian, Polish, Turkish, or Vietnamese.
• University degree (Bachelor’s or higher)
• 2–4 years of experience in data annotation, content quality, QA, or related fields
• Strong ability to interpret and apply complex guidelines with consistency
• Excellent attention to detail with a high bar for quality
• Ability to stay consistent while working with evolving guidelines and priorities
• Experience in AI/ML data workflows or human-in-the-loop evaluation environments
• Prior experience auditing or reviewing the work of others
• Familiarity with safety, compliance, or policy-driven content evaluation
• Must be authorized to work in the U.S. (no visa sponsorship)
• Candidates must be located in or able to commute to one of the target cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston.

Responsibilities

• Support quality and execution across DLA teams, ensuring work meets defined standards at scale
• Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency
• Act as the first line of support for DLAs — answering questions and helping interpret guidelines
• Help DLAs navigate ambiguity and apply evolving instructions effectively
• Support onboarding and training of new DLAs through hands-on guidance and coaching
• Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads
• Identify patterns, recurring issues, and edge cases in both human and model outputs
• Participate in calibrations, team discussions, and stakeholder syncs
• Contribute to improving guidelines, processes, and overall team performance
• Document findings and feedback in a clear, concise, and actionable way

Benefits

• Paid Vacation: 6 days
• Paid Company Holidays: 2 days (Memorial Day and Labor Day)
• Paid Sick Leave: accrued per applicable state law and company policy
• Medical, Dental, and Vision Insurance (eligibility applies)
• Health Savings Account (HSA)
• 401(k) Retirement Plan
• Employee Assistance Program
• Additional voluntary benefits (life, accident, critical illness, etc.)
• Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
• Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
• Unique Campus Features: Some locations include roof-top nature parks
• Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level