Italian Data Labeling Associate((Human-in-the-Loop AI))

Welocalize•San Francisco, CA

13d•Onsite

About The Position

Welo Data is seeking detail-oriented individuals to join their team as Data Quality Associates. This role involves working directly with AI systems, evaluating their outputs, identifying gaps, and improving their real-world performance. The position combines data quality, model evaluation, and human judgment, requiring critical thinking and the ability to follow guidelines. Candidates should be curious about AI, comfortable forming opinions, and confident in contributing to discussions with teammates, leads, and stakeholders.

Requirements

Native-level language proficiency
University degree (Bachelor’s or higher)
B2 or superior level of English
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines
Must be authorized to work in the U.S. (no visa sponsorship)
Candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, or Burlingame.

Nice To Haves

Experience in data quality, QA, annotation, or analysis is helpful — but not required

Responsibilities

Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way

Benefits

Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.