Italian Data Labeling Associate

Welo Data•Oakland, CA

10d•Onsite

About The Position

Welo Data is hiring an Italian-speaking Data Labeling Associate for Project Perseus, a human-in-the-loop AI project. This is not a traditional annotation role: the associate evaluates AI outputs, identifies gaps, and helps improve how AI systems behave in real-world scenarios. The work combines data quality, model evaluation, and human judgment, with an emphasis on critical thinking and contributing to discussions with teammates, leads, and stakeholders. This is a full-time, 40-hour-per-week W-2 employee position requiring 100% onsite work in one of the listed U.S. cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Los Angeles, Washington, DC, or Boston. Applicants must be authorized to work in the U.S.; visa sponsorship is not available. The pay rate is $34 per hour.

Requirements

Native-level proficiency in Italian.
A university degree at the bachelor's level or higher.
B2 or higher level of English.
1–2 years of professional writing experience and strong structured-writing skills.
Ability to apply complex writing rules and guidelines consistently.
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience.
Strong critical thinking and attention to detail.
Ability to make sound judgments in ambiguous situations.
Curiosity about AI, technology, and system behavior.
Comfort speaking up, asking questions, and contributing ideas.
Strong written and verbal communication skills.
Ability to remain consistent while working with evolving guidelines.
Must be authorized to work in the U.S.; visa sponsorship is not available.
Must be located in or able to commute to one of the specified cities, as the role is 100% onsite.

Nice To Haves

Experience in data quality, QA, annotation, or analysis.

Responsibilities

Evaluate AI model outputs and provide structured, high-quality feedback.
Conduct audit-based reviews of data and model behavior, identifying patterns, edge cases, and failure modes.
Apply guidelines thoughtfully and flag cases where they do not reflect real-world scenarios.
Contribute to improving evaluation frameworks.
Identify trends in model performance and communicate insights clearly.
Participate in team discussions, calibrations, and stakeholder syncs.
Partner with leads and cross-functional teams to refine quality standards.
Document findings clearly, concisely, and actionably.

Benefits

Paid vacation: 6 days.
Paid company holidays: 2 days (Memorial Day and Labor Day).
Paid sick leave accrued according to applicable state law and company policy.
Medical, dental, and vision insurance, subject to eligibility.
Health Savings Account (HSA).
401(k) retirement plan.
Employee Assistance Program.
Additional voluntary benefits, including life, accident, and critical illness coverage.
Free breakfast, lunch, and dinner, with a variety of cuisines in multiple cafes.
Offices stocked with free snacks and beverages, including premium coffee and La Croix.
Some locations include rooftop nature parks.
Commuter benefits, including free transport, shuttles, and sometimes bike-to-work perks.