Portuguese (Brazil) Data Labeling Associate - NYC based
About The Position
Welo Data is seeking Data Labeling Associates for Project Perseus. This role is not a traditional annotation position, but rather involves working at the intersection of human judgment and machine learning. The associate will evaluate how cutting-edge AI systems handle language nuances, cultural context, and safety boundaries. While the job title specifies Portuguese (Brazil), the responsibilities section explicitly mentions critiquing Arabic AI outputs, identifying bias and risks in Arabic datasets, and refining evaluation frameworks for Arabic dialects and contexts. The mission is to achieve human-in-the-loop excellence by providing structured feedback to drive model improvement, identifying failure modes, applying complex linguistic guidelines, communicating findings to technical stakeholders, and ensuring consistent quality across global AI workstreams. This is a W2 Full-Time Employee role, requiring 40 hours/week, and is located on-site in New York City.
Requirements
- Professional-level proficiency in Portuguese (Brazil)
- Bachelor’s degree or higher
- B2 level or superior English skills to navigate technical guidelines and stakeholder syncs
- 1–2 years of experience in professional writing, journalism, or content creation
- 2+ years of experience focusing on Safety & Trust in Generative AI data delivery
- The ability to make sound judgment calls in ambiguous "grey area" scenarios
- A natural curiosity about LLMs and the confidence to flag issues when a model's behavior feels "off."
Responsibilities
- Critique Arabic AI outputs for accuracy, fluency, and tone, providing structured feedback to drive model improvement
- Use your 2+ years of GenAI safety experience to identify bias, risks, and failure modes in Arabic datasets
- Apply complex linguistic guidelines thoughtfully and help refine evaluation frameworks to reflect real-world Arabic dialects and contexts
- Identify trends in model performance and communicate findings clearly to technical stakeholders
- Participate in team syncs to ensure consistent quality across global AI workstreams
Benefits
- Free breakfast, lunch, and dinner with a wide variety of cuisines
- Micro-kitchens stocked with premium coffee, beverages, and healthy treats
- Modern collaborative spaces
- Unique amenities like rooftop nature parks (at select locations)
- Comprehensive Medical, Dental, and Vision
- 401(k) and HSA eligibility
- Free transport, shuttles, and bike-to-work perks
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
1,001-5,000 employees
