English (Australia) Data Labeling Associate - NYC based

Welo Data•New York, NY

7d•Onsite

About The Position

Welo Data is seeking detail-oriented individuals for the role of Data Labeling Associate. This position involves working directly with AI systems to evaluate outputs, identify limitations, and enhance their real-world performance. The role requires a blend of data quality assessment, model evaluation, and human judgment, emphasizing critical thinking and adherence to guidelines. Ideal candidates are curious about AI, comfortable forming opinions, and confident in contributing to discussions with team members and stakeholders.

Requirements

Native-level Australian English proficiency
A university degree (Bachelor’s or higher)
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines
Must be authorized to work in the U.S. (no visa sponsorship)

Nice To Haves

Experience in data quality, QA, annotation, or analysis is helpful — but not required

Responsibilities

Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way

Benefits

Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.