AI Safety & Data Quality Analyst (HITL) - California

Welo Data • Oakland, CA

22h • Onsite

About The Position

Welo Data is seeking Data Quality Analysts to join the Human Intelligence Behind the World’s Leading AI. This Human-in-the-Loop (HITL) role requires individuals who are sharp, curious, and detail-oriented to go beyond simple labels and help define how AI should behave in the real world. Analysts will refine guidelines, identify failure modes, and ensure the next generation of AI is safe, accurate, and helpful. This is a W2 Full-Time Employee position, requiring 40 hours per week, and is located in California.

Requirements

• A University degree combined with native-level language proficiency.
• 1–2 years of professional writing experience.
• Ability to articulate complex "why" justifications clearly.
• 2+ years of experience specifically focusing on Safety & Trust in GenAI data delivery.
• The ability to navigate "grey areas" and make sound judgment calls when guidelines are ambiguous.
• Naturally interested in how LLMs behave and aren't afraid to speak up when something feels "off."

Responsibilities

• Critique AI outputs and provide structured, high-level feedback that drives model improvement.
• Use your 2+ years of GenAI safety experience to identify bias, risks, and edge cases.
• Spot patterns in how models fail and communicate these insights to stakeholders.
• Help improve the evaluation frameworks themselves.
• Partner with leads and cross-functional teams to set the gold standard for AI quality.

Benefits

• Free Gourmet Dining: Chef-prepared breakfast, lunch, and dinner with global cuisines.
• Endless Snacks: Micro-kitchens stocked with premium coffee, beverages, and healthy treats.
• Campus Life: Access to unique features like rooftop nature parks and modern collaborative spaces.
• Commuter Ease: Free transport, shuttles, and bike-to-work perks.
• Full Security: Comprehensive Medical, Dental, and Vision + 401(k) and HSA.
• Time Off: 15 days of combined Paid Sick/Holiday time + major holidays.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 1,001-5,000 employees