AI Operations Lead (Human-in-the-Loop) - California-based

Welo Data•Oakland, CA

18h•Onsite

About The Position

Welo Data is seeking a Data Quality Lead to oversee high-impact teams of analysts dedicated to AI model evaluation. This role is a strategic leadership opportunity to define how quality is measured in a human-in-the-loop environment. You will act as the bridge between technical stakeholders and analyst teams, translating complex AI guidelines into clear, actionable operational excellence, shaping the future of AI.

Requirements

5–8 years of experience in Data Quality, QA, or AI/ML operations.
2+ years of experience managing teams in a high-scale data or AI environment.
Ability to "zoom out" to see patterns while maintaining deep attention to detail.
Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).

Responsibilities

Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
Turn ambiguous, evolving AI guidelines into structured direction for your teams.
Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.

Benefits

Free breakfast, lunch, and dinner with a wide variety of cuisines.
Comprehensive Medical, Dental, and Vision coverage + 401(k) and HSA.
15 days of combined Paid Sick/Holiday time + Memorial Day and Labor Day.
Access to micro-kitchens, premium coffee, and unique features like rooftop nature parks.
Free shuttles, transport benefits, and bike-to-work perks.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume