AI Operations Lead (Human-in-the-Loop) - WA-based

Welo Data

18h • Onsite

About The Position

Welo Data is seeking an AI Operations Lead to oversee high-impact teams of analysts dedicated to AI model evaluation in a human-in-the-loop environment. This role is an opportunity to define how quality is measured, acting as a bridge between technical stakeholders and analyst teams. The lead will translate complex AI guidelines into clear, actionable operational excellence, focusing on quality leadership at scale, driving continuous improvement, and fostering team growth.

Requirements

• 5–8 years of experience in Data Quality, QA, or AI/ML operations.
• 2+ years of experience managing teams in a high-scale data or AI environment.
• Ability to "zoom out" to see patterns while maintaining deep attention to detail.
• Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
• A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).

Responsibilities

• Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
• Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
• Turn ambiguous, evolving AI guidelines into structured direction for your teams.
• Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
• Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.

Benefits

• Free breakfast, lunch, and dinner with a wide variety of cuisines.
• Comprehensive Medical, Dental, and Vision coverage
• 401(k)
• HSA.
• 15 days of combined Paid Sick/Holiday time
• Memorial Day and Labor Day.
• Access to micro-kitchens, premium coffee, and unique features like rooftop nature parks.
• Free shuttles, transport benefits, and bike-to-work perks.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed
• Number of Employees: 1,001-5,000 employees