Data Quality Team Lead (Human-in-the-Loop AI)

Welocalize•San Francisco, CA

36d•$44•Onsite

About The Position

Welo Data is seeking a Data Quality Lead to manage teams of Data Quality Analysts who support AI model evaluation and enhancement. This role requires a blend of people leadership, quality assurance, and operational strategy. The successful candidate will guide teams through dynamic work, ensure high-quality outcomes, and serve as a liaison between analysts and stakeholders. The focus is not solely on managing output, but on defining, measuring, and improving quality within a human-in-the-loop AI context.

Requirements

5–8 years of experience in data quality, QA, AI/ML operations, or related fields
2+ years of experience leading teams in data quality, QA, or AI/ML-related work at scale
Native-level English proficiency
University degree (Bachelor’s or higher)
Strong operational mindset with experience managing performance across multiple workstreams
Proven ability to drive quality, delivery, and process improvements
Strong judgment and ability to operate in ambiguity
Comfortable interacting with stakeholders and representing the team
Ability to balance quality, speed, and evolving priorities
Strong communication and organizational skills
Deep attention to detail, with the ability to zoom out and see patterns
Interest in AI and how human feedback shapes model behavior
Candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, or Burlingame.

Nice To Haves

Proficiency in languages other than English is preferred, with particular interest in candidates demonstrating bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese.

Responsibilities

Lead and support a team of Data Quality Analysts
Oversee overall operational performance across workflows and teams
Ensure team activities align with broader business objectives and program goals
Drive the success of key initiatives across quality, delivery, and team performance
Own quality across workflows — including audits, calibrations, and feedback loops
Identify trends, risks, and gaps in model performance and data quality
Translate ambiguous or evolving guidelines into clear team direction
Run calibrations and ensure consistency across reviewers
Partner with stakeholders to align on quality standards and expectations
Prioritize and support hiring of linguists and specialized talent as needed
Drive continuous improvement across processes, tooling, and evaluation methods
Step into edge cases and complex decisions when needed
Support team growth, coaching, and performance management
Accountable for end-to-end operational success — including resource management, process optimization, and continuous improvement
Focus on long-term outcomes, ensuring the team consistently meets targets across quality, delivery, and overall program performance.

Benefits

Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.