Domain Consultant - United States

Persistent Systems•Santa Clara, CA
•Hybrid

About The Position

The Artificial Intelligence Data Quality Specialist will help ensure the quality and effectiveness of Intuit AI capabilities, particularly agentic experiences designed to assist TurboTax members. The role uses Python to investigate AI quality issues, evaluate agent traces and conversations, and work with cross-functional stakeholders to improve response accuracy and quality. The position is based in Santa Clara, United States, and the posting states 8 to 12 years of experience.

Requirements

  • Strong proficiency in Python.
  • BA or BS degree in a relevant field such as English, Communications, Linguistics, Business, Data Analytics, Computer Science, or Information Systems.
  • 1–3 years of experience in support, customer service, or content design QA.
  • Ability to evaluate conversations from multiple perspectives and identify areas for improvement.
  • Excellent analytical skills, with experience using Microsoft Excel or Google Sheets, SQL, and Python for data analysis.
  • Effective verbal and written communication skills.
  • Detail-oriented, with a high level of accuracy.
  • Proven experience resolving complex customer issues and managing escalations.
  • Flexible and adaptable in a rapidly evolving environment.

Nice To Haves

  • Experience in a financial institution or other highly regulated environment.
  • Familiarity with CRM and QA platforms.
  • Spanish fluency.
  • Ability to design and create diverse evaluators, rubrics, and prompts tailored to specific AI tasks.
  • Innovative approach to generating prompts that enhance model performance.
  • Experience conducting research to curate relevant data sources for evaluator development.
  • Commitment to keeping up with advancements in natural language processing and AI technologies.

Responsibilities

  • Evaluate AI conversations and agent traces across TurboTax experiences, identifying trends, errors, and member frustrations.
  • Label data with specific outcomes as needed and generate synthetic datasets for evaluations.
  • Collaborate with cross-functional stakeholders to identify gaps and other issues affecting AI performance.
  • Support improvements to AI agent responses, including LLM judge and rubric generation.
  • Analyze qualitative and quantitative data to identify patterns in member satisfaction and dissatisfaction.
  • Participate in audit-the-auditor programs and calibration sessions to ensure inter-labeler alignment.
  • Investigate non-natural language patterns, including anomalies in conversation distributions and sentiment.
  • Engage with additional services, data pipelines, and trained models to discover quality opportunities.
  • Perform other assigned tasks as needed to fulfill the role.

Benefits

  • Competitive salary and benefits package.
  • Talent development culture with quarterly growth opportunities.
  • Company-sponsored higher education and certifications.
  • Opportunity to work with cutting-edge technologies.
  • Employee engagement initiatives, including project parties and Long Service awards.
  • Flexible work hours.
  • Annual health check-ups.
  • Insurance coverage, including group term life, personal accident, and Mediclaim hospitalization for the employee, spouse, two children, and parents.
  • Hybrid work and flexible hours.
  • Accessibility-friendly office with ergonomic setups and assistive technologies.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service