LLM AI Quality Analyst Chinese

Donato Technologies Inc

3d • $10 - $13 • Remote

About The Position

We are looking for Chinese-speaking AI Quality Analysts to support a short-term AI evaluation project with a leading AI technology company. This is a remote position with an immediate start, requiring a minimum of 4 hours overlap with PST. The role involves evaluating personalized AI responses, creating prompts, reviewing AI outputs for accuracy and personalization, identifying issues like incorrect personalization and hallucinations, comparing responses, and providing detailed feedback with clear rationales.

Requirements

• Strong Chinese reading and writing skills
• Excellent analytical and critical-thinking skills
• Strong written communication
• Bachelor's degree or equivalent experience
• Comfortable working independently in a remote environment
• Laptop/desktop with reliable internet
• Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation

Nice To Haves

• Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred

Responsibilities

• Evaluate personalized AI responses and determine their quality
• Create multi-turn prompts based on personal experiences and context
• Review AI responses for accuracy, helpfulness, and appropriate personalization
• Identify incorrect personalization, unsupported assumptions, and hallucinations
• Compare AI responses side-by-side and provide detailed feedback
• Write clear rationales explaining your evaluations

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level