LLM AI Quality Analysts
About The Position
We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity. This role requires strong English reading and writing skills, as well as strong analytical and attention-to-detail skills. The ideal candidate will have experience in AI evaluation, data annotation, content moderation, or related fields. You will be responsible for evaluating personalized AI/Gemini responses, creating and testing multi-turn prompts, and assessing AI responses for Grounding, Integration, and Helpfulness. This is a remote position requiring a laptop/desktop with reliable internet and a willingness to use a primary personal Google account.
Requirements
- Strong English reading and writing skills
- Strong analytical and attention-to-detail skills
- Ability to work independently in a remote environment
- Laptop/Desktop with reliable internet
- Willingness to use a primary personal Google account and enable personal data sources for the assessment
Nice To Haves
- AI evaluation, data annotation, content moderation, or related experience preferred
Responsibilities
- Evaluate personalized AI/Gemini responses
- Create and test multi-turn prompts
- Assess AI responses for Grounding, Integration, and Helpfulness
- Compare model responses side-by-side
- Identify incorrect personalization, poor inferences, and hallucinations
- Provide detailed feedback and rationales
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Career Level
Mid Level
