Bilingual Japanese Korean - AI Model Rater

Productive Playhouse•,

2d•$24 - $24•Remote

About The Position

Productive Playhouse is building a talent pool of Japanese + Korean speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. This is an independent contractor engagement (task-based - project-based). The pay rate is $24.00 per hour. You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them).

Requirements

Native or expert-level fluency in both Japanese and Korean, as spoken in South Korea
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency assessment and AI evaluation task
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours

Responsibilities

Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.