Remote | Turkish Voice AI Evaluation Specialist — Up to $25/hour

24-Mag•New York, NY

1d•$0 - $25•Remote

About The Position

We are sharing a specialised part-time consulting opportunity for native Turkish speakers experienced in bilingual communication, voice-based task completion, transcription, AI response evaluation, and structured quality review. This role supports a short-term remote consulting project focused on evaluating natural voice interactions with an advanced AI assistant. Selected professionals will complete everyday productivity tasks using spoken Turkish, review the assistant's responses, prepare accurate transcripts, and document results through structured evaluation workflows.

Requirements

Native or near-native Turkish proficiency, with strong familiarity with language use in Turkey
Ability to understand and follow written and spoken instructions in English
Strong attention to detail across transcription, evaluation, and structured data entry
Regular experience using email, messaging, documents, spreadsheets, browsers, and similar productivity tools
Confidence completing tasks through spoken instructions
Ability to work independently and perform careful self-review
Reliable availability during a short-term remote project
Applicants must own a Mac with an Apple Silicon M1, M2, or M3 chip
The device must run macOS Sequoia 15.0 or newer

Nice To Haves

A degree in linguistics, translation, communications, language studies, journalism, education, or a related field is helpful
Professional writing, editing, transcription, localisation, or language-quality experience is highly relevant
Equivalent practical experience using Turkish and English in professional or academic settings may also be considered
Formal language qualifications are helpful but not required where native-level proficiency can be demonstrated
Experience with transcription, captioning, translation, localisation, or bilingual content review
Previous involvement in AI evaluation, data annotation, quality assurance, or language research
Familiarity with voice assistants, speech-recognition tools, or conversational AI systems
Experience working with structured spreadsheets and shared cloud-based files
Strong written Turkish and the ability to distinguish natural phrasing from literal or awkward outputs
Background in usability testing, product evaluation, or digital research workflows

Responsibilities

Use spoken Turkish to complete realistic tasks across everyday productivity applications
Compose messages, emails, notes, and other written content through voice instructions
Direct the AI assistant to perform actions such as formatting text, generating images, applying spreadsheet formulas, and summarising documents
Evaluate how accurately the assistant understands and completes each spoken request
Prepare accurate transcripts of spoken Turkish queries
Produce cleaned and standardised versions while preserving the original meaning
Review language quality, naturalness, grammar, and contextual accuracy
Identify recognition errors, missing information, and inconsistencies between the spoken request and written transcript
Rate AI-generated responses using structured project criteria
Assess instruction-following, relevance, accuracy, language quality, and task completion
Document errors and explain evaluation decisions clearly
Apply consistent quality standards across different task types and productivity workflows
Record task information accurately in a structured tracking sheet
Upload supporting recordings and project materials to an approved shared workspace
Review completed submissions for accuracy, completeness, and formatting consistency
Follow detailed instructions and manage assigned work independently