Remote | Hindi Audio Transcription & AI Evaluation Specialist — Up to $45/hour

24-Mag • New York, NY

2d • $0 - $45 • Remote

About The Position

We are sharing a specialised part-time consulting opportunity for Hindi-speaking professionals based in the San Francisco Bay Area with strong transcription, writing, linguistic analysis, annotation, and structured evaluation skills. This short-term role supports an audio AI research initiative focused on training and benchmarking advanced language models. Selected professionals will transcribe Hindi audio and video content, evaluate model-generated outputs, develop bilingual grading standards, and document linguistic nuances across contemporary Hindi, regional variation, and Hindi-English code-switching.

Requirements

• Native or near-native spoken and written fluency in Hindi
• Professional fluency in English
• Current residence in the San Francisco Bay Area
• Strong familiarity with contemporary spoken Hindi, regional vocabulary, dialects, and informal usage
• Ability to recognise and evaluate Hindi-English code-switching
• Excellent writing, editing, critical-thinking, and analytical skills
• Experience accurately transcribing and analysing audio content
• Ability to work independently, manage deadlines, and follow detailed instructions
• Availability to contribute approximately 10–20 hours per week

Nice To Haves

• Previous experience with Hindi transcription, annotation, localisation, or language-quality review
• Familiarity with regional Hindi variation and contemporary colloquial language
• Experience reviewing Hinglish or other Hindi-English code-switching patterns
• Background in research, benchmarking, data annotation, or structured evaluation workflows
• Familiarity with generative AI, language models, speech technology, or applied language research
• Experience developing grading rubrics, reviewer guidelines, or quality standards
• Comfort participating in occasional in-person collaboration within the San Francisco Bay Area when required

Responsibilities

• Listen to, analyse, and transcribe Hindi-language audio and video content
• Produce accurate written outputs in Hindi, with supporting English content when required
• Follow detailed formatting, stylistic, and task-specific instructions
• Capture tone, intent, register, pronunciation, regional vocabulary, and dialectal variation
• Review completed transcripts for clarity, completeness, and linguistic accuracy
• Define expectations for correct and high-quality responses in general consumer audio contexts
• Develop detailed evaluation rubrics and grading instructions in Hindi and English
• Document scoring standards that can be applied consistently across reviewers
• Identify grammatical complexities, colloquialisms, code-switching patterns, and language-specific edge cases
• Refine guidelines when ambiguity or inconsistent interpretation arises
• Run assigned prompts through language models and review generated responses
• Evaluate outputs for accuracy, completeness, fluency, relevance, and instruction adherence
• Assess whether model responses appropriately reflect spoken Hindi and contemporary usage
• Identify transcription errors, unnatural phrasing, missed context, and linguistic inconsistencies
• Provide structured written feedback supporting model improvement
• Participate in review and quality-assurance cycles across tasks, rubrics, and outputs
• Maintain consistency before materials are incorporated into formal evaluation benchmarks
• Review the work of other contributors when required
• Collaborate with project leads to resolve unclear instructions and improve task design
• Apply feedback and calibration standards consistently across assignments

Benefits

• Competitive compensation of up to $45 per hour depending on expertise and project scope
• Flexible scheduling
• Weekly payments via Stripe or Wise

What This Job Offers

• Job Type: Part-time
• Career Level: Entry Level
• Education Level: No Education Listed