Copy of Welsh-Speaking JSON & Coding Experts for Audio Evaluations
About The Position
An Enterprise client is seeking Welsh-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format. Work is expected to begin right away, and continue for 2-3 months, with the potential for additional work beyond this initial project. Experts may work at any schedule of their choosing, for as long as tasks are available. Experts (Operators) will review a mix of customer service-style responses and technical content, with a strong focus on coding knowledge, JSON structure, formatting accuracy, and overall response quality. Experts should be comfortable identifying whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines. Fluency in Welsh, as spoken in the United Kingdom, is required. Experts with multilingual fluency may be offered work for this project and/or others, in additional languages.
Requirements
- Pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency)
- C1/C2-level fluency (CEFR) in Welsh, verified through a speaking/listening assessment
- JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues
- Capable of producing clear audio quality with no background noise
Nice To Haves
- Strong attention to detail
- Strong written communication skills
- Ability to evaluate both the customer experience and the technical correctness of a response
- Multilingual fluency
Responsibilities
- Participating in live, real-time conversational scenarios with AI systems
- Reviewing and labeling conversation transcripts
- Evaluating AI-generated responses using structured rubrics and providing written justifications
- Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
- Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs
- Environment preparation and tool verification before each session
- Speaking naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses to evaluate natural voice cadence.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Part-time
Career Level
Entry Level
Education Level
No Education Listed
