Turing is seeking a Software Engineering evaluator to create datasets for training, benchmarking, and advancing large language models in collaboration with researchers. The work includes curating code examples, providing solutions, correcting code, and evaluating AI-generated code for efficiency, scalability, and reliability. The role also supports cross-functional teams developing enterprise-level AI-driven coding solutions. Typical work includes contributing to AI model training initiatives; building agents to verify code quality and identify error patterns; hypothesizing about and evaluating model capabilities across software engineering stages such as prototyping, architecture and API design, production implementation, launch, experimentation, monitoring, and operational maintenance; and designing mechanisms to automatically verify solutions to software engineering tasks. This is a flexible contractor engagement requiring at least 10 hours per week and up to 40 hours per week, with partial overlap with Pacific Time required. The initial duration is one month, starting next week, with potential extensions based on performance and fit. Candidates must be based in the US, Canada, or specified Western European countries (UK, Netherlands, Italy, or Germany). The engagement does not include medical benefits or paid leave. Applicants will complete an AI video interview and, after applying, receive a link to access a portal and complete their profile.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Mid Level
Education Level
No Education Listed