Turing is hiring a remote Software Engineering evaluator to create datasets for training, benchmarking, and advancing large language models in collaboration with researchers. The work involves curating code examples, providing solutions, correcting code primarily in C/C++, and working with Python, JavaScript (including ReactJS), Java, Rust, and Go. The evaluator will assess and refine AI-generated code for efficiency, scalability, and reliability, and collaborate with cross-functional teams to improve enterprise AI-driven coding solutions against industry performance benchmarks. The role also includes building agents that verify code quality and identify error patterns; hypothesizing about software engineering lifecycle steps and evaluating model capabilities across them; and designing mechanisms to automatically verify solutions to software engineering tasks. Engagement is flexible, with a minimum commitment of 10 hours per week and a maximum of 40 hours per week. The contractor engagement is for one month, with potential extensions based on performance and fit. Candidates must be based in the US, Canada, or the listed Western European countries. The application takes 15–30 minutes and requires an AI video interview.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Mid Level
Education Level
No Education Listed