Turing is hiring a remote Full Stack Engineer as a Software Engineering evaluator. The role involves creating datasets to train, benchmark, and advance large language models in collaboration with researchers. Work includes curating code examples, providing solutions, correcting code, and evaluating AI-generated code for efficiency, scalability, and reliability. The primary focus is Python across backend services, data pipelines, and ML infrastructure, with additional work in JavaScript (including ReactJS), C/C++, Java, Rust, and Go. The engineer will collaborate with cross-functional teams to improve enterprise-level AI-driven coding solutions. Typical work includes building Python agents and automated verification tools to assess code quality and identify error patterns; evaluating model capabilities across stages of the software engineering cycle; and designing mechanisms that automatically verify solutions to software engineering tasks. This is a flexible contractor engagement requiring at least 10 hours per week and allowing up to 40 hours per week. The initial duration is one month, with possible extensions based on performance and fit. Candidates must be based in the United States. The application process takes 15–30 minutes and requires completion of an AI video interview. The engagement does not include medical or paid leave.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Mid Level
Education Level
No Education Listed