About The Position
Turing is hiring a Backend Engineer to work as a Software Engineering evaluator on AI model training initiatives. The role involves creating datasets to train, benchmark, and advance large language models in close collaboration with researchers. The evaluator will curate code examples, provide precise solutions, and correct code across backend and frontend applications, primarily using Python and JavaScript (React and Node.js), with additional work in C/C++, Java, Rust, and Go. The role also involves evaluating and refining AI-generated code for efficiency, scalability, and reliability; collaborating with cross-functional teams to improve enterprise AI coding solutions; building agents to verify code quality and identify error patterns; and assessing model capabilities across stages of the software engineering lifecycle. The engagement is for candidates based in the United States, with a flexible commitment of 10 to 40 hours per week. It is a one-month contractor engagement, with potential extensions based on performance and fit.
Requirements
- At least 3 years of software engineering experience.
- Strong expertise building full-stack applications using Python and JavaScript, including React and Node.js, and the ability to work across backend and frontend codebases.
- Experience deploying scalable, production-grade software using modern languages and tools.
- Deep understanding of software architecture, design, development, debugging, and code quality and review assessment.
- Excellent oral and written communication skills for clear, structured evaluation rationales.
- Must be based in the United States.
Nice To Haves
- Experience building production systems at high-scale engineering organizations such as Google, Microsoft, Apple, Amazon, Meta, or similar companies.
- Graduation from a leading program such as Harvard, Columbia, Princeton, Yale, or the University of Pennsylvania, or a comparable institution; exceptional experience and skill take precedence over pedigree.
Responsibilities
- Curate code examples, build solutions, and correct code for AI model training initiatives.
- Evaluate and refine AI-generated code across backend and frontend contexts for efficiency, scalability, and reliability.
- Collaborate with cross-functional teams to improve AI-driven coding solutions against industry performance benchmarks.
- Build agents that verify code quality and identify error patterns across full-stack applications.
- Evaluate model capabilities across software engineering activities, including prototyping, architecture and API design, production implementation, launch, experimentation, monitoring, and operational maintenance.
- Design verification mechanisms that can automatically verify solutions to software engineering tasks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Career Level
Mid Level
Education Level
No Education Listed
