Python Developer

Turing • Austin, TX

3d

About The Position

Turing is hiring a Python Developer to work as a Software Engineering evaluator, creating datasets that train, benchmark, and advance large language models. The role involves collaborating closely with researchers to curate code examples, provide precise solutions, and correct code, primarily in Python across backend services, data pipelines, and machine-learning infrastructure, with additional work in JavaScript (including ReactJS), C/C++, Java, Rust, and Go.

The developer will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and collaborate with cross-functional teams to improve enterprise-level AI-driven coding solutions. The work also includes building Python agents and automated verification tools, assessing model capabilities across stages of the software engineering cycle, and designing mechanisms to automatically verify solutions to software engineering tasks.

This is a flexible contractor engagement for candidates based in the United States. The commitment is 10 to 40 hours per week, with an initial duration of one month and possible extensions based on performance and fit. The engagement does not include medical benefits or paid leave. Applicants must complete an AI video interview.

Requirements

• At least 3 years of software engineering experience.
• Strong Python expertise, including deep knowledge of frameworks, tooling, and best practices for building production-grade software.
• Experience building full-stack applications and deploying scalable software using modern languages and tools.
• Deep understanding of software architecture, design, development, debugging, and code quality and review assessment.
• Excellent oral and written communication skills for producing clear, structured evaluation rationales.
• Must be based in the United States.
• Must complete an AI video interview.

Nice To Haves

• Experience building production systems at Google, Microsoft, Apple, Amazon, Meta, or similar high-scale engineering organizations.
• Graduation from a top computer science program such as Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, or a comparable institution; exceptional experience and skill take precedence over pedigree.

Responsibilities

• Curate code examples, build solutions, and correct code for AI model training initiatives, primarily in Python and also in JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
• Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability.
• Collaborate with cross-functional teams to improve AI-driven coding solutions against industry performance benchmarks.
• Build Python agents and automated verification tools to assess code quality and identify error patterns.
• Hypothesize and evaluate model capabilities across software engineering stages, including prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, and operational maintenance.
• Design verification mechanisms that can automatically verify solutions to software engineering tasks.

What This Job Offers

• Career Level: Mid Level
• Education Level: No Education Listed