Python/Typescript Engineer

Turing • San Francisco, CA

2d • Remote

About The Position

Turing is seeking a high-taste engineer with strong quality judgment and hands-on experience with preference data and rubric creation. The role involves designing and refining evaluation criteria, reviewing and labeling data, and building and maintaining infrastructure for data-generation, collection, and evaluation workflows. The engineer will synthesize findings into clear, actionable updates and collaborate with researchers and engineers to turn qualitative judgment into scalable processes.

The work is fully remote and supports cutting-edge AI projects with leading LLM companies. The engagement is an independent contractor role lasting three months, with an expected start as soon as possible. Compensation is market rate; applicants are asked to provide a specific rate expectation. Availability of 40 hours per week is preferred, with at least six hours of overlap with Pacific Time. Candidates unable to commit to 40 hours should share their availability and overlap window. The evaluation process is approximately 30 minutes and consists of one technical and cultural discussion.

Requirements

• Proficiency in Python, especially building and maintaining pipelines and infrastructure, or proficiency in TypeScript.
• Hands-on experience with preference data collection and/or rubric creation.
• Strong written and verbal communication skills, including the ability to distill technical work into clear, actionable summaries.
• Demonstrated high-taste judgment and the ability to articulate why something is good.

Nice To Haves

• Experience contributing to or navigating large codebases such as VSCode.
• Availability for 40 hours per week, with a minimum six-hour overlap with Pacific Time.

Responsibilities

• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label data to a high quality standard, identifying subtle issues.
• Build and maintain pipelines and infrastructure supporting data-generation, collection, and evaluation workflows.
• Synthesize findings from data work into clear write-ups, updates, or recommendations.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable processes.

What This Job Offers

• Education Level: No Education Listed