About The Position

Turing is seeking experienced, tech-lead-level software engineers familiar with high-quality public GitHub repositories to contribute to projects that build LLM evaluation and training datasets. The project creates verifiable software engineering tasks from public repository histories using a synthetic approach with human involvement, while expanding coverage across programming languages and difficulty levels. The role involves hands-on software engineering, including development environment automation, issue triage, and evaluation of test coverage and quality. Engineers will work with trending open-source libraries, run and modify real codebases to assess LLM performance in bug-fixing scenarios, and collaborate with researchers to identify challenging repositories and issues. There may also be opportunities to lead junior engineers. This is a fully remote contractor assignment supporting AI research and evaluation. The required commitment is at least 4 hours per day and 20 hours per week, with 4 hours of overlap with PST. Available commitment options are 20, 30, or 40 hours per week. The assignment does not include medical or paid leave.

Requirements

  • At least 3 years of overall experience.
  • Strong experience in JavaScript and/or TypeScript.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfort running, modifying, and testing real-world projects locally.

Nice To Haves

  • Experience contributing to or evaluating open-source projects.
  • Previous participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and development environment setup.
  • Evaluate unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
  • Potentially lead a team of junior engineers collaborating on projects.

Benefits

  • Fully remote work environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service