About The Position

Turing is building LLM evaluation and training datasets based on realistic software engineering problems. This project creates verifiable software engineering tasks from public repository histories using a synthetic approach with human involvement, while expanding coverage across programming languages and difficulty levels. The role is for experienced, tech-lead-level software engineers familiar with high-quality public GitHub repositories. It involves hands-on software engineering, including development environment automation, issue triaging, and evaluation of test coverage and quality. The engineer will assess how LLMs handle real code and bug-fixing scenarios, and may have opportunities to lead junior engineers. This is a fully remote contractor assignment involving a commitment of at least 20 hours per week, with four hours of overlap with Pacific Time.

Requirements

  • At least 3 years of overall experience.
  • Strong experience in JavaScript or TypeScript.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfort running, modifying, and testing real-world projects locally.
  • Commitment of at least 20 hours per week, with at least 4 hours per day and 4 hours of overlap with Pacific Time.

Nice To Haves

  • Experience contributing to or evaluating open-source projects.
  • Previous participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Responsibilities

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and development environment setup.
  • Evaluate unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to design and identify repositories and issues that challenge LLMs.
  • Potentially lead a team of junior engineers working on projects.

Benefits

  • Opportunity to work on cutting-edge AI projects with leading LLM companies.
  • Fully remote work environment.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service