JavaScript Engineer

Turing

1d • Remote

About The Position

Turing is building LLM evaluation and training datasets based on realistic software engineering problems. This project creates verifiable software engineering tasks from public repository histories using a synthetic approach with human involvement, while expanding coverage across programming languages and difficulty levels.

The role is for experienced software engineers at a tech-lead level who are familiar with high-quality public GitHub repositories. It involves hands-on engineering, including development environment automation, issue triage, and evaluation of test coverage and quality. The engineer will assess how LLMs handle real code and collaborate with researchers on tasks that challenge LLMs. There may also be opportunities to lead junior engineers.

This is a fully remote contractor assignment. Commitment options are 20, 30, or 40 hours per week; the minimum is 20 hours weekly and at least four hours per day, with four hours of overlap with PST. The assignment does not include medical or paid leave.

Requirements

• At least 3 years of overall experience.
• Strong experience with JavaScript and/or TypeScript.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfort running, modifying, and testing real-world projects locally.

Nice To Haves

• Experience contributing to or evaluating open-source projects.
• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Responsibilities

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and development environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
• Potentially lead a team of junior engineers working on projects.

Benefits

• Fully remote work environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed