AI Trainer (SWE) | Remote - Contract

Xperteez Technology•,
•$60 - $120•Remote

About The Position

This fully remote contractor role supports a project focused on improving advanced AI systems. The AI Trainer uses software engineering expertise to create challenging technical tasks, evaluate model-generated code, identify failures, and establish objective standards for correct solutions. The role is intended for candidates with prior substantive AI-training or model-evaluation experience. The time commitment is 15+ hours per week, with a flexible schedule. Compensation is output-based: experts are paid for tasks that meet project specifications and quality requirements; task availability and completion time may vary.

Requirements

  • Prior paid experience training, evaluating, benchmarking, or improving AI systems.
  • Strong practical proficiency with Python.
  • Professional experience with at least one additional programming language, such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
  • Strong knowledge of software design, debugging, testing, version control, and dependency management.
  • Strong applicants should provide public evidence of skill, such as substantial GitHub or GitLab repositories, meaningful open-source contributions, maintainer or core-contributor responsibilities, programming-competition results, public developer tools or technical projects, or technical publications, benchmarks, or engineering write-ups.

Nice To Haves

  • Experience creating AI-training tasks, reference solutions, tests, graders, or benchmark problems.
  • Experience reviewing other AI trainers’ technical submissions.
  • Codeforces rating of approximately 1900 or higher, or strong results in another programming competition.
  • Experience with Linux, Docker, CI/CD, command-line tools, or sandboxed environments.
  • Prior experience with long-horizon or agentic coding evaluations.
  • Availability to begin immediately.

Responsibilities

  • Create realistic software engineering tasks that challenge advanced AI models.
  • Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
  • Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
  • Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service