AI Trainer- Coding

Aston Carter•New York, NY
•$45,000 - $60,000•Remote

About The Position

The Software Engineering Evaluator / Code Quality Specialist assesses and improves the quality of AI-generated software development work. The role applies engineering expertise to design realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on code quality, correctness, and technical execution. It is suited to software engineers who enjoy code review, technical problem-solving, and applying engineering judgment to promote high-quality, production-ready outcomes. The position is permanent and fully remote, based out of New York, NY. The listed pay range is $45,000–$60,000 per year. Individual compensation depends on qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other job-related factors. The posting also states that the worker is an independent contractor paid through PayPal and that no benefits are offered.

Requirements

  • Experience developing, testing, and maintaining software applications or systems.
  • Proficiency in at least one modern programming language, such as Python, JavaScript or TypeScript, Java, Go, C++, C#, Ruby, PHP, Swift, Kotlin, or Rust.
  • Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
  • Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
  • Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.
  • Excellent written communication skills and ability to explain technical findings clearly and objectively.
  • Professional-level English proficiency.

Nice To Haves

  • Two or more years of software development experience in a professional, academic, freelance, or open-source setting.
  • Familiarity with containerization, CI/CD pipelines, and modern development workflows.
  • Experience using AI-powered coding assistants or large language model tools such as ChatGPT, Claude, or GitHub Copilot.
  • Bachelor's degree, completed or in progress, in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.

Responsibilities

  • Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
  • Evaluate AI-generated code against professional standards for correctness, maintainability, performance, and reliability.
  • Compare outputs from different AI systems under identical requirements and environments, documenting relative strengths and areas for improvement.
  • Develop test plans, evaluation rubrics, and success criteria covering expected functionality, coding standards, and edge-case handling.
  • Review code changes, implementation decisions, automated tests, and design approaches for technical quality and adherence to requirements.
  • Identify and document missed edge cases, incorrect or incomplete implementations, fragile code changes, ineffective testing strategies, misinterpreted requirements, unsupported assumptions, and fabricated outputs.
  • Collaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.
  • Contribute technical expertise across a variety of technologies, platforms, and software development environments.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service