AI Trainer- Coding

Aston Carter•Tampa, FL
•$45,000 - $60,000•Remote

About The Position

The Software Engineering Evaluator / Code Quality Specialist assesses and improves the quality of AI-generated software development work. The role applies engineering expertise to create realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on correctness, code quality, and technical execution. It is suited to software engineers who enjoy code review, technical problem-solving, and applying engineering judgment to promote production-ready outcomes. The position is permanent and fully remote, based out of Tampa, Florida. It is described as an independent contractor role paid through PayPal, with no benefits offered. The stated annual pay range is $45,000–$60,000. Individual compensation depends on qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other job-related factors.

Requirements

  • Experience developing, testing, and maintaining software applications or systems.
  • Proficiency in at least one modern programming language, such as Python, JavaScript/TypeScript, Java, Go, C++, C#, Ruby, PHP, Swift, Kotlin, or Rust.
  • Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
  • Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
  • Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.
  • Excellent written communication skills and the ability to explain technical findings clearly and objectively.
  • Professional-level English proficiency.

Nice To Haves

  • Two or more years of software development experience in a professional, academic, freelance, or open-source setting.
  • Familiarity with containerization, CI/CD pipelines, and modern development workflows.
  • Experience using AI-powered coding assistants or large language model tools such as ChatGPT, Claude, or GitHub Copilot.
  • A completed or in-progress bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.

Responsibilities

  • Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
  • Evaluate AI-generated code solutions against professional standards for correctness, maintainability, performance, and reliability.
  • Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.
  • Develop test plans, evaluation rubrics, and success criteria covering expected functionality, coding standards, and edge-case handling.
  • Review code changes, implementation decisions, automated tests, and design approaches for technical quality and adherence to requirements.
  • Identify and document missed edge cases, incorrect or incomplete implementations, fragile code changes, ineffective testing strategies, requirements misinterpretation, unsupported assumptions, and fabricated outputs.
  • Collaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.
  • Contribute technical expertise across a variety of technologies, platforms, and software development environments.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service