About The Position

We're hiring a Code Reviewer with deep C/C++ expertise to review evaluations completed by data annotators assessing AI-generated C/C++ code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Requirements

  • 5–7+ years of experience in C/C++ development, QA, or code review.
  • Strong knowledge of C/C++ syntax, memory management, debugging, edge cases, and testing.
  • Experience with build systems (Make, CMake, etc.) and testing frameworks.
  • Comfortable using code execution environments and debugging tools.
  • Excellent written communication and documentation skills.
  • Experience working with structured QA or annotation workflows.
  • English proficiency at B2, C1, C2, or Native level.

Nice To Haves

  • Experience in AI training, LLM evaluation, or model alignment.
  • Familiarity with annotation platforms.
  • Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.
  • Background in security-sensitive code review or vulnerability assessment.

Responsibilities

  • Review and audit annotator evaluations of AI-generated C/C++ code.
  • Assess if the C/C++ code follows the prompt instructions, is functionally correct, and secure.
  • Validate code snippets using proof-of-work methodology.
  • Identify inaccuracies in annotator ratings or explanations.
  • Provide constructive feedback to maintain high annotation standards.
  • Work within Project Atlas guidelines for evaluation integrity and consistency.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service