As a Software Engineering evaluator, you will create datasets to train and benchmark large language models and advance their capabilities, working closely with researchers. You will curate code examples, provide solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and collaborate with cross-functional teams to improve enterprise-level AI-driven coding solutions. The role also involves building agents that verify code quality and identify error patterns; assessing model capabilities across software engineering activities such as prototyping, architecture and API design, production implementation, launch, experimentation, monitoring, and operational maintenance; and designing mechanisms to automatically verify solutions to software engineering tasks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed