Weekday is recruiting for a client seeking PhD-level subject matter experts for a paid machine learning model evaluation project. Experts will assess the quality, accuracy, and reliability of AI-generated responses to research-focused prompts and domain-specific questions, helping identify where models perform effectively and where their outputs need refinement. The role is suited to experienced researchers, academics, data analysts, technical writers, and domain specialists who can critically assess complex information, identify factual inaccuracies, and provide structured, evidence-based feedback. The engagement is an independent contractor project expected to involve approximately five hours of evaluation work. It is fully remote, flexible, and asynchronous. Payment is $150 per hour and is processed weekly based on services rendered. The engagement may be extended, shortened, or concluded early depending on project requirements and individual performance. The posting notes that candidates should be able to start by Friday at end of day, but does not specify a calendar date. Applicants must be based in the US, UK, Canada, the EU, Norway, Switzerland, or Iceland, and should have a finished or ongoing paper in a topic associated with NeurIPS, ICML, ICLR, COLM, or RLC. H-1B and STEM OPT candidates cannot be supported. Participation does not require access to confidential or proprietary information belonging to a current or former employer, client, or academic institution. During interviews, candidates may be assessed on their review practices, critical thinking, and ability to improve evaluation quality. The posting identifies three habits for discussion: exchanging unfinished review notes with another reviewer, maintaining a separate log of opinions or assessments that change during the review process, and using review notes and feedback to update personal reading lists.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Career Level
Senior
Education Level
Ph.D. or professional degree