Remote | AI Research & Evaluation Specialist (MacBook Required) — $45–$55/hour

24-Mag • New York, NY

5d • Remote

About The Position

This is a part-time consulting opportunity for detail-oriented professionals and postgraduate students with strong research, reasoning, communication, and information-synthesis skills. The role supports an advanced AI research initiative focused on benchmarking and improving cutting-edge language models. Selected professionals will create high-quality research questions, develop accurate reference answers, review information from multiple sources, and prepare structured evaluation materials used to assess and improve AI systems.

Requirements

• Approximately 2–3 years of relevant professional experience in a STEM, non-STEM, research, analytical, or related field
• Current or recently completed master's-level studies
• Alternatively, a bachelor's degree combined with relevant professional experience
• Strong online research and information-synthesis skills
• Excellent written communication and analytical reasoning
• Ability to gather information from diverse sources and summarise it clearly
• Strong attention to detail and comfort working independently
• Availability to contribute approximately 10–20 hours per week
• Access to a compatible MacBook throughout the project
• A MacBook with an Apple Silicon M-series processor is required
• Compatible devices include M-series MacBook Pro and MacBook Air models
• The device must support the project's required macOS environment, including macOS 15 or higher where applicable
• A desktop or non-Apple device cannot substitute for the required MacBook setup

Nice To Haves

• An interdisciplinary academic or professional background
• Previous research-assistant, analyst, data, or evaluation experience
• Familiarity with AI tools and large language models
• Experience developing research questions, reference answers, or structured assessment materials
• Background in fact-checking, content review, quality assurance, or data annotation
• Experience working independently on research-intensive projects

Responsibilities

• Conduct structured online research across a variety of STEM and non-STEM topics
• Gather relevant information from multiple sources and synthesise findings clearly
• Evaluate source quality, relevance, and consistency
• Identify gaps, contradictions, and important contextual details within research materials
• Create high-quality research questions designed to test advanced AI systems
• Develop accurate, well-supported reference answers
• Structure questions and solutions so they can be evaluated consistently
• Apply strong reasoning and written communication across interdisciplinary subject areas
• Develop structured materials used to benchmark and assess language-model performance
• Review AI-generated responses for accuracy, reasoning quality, completeness, and clarity
• Identify subtle errors, omissions, and unsupported conclusions
• Provide clear written feedback that supports model improvement
• Follow project instructions and evaluation criteria carefully
• Maintain strong accuracy across independent research and review tasks
• Manage assignments within a flexible asynchronous workflow
• Incorporate feedback and project guidance into subsequent work

Benefits

• Flexible scheduling
• Competitive rates between $45–$55 per hour depending on experience and project scope
• Weekly payments via Stripe or Wise

What This Job Offers

• Job Type: Part-time
• Career Level: Mid Level
• Education Level: Associate degree