Remote | Legal Research Expert (AI Benchmarking) — $70–$95/hour

24-Mag • New York, NY

2d • Remote

About The Position

We are sharing a specialised part-time consulting opportunity for legal professionals and academic experts with advanced expertise in legal reasoning, statutory interpretation, regulatory analysis, and complex commercial or public-law domains. This role supports an AI research initiative focused on developing rigorous legal benchmarks. Selected experts will author or verify challenging multiple-choice assessment content, evaluate legal accuracy and reasoning quality, develop authoritative reference solutions, and help establish high-quality evaluation standards for advanced AI systems.

Requirements

• JD, LLM, SJD, or doctoral-level training in Law or a closely related discipline
• Master's-level candidates may be considered where they demonstrate exceptional depth in a relevant legal subdomain
• Strong command of legal reasoning, statutory interpretation, and jurisprudential analysis
• Expertise in one or more areas including Intellectual Property, Privacy, Technology Law, Regulatory Affairs, Securities, Capital Markets, Financial Regulation, Private Equity, M&A, Antitrust, Healthcare, Life Sciences, Environmental Law, Energy Law, or ESG
• Excellent written English and ability to communicate complex legal concepts clearly and precisely
• Legal academic research or publication experience is highly valued
• Experience with bar examination writing, legal assessment development, or judicial clerkships is advantageous
• Strong attention to legal accuracy, ambiguity, citation quality, and analytical rigour

Responsibilities

• Create original multiple-choice questions that test substantive legal reasoning rather than surface-level recall
• Develop challenging problems within relevant areas of legal expertise
• Ensure questions are self-contained, precise, unambiguous, and independently solvable
• Design questions appropriate for undergraduate, advanced undergraduate, and postgraduate difficulty levels
• Produce one correct answer alongside nine plausible and carefully constructed distractors
• Review pre-written legal questions for accuracy, clarity, rigour, and completeness
• Identify ambiguity, incorrect legal assumptions, unsupported conclusions, or solvability issues
• Edit questions and answer choices where required
• Verify that designated correct answers are legally defensible under the stated facts and applicable framework
• Document substantive changes and explain the reasoning behind them
• Develop structured solution explanations supporting the correct answer
• Apply statutory interpretation, case-law analysis, regulatory reasoning, and jurisprudential principles where relevant
• Explain why alternative answers are legally weaker or incorrect
• Ensure reasoning is concise, technically precise, and suitable for expert review
• Translate complex legal concepts into clear assessment material
• Develop or review content involving securities, capital markets, financial regulation, and compliance
• Create problems involving private equity, M&A, transaction structuring, and corporate transactions
• Apply expertise in antitrust, merger control, and competition law
• Evaluate legal and regulatory considerations affecting sophisticated commercial transactions
• Design questions requiring careful interpretation of regulatory frameworks and transactional structures
• Develop assessment content involving intellectual property, technology law, and privacy
• Evaluate legal questions involving digital platforms, data governance, and emerging technologies
• Apply relevant statutory, regulatory, and doctrinal frameworks
• Create problems involving competing rights, obligations, and compliance requirements
• Ensure technology-related content reflects current legal reasoning and established authorities
• Develop content involving regulatory and government affairs
• Create questions covering healthcare, life sciences, and pharmaceutical regulation
• Apply expertise in environmental, energy, ESG, and climate-related legal frameworks
• Evaluate complex interactions between regulation, commercial activity, and public policy
• Develop domain-specific questions requiring advanced legal judgement
• Provide 1–5 authoritative legal or academic references per question where required
• Use reputable sources such as legal repositories, statutes, judicial decisions, peer-reviewed publications, and academic institutions
• Rate question difficulty according to defined Medium, Hard, and Expert standards
• Help maintain consistent legal and academic quality across benchmark content
• Contribute to gold-standard evaluation materials used to assess advanced AI capabilities

Benefits

• Part-time independent contractor engagement
• Fully remote and asynchronous
• Expected availability of at least 10 hours per week
• Flexible scheduling based on project requirements
• Compensation: $70–$95/hour
• Contributors may be assigned either question-authoring or question-verification workstreams
• Projects may be extended, shortened, or concluded based on project needs and performance
• Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
• H1-B and STEM OPT support is unavailable for this engagement

What This Job Offers

• Job Type: Part-time
• Career Level: Entry Level