Remote | Corporate Counsel (UK) — $145–$155/hour
24-Mag•New York, NY
•Remote
About The Position
This is a specialized part-time consulting opportunity for experienced in-house legal professionals with at least five years of experience practicing in the United Kingdom and strong expertise in UK commercial and contract law. This role supports a legal AI evaluation initiative focused on assessing how accurately advanced AI systems answer real-world questions involving UK law. Selected professionals will compare responses generated by two AI platforms, score them against a standardized rubric, and provide concise written feedback grounded in professional legal judgment.
Requirements
- At least 5 years of professional experience as in-house legal counsel practicing in the United Kingdom
- Strong command of UK law
- Substantial experience with commercial and contract matters
- Experience advising businesses on practical legal issues
- Strong ability to evaluate complex legal reasoning
- Excellent written English and attention to detail
- Ability to work independently using structured evaluation criteria
- Strong professional judgment and consistency when reviewing legal work
- A legal degree or equivalent professional legal qualification is highly relevant
- Professional qualifications appropriate to legal practice in the United Kingdom may strengthen an application
- Substantial professional experience involving UK commercial and contract law is particularly important for this engagement
Nice To Haves
- Experience reviewing legal research or analysis produced by other professionals
- Background advising multinational or complex commercial organizations
- Experience with technology, software, or AI-related legal matters
- Familiarity with legal research or legal technology platforms
- Prior experience with rubric-based legal review or structured evaluation
- Experience evaluating AI-generated legal content
Responsibilities
- Review AI-generated responses to realistic questions involving UK law
- Assess legal accuracy, completeness, reasoning quality, and practical relevance
- Apply experienced in-house counsel judgment to commercial and contractual matters
- Identify incorrect legal conclusions, missing considerations, and unsupported reasoning
- Evaluate whether responses appropriately reflect UK legal practice
- Run identical legal prompts across two AI platforms
- Compare responses side by side using consistent evaluation criteria
- Identify meaningful differences in legal reasoning, accuracy, and usefulness
- Determine which response more effectively addresses the underlying legal question
- Flag errors or omissions that could materially affect legal decision-making
- Score each response against a provided standardized rubric
- Apply evaluation criteria consistently across assignments
- Distinguish substantive legal weaknesses from minor presentation issues
- Ensure scores reflect both legal accuracy and practical usefulness
- Maintain rigorous and defensible evaluation standards
- Provide concise written justification for each evaluation
- Explain significant legal errors, omissions, or reasoning weaknesses clearly
- Document relevant differences between competing AI responses
- Communicate findings precisely in written English
- Complete assigned evaluations according to project deadlines
Benefits
- Competitive hourly compensation
- Potential for additional work following the initial project scope
- Weekly payments via Stripe or Wise
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Part-time
Career Level
Senior
Education Level
Associate degree
