Remote | Corporate Counsel (Japan) — $135–$145/hour
24-Mag•New York, NY
•Remote
About The Position
We are sharing a specialised consulting opportunity for experienced in-house legal professionals practising in Japan with strong expertise in Japanese commercial and contract law. This role supports a legal AI evaluation initiative focused on assessing how accurately advanced AI systems answer real-world questions involving Japanese law. Selected professionals will run identical legal prompts across two AI platforms, compare their responses side by side, score each answer using a standardised rubric, and provide concise written feedback grounded in professional legal judgment.
Requirements
- At least 5 years of professional experience as in-house legal counsel practising in Japan
- Strong knowledge of Japanese law
- Substantial experience with commercial and contract matters
- Experience advising businesses on practical legal issues
- Strong ability to evaluate complex legal reasoning
- Excellent written communication and attention to detail
- Ability to work independently according to structured evaluation criteria
- Current professional experience or substantial recent experience in the Japanese legal environment
- A legal degree or equivalent professional legal qualification is highly relevant
- Professional qualification appropriate to the candidate's legal practice may strengthen an application
- Substantial in-house legal experience involving Japanese commercial and contract law is particularly important for this engagement
Nice To Haves
- Experience reviewing or comparing legal research produced by other professionals
- Background advising multinational or complex commercial organisations
- Experience with technology, software, or AI-related legal matters
- Familiarity with legal research or legal technology platforms
- Prior experience with structured legal evaluation, benchmarking, or rubric-based review
- Experience evaluating AI-generated legal content
Responsibilities
- Review AI-generated answers to realistic questions involving Japanese law
- Assess legal accuracy, completeness, reasoning quality, and practical relevance
- Apply professional in-house counsel judgment to commercial and contractual matters
- Identify incorrect legal conclusions, missing considerations, or unsupported reasoning
- Evaluate whether responses appropriately reflect Japanese legal practice
- Run identical prompts across two AI platforms
- Compare outputs side by side using consistent evaluation criteria
- Identify meaningful differences in legal reasoning, accuracy, and usefulness
- Determine which response provides stronger support for the relevant legal question
- Flag errors or omissions that could materially affect legal decision-making
- Score each response against a provided standardised rubric
- Apply evaluation criteria consistently across assignments
- Distinguish substantive legal weaknesses from minor presentation issues
- Ensure scoring reflects both doctrinal accuracy and practical legal usefulness
- Work independently while maintaining consistent evaluation standards
- Provide concise written justification for each evaluation
- Explain significant legal errors, omissions, or reasoning weaknesses clearly
- Document why one response performs better where relevant
- Communicate findings precisely and efficiently
- Meet agreed project deadlines and quality requirements
Benefits
- Competitive hourly compensation
- Potential for additional work following the initial project scope
- Weekly payments via Stripe or Wise
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Career Level
Senior
Education Level
No Education Listed
