Remote | Corporate Counsel (Germany) — $135–$145/hour
24-Mag•New York, NY
•Remote
About The Position
This is a specialized part-time consulting opportunity for experienced in-house legal professionals practicing in Germany with strong expertise in German commercial and contract law. This role supports a legal AI evaluation initiative focused on assessing how accurately advanced AI systems answer real-world questions involving German law. Selected professionals will run identical legal prompts across two AI platforms, compare their responses side by side, score each answer using a standardized rubric, and provide concise written feedback grounded in professional legal judgment.
Requirements
- At least 5 years of professional experience as in-house legal counsel practicing in Germany
- Strong knowledge of German law
- Substantial experience with commercial and contract matters
- Experience advising businesses on practical legal issues
- Strong ability to evaluate complex legal reasoning
- Excellent written communication and attention to detail
- Ability to work independently according to structured evaluation criteria
- Current professional experience or substantial recent experience in the German legal environment
- A legal degree or equivalent professional legal qualification is highly relevant
- Professional qualification appropriate to legal practice in Germany may strengthen an application
- Substantial in-house legal experience involving German commercial and contract law is particularly important for this engagement
Nice To Haves
- Experience reviewing or comparing legal research produced by other professionals
- Background advising multinational or complex commercial organizations
- Experience with technology, software, or AI-related legal matters
- Familiarity with legal research or legal technology platforms
- Prior experience with structured legal evaluation, benchmarking, or rubric-based review
- Experience evaluating AI-generated legal content
Responsibilities
- Review AI-generated answers to realistic questions involving German law
- Assess legal accuracy, completeness, reasoning quality, and practical relevance
- Apply professional in-house counsel judgment to commercial and contractual matters
- Identify incorrect legal conclusions, missing considerations, or unsupported reasoning
- Evaluate whether responses appropriately reflect German legal practice
- Run identical prompts across two AI platforms
- Compare outputs side by side using consistent evaluation criteria
- Identify meaningful differences in legal reasoning, accuracy, and usefulness
- Determine which response provides stronger support for the relevant legal question
- Flag errors or omissions that could materially affect legal decision-making
- Score each response against a provided standardized rubric
- Apply evaluation criteria consistently across assignments
- Distinguish substantive legal weaknesses from minor presentation issues
- Ensure scoring reflects both doctrinal accuracy and practical legal usefulness
- Work independently while maintaining consistent evaluation standards
- Provide concise written justification for each evaluation
- Explain significant legal errors, omissions, or reasoning weaknesses clearly
- Document why one response performs better where relevant
- Communicate findings precisely and efficiently
- Meet agreed project deadlines and quality requirements
Benefits
- Competitive hourly compensation
- Potential for additional work following the initial project scope
- Weekly payments via Stripe or Wise
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Part-time
Career Level
Senior
Education Level
Associate degree
