Legal Expert
$105 / hr
$105
Location: Geography restricted to USA, EU, UK, Canada Type: Full-time or Part-time Contract Work Fluent Language Skills Required: English
Why This Role Exists
Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
In legal contexts, precision, clarity, and correct reasoning are critical. This project focuses on evaluating and improving conversational AI behavior when responding to legal questions, explanations, and analyses. Your expertise helps ensure model responses reflect accurate legal understanding, appropriate reasoning, and responsible communication aligned with real-world legal practice.
What You’ll Do
-
Write and refine prompts to guide model behavior in legal use cases
-
Evaluate LLM-generated responses to legal queries for accuracy, reasoning, clarity, and completeness
-
Conduct fact-checking using trusted public sources and authoritative references
-
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
-
Assess tone, completeness, and appropriateness of responses for real-world legal scenarios
-
Ensure model responses align with expected conversational behavior and system guidelines
-
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Who You Are
-
You have a minimum of 5 years of real-world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent)
-
You have experience in one or more of the following sub-domains:
-
Corporate, Business & Commercial Law
-
Employment, Labor & Human Rights
-
Public, Criminal & International Governance
-
Private Law
-
-
You have significant experience using large language models (LLMs) and understand how and why people use them
-
You have excellent writing skills and can clearly explain complex legal concepts
-
You are comfortable evaluating complex arguments and identifying subtle reasoning or detail-level issues that others may overlook.
Nice-to-Have Specialties
-
Prior experience with RLHF, model evaluation, or data annotation work
-
Experience writing or editing high-quality legal or analytical content
-
Experience translating legal concepts for non-legal audiences
-
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
What Success Looks Like
-
You uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs
-
Your evaluations improve the reliability and clarity of legal AI responses
-
You deliver structured, reproducible feedback that meaningfully improves model performance
-
Mercor customers trust their AI systems in legal contexts because you’ve rigorously evaluated them
Why Join Mercor
Mercor offers legal professionals the opportunity to apply their expertise beyond traditional practice, shaping how AI systems reason about and communicate legal information. This flexible, remote role allows you to contribute directly to the future of legal AI while working on intellectually rigorous, high-impact projects.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
Earn up to $420 by referring
Posted 9 months ago
Completing assessments unlocks more roles and gets you considered automatically for future opportunities.
Take assessments