Rubrics Writer / Auditor

Role Overview

Mercor is collaborating with a leading AI lab to engage generalist writers with experience in rubric-based evaluation for a short-term, project-based initiative. This opportunity focuses on improving AI assistants’ ability to generate and assess high-quality conversational content. Contributors will apply structured evaluation frameworks to assess outputs and help refine model performance. The work is well-suited for detail-oriented writers interested in shaping how AI systems understand quality and nuance in writing, and exhibiting human-levels of judgement and memory. 

Key Responsibilities

• Evaluate AI-generated written conversations using predefined rubrics used to evaluation performance

• Draft and refine evaluation rubrics for generalist writing tasks

• Apply structured scoring criteria to assess clarity, coherence, accuracy, and style

• Review edge cases and ambiguous outputs to ensure consistent grading standards

Ideal Qualifications

• Experience with rubric-based grading, editing, or content evaluation at Mercor

• Strong generalist writing skills across multiple domains (e.g., business, academic, creative)

• Excellent attention to detail and consistency in applying guidelines consistently across a variety of contexts

• Ability to interpret nuanced criteria and make sound judgment calls

• Background in English, journalism, communications, or a related field is preferred

Compensation & Contract Terms

• Compensation range: $25–45/hour depending on experience and location

• Opportunities for expanded reviewer / lead responsibilities

Application Process

• Submit a resume or writing sample to get started

• Selected applicants will be contacted within a few days regarding next steps

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.