Rubric Academy Fellowship

Mercor is launching the Rubric Academy, an optional professional development program for subject-matter experts interested in contributing to our advanced AI evaluation and research projects. The Academy provides informational resources on how high-performing evaluation systems are designed, enabling experts to better understand how AI models are assessed and improved.

We work with independent professionals who bring their own judgment, methodology, and domain standards. The Academy simply introduces the conceptual framework behind “Prompt-Rubric Pairing”—a methodology used in frontier AI evaluation—without prescribing how experts must perform their work.

Professionals who complete the Academy may choose to make themselves eligible for Mercor’s specialized expert opportunities.

About the Academy

This is a paid, 3–5 hour, self-guided course intended to familiarize experts with the concepts used in AI evaluation. The course offers background knowledge—not instructions for how contractors must complete services.

Upon completion, you may opt in to be considered for our high-paying expert projects.

What You Will Learn

Participants receive an overview of the principles used across the AI evaluation industry:

The Art of the Prompt

An introduction to how prompts can set context and clarify expectations when interacting with AI systems.

The “Golden Response”

A conceptual framework for describing ideal outputs, including how experts articulate quality, nuance, and professional standards in their own fields.

Rubric Architecture

An overview of how evaluation criteria and scoring systems are commonly structured in AI benchmarking environments.

These modules are designed to provide context—not mandates—for how experts should approach their own evaluation work.

Who We Are Looking For

We welcome independent experts from any discipline:

• Deep Expertise: You have specialized knowledge that informs your own professional judgment.

• Analytical Rigor: You can articulate how you evaluate quality in your domain.

• Integrity: You rely on your own reasoning and domain knowledge when completing evaluation work.

Experts maintain full autonomy over how they apply their expertise in any project.

Project Details & Compensation

• Stipend: $50–$150, paid upon successful completion of the Academy and the optional Practice Task.

• Time Commitment: ~3–5 hours, self-paced.

• Future Opportunities: Graduates may opt in to be considered for ongoing Expert Contributor roles.

• Requirements: No subscriptions required. You may reference any valid sources that support your professional assessments.

Why Participate?

Professional Development

Gain insight into emerging evaluation methodologies used in frontier AI research.

Set the Standard

Your independent professional judgment helps define quality benchmarks for complex tasks.

Access Expert Opportunities

Completion makes you eligible to participate in Mercor’s specialized, high-rate expert projects—should you choose to do so.

Apply today to join the Rubric Academy and bring your professional standards to the next generation of AI evaluation.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.