Generalist

1. Role Overview

Mercor is collaborating with a leading AI lab on a short-term project focused on improving preference ranking models for conversational AI systems. We’re seeking detail-oriented generalists—ideally with prior experience in data labeling or content evaluation—to assess and rank model outputs across a variety of domains. This opportunity is well-suited for professionals comfortable with nuanced judgment tasks and working independently in a remote setup.

2. Key Responsibilities

• Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness

• Assign preference rankings to pairs or sets of model outputs

• Follow detailed labeling guidelines and adjust based on evolving criteria

• Provide brief written explanations for ranking decisions when required

• Flag edge cases or inconsistencies in task design or model output

3. Ideal Qualifications

• Prior experience in data labeling, content moderation, or preference ranking tasks

• Excellent critical thinking and reading comprehension skills

• Comfort working with evolving guidelines and ambiguity

• Strong attention to detail and consistency across repetitive tasks

• Availability for regular part-time work on a weekly basis

6. Application Process

• Submit your resume to get started

• Complete a short form to highlight your relevant experience

• You may be asked to complete a brief assessment to evaluate task fit

• Expect a response within 3–5 business days

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.