Consumer Expert

Role Overview This project focused on improving the performance of advanced language models. We are seeking experts with experience consumer fields (e.g. shopping, travel, gaming, food) to evaluate and refine model outputs. Experts will help craft domain-relevant prompts and assess AI-generated responses for clarity, accuracy, and stylistic consistency. This is a unique opportunity to apply your field knowledge toward shaping frontier AI systems.

Key Responsibilities

• Create domain-relevant prompts reflective of real-world use cases

• Evaluate AI responses for adherence to professional tone and formatting standards

• Draft expert-level “golden responses” that serve as benchmarks for model performance

• Flag errors, inconsistencies, or stylistic deviations in AI output

• Collaborate asynchronously with a research team refining model evaluation protocols

Ideal Qualifications

• Minimum 2 years of relevant experience in your particular consumer domain

• Deep familiarity with domain-specific writing, formatting, and communication norms

• Strong analytical and written communication skills

• Detail-oriented with a commitment to quality and consistency

• Experience with prompt engineering or AI tools is a plus, but not required

More About the Opportunity

• Expected commitment: 10+ hours/week

• Project duration: ~4 weeks with possible extension

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.