Internet-Native Bilingual Evaluator Expert (French)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages.

Job Responsibilities

Evaluate Internet-Native Communication

• Analyse content from French- and English-speaking online communities.

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity.

• Identify errors involving slang, memes, cultural references, sarcasm, and code-switching.

Develop Evaluation Standards

• Build evaluation rubrics for bilingual internet communication.

• Define expectations for culturally appropriate and platform-native language.

• Document linguistic and cultural edge cases.

Conduct Model Testing and Feedback

• Test language models using real-world bilingual prompts.

• Evaluate outputs in English and French.

• Provide detailed feedback to improve performance.

Support Quality Assurance

• Participate in QA reviews and benchmark creation.

• Ensure consistency across evaluators and datasets.

Minimum Qualifications

• Native or near-native fluency in French and professional fluency in English.

• Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.

• Active participation in internet culture across both languages.

• Strong writing, analytical, and critical thinking skills.

• Available to commit 10–20 hours per week.

Preferred Qualifications

• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.

• Familiarity with differences between European French, Québec French, and other French varieties.

• Experience evaluating online content and internet-native communication.

• Interest in AI and multilingual language technologies.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.