Internet-Native Bilingual Evaluator Expert (Spanish – Latin America)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (Spanish–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. In this role, you will evaluate, annotate, and improve AI model outputs across English and Spanish, helping ensure that models accurately understand modern online communication, cultural references, slang, and multilingual interactions. This role focuses specifically on Latin American Spanish internet culture, language use, and online communities across the region.

Job Responsibilities

Evaluate Internet-Native Communication

• Analyse content originating from social media, forums, messaging platforms, online communities, and consumer-facing digital environments.

• Assess AI-generated responses for naturalness, fluency, cultural appropriateness, and internet authenticity.

• Identify issues involving slang, memes, abbreviations, code-switching, and evolving online language.

• Evaluate content specific to Latin American internet culture, trends, and regional online communities.

Develop Evaluation Standards

• Create detailed rubrics and guidelines for evaluating bilingual and internet-native communication.

• Define standards for tone, cultural relevance, contextual understanding, and linguistic accuracy.

• Document edge cases involving internet culture, humour, sarcasm, and platform-specific language.

• Identify linguistic and cultural differences across major Spanish-speaking countries in Latin America.

Conduct Model Testing and Feedback

• Test language models using real-world multilingual prompts.

• Evaluate outputs in both English and Spanish.

• Provide structured feedback to improve model performance and cultural understanding.

Support Quality Assurance

• Participate in review cycles and benchmark development.

• Collaborate with project leads to improve evaluation frameworks.

• Maintain consistency across datasets and evaluation processes.

Minimum Qualifications

• Native or near-native fluency in Latin American Spanish and professional fluency in English.

• Deep familiarity with internet culture and online communities across one or more Spanish-speaking countries in Latin America.

• Active engagement with platforms such as YouTube, TikTok, Reddit, Discord, X, Instagram, Twitch, Facebook, WhatsApp communities, or similar online ecosystems.

• Strong understanding of Latin American Spanish slang, memes, internet humour, and contemporary digital culture.

• Strong writing, analytical, and critical thinking skills.

• Available to commit 10–20 hours per week.

Preferred Qualifications

• Experience in content moderation, localisation, translation, linguistics, social media, journalism, or AI evaluation.

• Familiarity with regional linguistic differences across Mexico, Argentina, Colombia, Chile, Peru, and other Spanish-speaking countries.

• Experience evaluating user-generated content or digital communications.

• Interest in AI, language models, and internet culture research.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.