Dutch Audio Generalist Evaluator Expert

Mercor is seeking detail-oriented transcribing and writing experts to contribute to a high-impact audio AI research project with a leading lab. Freelancers will listen to and transcribe audio, annotate images, and evaluate videos to help train advanced language models. This is a short-term, flexible opportunity for professionals with strong academic backgrounds, fluent in both Dutch and English, and with a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.

Job Details

Transcribe and Optimise Audio/Video

• Create detailed audio and video transcriptions with multiple constraints and instructions in Dutch, with supporting work in English when required.

Define and Document Evaluation Standards

• Establish high-level expectations for correct responses in general consumer audio contexts.

• Develop comprehensive evaluation rubrics and guidelines in Dutch and English.

Conduct Model Testing and Grading

• Run prompts through models and assess preliminary outputs against defined expectations.

Support Benchmarking and Quality Assurance

• Collaborate in QA review processes to ensure prompt tasks and rubrics meet high standards of rigour.

• Maintain consistency and reliability before integration into official benchmarks.

Minimum Qualifications

• Strong writing and critical thinking skills

• Ability to work independently and meet deadlines

• Fluent in Dutch and English

• Able to work within GMT or PST working hours

Preferred Qualifications

• College students or graduates

Application & Onboarding Process

• Complete an AI-led interview (approximately 15 minutes)

• If selected, you will be invited to work on the project

More Details About This Role

• Expected commitment of 3–6 months

• You’ll work in a structured project environment with clear goals and tools

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.