Dutch Audio Generalist Evaluator Expert (London, SF in-person)

Role Overview

Mercor is seeking detail-oriented transcribing and writing experts to contribute to a high-impact audio AI research project with a leading lab. Freelancers will listen to and transcribe audio, annotate images, and evaluate videos to help train advanced language models. This is a short-term, flexible opportunity for professionals with strong academic backgrounds, fluent in both Dutch and English, and with a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.

Job Details

Transcribe and Optimise Audio/Video

• Create detailed audio and video transcriptions with multiple constraints and instructions in Dutch, with supporting work in English when required.

Define and Document Evaluation Standards

• Establish high-level expectations for correct responses in general consumer audio contexts.
• Develop comprehensive evaluation rubrics and guidelines in Dutch and English.

Conduct Model Testing and Grading

• Run prompts through models and assess preliminary outputs against defined expectations.

Support Benchmarking and Quality Assurance

• Collaborate in QA review processes to ensure prompt tasks and rubrics meet high standards of rigour.
• Maintain consistency and reliability before integration into official benchmarks.

Minimum Qualifications

• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Fluent in Dutch and English
• Available to work remotely 10–20 hours per week
• Able to work within GMT or PST working hours

Preferred Qualifications

• College students or graduates

Application & Onboarding Process

• Complete an AI-led interview (approximately 15 minutes)
• If selected, you will be invited to work on the project

More Details About This Role

• Expected commitment of 3–6 months
• You’ll work in a structured project environment with clear goals and tools