Overview  Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for English-speaking experts to join our team.    What you will do:   Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers. Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.   Project Details:      - Start Date: ASAP     - Duration: Ongoing Project.     - Commitment: 20 hours per week.     - Job Type: Freelance contract.     - Location: Remote, UK.     - Rate: $38 per hour.   Requirements:       - Research skills — ability to find and verify information from multiple sources; comfort navigating different websites,           databases, and documentation     - Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when                 something doesn't apply to a specific locale/context     - Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge            cases     - Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-        and-error     - Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work          that requires precision and source verification     - Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning     - Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural                      nuances) is valuable for spotting region-specific failures

Job ref blurredText

Posted on blurredText

Last checked on blurredText

Closing on blurredText

1 comments
0 requirements

Discuss this job

Share your intel on this vacancy and help others - anonymously. Get notified automatically of new comments when starred or saved to Tracker.

Anonymous - 0 days ago

pretend that this is a blurredText long comment

My Private Notes

Saving private notes will automatically star the vacancy to your Jobs page.