Search Engine Quality Evaluator - English (Remote)

Requirements:

• Fluent in English, with strong written communication skills and comfort with natural, everyday conversation
• Careful attention to detail and patience to review media closely, including replaying audio or zooming in on images and video
• Ability to think on your feet and discuss realistic scenarios naturally
• Experience writing concise, evidence-based explanations or reviews
• Confidence making a clear choice when both options have flaws
• A bachelors degree or higher is a plus
• To sign up, provide a valid ID and mobile phone from your country of residence, an up-to-date resume, and a LinkedIn profile showing your education and work history
• Applicants must be authorized to work in their country of residence; applications are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States

Responsibilities:

• Hold live, scenario-based conversations in English with AI voice models and assess how natural, useful, and clear their responses are
• Compare AI-generated images and videos, including edited media, and determine which better follows the prompt or source material
• Closely inspect media for issues such as distorted anatomy, flickering, unnatural movement, text errors, or mismatched audio and video
• Rate outputs for qualities such as instruction adherence, quality, and realism, and explain findings in specific written feedback
• Label first-person videos of people or robots performing hands-on tasks by dividing clips into actions and correcting AI-generated caption drafts
• Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks involve recording a brief spoken explanation

Technologies:

• AI
• Mobile

More

Outlier is an AI training platform owned and operated by Scale AI. We engage experts on projects that help evaluate and improve AI systems, including work that supports the development of advanced models for real-world use. This is a remote, flexible freelance opportunity on the Outlier.ai platform, with no minimum hours; contributors can set their own schedules. Project work pays up to USD $15 per hour, with rates varying according to expertise, assessment results, location, project needs, and other factors. Additional Missions incentives may be available, and payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading large language models valued at over $200 per month, and our community includes more than 900,000 experts across 52 countries. To apply, create an Outlier account, upload a resume and valid ID, then complete available tasks. This is an independent-contractor opportunity, not employment; internships and sponsorship are not offered.

last updated 44 week of 2026