Remote Search Engine Evaluator - English

Requirements:

• Fluent in English, with strong written communication and comfort speaking naturally in everyday conversations.
• Strong attention to detail and patience when reviewing audio and visual content, including replaying or zooming in to inspect issues.
• Ability to think on your feet and discuss realistic scenarios conversationally.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make a clear choice when both options have flaws.
• A bachelors degree or higher is a plus.
• To sign up, you need a valid ID and mobile phone from your country of residence, an up-to-date resume highlighting your expertise, and a LinkedIn profile showing your education and work experience.
• You must be authorized to work in your country of residence.
• Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.

Responsibilities:

• Hold live, scenario-based English conversations with AI voice models and assess how natural, useful, and clear their responses are.
• Compare AI-generated images and videos, judging which better follows the prompt.
• Inspect outputs closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video.
• Rate outputs for qualities such as prompt adherence, quality, and realism, and write specific English explanations supported by what you observed.
• Compare generated images for instruction-following, visual quality, and AI artifacts; some assignments involve ranking edited images against originals.
• Rank generated videos against prompts or edited videos against their source clips.
• Label first-person videos of people or robots performing hands-on tasks by dividing clips into individual actions and writing precise captions, correcting AI-generated drafts as needed.
• Evaluate generated speech for naturalness, pronunciation, and similarity to a target voice; some assignments require recording a short spoken explanation.

Technologies:

• AI
• Mobile

More

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI model performance, helping improve how advanced systems reason, learn, and perform in real-world settings. This remote freelance work can be done from anywhere at any time, with no minimum hours and a self-set schedule. Project work pays up to USD $15 per hour, with rates varying according to expertise, skills assessment, location, project needs, and other factors. Contributors may also receive Missions incentives; payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading LLMs valued at over $200 per month and opportunities to collaborate with experts on pre-release models. Our community includes more than 900,000 experts across 52 countries, and we have paid more than $600 million to experts. This is a 1099 contract opportunity: contributors join us as freelancers or independent contractors, not employees. We do not offer internships, sponsorship, or employment through this opportunity. International students may be able to sign up while on a visa; individual tax or immigration questions should be directed to an appropriate advisor.

last updated 44 week of 2026