AI Quality Rater - English (Remote)

Requirements:

• Fluent in English, with strong written communication skills and comfort with natural, everyday conversation.
• Strong attention to detail and patience when reviewing visual and audio content, including replaying or zooming in to inspect it closely.
• Ability to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Able to make clear judgments when both options have flaws.
• A bachelors degree or higher is a plus.
• To sign up, you need a valid ID and mobile phone from your country of residence, an up-to-date resume highlighting your expertise, and a LinkedIn profile showing your education and work experience.
• Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States. You must be authorized to work in your country of residence; international students may be able to sign up while on a visa.
• This is a freelance independent-contractor opportunity, not employment. We do not offer internships or sponsorship.

Responsibilities:

• Hold live, scenario-based conversations in English with AI voice models and rate their naturalness, usefulness, and clarity.
• Compare AI-generated images and videos against prompts or source material, judging instruction-following and quality.
• Inspect outputs closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video.
• Rate outputs for qualities such as adherence, quality, and realism, and write specific English explanations based on what you observed or heard.
• Label first-person videos of people or robots performing hands-on tasks by dividing clips into actions and writing precise captions, correcting AI-generated drafts as needed.
• Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks involve recording a brief spoken explanation.

Technologies:

• AI
• Mobile

More

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI model performance, helping improve how advanced systems reason, learn, and perform in real-world settings. This remote opportunity lets you work flexibly from anywhere and set your own schedule, with no minimum hours; contributors may work five to 40 or more hours per week. Project work pays up to USD $15 per hour, with possible additional incentives; rates vary based on expertise, assessment results, location, project needs, and other factors. Payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading LLMs valued at over $200 per month and the opportunity to collaborate with experts on pre-release models. Outlier reports a community of more than 900,000 experts across 52 countries and over $600 million paid to experts. This is a 1099 contract opportunity on the Outlier.ai platform; tax and immigration questions should be directed to an appropriate advisor.

last updated 43 week of 2026