Prompt Quality Evaluator - English Speaker (Remote)

Requirements:

• We seek fluent English speakers with clear written communication skills and comfort with everyday conversational speech.
• Candidates should have strong attention to detail, patience when reviewing audio and visual outputs, and the ability to think quickly in realistic conversational scenarios.
• We value experience writing concise, evidence-based explanations or reviews and the ability to make clear judgments when both options have flaws.
• A bachelors degree or higher is a plus.
• To sign up, contributors need a valid ID and mobile phone from their country of residence, an up-to-date resume, and a LinkedIn profile showing education and work experience.
• Applicants must be authorized to work in their country of residence. We are currently accepting applicants from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.

Responsibilities:

• Hold live, scenario-based conversations in English with AI voice models, then assess their naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, including edited versions, and determine which better follows the prompt or source material.
• Closely inspect media by zooming in or replaying it to identify issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video.
• Rate outputs for prompt adherence, quality, and realism, and write specific English explanations supported by what you observe or hear.
• Label first-person videos of people or robots performing hands-on tasks by dividing clips into actions and refining AI-drafted captions.
• Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks may require recording a brief spoken explanation.

Technologies:

• AI
• Mobile

More

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI model performance, helping improve how advanced systems reason, learn, and perform in real-world settings. This is remote freelance contract work on the Outlier.ai platform, not employment; it offers flexible scheduling with no minimum hours, and contributors set their own availability. Project work pays up to USD $15 per hour, with possible additional incentives; rates vary according to expertise, skills assessment, location, project needs, and other factors. Payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading LLMs valued at over $200 per month and offer opportunities to collaborate with experts on pre-release models. Outlier has more than 900,000 experts across 52 countries and has paid over $600 million to contributors. We do not offer internships, sponsorship, or employment through this freelance opportunity.

last updated 44 week of 2026