AI Prompt Evaluator (Remote)

Requirements:

• Fluent in English, with clear written communication and ease with everyday conversation
• Strong attention to detail and patience when reviewing or replaying audio and video
• Able to speak naturally through realistic scenarios and make clear decisions when both options have flaws
• Experience writing concise, evidence-based explanations or reviews
• A bachelors degree or higher is a plus
• To sign up, provide a valid ID and mobile phone from your country of residence, an up-to-date résumé, and a LinkedIn profile showing your education and work experience
• Applicants must reside in Australia, Canada, Ireland, New Zealand, the United Kingdom, or the United States, and be authorized to work in their country of residence

Responsibilities:

• Hold scenario-based conversations in English with AI voice models and rank their naturalness, usefulness, and clarity
• Compare AI-generated images and videos, including edited content, and assess how well they follow prompts and meet quality standards
• Inspect media closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio
• Rate outputs for prompt adherence, quality, and realism, and explain decisions with specific evidence in English
• Label first-person videos by dividing clips into individual actions and writing precise captions, correcting AI-generated drafts
• Evaluate generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks include recording a brief spoken explanation

Technologies:

• AI
• Mobile

More

We are Outlier, an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI models, helping improve how advanced systems perform in real-world settings. This remote freelance opportunity offers flexible scheduling with no minimum hours, and contributors can work from anywhere at times that suit them. Project work pays up to USD $15 per hour; rates vary according to expertise, assessment results, location, project needs, and other factors. Additional incentives may be available, and payments are processed weekly through PayPal, AirTM, or ACH transfer. We provide free access to leading language models valued at over $200 per month, and contributors collaborate with experts on pre-release models. This is a 1099 independent-contractor opportunity on the Outlier.ai platform, not employment; internships and sponsorship are not offered.

last updated 44 week of 2026