Online Data Quality Evaluator (Remote)

Requirements:

• Fluent English, with clear written communication and comfort using natural, everyday conversational speech
• Strong attention to detail and patience when reviewing audio and visual content, including replaying or zooming in to inspect issues
• Ability to think on your feet and speak naturally through realistic scenarios
• Experience writing concise, evidence-based explanations or reviews
• Confidence making a clear choice when both options have flaws
• A bachelors degree or higher is preferred but not required
• To sign up, you need a valid ID and mobile phone from your country of residence, an up-to-date resume, and a LinkedIn profile that shows your education and work experience
• Applicants must be authorized to work in their country of residence; international students may be able to sign up depending on their visa
• We are currently accepting applicants from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States

Responsibilities:

• Hold live, scenario-based English conversations with AI voice models and rate how natural, useful, and clear their responses are
• Compare AI-generated images and videos, selecting the output that best follows its prompt or source material
• Inspect outputs closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or audio that does not match the video
• Rate outputs for prompt adherence, quality, and realism, and write specific English explanations based on what you observed
• Label first-person videos of people or robots performing hands-on tasks by dividing clips into individual actions and writing precise captions, correcting AI-generated drafts as needed
• Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks also involve recording a short spoken explanation

Technologies:

• AI
• Mobile

More

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI model performance, helping improve how advanced systems reason, learn, and perform in real-world settings. This is a remote freelance/independent-contractor opportunity on the Outlier.ai platform, not an employee position; we do not offer internships, sponsorship, or employment. Work is flexible, with no minimum hours, and you choose your schedule. Project work pays up to USD $15 per hour, with additional Missions incentives available; rates vary by expertise, skills assessment, location, project needs, and other factors, and some non-core work is paid at lower rates. Payments are processed weekly on Tuesdays via PayPal, AirTM, or ACH transfer. Contributors receive free access to leading LLMs valued at over $200 per month and can collaborate with experts working on pre-release models. Outlier reports a community of more than 900,000 experts across 52 countries and over $600 million paid to experts. Applicants can create an account, upload a resume and valid ID, and begin completing tasks. For questions about individual tax or immigration circumstances, consult an appropriate advisor.

last updated 44 week of 2026