Language Data Quality Analyst (Remote)

Requirements:

• Fluent in English, with strong written communication and comfort speaking naturally in everyday conversations
• Careful and detail-focused, with patience to inspect and replay audio or zoom in on visual content
• Able to think on your feet and discuss realistic scenarios conversationally
• Experienced in writing concise, evidence-based explanations or reviews
• Comfortable making a clear choice when both options have shortcomings
• A bachelors degree or higher is a plus
• To sign up, provide a valid ID and mobile phone from your country of residence, an up-to-date résumé, and a LinkedIn profile showing your education and work history
• Applicants must be from Australia, Canada, Ireland, New Zealand, the United Kingdom, or the United States
• Must be authorized to work in your country of residence
• This is a freelance independent-contractor opportunity; it does not offer internships, sponsorship, or employment.

Responsibilities:

• Hold live, scenario-based conversations in English with AI voice models and assess their naturalness, usefulness, and clarity
• Compare AI-generated images and videos, judging how well they follow their prompts
• Inspect outputs closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video
• Rate outputs for prompt adherence, quality, and realism, and write specific English explanations based on what you observed or heard
• Compare generated images for instruction-following, visual quality, and AI artifacts; some tasks involve comparing edited images with originals
• Rank generated videos against prompts or edited videos against their source clips
• Label first-person videos of people or robots performing practical tasks by dividing clips into actions and writing precise captions, revising AI-generated drafts as needed
• Evaluate generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks involve recording a brief spoken explanation

Technologies:

• AI
• Mobile

More

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI models, helping improve how advanced systems reason, learn, and perform in real-world settings. This remote opportunity offers flexible scheduling with no minimum hours, and contributors can work from anywhere at times they choose. Project work pays up to USD $15 per hour, with possible additional incentives; rates vary according to expertise, assessment results, location, project needs, and other factors. Payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH. We provide free access to leading large language models, and contributors join a global community of experts collaborating on pre-release models. This is a 1099 freelance independent-contractor role on the Outlier.ai platform, not an employee position. International students may be able to sign up while on a visa; individuals with questions about their circumstances are advised to consult a tax or immigration professional.

last updated 44 week of 2026