Remote - AI Evaluator - English
Outlier
- Location
- Remote (US)
- Workplace
- Remote
- Job type
- Full-time
- Salary
- $31k
- Posted
- Today
- Source
- DevITJobs
Requirements:
- Fluent in English, with strong written communication and confidence in natural, everyday conversation
- Pursuing or hold a bachelors degree or higher
- Strong attention to detail and patience when reviewing audio and visual content
- Able to think on your feet and discuss realistic situations naturally
- Experience writing concise, evidence-based explanations or reviews
- Comfortable making clear judgments when both options have flaws
- Have a computer, reliable internet connection, and headphones
- Have access to a quiet place for projects involving live conversations
- Provide original ratings and written explanations without using AI tools to write them
- Complete a short screening and onboarding process, which may include a brief spoken English check
- Be authorized to work in your country of residence
Responsibilities:
- Hold live, scenario-based conversations in English with AI voice models and rate how natural, useful, and clear they sound
- Compare pairs of AI-generated images and videos to assess which better follows the prompt
- Review outputs closely, including zooming in or replaying content, to identify issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video
- Rate outputs for prompt adherence, quality, and realism, and write specific explanations in English based on what you observed or heard
Technologies:
- AI
More
We help innovative companies improve their AI models through human feedback. This remote freelance opportunity on our Outlier.ai platform involves training generative AI voice, image, and video models, with flexible hours. Core project work pays up to USD $15 per hour. Contributors earn an average of 7.5% in additional incentives through Missions, while top-quartile contributors increase their earnings by an average of 11%. Rates vary according to expertise, skills assessments, location, project needs, and other factors; lower rates may apply to non-core work, and incentive availability varies by project. This is a 1099 contract opportunity, not employment or an internship, and we do not offer sponsorship. We handle applicant data for business purposes in accordance with our privacy policy and internal data-protection practices. Consult a tax or immigration advisor with questions about your circumstances.
last updated 43 week of 2026