Data Scientist - AI Evaluator

Requirements:

• At least 1 year of professional, hands-on data science experience at a top company, in industry or research
• Bachelors degree in Data Science, Statistics, Mathematics, Computer Science, or a related field
• Demonstrated depth in at least one area: machine learning and applied ML; statistical modeling and experimentation, including A/B testing or causal inference; or large-scale data analysis and feature engineering
• Based in the United States
• Strong written communication skills and attention to detail
• Ability to explain complex data science concepts clearly
• Ability to work independently in a remote, asynchronous environment
• Experience at a recognized, top-tier technology company is advantageous but not required

Responsibilities:

• Create expert-level data science problems and scenarios based on real modeling, analysis, and experimentation work
• Assess AI-generated responses for technical accuracy, practical feasibility, and consistency with real-world data science practice
• Write structured feedback to help improve AI model performance
• Complete project tasks at your own pace, without a set schedule or minimum hour requirement

Technologies:

• AI
• Support
• Machine Learning

More

We at Handshake offer experienced data scientists an ongoing, project-based contract opportunity to support AI research by evaluating AI-generated content and helping models reason like practicing data scientists. This flexible, part-time work can be done alongside your current role. The position is remote, with work location in the United States, and pays up to $120 per hour.

last updated 43 week of 2026