Data Scientist – AI Training & Evaluation

About The Role

AI is only as good as the experts who train it. We're looking for data scientists to help evaluate, refine, and improve next-generation AI systems — bringing your quantitative expertise directly to bear on how the world's most advanced models reason, analyze, and communicate.

This is a fully remote, flexible contract role. You set your hours and work at your own pace, contributing to projects that sit at the frontier of applied AI research.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10--40 hours/week

What You'll Do

• Evaluate AI model outputs for statistical soundness, reasoning quality, and analytical accuracy
• Design and apply data-driven evaluation criteria and scoring rubrics
• Analyze patterns in AI-generated responses to surface systematic errors or biases
• Create high-quality training data — including prompts, worked solutions, and expert annotations — across data science and ML domains
• Review AI-generated code, visualizations, and statistical analyses for correctness and best practices
• Provide structured, detailed feedback that directly improves model performance
• Work independently and asynchronously on your own schedule

Who You Are

• Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
• Strong foundation in statistics, probability, and machine learning concepts
• Proficient in Python, R, SQL, or similar data analysis tools
• Experienced with data wrangling, exploratory data analysis, and model evaluation
• Sharp analytical thinker with excellent attention to detail
• Clear written communicator — able to explain complex technical concepts concisely
• Self-motivated and comfortable working independently in an async environment

Nice to Have

• Experience with deep learning frameworks such as PyTorch or TensorFlow
• Familiarity with NLP, large language models, or AI evaluation workflows
• Published research or hands-on industry experience in applied machine learning
• Background in A/B testing, causal inference, or experimental design

Why Join Us

• Work on cutting-edge AI projects alongside top research labs and AI teams globally
• Get rare, inside exposure to how state-of-the-art LLMs are trained and evaluated
• Fully remote and async — work when and where it suits you
• Complete autonomy over your schedule and workload (10--40 hrs/week)
• Join a growing community of expert contributors who are actively shaping the future of AI
• Potential for ongoing work and long-term contract extension