Job Description
Job Description
Project Timeline
- Start Date : Immediate
- Duration : 5 6 weeks
- Commitment : Part-time, ~20 hours / week (flexible)
- Schedule : Fully remote and asynchronous
Key Responsibilities
Evaluate AI-generated data analyses for quality, correctness, and clarity.Understand dataset context and apply statistical analysis and modeling for both specific and open-ended prompts.Design prompts and create clear, detailed rubrics for reward modeling and evaluation.Produce gold-standard responses : data visualizations, explanatory text, and executable Python notebooks (.ipynb).Translate data-science reasoning and decisions into gradable criteria for AI agents.Ideal Qualifications
Education : Bachelor's, Master's, or PhD in Data Science, Machine Learning, or a related field.Experience : 2+ years in industry data-science roles.Technical Skills : Proficient in Python and common data libraries (pandas, numpy, scikit-learn).Data Expertise : Strong understanding of statistical analysis, modeling, and visualization; ability to identify patterns and communicate insights.Communication : Excellent analytical and data-driven writing skills; able to distill complex findings into clear, concise recommendations.Application Onboarding Process
Submit Resume
AI Interview & A short, 25-minute technical interview which will assess conceptual project-based questions and a Google Co-Lab data analysis exercise
Work trial
6 lessons on rubric-writing fundamentals
Short comprehension quizzes (non-evaluative)
A final quiz and 1–2 hour prompt-writing exercise
Total time : ~3 hours