Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)Mercor • Redwood City, California, US
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)
Mercor • Redwood City, California, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
- serp_jobs.job_card.full_time
- serp_jobs.filters.remote
job_description.job_card.job_description2\. Key Responsibilities Create original, expert-level prompts that require tool use (e.g., search, browse, or code execution). - Ensure prompts are objective, self-contained, and yield clear, unambiguous answers. - Test prompts against advanced AI models and document failures / successes. - Provide reasoning steps and solutions for each prompt. - Classify prompts into subject domains for dataset organization. - Collaborate with reviewers for expert validation and prompt refinement. ## 3\. Ideal Qualifications Advanced academic or professional expertise in a specialized subject (STEM, law, finance, history, cultural studies, etc.). - Strong ability to design precise, high-difficulty questions requiring deep knowledge and external references. - Experience in academic research, benchmarking, or test question design preferred. - Attention to detail and ability to provide concise reasoning explanations. - Familiarity with AI models and their limitations is a plus. ## 4\. More About the Opportunity Remote and asynchronous — set your own hours. - Expected commitment : ~10–20 hours / week. - Project duration : ~2 months, with possible extensions based on dataset needs. - Opportunity to contribute to high-impact AI safety and evaluation research. ## 5\. Compensation & Contract Terms Competitive hourly compensation based on expertise. - Independent contractor engagement. - Payments for services rendered processed weekly via Stripe Connect. ## 6\. Application Process Submit your resume or CV highlighting your subject matter expertise. - Complete a brief questionnaire about your background and areas of specialization. - Selected applicants may be asked to draft a short test prompt. - You’ll receive follow-up within a few days regarding next steps. ## 7\. About Mercor Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations. - Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey. - Thousands of professionals across domains like law, creatives, engineering, and research have joined Mercor to work on frontier projects shaping the next era of AI.
##
- 1\. Role Overview
Mercor is collaborating with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge across diverse fields to design extremely challenging prompts that cannot be solved by existing AI systems without internet search or browsing capabilities. The goal is to create a benchmark dataset that pushes the limits of current AI reasoning and retrieval. This is a short-term research engagement with significant impact on AI evaluation. ##
serp_jobs.job_alerts.create_a_job
Curator • Redwood City, California, US
Job_description.internal_linking.related_jobs UK / Canada / Europe / Singapore / Dubai / Australia-based • •Investment Banking or Private Equity Experts • • for a research project with a leading foundational model AI lab.
You are a good fit if you : - Have •...serp_jobs.internal_linking.show_more UK / Canada / Europe / Singapore / Dubai / Australia-based • •Investment Banking or Private Equity Experts • • for a research project with a leading foundational model AI lab.
You are a good fit if you : - Have •...serp_jobs.internal_linking.show_more 
Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations.
At the center of it is an omnipresent, intelligent, and...serp_jobs.internal_linking.show_more
At Pulley, we are on a mission to help construction teams break ground faster.Meanwhile, retail and office real estate.Permitting requirements vary vastly by jurisdiction, making it challenging to ...serp_jobs.internal_linking.show_more
At Sprinter Health, our mission is reimagining how people access care by bringing it directly to their homes.Nearly 30% of patients in the U.
For many, the ER becomes their first touchpoint with the...serp_jobs.internal_linking.show_more
Joining us as a Research Engineer, you'll be at the forefront of tackling one of the most critical challenges in AI today : safety and alignment.
Your work will be pivotal in understanding and mitiga...serp_jobs.internal_linking.show_more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...serp_jobs.internal_linking.show_more
Moloco is a machine learning company empowering organizations of all sizes to grow and unlock the full value of their unique first-party data, elevating the traditional path to performance advertis...serp_jobs.internal_linking.show_more
As a Senior AI Applications Engineer on this pivotal project, you will be instrumental in designing, developing, and deploying the core AI systems that power our intelligent data matching, recommen...serp_jobs.internal_linking.show_more
Biohub is leading the new era of AI-powered biology to cure or prevent disease through its 501c3 medical research organization, with the support of the Chan Zuckerberg Initiative.Biohub supports th...serp_jobs.internal_linking.show_more Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...serp_jobs.internal_linking.show_more Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.
We guarantee 15-25 hours per week with an hourly pay of bet...serp_jobs.internal_linking.show_more 
But a large portion of training compute is wasted training on data that are already learned, irrelevant, or even harmful, leading to worse models that cost more to train and deploy.At DatologyAI, w...serp_jobs.internal_linking.show_more
At Dexterity, we believe robots can positively transform the world.Our breakthrough technology frees people to do the creative, inspiring, problem-solving jobs that humans do best by enabling robot...serp_jobs.internal_linking.show_more
Remote contract for PhDs in Biology, Biotechnology, Biochemistry, or related fields.Work on cutting-edge projects with top AI labs while earning up to $50+ / hour, fully remote, with flexible weekly ...serp_jobs.internal_linking.show_more UK / Canada / Europe / Singapore / Dubai / Australia-based • •Investment Banking or Private Equity Experts • • for a research project with a leading foundational model AI lab.
You are a good fit if you : - Have •...serp_jobs.internal_linking.show_more 
AI Research Scientist / Engineer.Menlo Park, CA | On-Site | Full-Time / Direct Hire .Client Opportunity | Through Phizenix (WBENC & Minority-Certified Recruiting Partner).
Join a trailblazing AI startup...serp_jobs.internal_linking.show_more At Dexterity, we believe robots can positively transform the world.Our breakthrough technology frees people to do the creative, inspiring, problem-solving jobs that humans do best by enabling robot...serp_jobs.internal_linking.show_more
Remote Financial Expert - AI Trainer ($150 per hour)
Mercor • Redwood City, California, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Remote Financial Analyst - AI Trainer ($150 per hour)
Mercor • Redwood City, California, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Engineer, AI Evaluation & Reliability (Agentic AI)
Anomali • Redwood City, CA, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior Applied AI Engineer
Pulley • San Francisco, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
AI Incubator - Data Engineer
Sprinter Health • Menlo Park, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Research Engineer, AI Safety & Alignment
Character.ai • Redwood City, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Work From Home Product Tester – $25-$45 / hr – No Experience Needed
OCPA • Atherton, California, us
serp_jobs.filters.remote
serp_jobs.job_card.part_time +1
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Staff Machine Learning Engineer
Moloco • Redwood City, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Senior AI Applications Engineer, Collaboration
Snowflake • Menlo Park, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Senior Staff Data Scientist, Imaging, Data
Biohub • Redwood City, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Remote Product Tester – $45 / hr + Free Products – Start Now!
OCPA • Woodside, California, us
serp_jobs.filters.remote
serp_jobs.job_card.part_time +1
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Flexible Remote Work – Get Paid to Share Your Opinions on Top Brands
OCPA • Pescadero, California, us
serp_jobs.filters.remote
serp_jobs.job_card.part_time +1
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Forward Deployed AI Engineer
Datologyai • Redwood City, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
Senior / Staff Machine Learning Engineer
Dexterity • Redwood City, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Remote STEM PHDs - Biology (San Francisco)
Turing • San Francisco, CA, US
serp_jobs.filters.remote
serp_jobs.job_card.part_time
serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
Remote Financial Planner - AI Trainer ($150 per hour)
Mercor • Redwood City, California, US
serp_jobs.filters.remote
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
AI Research Scientist / Engineer
Phizenix • Menlo Park, California, United States
serp_jobs.job_card.full_time +1
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
Senior / Staff AI Algorithms Engineer
Dexterity • Redwood City, California, United States
serp_jobs.job_card.full_time
serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted