Talent.com
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)Mercor • Billings, Montana, US
Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

Remote Expert Prompt Curators for Advanced AI Evaluation Dataset - AI Trainer ($50-$70 per hour)

Mercor • Billings, Montana, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
job_description.job_card.job_description

##

  • 1\. Role Overview

Mercor is collaborating with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge across diverse fields to design extremely challenging prompts that cannot be solved by existing AI systems without internet search or browsing capabilities. The goal is to create a benchmark dataset that pushes the limits of current AI reasoning and retrieval. This is a short-term research engagement with significant impact on AI evaluation. ##

  • 2\. Key Responsibilities
  • Create original, expert-level prompts that require tool use (e.g., search, browse, or code execution). - Ensure prompts are objective, self-contained, and yield clear, unambiguous answers. - Test prompts against advanced AI models and document failures / successes. - Provide reasoning steps and solutions for each prompt. - Classify prompts into subject domains for dataset organization. - Collaborate with reviewers for expert validation and prompt refinement. ##
  • 3\. Ideal Qualifications
  • Advanced academic or professional expertise in a specialized subject (STEM, law, finance, history, cultural studies, etc.). - Strong ability to design precise, high-difficulty questions requiring deep knowledge and external references. - Experience in academic research, benchmarking, or test question design preferred. - Attention to detail and ability to provide concise reasoning explanations. - Familiarity with AI models and their limitations is a plus. ##
  • 4\. More About the Opportunity
  • Remote and asynchronous — set your own hours. - Expected commitment : ~10–20 hours / week. - Project duration : ~2 months, with possible extensions based on dataset needs. - Opportunity to contribute to high-impact AI safety and evaluation research. ##
  • 5\. Compensation & Contract Terms
  • Competitive hourly compensation based on expertise. - Independent contractor engagement. - Payments for services rendered processed weekly via Stripe Connect. ##
  • 6\. Application Process
  • Submit your resume or CV highlighting your subject matter expertise. - Complete a brief questionnaire about your background and areas of specialization. - Selected applicants may be asked to draft a short test prompt. - You’ll receive follow-up within a few days regarding next steps. ##
  • 7\. About Mercor
  • Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations. - Our investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey. - Thousands of professionals across domains like law, creatives, engineering, and research have joined Mercor to work on frontier projects shaping the next era of AI.
  • serp_jobs.job_alerts.create_a_job

    Curator • Billings, Montana, US

    Job_description.internal_linking.related_jobs
    Travel Nurse RN - Electrophysiology Lab - $2,524 per week in Saint Louis, MO

    Travel Nurse RN - Electrophysiology Lab - $2,524 per week in Saint Louis, MO

    TravelNurseSource • Billings, Montana, US
    serp_jobs.job_card.full_time
    TravelNurseSource is working with Triage Staffing to find a qualified EP Lab RN in Saint Louis, Missouri, 63101!.Travel Nursing : Electrophysiology Saint Louis, MO. Location : Saint Louis, MO....serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel CT Tech - $2,033 per week in Saint Louis, MO

    Travel CT Tech - $2,033 per week in Saint Louis, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with OneStaff Medical to find a qualified CT Tech in Saint Louis, Missouri, 63128!.An independently-owned, nationally-recognized and amazingly awesome staffing firm r...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,506 to $2,801 per week in Springfield, MO

    Travel EP Tech / EP Lab Tech - $2,506 to $2,801 per week in Springfield, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Prime Time Healthcare to find a qualified Electrophysiology Tech in Springfield, Missouri, 65801!. Now Hiring : Allied Healthcare EP - Springfield, MO.Contact us f...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,510 per week in Kansas City, MO

    Travel EP Tech / EP Lab Tech - $2,510 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with FlexCare to find a qualified Electrophysiology Tech in Kansas City, Missouri, 64101!. FlexCare is a nationwide leader in the staffing of travel nurses and clinici...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,321 to $2,514 per week in Kansas City, MO

    Travel EP Tech / EP Lab Tech - $2,321 to $2,514 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time +1
    AlliedTravelCareers is working with Aya Healthcare to find a qualified Electrophysiology Tech in Kansas City, Missouri, 64101!. Aya Healthcare has an immediate opening for the following position : El...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel MRI Tech - $2,038 per week in Troy, MO

    Travel MRI Tech - $2,038 per week in Troy, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Convergence Medical Staffing to find a qualified MRI Tech in Troy, Missouri, 63379!.Job Tech,Travel : MRI Tech - Days, City : Troy, State : Missouri, Estimated Sta...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel Radiology Tech - $2,499 per week in St. Louis, MO

    Travel Radiology Tech - $2,499 per week in St. Louis, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with AHS Staffing to find a qualified Rad Tech in St.AHS Staffing is looking for a MRI Tech Radiologic Technologist in St. Louis, MO for a Long Term (Travel) position....serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,392 to $2,673 per week in Saint Louis, MO

    Travel EP Tech / EP Lab Tech - $2,392 to $2,673 per week in Saint Louis, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Prime Time Healthcare to find a qualified Electrophysiology Tech in Saint Louis, Missouri, 63101!. Now Hiring : Allied Healthcare EP - Saint Louis, MO.Contact us f...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel Cath Lab Tech - $2,652 to $2,852 per week in Saint Louis, MO

    Travel Cath Lab Tech - $2,652 to $2,852 per week in Saint Louis, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Ventura MedStaff to find a qualified Cath Lab Tech in Saint Louis, Missouri, 63131!.Are you ready to take your Travel career to the next level? See places you h...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel Nurse RN - Telemetry - $2,061 per week in Kansas City, MO

    Travel Nurse RN - Telemetry - $2,061 per week in Kansas City, MO

    TravelNurseSource • Billings, Montana, US
    serp_jobs.job_card.full_time
    TravelNurseSource is working with FlexCare to find a qualified Telemetry RN in Kansas City, Missouri, 64101!.FlexCare is a nationwide leader in the staffing of travel nurses and clinicians.With acc...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,373 per week in Kansas City, MO

    Travel EP Tech / EP Lab Tech - $2,373 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Atlas MedStaff to find a qualified Electrophysiology Tech in Kansas City, Missouri, 64132!. Atlas Medstaff is currently seeking candidates in the EP Tech (EP Tech...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,393 per week in Kansas City, MO

    Travel EP Tech / EP Lab Tech - $2,393 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Medical Solutions to find a qualified Electrophysiology Tech in Kansas City, Missouri, 64132!. A facility in Kansas City, MO is seeking its next amazing EP Techno...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,692 per week in Saint Louis, MO

    Travel EP Tech / EP Lab Tech - $2,692 per week in Saint Louis, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with GetMed Staffing to find a qualified Electrophysiology Tech in Saint Louis, Missouri, 63141!. GetMed Staffing is searching for a strong EP Tech to assist our trave...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel CT Tech - $2,360 per week in St. Joseph, MO

    Travel CT Tech - $2,360 per week in St. Joseph, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Anders Group to find a qualified CT Tech in St.Allied CT Tech - Computed Tomography.Apply online or contact us ASAP for more information on this great opportunit...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,345 per week in Kansas City, MO

    Travel EP Tech / EP Lab Tech - $2,345 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with GetMed Staffing to find a qualified Electrophysiology Tech in Kansas City, Missouri, 64132!. GetMed Staffing is searching for a strong EP Tech to assist our trave...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel Cath Lab Tech - $1,775 to $1,975 per week in Kansas City, MO

    Travel Cath Lab Tech - $1,775 to $1,975 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Ventura MedStaff to find a qualified Cath Lab Tech in Kansas City, Missouri, 64114!.Are you ready to take your Travel career to the next level? See places you h...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Travel EP Tech / EP Lab Tech - $2,416 per week in Kansas City, MO

    Travel EP Tech / EP Lab Tech - $2,416 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Anders Group to find a qualified Electrophysiology Tech in Kansas City, Missouri, 64132!. Apply online or contact us ASAP for more information on this great oppor...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Travel Cath Lab Tech - $1,954 to $2,107 per week in Kansas City, MO

    Travel Cath Lab Tech - $1,954 to $2,107 per week in Kansas City, MO

    AlliedTravelCareers • Billings, Montana, US
    serp_jobs.job_card.full_time
    AlliedTravelCareers is working with Host Healthcare to find a qualified Cath Lab Tech in Kansas City, Missouri, 64114!.Host Healthcare is an award-winning travel healthcare company with an immediat...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted