Average salary: $157,415 /yearly

More stats
Get new jobs by email
  • $20 per hour

     ...friend. Invite someone, talk naturally, and earn rewards together! Earn up to 4.8 USD/h in USDC Payment for accepted data only. Amounts are estimates, not guaranteed. 20X Raffle Tickets Raffle rewards are governed by the Raffle Terms. 2+ and up to 2 participants Refer & earn... 
    Data
    Contract work

    Silencio AI

    Remote
    a month ago
  •  ...AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring health economists...  ...from research question through recommendation • Write reference answers with the methodological reasoning behind each choice • Grade... 
    Data
    Contract work
    For contractors

    AfterQuery

    Remote
    a month ago
  •  ...Technical writers build expert-level evaluation and training data for frontier AI labs. AfterQuery partners with frontier AI labs to...  ...explain complex systems clearly. You will evaluate AI-generated API references, how-to guides, release notes, and user documentation for... 
    Data
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...standard, and judge whether each was handled correctly. Write the reference answer — what a correct response looks like, and the technical...  ...someone else how it was meant to work; the same compatibility data that keeps a magazine safe describes what stays stable elsewhere.... 
    Data
    Part time

    Mercor

    Remote
    a month ago
  • $90 - $120 per hour

     ...examples for invalid derivations, confounding factors, and conclusions unsupported by the data. Assess whether the reasoning meets professional standards for the stated task. Write reference answers and scoring criteria grounded in proofs, numerical reasoning, assumptions,... 
    Data
    Contract work
    Remote job

    Alpheva

    Remote
    a month ago
  • $126 per hour

     ...scoring rubrics to clinical cases Document findings to serve as reference evaluations for benchmarks Who Should Apply Practicing radiologist...  ...providing structured, written evaluations of clinical data Ability to review cases carefully and apply detailed scoring rubrics... 
    Data
    Contract work
    For contractors
    Remote job

    Terac

    Remote
    17 days ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...structural scenarios, from load analysis through connection design Write reference answers with the code and load path reasoning behind each... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...This is a remote, project-based role for data scientists and product analysts with 3+ years of full time experience on a product team....  ...experiments, metrics, retention and growth, and work each one through to a reference answer that frontier AI labs use to test model judgment. Work is... 
    Data
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...test practical accuracy. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...realistic prescription processing and adjudication scenarios Write reference answers that show the correct workflow order, not just the end... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...respiratory care scenarios from assessment through intervention Write reference answers with the clinical reasoning behind each setting change... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...primary classroom scenarios from planning through assessment Write reference answers with the developmental reasoning behind each choice Grade... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...from alert triage through incident response and remediation Write reference answers with the investigative reasoning behind each decision Grade... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...standard, and judge whether each was handled correctly. Write the reference answer — what a correct response looks like, and the technical...  ...and initiation systems, with real hardware and real test data behind them. What matters most is being able to tell a routine professional... 
    Data
    Part time
    Hybrid work

    Mercor

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...from argument reconstruction to applied ethical dilemmas. Write reference answers with the argumentative structure made explicit, premises,... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...author realistic empirical economics problems drawn from your work, covering causal questions, panel data, choice models, or forecasting, and work each one through to a reference answer that frontier AI labs use to test model judgment. Work is fully async with no fixed hours,... 
    Data
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...scenarios covering positioning, technique, and safety calls Write reference answers with the reasoning behind each protocol choice Grade model... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...standard, and judge whether each was handled correctly. Write the reference answer — what a correct response looks like, and the technical...  ...an exposure someone might intend; the same decontamination data that protects responders tells you what defeats it. A model that... 
    Data
    Part time

    Mercor

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...method, from source criticism to competing causal explanations. Write reference answers with the evidentiary reasoning behind each interpretation... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  • $110 - $140 per hour

     ...examples for invalid derivations, confounding factors, and conclusions unsupported by the data. Assess whether the reasoning meets professional standards for the stated task. Write reference answers and scoring criteria grounded in reaction mechanisms, analytical methods, lab... 
    Data
    Contract work
    Remote job

    Alpheva

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...realistic prehospital scenarios from dispatch through handoff Write reference answers with the field reasoning behind each protocol decision... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...Remote, async, paid weekly. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...scenarios from admission through post acute placement Write reference answers with the reasoning behind each level of care call Grade model... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...aerospace scenarios, from requirements through design review Write reference answers with the engineering reasoning behind each decision Grade... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...scenarios from specimen receipt through result interpretation Write reference answers with the analytical reasoning behind each result call... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  • $70 - $90 per hour

     ...validate technical tasks for AI systems working with enterprise, data-center, and service-provider networks. The work focuses on executable...  ...verification. Contributors create the network artifacts and reference solutions behind each task and test whether a proposed... 
    Data
    Contract work

    Mercor

    Remote
    5 days ago
  •  ...model judgment and safety. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ..., safety planning, resource navigation, ethical dilemmas Write reference responses with the clinical judgment behind each decision Grade model... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...realistic ALS scenarios from dispatch through transfer of care Write reference answers with the clinical reasoning behind each intervention... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...real-world workflows. Role Overview: We are looking for Data Annotators to evaluate AI-generated responses against defined...  ...self-harm, violence, and abuse. Familiarity with US-specific references, systems, and terminology. Preferred Qualifications:... 
    Data
    Part time

    Turing

    Remote
    17 days ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...teaching scenarios from lesson planning through assessment Write reference answers with the pedagogical reasoning behind each decision Grade... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...problems drawn from your work, covering designed experiments, statistical process control, and reliability and failure data, and work each one through to a reference answer that frontier AI labs use to test model judgment. Work is fully async with no fixed hours, a minimum of 10... 
    Data
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago
  •  ...to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We...  ...prequalification and program selection through underwriting and closing Write reference answers with the guideline reasoning behind each lending decision... 
    Data
    Weekly pay
    Contract work
    For contractors
    Remote job

    AfterQuery

    Remote
    a month ago