Average salary: $152,883 /yearly
More statsGet new jobs by email
- ...TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students, graduates, researchers and experienced professionals with expertise across Artificial Intelligence, Machine Learning...Suggested
TELUS International
Remote25 days ago - ...About the Role mpathic provides independent, multidisciplinary evaluations of healthcare AI technologies seeking deployment in real-world clinical settings. As part of our work supporting Utah's Office of Artificial Intelligence Policy (OAIP) regulatory sandbox, we are...Suggested
mpathic
Remote13 days ago - ...What You'll Do Participate in a 60-minute remote video interview Walk us through how you currently evaluate new artificial intelligence platforms Describe the key criteria and stakeholders involved in your software purchasing decisions Share candid feedback on recent challenges...Suggested
Terac
Remote5 days ago $2.4 per hour
...Key Responsibilities Review and evaluate posts on various social media platforms. Identify and analyze the quality of information shared. Provide constructive feedback to enhance content credibility. Key Requirements: Must be located in Myanmar Native/Bilingual...SuggestedAppen
Remote25 days ago- ...Apply for a paid 30-60 minute product feedback interview for expert practitioners who evaluate trust, authenticity, quality, provenance, scriptedness, AI assistance, or overstated expertise. We are looking for a small number of expert practitioners for a paid 30-60 minute product...Suggested
Remoat Teams
Remote11 days ago $30 - $60 per hour
...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents...Suggestedmicro1
Remote10 days ago$65 per hour
...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while...SuggestedTerac
Remote25 days ago- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Suggested
Rise Data Labs
Remote25 days ago - ...About the Role We are looking for software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up reproducible environments, assess test quality, and check how well models fix real bugs. Key Responsibilities...Suggested
RemoExperts
Remote25 days ago - ...AI Fact-Checking & Response Evaluation Reviewer (French) Mission of the Role Apply independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps. Successful reviewers do not simply validate AI-generated...Suggested
e2f
Remote4 days ago - ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Suggested
Rise Data Labs
Remote25 days ago $150 per hour
...Evaluate security vulnerabilities in GenAI applications using static analysis tools. About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced...SuggestedTuring
Remote3 days ago- ...What You'll Do You'll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work. Develop sophisticated finance-related prompts and tasks grounded in real-world professional work. Test and evaluate AI-generated...Suggested
Rise Data Labs
Remote25 days ago - ...profile for better job matches and setting up your wallet so you can get paid when a job comes through. What You May Work On Evaluate AI-generated advertisements and marketing creative across digital, social, display, email, and other campaign formats. Provide structured...Suggested
Contra Labs
Remote18 days ago - ...Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness. Content...Suggested
CNTXT AI
Remote8 days ago - ...We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains. You'll create complex research tasks that challenge AI capabilities in sports analytics, financial analysis, patent research, academic planning, and...
AfterQuery
Remote25 days ago - ...Analyze GitHub issues and evaluate test quality for LLM projects. About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE...
Turing
Remote25 days ago - ...knowledge and clinical skills you're developing could help improve how artificial intelligence understands complex healthcare information, evaluates medical scenarios, and delivers more accurate, reliable responses? At Volga Partners, we're connecting medical students, residents,...
Volga Partners
Remote19 days ago - ...profile for better job matches and setting up your wallet so you can get paid when a job comes through. What You May Work On Evaluate AI-generated graphic design outputs across formats including illustrations, layouts, infographics, and print-ready assets Provide...
Contra Labs
Remote18 days ago $40 per hour
...Review proposed coding tasks and programming environments for realism Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code challenges Suggest improvements to make the test suites more robust...Terac
Remote25 days ago$100 - $150 per hour
...Evaluate and improve AI coding models by reviewing generated code. Freelance · Remote · North America (only) About Turing Turing is one of the world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality...Turing
Remote23 days ago- ...Curate and evaluate code in Rust to enhance AI training datasets. About Us Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports...
Turing
Remote3 days ago - ...review - We'll assess your Contra profile and portfolio for strength in videography across a range of subjects and styles. # Skills evaluation - You’ll complete a structured videography submission designed to evaluate attention to detail, consistency, and execution....
Contra Labs
Remote18 days ago - ...your profile for better job matches and setting up your wallet so you can get paid when a job comes through. What You May Work On Evaluate AI-generated games and interactive experiences for gameplay quality, technical execution, and overall player experience Provide...
Contra Labs
Remote18 days ago $210 per hour
...What You'll Do Complete a 30-minute external survey about your enterprise software experiences. Detail the evaluation criteria your organization uses when assessing ERP systems. Describe the stakeholder involvement and approval timelines for major software purchases. Share...Terac
Remote4 days ago- ...tasks that reflect how the work is actually done in practice. Benchmarks and domain depth: Design challenging finance tasks and evaluation sets, and help build finance-specific skills and tools together with the research team. Calibration: Work with client researchers...
Mercor
Remote25 days ago - ...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps leading AI labs improve the reasoning, problem...
Turing
Remote25 days ago $125 per hour
...weeks ~25% Within 6 weeks ~60% Within 3 months ~80% Why this role $125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the overhead of...Hourly payContract workRemote job- ...Do you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people. Using your search expertise, you will work through...Temporary workPart timeFreelanceOnlineRemote jobWork from homeHome officeFlexible hours
- ...depending on the engagement. We would rather tell you that than publish a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe, and Australia We are seeking qualified scientific and technical...Contract workFor contractorsRemote job
