AI Output Evaluator

Please login or register as jobseeker to apply for this job.

TYPE OF WORK

Full Time

SALARY

$4.50

HOURS PER WEEK

40

DATE UPDATED

Oct 1, 2026

JOB OVERVIEW

AI Output Evaluator

We are looking for a detail-oriented, highly disciplined Independent Contractor to evaluate AI-generated outputs (images, videos, audio, and text) for a U.S.-based AI training project.

The Work:
You will compare two AI-generated responses side-by-side and determine which one better satisfies a specific prompt based on observable evidence. You will be trained on our strict evaluation rubric and expected to write brief, evidence-based justifications for your choices.

Technical Requirements (Mandatory):
• All work MUST be performed on a provided AWS Virtual Machine (VM) accessed via Remote Desktop Protocol (RDP).
• You are strictly prohibited from using your personal computer, personal browser, or personal storage devices for task work.
• You must have a stable internet connection capable of maintaining a consistent RDP connection.
• You may not install any software on the AWS VM.

Compliance & Rules (Zero Tolerance):
• You must only work on tasks you are authorized to do (we will provide required attributes).
• You must log accurate active work hours. Time fraud (logging hours not actively worked) is grounds for immediate termination.
• Absolutely no use of ChatGPT, Claude, or any external AI tools to assist with evaluations.
• Strict confidentiality is required. You may not screenshot, copy, or share any task materials.
• Maximum 14 hours per day / 40 hours per week.

Schedule & Pay:
• Full-time: 40 hours per week (M–F 8 hours/day preferred, but flexible as long as 40 hours are reached).
• USA Business Hours schedule highly preferred (9:00-5:00 CST)
• Pay is structured as a revenue share equivalent to $4.50 per hour of active work on the AI platform.
• First week: $100 paid once 24 active hours are reached, and the remaining $80 paid at week's end.
• Ongoing: Weekly payouts processed by Handshake AI on Wednesdays (covering Mon–Sun of the previous week), taking 24–48 hours to clear.
• No taxes are withheld. You are responsible for your own taxes.

To apply: Please confirm you understand that this is a 1099 Independent Contractor role, that you can strictly follow the AWS VM/RDP requirement, inform us if you work during USA business hours, and that you are comfortable with the revenue-share pay structure.

VIEW OTHER JOB POSTS FROM:
SHARE THIS POST
facebook linkedin
  BENCHMARKS  
Loading Time: Base Classes  0.0010
Controller Execution Time ( Jobseekers / Job )  0.0130
Total Execution Time  0.0179
  GET DATA  
No GET data exists
  MEMORY USAGE  
1,486,200 bytes
  POST DATA  
No POST data exists
  URI STRING  
jobseekers/job/AI-Output-Evaluator-1741501
  CLASS/METHOD  
jobseekers/job
  DATABASE:  onlinejobs (Jobseekers:$db)   QUERIES: 13 (0.0064 seconds)  (Hide)
0.0003   SELECT *
                                
FROM exrates
                                WHERE rate_name 
= 'USD-PHP' 
0.0003   SELECT *
FROM `employer_jobs`
WHERE `job_id` = 1741501
 LIMIT 1 
0.0003   SELECT *
FROM `employers`
WHERE `employer_id` = 766855
 LIMIT 1 
0.0010   SELECT COUNT(*) AS `numrows`
FROM `t_thread` `t`
LEFT JOIN `t_thread_misc` `misc` ON `t`.`id` = `misc`.`thread_id`
WHERE `t`.`job_id` = 1741501
AND `misc`.`id` IS NULL 
0.0005   SELECT e.business_name, e.logo, e.website, e.rebill_date, e.date_added member_date, hits, DATEDIFF('2026-10-16',ej.date_added) duration_days, DATEDIFF('2026-10-16',e.rebill_date) duration_rebill, ej.*, e.deactivate FROM employers e, employer_jobs ej WHERE e.employer_id = ej.employer_id AND
                                   ((
e.user_level >= '500' AND ej.date_added <= e.rebill_date)
                                   OR 
e.employer_id = '' OR (ej.date_approved <> '2000-01-01' and DATEDIFF('2026-10-16',ej.date_added) <= 14 ))
                                   AND 
e.deactivate != 1 AND ej.deleted = 0 AND job_id = '1741501' 
0.0003   SELECT *
FROM `employer_jobs_skills` `ejs`
LEFT JOIN `skills_categories` `sc` ON `ejs`.`skill_id` = `sc`.`id`
WHERE `job_id` = 1741501 
0.0007   UPDATE employer_jobs SET hit_counts = '***Oct-01-2026=1051***Oct-02-2026=69***Oct-03-2026=42***Oct-04-2026=31***Oct-05-2026=59***Oct-06-2026=28***Oct-07-2026=44***Oct-08-2026=20***Oct-09-2026=28***Oct-10-2026=9***Oct-11-2026=3***Oct-12-2026=2***Oct-13-2026=1***Oct-14-2026=1***Oct-15-2026=1***Oct-16-2026=2' WHERE job_id= '1741501'  
0.0006   UPDATE employer_jobs SET monthly_hits = '***Oct-2026=1388' WHERE job_id= '1741501'  
0.0007   SELECT date_sent FROM jobseeker_sent_emails WHERE jobseeker_id = '' AND job_id = '1741501' AND status LIKE 'sent%' ORDER BY id DESC  
0.0003   SELECT *
FROM `employer_jobs_skills` `ejs`
LEFT JOIN `skills_categories` `sc` ON `ejs`.`skill_id` = `sc`.`id`
WHERE `job_id` = 1741501 
0.0009   SELECT COUNT(*) AS `numrows`
FROM `employer_jobs`
WHERE `employer_id` = '766855'
AND `date_added` >= '2022-06-08' 
0.0003   select * from teasers 
0.0002   SELECT * FROM skill_categories WHERE skill_cat_id='' 
  HTTP HEADERS  (Show)
  SESSION DATA  (Show)
  CONFIG VARIABLES  (Show)