Full Time
$4.50
40
Oct 1, 2026
AI Output Evaluator
We are looking for a detail-oriented, highly disciplined Independent Contractor to evaluate AI-generated outputs (images, videos, audio, and text) for a U.S.-based AI training project.
The Work:
You will compare two AI-generated responses side-by-side and determine which one better satisfies a specific prompt based on observable evidence. You will be trained on our strict evaluation rubric and expected to write brief, evidence-based justifications for your choices.
Technical Requirements (Mandatory):
• All work MUST be performed on a provided AWS Virtual Machine (VM) accessed via Remote Desktop Protocol (RDP).
• You are strictly prohibited from using your personal computer, personal browser, or personal storage devices for task work.
• You must have a stable internet connection capable of maintaining a consistent RDP connection.
• You may not install any software on the AWS VM.
Compliance & Rules (Zero Tolerance):
• You must only work on tasks you are authorized to do (we will provide required attributes).
• You must log accurate active work hours. Time fraud (logging hours not actively worked) is grounds for immediate termination.
• Absolutely no use of ChatGPT, Claude, or any external AI tools to assist with evaluations.
• Strict confidentiality is required. You may not screenshot, copy, or share any task materials.
• Maximum 14 hours per day / 40 hours per week.
Schedule & Pay:
• Full-time: 40 hours per week (M–F 8 hours/day preferred, but flexible as long as 40 hours are reached).
• USA Business Hours schedule highly preferred (9:00-5:00 CST)
• Pay is structured as a revenue share equivalent to $4.50 per hour of active work on the AI platform.
• First week: $100 paid once 24 active hours are reached, and the remaining $80 paid at week's end.
• Ongoing: Weekly payouts processed by Handshake AI on Wednesdays (covering Mon–Sun of the previous week), taking 24–48 hours to clear.
• No taxes are withheld. You are responsible for your own taxes.
To apply: Please confirm you understand that this is a 1099 Independent Contractor role, that you can strictly follow the AWS VM/RDP requirement, inform us if you work during USA business hours, and that you are comfortable with the revenue-share pay structure.