AI Quality & Evaluation Specialist

Please login or register as jobseeker to apply for this job.

: TYPE OF WORK

Full Time

: SALARY

₱65,000 per month

: HOURS PER WEEK

40

: DATE UPDATED

Oct 9, 2026

JOB OVERVIEW

We’re hiring an AI Quality & Evaluation Specialist to help improve the quality and reliability of an AI-powered platform used in real-time security operations. The platform monitors live inputs such as video, audio, location data, GPS, telemetry, and chat messages to identify potential i ---------- , send alerts to officers, and escalate events for operational review.

This role follows a human-in-the-loop approach, where human judgment and feedback help AI systems improve their performance and decision-making. You’ll contribute to the ongoing development of AI technology by helping ensure its outputs are accurate, appropriate, and reliable in real-world situations.

This is a great opportunity for someone who enjoys working with technology, analyzing information, solving problems, and improving processes. If you’re detail-oriented, naturally curious, and interested in helping AI systems become more effective over time, we’d love to hear from you.

Responsibilities:
- Review AI-generated alerts, messages, and actions to determine whether they are correct, appropriate, and supported by the available information.
- Identify and label incorrect AI outputs, including false positives, inaccurate location or status information, inappropriate messages, and other errors.
- Document why an AI-generated action was incorrect and provide clear, actionable feedback to help improve its accuracy and decision-making.
- Evaluate correct AI outputs to help identify successful decisions and maintain consistent quality standards.
- Identify recurring errors and patterns in AI-generated outputs and communicate findings to the appropriate teams.
- Maintain accurate records of evaluations, error classifications, and feedback using internal tools and systems.
- Apply critical thinking and sound judgment when reviewing alerts, messages, and other AI-generated actions.
- Follow established evaluation guidelines and flag unclear or unusual cases for further review when needed.
- Collaborate with operations and other internal teams to share findings and support continuous improvements to the AI platform.
- Help improve evaluation criteria, review guidelines, and workflows to make the quality review process more consistent and effective.

Requirements:
- 3+ years of experience in Operations, Quality Assurance, Data Review, Process Improvement, Customer Support, or a related field.
- Experience reviewing AI-generated outputs, evaluating AI systems, or working with AI-powered tools is a big plus.
- Experience working with US-based companies or teams is a plus.
- Experience as a Team Lead or Subject Matter Expert is a plus.
- Familiarity with AI tools such as ChatGPT and a genuine interest in understanding how AI systems work and improve.
- Strong analytical and critical thinking skills, with the ability to assess information, identify errors, and distinguish correct outputs from incorrect or misleading ones.
- Excellent attention to detail and the ability to recognize inconsistencies, false alarms, data errors, and inappropriate messages.
- Strong written English communication skills, especially when documenting errors, explaining decisions, and providing actionable feedback.
- A process improvement mindset, with the ability to identify recurring issues and suggest practical solutions.
- Naturally inquisitive and comfortable asking questions to understand how systems work and why errors occur.
- A fast learner who takes feedback well and adapts to changing guidelines and processes.
- Able to work independently while maintaining accuracy, consistency, and productivity.
- Comfortable navigating SaaS tools and learning new systems in a fast-paced environment.
- Must be available to work graveyard hours aligned with U.S. time zones.
- Reliable internet connection and dedicated work-from-home setup required.

Salary and Benefits:
- Base salary: ₱65,000 per month.
- Paid Time Off and paid holidays.
- 100% work from home.

Application Instructions
Please send your resume link using a publicly accessible PDF from Google Drive. Make sure it is a direct file link (not a folder or Google Doc).
Links from Dropbox, OneDrive, OnlineJobs, or other similar platforms, as well as non-direct file links, may not be reviewed by our Talent Team.
Please also include:
- A short explanation of why you're a good fit for the role
- Copy and paste this Job ID: recmu2hWeFhxkBBZf and include it in your email subject line
- Include this message in your email body: "I'm excited to be applying to Job recmu2hWeFhxkBBZf!"

This will help us identify your application quickly and also shows that you’ve read the entire job description (attention to detail is important for this role). Thanks and hope to hear from you soon!

SKILL REQUIREMENT

Problem Solving Quality Assurance Artificial Intelligence

SHARE THIS POST

Job Post	Reporter	Rank	Reason	Date

BENCHMARKS

Loading Time: Base Classes	0.0011
Controller Execution Time ( Jobseekers / Job )	0.0397
Total Execution Time	0.0420

GET DATA

No GET data exists

MEMORY USAGE

1,532,984 bytes

POST DATA

No POST data exists

URI STRING

jobseekers/job/AI-Quality-Evaluation-Specialist-1747118

CLASS/METHOD

jobseekers/job

DATABASE: onlinejobs (Jobseekers:$db) QUERIES: 13 (0.0246 seconds) (Hide)

0.0014	`SELECT * FROM exrates WHERE rate_name = 'USD-PHP'`
0.0006	SELECT * FROM `employer_jobs` WHERE `job_id` = 1747118 LIMIT 1
0.0015	SELECT * FROM `employers` WHERE `employer_id` = 661746 LIMIT 1
0.0005	SELECT COUNT(*) AS `numrows` FROM `t_thread` `t` LEFT JOIN `t_thread_misc` `misc` ON `t`.`id` = `misc`.`thread_id` WHERE `t`.`job_id` = 1747118 AND `misc`.`id` IS NULL
0.0006	SELECT e.business_name, e.logo, e.website, e.rebill_date, e.date_added member_date, hits, DATEDIFF('2026-10-16',ej.date_added) duration_days, DATEDIFF('2026-10-16',e.rebill_date) duration_rebill, ej.*, e.deactivate FROM employers e, employer_jobs ej WHERE e.employer_id = ej.employer_id AND ((e.user_level >= '500' AND ej.date_added <= e.rebill_date) OR e.employer_id = '' OR (ej.date_approved <> '2000-01-01' and DATEDIFF('2026-10-16',ej.date_added) <= 14 )) AND e.deactivate != 1 AND ej.deleted = 0 AND job_id = '1747118'
0.0003	SELECT * FROM `employer_jobs_skills` `ejs` LEFT JOIN `skills_categories` `sc` ON `ejs`.`skill_id` = `sc`.`id` WHERE `job_id` = 1747118
0.0007	`UPDATE employer_jobs SET hit_counts = '*Oct-09-2026=466Oct-10-2026=229Oct-11-2026=4Oct-12-2026=2Oct-13-2026=2Oct-14-2026=1Oct-15-2026=4*Oct-16-2026=7' WHERE job_id= '1747118'`
0.0007	`UPDATE employer_jobs SET monthly_hits = '***Oct-2026=714' WHERE job_id= '1747118'`
0.0004	`SELECT date_sent FROM jobseeker_sent_emails WHERE jobseeker_id = '' AND job_id = '1747118' AND status LIKE 'sent%' ORDER BY id DESC`
0.0004	SELECT * FROM `employer_jobs_skills` `ejs` LEFT JOIN `skills_categories` `sc` ON `ejs`.`skill_id` = `sc`.`id` WHERE `job_id` = 1747118
0.0169	SELECT COUNT(*) AS `numrows` FROM `employer_jobs` WHERE `employer_id` = '661746' AND `date_added` >= '2022-06-08'
0.0004	`select * from teasers`
0.0003	`SELECT * FROM skill_categories WHERE skill_cat_id=''`

HTTP HEADERS (Show)

SESSION DATA (Show)

__ci_last_regenerate	1792133065
last_page	https://v1.stage.onlinejobs.ph/jobseekers/job/AI-Quality-Evaluation-Specialist-1747118
csrf-token	0d4304766286a475c2f76e118e2faaf6

CONFIG VARIABLES (Show)

base_url	https://v1.stage.onlinejobs.ph
log_threshold	2
enable_profiler
index_page
uri_protocol	PATH_INFO
url_suffix
language	english
charset	UTF-8
enable_hooks	1
subclass_prefix	MY_
composer_autoload	vendor/autoload.php
permitted_uri_chars	a-z 0-9~%.:_\=\-\+\@?\&
enable_query_strings
controller_trigger	c
function_trigger	m
directory_trigger	d
allow_get_array	1
log_path
log_file_extension
log_file_permissions	420
log_date_format	Y-m-d H:i:s
error_views_path
cache_path
cache_query_string
encryption_key	OdBUArjiWg9I7u7bvAwQ7Fu35VB1kzga
sess_driver	files
sess_cookie_name	ci_session
sess_expiration	2678400
sess_save_path
sess_match_ip
sess_time_to_update	300
sess_regenerate_destroy
cookie_prefix
cookie_domain
cookie_path	/
cookie_secure
cookie_httponly
standardize_newlines
global_xss_filtering	1
csrf_protection
csrf_token_name	csrf_test_name
csrf_cookie_name	csrf_cookie_name
csrf_expire	7200
csrf_regenerate	1
csrf_exclude_uris	Array ( )
compress_output
time_reference	local
rewrite_short_tags
proxy_ips
ojadmin	JpjZkQN5A8l@^L
salt	+UFjSAT49tPZLtmU2CIG2FYN7pRhgsWyLHgSyQa6k3I=
queue_enabled
twilio	Array ( [sid] => AC00c0594045c6eef9407e8fff01f3d467 [token] => f0bfc0b73444a077894a43f5f75e6d41 [length] => 6 [from] => +639221200200 [code_expiry_seconds] => 14400 )
maintenance	Array ( [admin] => Array ( [verification] => ) [announcement_bar] => Array ( [show_slow_issue_message] => ) )
trustpilot	Array ( [to_email] => onlinejobs.ph+3d844ebf71@invite.trustpilot.com )
services	Array ( [google_tag_manager] => Array ( [id] => GTM-T5CQMS6P ) [chatgpt] => Array ( [secret] => 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 ) [claude] => Array ( [secret] => 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 ) )
v2_url	https://v2.onlinejobs.ph
replacemyself_secret_key	Kk1WpgTMkc4wBQOqC5rqCssdLhACKrsJeTtO1ywUkT4=
app	Array ( [app] => Array ( [command] => Array ( [map] => Array ( [OnlineJobs\Mailer\Command\SendEmailCommand] => OnlineJobs\Mailer\Handler\SendEmailHandler [OnlineJobs\Mail\Command\SendEmailCommand] => OnlineJobs\Mail\Handler\SendEmailHandler [OnlineJobs\Mail\Command\QueueEmailPendingCommand] => OnlineJobs\Mail\Handler\QueueEmailPendingHandler [OnlineJobs\Mail\Command\QueueJobEmailPendingCommand] => OnlineJobs\Mail\Handler\QueueJobEmailPendingHandler [OnlineJobs\Mail\Command\QueueUnapprovedEmailCommand] => OnlineJobs\Mail\Handler\QueueUnapprovedEmailHandler [OnlineJobs\Mail\Command\ProcessEmailQueueCommand] => OnlineJobs\Mail\Handler\ProcessEmailQueueHandler [OnlineJobs\Mail\Command\PutJobseekerEmailOnHoldCommand] => OnlineJobs\Mail\Handler\PutJobseekerEmailOnHoldHandler [OnlineJobs\Purchase\Command\RealEstateVaCourseCommand] => OnlineJobs\Purchase\Handler\RealEstateVaCourseHandler [OnlineJobs\Test\Command\HelloCommand] => OnlineJobs\Test\Handler\HelloHandler ) [middleware] => Array ( ) ) [providers] => Array ( [0] => OnlineJobs\Bus\BusServiceProvider [1] => OnlineJobs\Database\DbServiceProvider [2] => OnlineJobs\Mailer\MailerServiceProvider [3] => OnlineJobs\Support\SupportServiceProvider [4] => OnlineJobs\Employer\ServiceProvider [5] => OnlineJobs\Jobseeker\ServiceProvider [6] => OnlineJobs\Mail\ServiceProvider [7] => OnlineJobs\Postal\ServiceProvider [8] => OnlineJobs\Queue\ServiceProvider [9] => OnlineJobs\Courier\ServiceProvider [10] => OnlineJobs\Job\ServiceProvider [11] => OnlineJobs\Purchase\ServiceProvider ) ) )
meta	Array ( [facebook] => Array ( [input] => 1 [connect] => 2 [timezone] => 3 [url] => 30 [id] => 31 [photo] => 32 [name] => 33 [email] => 34 [review] => 35 ) [trust] => Array ( [government_id] => 4 [utility_bill] => 5 [selfie_photo] => 6 [profile_picture] => 7 [phone_number] => 8 [facebook] => 9 ) [verify] => Array ( [profile_picture] => 10 [government_id] => 11 [selfie_photo] => 12 [utility_bill] => 13 [address] => 14 [name] => 15 [reviewed] => 16 [government_group] => 28 [address_group] => 29 [mobile] => 38 ) [address] => Array ( [complete] => 17 [room_unit_no] => 20 [house_no] => 21 [street] => 22 [subdivision] => 23 [barangay] => 24 [city] => 25 [province] => 26 [postcode] => 27 ) [reviewed] => Array ( [similar_names] => 1 ) [name] => 18 [phone] => 19 [sms_verification_code] => 36 [resend_verification_code] => 37 [address_read] => 39 [first_name] => 100 [middle_name] => 101 [last_name] => 102 [edit] => Array ( [government_id_group] => 40 [address_group] => 41 [mobile_group] => 42 ) [salary_re_entry] => 103 [id_proof_recalibrate] => 104 [email] => 44 [mobile_verification_type] => 45 )
honeypot	Array ( [name_field] => my_name [enabled] => 1 )

HTTP_ACCEPT	/
HTTP_USER_AGENT	Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
HTTP_CONNECTION	Upgrade
SERVER_PORT	80
SERVER_NAME	v1.stage.onlinejobs.ph
REMOTE_ADDR	127.0.0.1
SERVER_SOFTWARE	Apache/2.4.58 (Ubuntu)
HTTP_ACCEPT_LANGUAGE
SCRIPT_NAME	/index.php
REQUEST_METHOD	GET
HTTP_HOST
REMOTE_HOST
CONTENT_TYPE
SERVER_PROTOCOL	HTTP/1.1
QUERY_STRING
HTTP_ACCEPT_ENCODING	gzip, br, zstd, deflate
HTTP_X_FORWARDED_FOR	216.73.216.145
HTTP_DNT

AI Quality & Evaluation Specialist

Please login or register as jobseeker to apply for this job.

TYPE OF WORK

SALARY

HOURS PER WEEK

DATE UPDATED

Why is this blurred?