Senior Python Data Scraping Engineer (Remote)

Please login or register as jobseeker to apply for this job.

: TYPE OF WORK

Gig

: SALARY

$100

: HOURS PER WEEK

TBD

: DATE UPDATED

Jul 4, 2026

JOB OVERVIEW

We’re looking for an experienced Senior Python Data Scraping Engineer to build a scalable data collection platform capable of gathering publicly available information from a variety of online sources.

The ideal candidate has extensive experience developing custom scraping applications in Python and understands how to build reliable, efficient systems that collect, process, and organize large amounts of public web data.

Responsibilities

* Design and build a custom Python-based data scraping platform
* Collect publicly available information from websites, forums, blogs, message boards, directories, and social platforms where permitted
* Develop scalable scraping workflows capable of handling large datasets
* Implement proxy management and request optimization for reliable data collection
* Build modular, maintainable, and well-documented code
* Store, clean, and organize collected data for downstream processing
* Monitor scraper performance and resolve issues as websites evolve

Required Skills

* 3+ years of professional Python development
* Strong experience building custom web scraping applications
* Experience with Scrapy, Playwright, BeautifulSoup, Requests, Selenium, or similar frameworks
* Experience with proxy management and large-scale scraping architecture
* Strong understanding of HTTP, APIs, sessions, cookies, headers, and HTML parsing
* Experience with databases such as PostgreSQL, MySQL, MongoDB, or SQLite
* Comfortable working in PyCharm or another professional Python development environment
* Experience using Git and collaborative development workflows

Nice to Have

* Experience collecting publicly available data from online communities, discussion forums, blogs, review websites, and social platforms where permitted
* Experience with asynchronous programming, multiprocessing, or distributed scraping
* Experience deploying Python applications to cloud or VPS environments
* Familiarity with Docker and automated scheduling tools

To Apply

Please include:

1. A summary of your Python development experience.
2. Examples of scraping projects you’ve built.
3. Which Python libraries and frameworks you use most often.
4. The largest data collection project you’ve completed.
5. Your experience working with proxies and scalable scraping systems.
6. Links to your GitHub or portfolio (if available).
7. Your expected hourly or monthly rate.

We’re looking for someone who can architect and build a reliable, production-ready data collection system from the ground up while following applicable laws and the terms governing the data sources used.

SKILL REQUIREMENT

Python Data scraping Web Scraping

SHARE THIS POST

Job Post	Reporter	Rank	Reason	Date

BENCHMARKS

Loading Time: Base Classes	0.0008
Controller Execution Time ( Jobseekers / Job )	0.0282
Total Execution Time	0.0296

GET DATA

No GET data exists

MEMORY USAGE

1,501,072 bytes

POST DATA

No POST data exists

URI STRING

jobseekers/job/Senior-Python-Data-Scraping-Engineer-Remote-1682157

CLASS/METHOD

jobseekers/job

DATABASE: onlinejobs (Jobseekers:$db) QUERIES: 13 (0.0208 seconds) (Hide)

0.0009	`SELECT * FROM exrates WHERE rate_name = 'USD-PHP'`
0.0009	SELECT * FROM `employer_jobs` WHERE `job_id` = 1682157 LIMIT 1
0.0014	SELECT * FROM `employers` WHERE `employer_id` = 908825 LIMIT 1
0.0015	SELECT COUNT(*) AS `numrows` FROM `t_thread` `t` LEFT JOIN `t_thread_misc` `misc` ON `t`.`id` = `misc`.`thread_id` WHERE `t`.`job_id` = 1682157 AND `misc`.`id` IS NULL
0.0011	SELECT e.business_name, e.logo, e.website, e.rebill_date, e.date_added member_date, hits, DATEDIFF('2026-07-13',ej.date_added) duration_days, DATEDIFF('2026-07-13',e.rebill_date) duration_rebill, ej.*, e.deactivate FROM employers e, employer_jobs ej WHERE e.employer_id = ej.employer_id AND ((e.user_level >= '500' AND ej.date_added <= e.rebill_date) OR e.employer_id = '' OR (ej.date_approved <> '2000-01-01' and DATEDIFF('2026-07-13',ej.date_added) <= 14 )) AND e.deactivate != 1 AND ej.deleted = 0 AND job_id = '1682157'
0.0009	SELECT * FROM `employer_jobs_skills` `ejs` LEFT JOIN `skills_categories` `sc` ON `ejs`.`skill_id` = `sc`.`id` WHERE `job_id` = 1682157
0.0022	`UPDATE employer_jobs SET hit_counts = '*Jul-04-2026=496Jul-05-2026=36Jul-06-2026=27Jul-07-2026=22Jul-08-2026=5Jul-09-2026=8Jul-10-2026=7Jul-11-2026=4**Jul-13-2026=1' WHERE job_id= '1682157'`
0.0011	`UPDATE employer_jobs SET monthly_hits = '***Jul-2026=606' WHERE job_id= '1682157'`
0.0013	`SELECT date_sent FROM jobseeker_sent_emails WHERE jobseeker_id = '' AND job_id = '1682157' AND status LIKE 'sent%' ORDER BY id DESC`
0.0008	SELECT * FROM `employer_jobs_skills` `ejs` LEFT JOIN `skills_categories` `sc` ON `ejs`.`skill_id` = `sc`.`id` WHERE `job_id` = 1682157
0.0071	SELECT COUNT(*) AS `numrows` FROM `employer_jobs` WHERE `employer_id` = '908825' AND `date_added` >= '2022-06-08'
0.0009	`select * from teasers`
0.0008	`SELECT * FROM skill_categories WHERE skill_cat_id=''`

HTTP HEADERS (Show)

SESSION DATA (Show)

__ci_last_regenerate	1783978503
last_page	https://v1.stage.onlinejobs.ph/jobseekers/job/Senior-Python-Data-Scraping-Engineer-Remote-1682157
csrf-token	2ad900fcf15fd77cf3b745b4e27e7f37

CONFIG VARIABLES (Show)

base_url	https://v1.stage.onlinejobs.ph
log_threshold	2
enable_profiler
index_page
uri_protocol	PATH_INFO
url_suffix
language	english
charset	UTF-8
enable_hooks	1
subclass_prefix	MY_
composer_autoload	vendor/autoload.php
permitted_uri_chars	a-z 0-9~%.:_\=\-\+\@?\&
enable_query_strings
controller_trigger	c
function_trigger	m
directory_trigger	d
allow_get_array	1
log_path
log_file_extension
log_file_permissions	420
log_date_format	Y-m-d H:i:s
error_views_path
cache_path
cache_query_string
encryption_key	OdBUArjiWg9I7u7bvAwQ7Fu35VB1kzga
sess_driver	files
sess_cookie_name	ci_session
sess_expiration	2678400
sess_save_path
sess_match_ip
sess_time_to_update	300
sess_regenerate_destroy
cookie_prefix
cookie_domain
cookie_path	/
cookie_secure
cookie_httponly
standardize_newlines
global_xss_filtering	1
csrf_protection
csrf_token_name	csrf_test_name
csrf_cookie_name	csrf_cookie_name
csrf_expire	7200
csrf_regenerate	1
csrf_exclude_uris	Array ( )
compress_output
time_reference	local
rewrite_short_tags
proxy_ips
ojadmin	JpjZkQN5A8l@^L
salt	+UFjSAT49tPZLtmU2CIG2FYN7pRhgsWyLHgSyQa6k3I=
queue_enabled
twilio	Array ( [sid] => AC00c0594045c6eef9407e8fff01f3d467 [token] => f0bfc0b73444a077894a43f5f75e6d41 [length] => 6 [from] => +639221200200 [code_expiry_seconds] => 14400 )
maintenance	Array ( [admin] => Array ( [verification] => ) [announcement_bar] => Array ( [show_slow_issue_message] => ) )
trustpilot	Array ( [to_email] => onlinejobs.ph+3d844ebf71@invite.trustpilot.com )
services	Array ( [google_tag_manager] => Array ( [id] => GTM-T5CQMS6P ) [chatgpt] => Array ( [secret] => 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 ) [claude] => Array ( [secret] => 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 ) )
v2_url	https://v2.onlinejobs.ph
replacemyself_secret_key	Kk1WpgTMkc4wBQOqC5rqCssdLhACKrsJeTtO1ywUkT4=
app	Array ( [app] => Array ( [command] => Array ( [map] => Array ( [OnlineJobs\Mailer\Command\SendEmailCommand] => OnlineJobs\Mailer\Handler\SendEmailHandler [OnlineJobs\Mail\Command\SendEmailCommand] => OnlineJobs\Mail\Handler\SendEmailHandler [OnlineJobs\Mail\Command\QueueEmailPendingCommand] => OnlineJobs\Mail\Handler\QueueEmailPendingHandler [OnlineJobs\Mail\Command\QueueJobEmailPendingCommand] => OnlineJobs\Mail\Handler\QueueJobEmailPendingHandler [OnlineJobs\Mail\Command\QueueUnapprovedEmailCommand] => OnlineJobs\Mail\Handler\QueueUnapprovedEmailHandler [OnlineJobs\Mail\Command\ProcessEmailQueueCommand] => OnlineJobs\Mail\Handler\ProcessEmailQueueHandler [OnlineJobs\Mail\Command\PutJobseekerEmailOnHoldCommand] => OnlineJobs\Mail\Handler\PutJobseekerEmailOnHoldHandler [OnlineJobs\Purchase\Command\RealEstateVaCourseCommand] => OnlineJobs\Purchase\Handler\RealEstateVaCourseHandler [OnlineJobs\Test\Command\HelloCommand] => OnlineJobs\Test\Handler\HelloHandler ) [middleware] => Array ( ) ) [providers] => Array ( [0] => OnlineJobs\Bus\BusServiceProvider [1] => OnlineJobs\Database\DbServiceProvider [2] => OnlineJobs\Mailer\MailerServiceProvider [3] => OnlineJobs\Support\SupportServiceProvider [4] => OnlineJobs\Employer\ServiceProvider [5] => OnlineJobs\Jobseeker\ServiceProvider [6] => OnlineJobs\Mail\ServiceProvider [7] => OnlineJobs\Postal\ServiceProvider [8] => OnlineJobs\Queue\ServiceProvider [9] => OnlineJobs\Courier\ServiceProvider [10] => OnlineJobs\Job\ServiceProvider [11] => OnlineJobs\Purchase\ServiceProvider ) ) )
meta	Array ( [facebook] => Array ( [input] => 1 [connect] => 2 [timezone] => 3 [url] => 30 [id] => 31 [photo] => 32 [name] => 33 [email] => 34 [review] => 35 ) [trust] => Array ( [government_id] => 4 [utility_bill] => 5 [selfie_photo] => 6 [profile_picture] => 7 [phone_number] => 8 [facebook] => 9 ) [verify] => Array ( [profile_picture] => 10 [government_id] => 11 [selfie_photo] => 12 [utility_bill] => 13 [address] => 14 [name] => 15 [reviewed] => 16 [government_group] => 28 [address_group] => 29 [mobile] => 38 ) [address] => Array ( [complete] => 17 [room_unit_no] => 20 [house_no] => 21 [street] => 22 [subdivision] => 23 [barangay] => 24 [city] => 25 [province] => 26 [postcode] => 27 ) [reviewed] => Array ( [similar_names] => 1 ) [name] => 18 [phone] => 19 [sms_verification_code] => 36 [resend_verification_code] => 37 [address_read] => 39 [first_name] => 100 [middle_name] => 101 [last_name] => 102 [edit] => Array ( [government_id_group] => 40 [address_group] => 41 [mobile_group] => 42 ) [salary_re_entry] => 103 [id_proof_recalibrate] => 104 [email] => 44 [mobile_verification_type] => 45 )
honeypot	Array ( [name_field] => my_name [enabled] => 1 )

HTTP_ACCEPT	/
HTTP_USER_AGENT	Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
HTTP_CONNECTION	Upgrade
SERVER_PORT	80
SERVER_NAME	v1.stage.onlinejobs.ph
REMOTE_ADDR	127.0.0.1
SERVER_SOFTWARE	Apache/2.4.58 (Ubuntu)
HTTP_ACCEPT_LANGUAGE
SCRIPT_NAME	/index.php
REQUEST_METHOD	GET
HTTP_HOST
REMOTE_HOST
CONTENT_TYPE
SERVER_PROTOCOL	HTTP/1.1
QUERY_STRING
HTTP_ACCEPT_ENCODING	gzip, br, zstd, deflate
HTTP_X_FORWARDED_FOR	216.73.216.61
HTTP_DNT

Senior Python Data Scraping Engineer (Remote)

Please login or register as jobseeker to apply for this job.

TYPE OF WORK

SALARY

HOURS PER WEEK

DATE UPDATED

Why is this blurred?