Find Jobs
Hire Freelancers

Finish a scrape script

$10-30 USD

In Progress
Posted over 6 years ago

$10-30 USD

Paid on delivery
I have a (perhaps) 60% finished script that scrapes a website. You need to finish this. You do not need to perform any scraping yourself, just finishing the script. We need profile data and images. See the list of profiles here [login to view URL] - Due to the heavy use of Googles CAPTCHA we need to use the scraping script via a Chrome Extension so an actual human can do the CAPTCHA when needed. - The script need to traverse the list of profiles (see link above) grabbing the profile image and the link for each profile. - Then we need to go through each profile to scrape the data as described in the list below and save that into Firebase, except for images, which are naturally stored separately and locally on the computer. - The script must, of course, handle correctly that the web page asks for a CAPTCHA once in a while. We are targeting profiles in Norway. Let us use English language. The from the profiles the script must scrape is listed below. Note that phone number is a special case that needs special treatment. - URL - Small image from the list of profiles. Even if this image is in large format in the profile, we also need the one from the profile list because this is without a watermark. - Category (the small icon above the pictures) - The large images - Validated ad (the left top corner marker on some profiles) - Username - Age - Height - Weight - Shoe size - Hair color - Cup size - Silicon breasts - Shaving - Smoker - Nationality - Piercings - Escort - Massage - Striptease - Incall - Outcall - Prices 15 min. Incall (leave out cumshots), amount (NOK) - Prices 15 min. Outcall (leave out cumshots), amount (NOK) - Prices 30 min. Incall (leave out cumshots), amount (NOK) - Prices 30 min. Outcall (leave out cumshots), amount (NOK) - Prices 1 hour. Incall (leave out cumshots), amount (NOK) - Prices 1 hour. Outcall (leave out cumshots), amount (NOK) - Prices 2 hours. Incall (leave out cumshots), amount (NOK) - Prices 2 hours. Outcall (leave out cumshots), amount (NOK) - Prices Extra hour. Incall (leave out cumshots), amount (NOK) - Prices Extra hour. Outcall (leave out cumshots), amount (NOK) - Prices Dinner Date. Incall (leave out cumshots), amount (NOK) - Prices Dinner Date. Outcall (leave out cumshots), amount (NOK) - Prices Overnight. Incall (leave out cumshots), amount (NOK) - Prices Overnight. Outcall (leave out cumshots), amount (NOK) - Prices 24 hours. Incall (leave out cumshots), amount (NOK) - Prices 24 hours. Outcall (leave out cumshots), amount (NOK) - Video (example: [login to view URL]) - Description - Languages: Language and level - Services (gives) - Services (receives) - Accept sms - Accept anonymous calls - Telephone numbers: One or two numbers. Sometimes the phone number is in clear text, then just scrape it. But sometimes the phone number is hidden via a link to a popup box that has a CAPTCHA that needs to be performed before the phone number is revealed in the same popup box. - Is telephone number protected? I hope I did not overlook anything. If you see that a profile has some info not listed here, then we need also that info.
Project ID: 15386258

About the project

2 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
2 freelancers are bidding on average $40 USD for this job
User Avatar
Am good at writing scripts based on anything Relevant Skills and Experience Writing
$25 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of NORWAY
Gardermoen, Norway
4.9
12
Payment method verified
Member since Jan 27, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.