Find Jobs
Hire Freelancers

Scraping competitor's website for specific data points

$30-250 USD

Completed
Posted over 8 years ago

$30-250 USD

Paid on delivery
***Please do not reply until you have visited the URL I need you to scrape, which is listed below (removed 'http://www' and using DOT net instead of .net to avoid bots etc., so you will need to adjust the URL to fix it before viewing in your browser)*** powertrainproducts DOT net/Engines-s/[login to view URL] This is a straightforward scrape job. On this page, scroll down a bit and you will see that there are 100 engine products for sale on each page, and there are 17 pages. There are about 1,700 products total. The "page=" URL parameter controls the pagination. We need the scraper to request each individual product page, for example this one (URL refromatted): powertrainproducts DOT net/Isuzu-88-91-1-6-4xe1-engine-p/[login to view URL] There are 8 data points we need the scraper to collect from each individual product page. You need to deliver this solution as a MySQL dump file (.sql) with 1 main table and 1 subtable. The main table is to store data points 1 through 7. I will explain the subtable in data point #8 below. The 8 data points are marked in purple and numbered 1 through 8 in the attached screenshot. Here are the 8 data points shown in the attached screenshot: 1. title 2. subtitle 3. price 4. stock status 5. availability + product code 6. all image URLs (full size) 7. all text from the 'Description' tab 8. all listed applications for each individual product (this should be a sub-table in the MySQL DB and linked by ID columns to the main table). As you can see this website is organized easy for scraping. We have the ability and know-how to do this job ourselves, but we do not have the time. So we need to hire you. Please provide a reasonable quote only after you have FULLY reviewed all URLs, the attachment and you completely understand the requirements. Thank you!
Project ID: 8437624

About the project

17 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, I have extensive knowledge in web scraping with Ruby. I can get this completed in 4 hours. I recently scraped Amazon,Yell,Zillow,Yellow Pages. And I use these techniques Tor,Proxies, User Agent switching and timeouts. Let me know if you are [login to view URL]
$80 USD in 0 day
5.0 (5 reviews)
3.7
3.7
17 freelancers are bidding on average $117 USD for this job
User Avatar
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$111 USD in 3 days
5.0 (251 reviews)
7.4
7.4
User Avatar
HI, i have checked your mentioned website, ​I specialize in web scraping jobs like this one. You can see on my profile that I have completed many similar jobs. Don't make the mistake of hiring an amateur, who doesn't have the skill set to properly complete this task and will only waste your time. Hire me, a professional with a rock solid reputation and over 8 years of experience specifically in writing scraping code like this. I know what I can and cannot do, and I won't waste your time by saying I can do something that I can't. because I exclusively write scraping code I know what to expect and I will always live up to what I tell you, and will also deliver a higher quality final product than my competitors. Regards
$100 USD in 3 days
4.9 (232 reviews)
6.9
6.9
User Avatar
A proposal has not yet been provided
$147 USD in 3 days
4.8 (159 reviews)
7.0
7.0
User Avatar
A proposal has not yet been provided
$133 USD in 3 days
5.0 (31 reviews)
5.9
5.9
User Avatar
Bookmarking this project, Trying to create script.. Will update proposal when done.. Thank you
$100 USD in 1 day
5.0 (73 reviews)
5.7
5.7
User Avatar
A proposal has not yet been provided
$55 USD in 3 days
5.0 (47 reviews)
5.4
5.4
User Avatar
Hi How are you? I have read all your points and also seen attachment. I have good experties in development also scraping. I have scraped various sites with millions products! I can deliver you all products in 2-3 days with all information in database or if you want any other format also. We can also discuss more if you want. I am available now at freelancer and also on skype: abu_gosia I hope you will happy from my work! Thanks
$277 USD in 3 days
5.0 (35 reviews)
5.3
5.3
User Avatar
Hello, Thank you very much for this Scraping Project. I read through the job details extremely carefully and understand your required, for this I am absolutely sure that I can do the project very well. I can complete this Scraping project on time and within your budget. I have worked on similar Scraping projects, and I am confident I can exceed your expectations. Regards by Feroz Ahmed See My Feedback: www.freelancer.com/u/ferozstk.html
$100 USD in 2 days
4.7 (23 reviews)
4.9
4.9
User Avatar
A proposal has not yet been provided
$222 USD in 2 days
2.2 (1 review)
3.0
3.0
User Avatar
Hello Sir , I am 100% Sure That i am Perfect For This Job. I have 5 Year Of Exp. In Same Feild And I am Available For 24*7 Support . ALso We Offer You a 30 Days Free Maintainance. Please Message Me Once before You Award The Project . I'll Give You best Deal Possible. Regards Webexe Solutions
$54 USD in 3 days
0.0 (1 review)
0.0
0.0
User Avatar
Hi I can develop a website scraping script. The script will get all necessary information and put in a MySql database. I use Java language and Selenium, Jsoup libraries for developing.
$30 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
SAINT PETERS, United States
5.0
9
Member since Feb 27, 2014

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.