Find Jobs
Hire Freelancers

Data mining and web crawling to find websites and products

$30-250 USD

Closed
Posted over 7 years ago

$30-250 USD

Paid on delivery
I am searching for somebody who has experience with data crawling in the web. You should also know the shop system by Shopify The project includes the following tasks: 1) Collect all URLs from active stores in the Internet which are using the Shopify shop system. There are more than 250.000 store to collect. 2) Insert this data in a database (MongoDB prefered) and rank it by traffic. Therefor you need to find out how high the traffic (visits) per month is. 3) Let the crawler open the page with the best selling products and save the 5 best selling products for each store in the database as well. For each product we need to save the following information: - product name - product price - product image The crawler and all other written should be copied to our repository after the project is done so that we can run the crawler later again. The database should be hosted on our infrastructure once the job is done. PLEASE ONLY APPLY FOR THIS JOB IF YOU ALREADY HAVE EXPERIENCE WITH SUCH JOBS AND IF YOU KNOW THE SHOPIFY SHOP SYSTEM.
Project ID: 11595013

About the project

9 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average $167 USD for this job
User Avatar
Hello. I am the professional web scraping specialist with more than 5 years of experience in this field. I have scraped every type of website and I have ability to scrape protected , ajex and java websites. let's discuss further about your task. Thanks
$111 USD in 3 days
4.9 (143 reviews)
6.8
6.8
User Avatar
Hello I am very interested in your project。 I am an expert in C#, php, asp.net, web scraping, web automation, selenium and others. I am ready to start to work this job. And I am free in recent days, so I can do my best for your project. Please let discuss details and the price about the project. Best Regards。
$222 USD in 5 days
4.8 (47 reviews)
5.9
5.9
User Avatar
I'm expert web scraping, web bot, web crawler, spider with python and php please read my review Recently I completed ADIDAS web crawler project that get link URL address by inputting web form with shoes size,kind.. I want to discuss your project and going on work with you for long time. thanks.
$250 USD in 3 days
5.0 (5 reviews)
4.3
4.3
User Avatar
With 6 years work experience, I am confident that I am the best candidate for your vacancy. My Expertise Areas is Email and Contacts Collections ,Scraping data, On/Off line Data Entry, Product Research, Photoshop, Content writing, Data entry, Internet Research, PDF to Word and Excel, Word to excel, excel and Formatting-Automation (Formulas).
$205 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Greetings!! I have several years of experience in programming, mostly focusing on the Python programming language, Ruby programming language & C++ programming. I've developed everything from simple web scrapers to complex programs & even complex web applications involving complex databases in backend. With huge experience in programming I am confident that I can complete your project upto your satisfaction. Please contact me for further discussion. Regards, Nishant Goel
$133 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of GERMANY
Ems, Germany
0.0
0
Payment method verified
Member since Jul 19, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.