Find Jobs
Hire Freelancers

Website scrapper & Analyzer for arbitrage (READ before bidding)

$30-250 USD

Completed
Posted almost 6 years ago

$30-250 USD

Paid on delivery
I'm in the need of automating a very manual process. If I speed up this process I save 85% of the time it takes me to do the whole thing. I need a script/software build to scrap a specific website that already offers data but does not offer API. I need it to scrape through all the links available in a list of more than 25,000 items daily. Then while it scrapes each item of the list I need it to Analyze the data provided doing a comparison from a couple variables provided in the page of the item. Then, if certain parameters are met I need it to create a report with the items that meet the criteria. Please read in detail my requirement, I don't have a big budget for this project since I'm short in resources but since is only one specific website I think this can be done easily and inexpensively.
Project ID: 16685290

About the project

19 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Dear Employer, I understand your job completely. Below is the description of what you need: - An app to scrap data daily from the website that doesnt provide API. - Check some internal variable and get only those products which satisfy those criterias. - Get the detail in Excel or CSV or whatever format you need. I understand this and will do this. I have few questions which most of other freelancers will not ask or may not even know: - Most websites create Pagination, which means you will not able to see products after a particular number for a URL, we have to break the URL in multiple on the basis of filters. How are you planning to do that? Or are those 25K products on the basis of some ID (like ASIN in Amazon)? - Do you have an idea about use of proxies and captcha handlers for eCommerce or even data scraping? Please give me an opportunity. I know everything about eCommerce scraping, will give you a good solution. Thanks and Regards, Ash
$222 USD in 3 days
5.0 (171 reviews)
7.5
7.5
19 freelancers are bidding on average $155 USD for this job
User Avatar
Hi sir, This is Lin and I am scraping expert, please check my reviews then you will know. Can we discuss more details about your project? Thanks, Lin
$200 USD in 3 days
5.0 (409 reviews)
7.8
7.8
User Avatar
Dear sir I am a qualified python developer with 8 years of web scraping. I read the job description carefully and am confident with this project. I am ready to work for you. Looking forward to hearing from you soon. Best Regards, Yongtao
$250 USD in 3 days
4.9 (116 reviews)
7.5
7.5
User Avatar
Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Web Data Extractor & Automator and I'd like to help you. Experience building solutions like: Windows Desktop Apps (using Excel, Access, .NET, Winautomation) Scrapers Apps Scrape services Automation programs/bots Web apps/systems. Message me to have the whole idea about your project. Will wait for your contact. Thanks.
$200 USD in 3 days
5.0 (215 reviews)
7.5
7.5
User Avatar
I can provide you fast and effective scraping program that will visit website and process all 25,000 items daily. Also it will check each item against some rules and generate report if needed. Please give me more details (website URL etc) so I can check everything on my side.
$130 USD in 2 days
5.0 (563 reviews)
7.6
7.6
User Avatar
Hello. I am a Python programmer and expert in web scraping. I read your description and I am offering this price. We can discuss it further after providing me with more details about what data needs to be scraped and the website. Kind Regards Maciej
$66 USD in 3 days
5.0 (98 reviews)
6.4
6.4
User Avatar
EXPERIENCED DEVELOPER... PLEASE CHECK MY BADGES, PROJECTS AND REVIEWS and ensure yourself that I can do this very well and very quick... I have done many scrapings, as well as combined with arbitraging... like arbitrage betting and scraping the odds from booking sites
$177 USD in 5 days
5.0 (36 reviews)
6.0
6.0
User Avatar
Hello, I'm web automation expert with 7 years of experience. I've completed many similar jobs and I'm ready to start working right now. I'll make a script that runs on windows/linux/mac If you are interested, please contact me so we can talk about details. Thank you, Borna
$194 USD in 5 days
5.0 (20 reviews)
6.1
6.1
User Avatar
Hey there, It seems you require someone to automate the manual processing you've described. You've found the right person for the job! I have over 3 years of experience in Web development with over 8 years in general programming. I have used a wide variety of frameworks and technologies over the years. What you require can be done quite easily using NodeJS and Puppeteer. I have used it on a couple of projects and am fully confident that it fits the job. Looking forward to working on this. See you in chat!
$150 USD in 3 days
5.0 (4 reviews)
5.1
5.1
User Avatar
Hi. My name is Oleg and I am senior C#/.NET software developer from Ukraine. Please contact to discuss details regarding the project. What's the website?
$150 USD in 3 days
5.0 (4 reviews)
4.6
4.6
User Avatar
Hello, I have briefly read the description on Website scrapper & Analyzer for arbitrage development, and I can deliver as per the requirements however I need us to discuss for more clarity on the details, deadline and budget as well.
$155 USD in 3 days
5.0 (13 reviews)
4.6
4.6
User Avatar
Hi. Please see my profile for samples. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now
$83 USD in 3 days
4.6 (22 reviews)
4.3
4.3
User Avatar
I am an expert of scraping web sites using python. I can create a script with a gui, if you prefer. The structure of the site is important: I have to examine it beforehand.
$111 USD in 3 days
4.9 (4 reviews)
3.4
3.4
User Avatar
Hello, I've read your description. You've mentioned 25,000 items daily. Do you need to compare with certain criteria only daily data? Do you need to scrap data from item's page or from page which contain other items? Do you need to compare with previous day? Is there any specific preference for report i.e. Excel file? I think after getting answers on this question I will be able to complete this project in 1 day. Thanks a lot! Ivan
$188 USD in 1 day
5.0 (1 review)
2.4
2.4

About the client

Flag of DOMINICAN REPUBLIC
sc, Dominican Republic
5.0
24
Payment method verified
Member since Jun 8, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.