We're looking for a team that can build a scraping program for different websites. Its based on the following ideas:
- It has to run 24/7
- The program should be able to monitor all websites simultaneously (around 100)
- As soon as there are any website changes (new product, sizes restocked,..) the program should send a notification to a discord channel
- It should be able to support proxies
- It should be able to filter website changes with keywords (the program should only send a notification when there's a reliable product restocking. The notification should display: Link, Image of Product, Add to Cart Links, Sizes in Stock)
- preferably written in python or C, but up to the developer on what they think is best/fastest.
- It should be as fast as possible
- I must be able to configure the program to certain sites as well as certain keywords.
- The program will check against keywords in the product titles as well as the Shopify site's sitemap
- The product should be licensed to me and you should be able to give me further support.
- I will most likely be looking to scale this program into bigger as soon as there are more websites i want to scrape
Please reach out to me, if you're interested in my project. This is a big project and I want a experienced developer team.
40 freelancers are bidding on average $4730 for this job
share your sites ,.we will do all the functions. Relevant Skills and Experience we will deliver quality work . Proposed Milestones $4061 USD - milestone