Crawler and data feeder for price comparison website
$30-250 USD
Closed
Posted about 15 years ago
$30-250 USD
Paid on delivery
We need a system that will crawl and grab data like product name,price,title,image,description and add them in our database.
This will be done from a number of online shops and propably very often.
We also need to find a solution when a merchant can provide us with an xml file.
You may have to talk to our website developers.
How are you!
It seems very simple task. What about some universal grabber that can be extended to support any data/page layout? This grabber will have some config file with number of sites you need to grab and data format template. Same grabber may read the XML file provided by a merchant, because XML is actually same as HTML page.
I think one week is anougth for such simple task. And I will not ask a lot of money just becuase this is my first project on getafreelancer :-) And of course we need to discuss some details.
Have a nice day!
Hi,
creating webservices and scheduling them to run from the database server will do the task. At the same time we can mention all the required links and parameters to be crawled in a config file.
The number of days to develop may vary, once i get the clear Requirements i can come to a conclusion on number of days.