I need a custom crawler setup to automatically search up to 15 URLs at different times during the day for different keywords of printing Industry. Please email for a list of the websites. Websites include major classified sites but also some other smaller newspapers and online forums. This project could be longer term since this might need troubleshooting and I am adding new URLs periodically.
I am only interested in the most recent postings and ads, def. nothing older than 2 or 3 days.
If you have experience with this or can point me to a service that already exists I would appreciate it. Please include your past experience or sample of your work with your bid.
If you can create a custom scraper for each website that works as well since some of my queries are pretty broad and simple keyword search doesn't work for some websites. Your suggestions are welcome.
I can provide constant work of similar scrapping.