Create a crawler based on websites content patterns
$250-750 USD
In Progress
Posted over 12 years ago
$250-750 USD
Paid on delivery
Hello,
I need someone really smart in coding (PHP, Perl, Python, or whatever working on the web) improve a small web crawler (to fill a classifieds search engine).
The software already exists, but it needs some improvments to make it faster.
I also have new websites to crawl.
The software consists in detecting a the pattern of the content of given websites, and then, take the content and send it to a interface that will store it in a database. the software doesn't access directly to the database. It just send requests to another software in charge of storing all in database.
Any kind of ads should be remove from the content before storing it.
Applicants must have good knowledge in software development; I will need to know what you have already done before (things looking like crawler of course), because, I want somebody really fast in developping the crawler.
The price must be given a number of day of work on the problem, and after studying the software (which is attached as file), you should tell me how fast you can work.
Feel free to propose your price, the budget is just an indication.