Debug and enhance a custom web crawler 2

Cancelled Posted Feb 7, 2012 Paid on delivery
Cancelled Paid on delivery

1) change recursion to another search algorithm (you proposed BFS or Queue). However, I would go with anything that allow for increased performance and better memory utilization

2) part of 1) is to store the links as hash-codes. This will allow for faster comparison of visited domains as well as improve memory utilization

3) use of external java library. Also aimed at improving performance

4) add a subdomain yes/no check box. If checked to yes, the search will allow for expansion into subdomains, part of the main domain structure.

Java

Project ID: #1433815

About the project

2 proposals Remote project Active Feb 7, 2012

2 freelancers are bidding on average $450 for this job

dobreiiita

Hi, I am confident to handle your project. Please check your inbox,Thanks

$500 USD in 12 days
(189 Reviews)
6.7
barundebnath

Hi, I am expert in making web scrapper and crawler. Please see PM for more detail. Thanks

$400 USD in 10 days
(34 Reviews)
5.2