Website Spider Windows Service

I require a Windows Service to be built, in VB.NET using Visual Studio 2005 or Visual Studio 2008.

This service will act as an aggregator to a part of a larger application. It will spider about 3 websites that have easy and predictable content; a couple of forums, and also a service that serves up XML that is very easy to deconstruct.

The service should find new users listed on the above 3 websites. Users can also add themselves to our application, but the spider should find new users. If the user is not already listed in the database, then it should record that person.

If the web service is paused, it should pause its spidering and continue from where it was before. It should not respider pages it has visited for some time.

If the web service is stopped, it should stop its spidering and continue from where it was before. It should not respider pages it has visited for some time.

You may use a SQL 2005 database or the file system for any temporary data storage.

The database structure will be available to the developer. It is fairly easy though. There is one table, with joins with another table and you will need to check the users you find are not already listed in those tables.

If you find a new user, you add the user to the database using a stored procedure that is already present.

The web service should be multithreaded, and multiple spiders should operate simultaneously from the service.

I would like the developer to use a multithreading template that I have in place for another windows service, and I will provide this code.

The windows service will be running on a Windows Server 2003 server, and communicating with SQL Server 2005. It is preferable that the development is done in Visual Studio 2008.

The work must be done in Visual [url removed, login to view]

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):

a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Windows Server 2003 Standard Edition

SQL Server 2005

PHP

Project ID: #3457778

About the project