Website scraper and publish program for affiliate website.

Completed Posted Jun 27, 2007 Paid on delivery
Completed Paid on delivery

Element 1 A program that can be set-up to scrap ‘xx’ number of travel sites and populate a MySql database. Would be ideal if the program could reference a directory containing a list of text files that identify the site values and databases mappings. Element 2 A program (batch file) that can auto generate and publish the website every 3 days so as to ensure the latest offers are displayed. I DO NOT WANT A DYNAMIC SITE ??" no php, asp, jsp. Main Project requirements Req #1 Must be scaleable Req #2 Must run un-managed ??" although with sufficient error checking to report when travel sites have change values or URL’s for example Req #3 Continuing on from req #2 ??" must be easy to update values that are likely to change. Req #4 Must scrape every 3 days Req #5 Must publish website every 3 days (day behind the scrape to allow for errors) Req #6 Good quality code is a must Req #7 Site must be fast (another good reason why its static pages) Key Deliverables 1. Scraping program 2. Generating and Publishing program 3. E-R diagram of database 4. Any documentation regarding maintenance of the program Key Milestones 1. Database E-R diagram 2. Scraping program running and populating database correctly and error free for 2 weeks 3. Generating and publishing program running error free for 2 weeks. 4. Code inspection (external arranged) 5. Scraper, Generating and publishing programs running and website live for 1 week (minimum). I will also require storage for the database/programs and hosting for the site, etc. If you could recommend or identify requirements, I will purchase and supply their details on to you. Once a bid has been accepted I will: - supply a set of wireframes and sitemaps - identify initial sites to scrap (roughly 7 to start) - identify values to scrap and store - Provide content, images and templates for the site. If this project is successful, I will be looking to expand this into something longer term. Many thanks.

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):

a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Must be cross browser/platform support site IE6+ Firefox 2.x Safari

Engineering MySQL PHP Software Architecture Software Testing Translation Web Hosting Website Management Website Testing

Project ID: #3075371

About the project

4 proposals Remote project Active Jul 1, 2007

Awarded to:

rentme

See private message.

$147.89 USD in 119 days
(38 Reviews)
6.2

4 freelancers are bidding on average $1875 for this job

telosMed

See private message.

$425 USD in 119 days
(124 Reviews)
5.3
liniedreapta

See private message.

$127.5 USD in 119 days
(34 Reviews)
3.8
decal

See private message.

$6800 USD in 119 days
(0 Reviews)
0.0