Scrapper, Bots, Mining, Culling Data Project Longterm Relationship (Exp developer only)

Project Description:
We are looking to hire people who can build scrapers on a full time and part time basis. We have around 10,000 scrapers to build. The web site is completed to the point that we now need to build scrapers to able to add data to the site.

The scrapers you will build will scrape sites like these:

Video on how to scrape county site.

http://youtu.be/xrbVi6JluPM

County Site

http://apps.adcogov.org/PTForeclosureSearch/Index.aspx

Adams CSV File template attached

Trustee site

https://sales.hsbfirm.com/fcSalesList.aspx

Senter CSV File Template attached

These are just a few of the sites that we will need scraped. The idea behind building the scrapers it to build one base scraper for all similar sites. You will then take a copy of that code and tweak it for the other sites that are similar, thereby creating many scrapes for many sites.

We have found with our current scraper guys that they can build 1 base scraper in 6-10 hours and the within the next 5 hours they can build the other 20 scrapers that are similar. So it would take 15 hours to build 20 scrapers that are similar in design.

If you can build 20 scrapers in 15 hours, you would be required to build 50 scrapers a week and around 200 scrapers a month full time.

This is an example of amount of scrapers and time. The amount of scrapers that can be built and time it takes may vary.

We will require that you go to these two sites and build a test scraper for the two sites. Please populate the data to the CSV files provided with this listing. Please make sure that in this CSV record any fields that are not filled out, that you put dummy data in the CSV, so that we can see all fields populate.

Once you have sent us the CSV file, we will upload it manually to our site as test record. Once it is in the site we will check for proper populating of records. We will then create a link from our site that can be sent to the Main manager for his approval.

This is the process that you will use each time you build a scraper. You will need to bid on this job based on this type of process.

These scrapers need to built in a language that the Cron on our server can run the code on the automatic scrapers.

Please track your time to build and the output the scrapers to a CSV file. We need you to test these scrapers and your time to build so that when you give us an estimate of time to build and cost to build it will be apples to apples with other freelancers biding on this job.

We need you to bid the job on the monthly fee you would charge to do the above specs. You can give a us part time price of 20 to 30 hours a week and you can give us a Full Time price of 40 to 60 hours per week. Please specify in the notes weather you are bidding part time or full time so we will understand your bid.

You will communicate with me directly and I will get all bids approved by the main manager.

Good luck and we hope to see you as a part of our team soon.