Directory scrape of contact details

I require a scrape of publicly accessible information on a website.

It is not paid for content, nor members only content.

Deliverables:

Provide a list of Names, contact details and other figures from two sets of results pages in two excel spreadsheets/tab delimited files (not comma limited because data contains commas).

## Deliverables

**First results set:**

A list of all Estate agents across all counties: [url removed, login to view]

Search using county, All activities, using post requests

Converting to get requests reveals the page uses the following fields:

[url removed, login to view]*&SearchE=20&SearchB=&SearchC=*&SearchD=&SearchF=Firm&thesubsite=1&thetheindex=1&kids=0%2C66%2C87%2C70%2C71%2C83%2C106&parent=0&schemes=0%2C3%2C0%2C3%2C3%2C3%2C12&starvals=0%2C0%2C0%2C0%2C0%2C0%2C0%2C0&searchby=County&orderby=DEFAULT&viewpage=1&sizepage=20&x=14&y=34

[url removed, login to view]

SearchA=*

&SearchE=20

&SearchB=

&SearchC=*

&SearchD=

&SearchF=Firm

&thesubsite=1

&thetheindex=1

&kids=0%2C66%2C87%2C70%2C71%2C83%2C106&parent=0

&schemes=0%2C3%2C0%2C3%2C3%2C3%2C12

&starvals=0%2C0%2C0%2C0%2C0%2C0%2C0%2C0

&searchby=County

&orderby=DEFAULT

&viewpage=1

&sizepage=20

&x=14

&y=34

By changing the viewpage from 1 to 123 you can iterate through all the results pages.

Collect the following in seperate columns in the 1st spreadsheet/delimeted file.

Name,

street number and street,

locailty,

town,

postcode,

phone number,

email,

website,

No ofreferences,

Average value,

Satisfaction level (this can be found from the file name for the bargraph image, eg. [url removed, login to view] = 8.0, [url removed, login to view] = 9.1)

URL to "See what their customers say"

**Second results set**

A list of Letting agents across all counties: [url removed, login to view]

Search using county, All activities

Collect the following in separate columns in the 1st spreadsheet/delimited file.

Name,

street number and street,

locality,

town,

postcode,

phone number,

email,

website,

No of references,

-- Average value, this seems to be the average asking price for properties for sale.

Satisfaction level (this can be found from the file name for the bargraph image, eg. [url removed, login to view] = 8.0, [url removed, login to view] = 9.1)

URL to "See what their customers say"

C# Programming Engineering MySQL Perl PHP Script Install Software Architecture Software Testing Visual Basic Web Hosting Website Management Website Testing

Project ID: #3326719

About the project