I need a forum scraped for email addresses and a few other data points.
The adresses show up on some user profile pages, you will need to scrape all 598,707 of the profile pages.
In adition to the emails you will also need to scrape any Messenger program handles posted and append the appropriate (best guess) domain to to format them as email addresses.
So if a user has Yahoo messenger name: usertest1 then you would scrape that and turn it into a yahoo email address.
You will also need to scrape a few more data points from the profile page including:
Username, homepage, Date of birth, skype name, twitter name, facebook profile ID, Youtube profile name, Youtube profile name also turned into a gmail address
The final deliverable should be a CSV with a each unique scraped email address, all available data points, and the URL it was scraped from.
I will be checking the Scraped from URLs to verify the data.
Note: You will have to use proxies to scrape this forum.
If you have any questions please let me know.
I will have MANY more of these projects so a competative bid on this one and good work will result in a lot more jobs.
Thanks for bidding!