Data scraping: Google & Bing search results

$30-250 USD

Closed

Posted

over 8 years ago

$30-250 USD

Paid on delivery

Note: Experience/willingness to work with AWS, specifically Elastic IP is a must for this task. Description of task: i have an excel file with one column with celebrity names i need to know the number of google search results and number of bing results in 2 additional columns. In addition Bing many times has the person's occupation and short 1 paragraph bio and these need to be pulled into 2 columns. there are about 11000 rows the script you write should work for other single column excel sheets IMPORTANT: i found a plugin for excel that has a formula to pull google numbers but google blocks these requests after couple hundred rows... same for bing, so an important part of this will be to rotate the IPs (using a service like aws elastic ip) to avoid blocking. Using public proxies doesn't work and Google will continue to block. We have also tried using Google Scraper on github without success. If you are unable to scrape this info (e.g if we fail) then I ask that you complete the job using only the Bing API, but I will only pay a discretionary bonus. Bing also has an API that handles 5000 requests per account, so that may be a way to pull this information from Bing

Amazon Web Services

Python

Web Scraping

Project ID: 8294271

About the project

11 proposals

Remote project

Active 9 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

11 freelancers are bidding on average $192 USD for this job

@e3d

Hi, I can avoid google/bing to ban ip by using proxies and I have huge experience in that. Let me know if you want me to do it

$199 USD in 3 days

5.0

(264 reviews)

8.8

@cowboy14

Hello sir, Consider it as done within 3 days!! I checked your excel file and i am able to complete the file within 72 hours from both bing and google. I have registration on ipsocks and so ip is not a problem for me. Ready for sample work. Waiting for your reply. Thanks, Sakib

$200 USD in 5 days

4.9

(105 reviews)

7.5

@mirniyazuddin92

Dear Sir/Ma'am, I am a Web research and Data Entry expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information from different websites into an Excel sheet. I am ready to hear the details of the project more in detail now. I have always created a long-term collaboration with my clients through hard work and quality output for a reasonable price. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

$200 USD in 3 days

4.9

(199 reviews)

7.6

@phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta

$200 USD in 3 days

5.0

(77 reviews)

7.4

@adeelpirzada

Hi there i have done scrapping almost on Half of Worldwide web including ecommerce giants(Amazon,ebay,craigslist) News Feed, Social media websites, API's. I develop my own tools based on client requirements with Mulithreading, a Bot with human behaviour and Scrapping Applications with documents parsing. I Can do PDF Parsing and Capctha ByPass code as well. Contact me for further details and demo

$250 USD in 3 days

5.0

(40 reviews)

6.7

@pnvasko

Hello, i can scrap google & bing use elastic ip or use tor network. all be written in Python Best regards, Vasiliy

$177 USD in 3 days

4.9

(37 reviews)

6.4

@oneskybd

Hi, I am writing in response to your advertisement. After carefully reviewing the experience requirements of the job description it seems to me that my experience is suitable to match for the job. I have excellent experience in managing the extracted data in MS Excel, MS Word, MS Power point, Google Docs, Google Spreadsheet, Google Document and other related applications. I believe my capabilities would be perfect for your project. I can complete this job within your deadline. Moving ahead, I can dedicate 30 hours/week for your job, and my daily hours are negotiable. Please you can get in touch with me instantly to discuss this place further. Regards, Omar Faruq

$155 USD in 3 days

5.0

(8 reviews)

2.0

@mojians

I have done a project similar to this before. I switched vpn to avoid google ban while bing didn't ban IP at all.

$155 USD in 10 days

0.0

(0 reviews)

0.0

@IsrarKhan1993

I can create a Python script that will get the amount of results on each celebrity. However looking at the excel sheet you have provided, i have a few questions for which i think it is best to discuss on private message. My aim will be to make sure the script is fully automated and the script will be able to be used on different excel sheets as you have requested.

$250 USD in 5 days