Scraper tool to get allintitle number of results from Google -- 2

Completed Posted 3 years ago Paid on delivery
Completed Paid on delivery

****

Posted a project like this before. The dev tried, but on inspecting the code, and it's functionality, somewhat ineffectual. Actually it was, ineffectual. I still released the funds. You pay what you get for, as they say say. The guy tried. So I post this again.

Basically my requirements are:

A) Ability to manually enter, 'upload' or set/use a list of keywords saved in csv format. The more keywords at a time, the better. Would be good if I can upload/process 500-700 keywords at a time. A script that will read the '[login to view URL]' file for example is just fine.

B) For uploaded keywords, be able to scrape or fetch the 'allintitle' number of results. So for each of the keywords in the list, 'basically' conduct an allintitle search and fetch the number of results and store that in a csv file in the 'cell' adjacent to the particular keyword. Pls see the attached images. They are an exact representation of what I need, particularly the allintitle search.

C) I understand Goog isn't particularly fond of these types of 'automated' queries, understandable, so I need the ability if it's not already built-in to be able to upload or set a list of proxies. Basically, I need to bypass the reCapture. The processing of the keywords does not have to be immediate. It can take some time, an hour, two, three or so, etc. let's discuss that.

D) We run Linux based systems. I'm not afraid of scripts and some coding if need be. I post this because I don't have the time personally to figure out a solution. Too many other tasks to handle! Use whatever tools you are comfortable or competent with as long as it's able to run in a Linux environment or CLI

E) I have put an upper limit for the project at USD$250 for the time being. That is OPEN to negotiation, providing YOU ARE CONFIDENT YOU CAN DELIVER on the project! Give me a time frame and let's discuss!

****

I need a scraper software tool (either script which can be run on local computer or a web application tool) which will be able to do the following:

1) User will be able to import bulk keywords line by line (using a text file or direct import into the software).

2) The tool must take each keyword and run a query in Google with "allintitle:keyword".

3) Google will return a number of results from the above query. For example, Google returns the following text: "About 92 results"

4) The tool must store each keyword with the number of results (from allintitle query) in a new CSV file for export.

5) The tool shall also be able to accept a text file with proxy IP addresses and use those when scraping for avoiding limitations from Google.

Let me know if you can code such a tool and with what software development technology. Also I need to know what experience you have for such projects.

I don't want beautiful GUI or other fancy things with the tool. Just to do its job !!

Python Web Scraping Software Development Programming Web Development

Project ID: #26279956

About the project

14 proposals Remote project Active 3 years ago

Awarded to:

shashankmistry31

I remember this project , I had a fun while doing a demo for it . [login to view URL] I believe in work rather than words and the above video is the proof. Please don't award the project for 24 hours - I wil More

$150 USD in 2 days
(10 Reviews)
4.5

14 freelancers are bidding on average $193 for this job

meladbadder

Hi I have already this tool from my previous project I waiting your reply Thanks

$250 USD in 1 day
(30 Reviews)
5.9
mehamednews

I might be bedding late, But the description was a bit long So I needed some time to read it all. First I've added a bid on the previous project as well, This time I hope you'd give me a chance to show you my scraping More

$220 USD in 3 days
(26 Reviews)
5.8
Stephenrajs

Hi there, I Have Scraped Amazon, Aliexpress, Yellow Pages, Yelp, Etc. I Have Unlimited Internet.I Have 6 Systems. I can do it. I have done many related projects like this. If you are provide this work, it will he More

$250 USD in 7 days
(122 Reviews)
5.7
narsim3128

NOTE : I HAVE EXPERTISE IN C# / JAVA. With respect to this project I would like to present myself as a candidate for your consideration. I have more than 12 years of IT experience. I have successfully completed proje More

$250 USD in 7 days
(39 Reviews)
5.7
science64

Hello, Thank you for this long explanation. There are modules in python for google searches. I gathered many information before but it is limited but 500-700 searches are quite easy and fast maybe less than 30 mins it More

$200 USD in 7 days
(36 Reviews)
5.2
PKonstiantyn

Hello! Sir Very interesting in your project My name is konstiatyn who is professional in webscrapping. I have read your description and understand your idea I am specialized in webscrapping. I did so many scrapping wi More

$140 USD in 7 days
(15 Reviews)
4.6
swarnali2017

Dear Employer, I am Swarnali, living in Australia, available online for more than 16 hours. Now, I am working one python project that main goal is to scrap web data using Selenium Webdriver, Beautiful Soup, Requests, More

$50 USD in 2 days
(9 Reviews)
3.6
Bsram88

I understand the difficulties you faced with previous developer. however good to hear you paid for what he did. I have some question to make it clear. Okay. now shall we discuss bit more in chat ? Ram.

$111 USD in 5 days
(5 Reviews)
3.3
lukyaanton

Hi, manager! I have read your job description carefully. I am a web scraping expert using python. I have rich experiences with web scraping. and I can store data on excel or CSV file. so, don't worry about the project. More

$150 USD in 7 days
(2 Reviews)
1.3
dgaaiorowski

Hi, I can try get this job done. I have experience with parsing web pages. I can do it using python and scrappy.

$244 USD in 7 days
(0 Reviews)
0.0
Gerrard97

We are a team of Electrical and Electronics engineers and we are Excellent in the following areas: • PCB Designing-Proteus, Eagle. • Python • Embedded C Programming. • VHDL/Verilog • Microcontroller like Arduino, R More

$140 USD in 7 days
(0 Reviews)
0.0
OthmenBraham

Hi, I can scrape any website no matter what technology they use and how much security they have. Please feel free to ask any query, I am always be here to assist you. Even if you don't hire me, I will provide you my r More

$140 USD in 7 days
(0 Reviews)
0.0