Beautiful Soup/Selenium Webdriver - Automated Extraction of Website Content
$30-250 USD
Cancelled
Posted about 4 years ago
$30-250 USD
Paid on delivery
Hi guys,
I want to download data from a website available as HTML text (very little Java Script involved). Task should be automatically processed using a Python Script (e.g., combination of Beautiful Soup and Selenium Webdriver as not the full results are shown but only first couple of entry; rest only appears when you scroll down) and the output should be processed into a table with a fix structure.
Input would be for instance: Search for all results with Keyword "Chief Executive Officer".
Search [login to view URL] shows the input interface (Search mask)
Then, for each result, the script should download all the individual data given for a person by clicking on each result link (see [login to view URL]) and then download all text data (no graphs, just the text information). See [login to view URL] for an example how a result page looks like. All text data should be exported into a CSV table, where each result should be one row with clean text data and the categories would be variables.
Thanks for your interest in my project!
Hi there,
I am interested in your project. I would approach your project by making a program to collect the data automatically. The program will be written in Python3/Selenium. It could be run on any operating system and easy for maintenance.
I have 5+ years’ experience at Web scraping. If you'd like to view my previous work, take a look at my profile https://www.freelancer.com/u/etuannv or check some demo videos here: [login to view URL]
Thank you!
$198 USD in 3 days
5.0 (117 reviews)
6.9
6.9
10 freelancers are bidding on average $114 USD for this job
Hello sir,
Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss the details via pm. I look forward to hearing from you soon.
Best Regards,
Hello How are you?
I have experienced with python more than 5 years and Also I am familiar with scraping data.
So I will use selenium or bs4 for your project and I can start now and available.
I hope to hear from you soon.
Let's discuss in details about your project.
Best Regard.
Hello, dear
I have read your description carefully. Very interesting job.
Here is web scraping expert.
Looking forward to hearing from you soon.
I am ready to work for you.
Best wishes.
hi sir i would like to involve python and selenium and so I would complete this project in 1 hou
please reach out to me and let's get started now
thank you
i hope to hear from you soon
Hi,
How are you? I am very interested in your project and I have a lot of time currently for your project. I have done scraping using BeautifulSoup and requests. I have scraped The White House briefs and statements and it's on my portfolio. I am confident that I will deliver good work. I understand clients do not like projects being delivered late and I will be willing to work on agreed time.
Kindly text me on chat so that we can get into further details.
Thanks for your attention.
Warm regards.