Find Jobs
Hire Freelancers

Write a scraping script using python / selenium / bs4

$30-250 USD

Closed
Posted over 4 years ago

$30-250 USD

Paid on delivery
I collect stock market ticker symbols (and their associated company names) for private research. I prefer to gather these from the stock exchanges around the world. Some exchanges make it very easy to gather this information by providing downloadable spreadsheets or CSV files, others present the data in compact HTML tables, while still others spread this information out over a fairly large number of pages that require considerable navigation to view. I am looking for a person with extensive experience with Python (2.7), Beautiful Soup and Selenium. The task is to write script to automate the process of navigating sites (using selenium) and extracting and assembling [ticker symbol, company name] tuples from the HTML using BS4, and ultimately dumping the collected data to a flat file (preferably JSON). Here is an example of a national stock exchange site for which such a script needs to be written: [login to view URL] The interface consists of three levels. The top level allows a user to select the starting letter of a company name [A-Z,0-9]. Each of these hyperlinked starting characters leads to the second level of the interface that displays a table of companies. Each row in this table displays a company's name, but not its ticker. To see the ticker, the user must click on the name hyperlink to be taken to a "Company detail" page (the third level of the interface). This detail page shows one or more alphanumeric ticker symbols (called the "Trading Code") along with other useful company information to be parsed. I need this script to run on a headless Chrome browser running on Linux (Ubuntu). This 3-level tree must be traversed by using Selenium since some of the hrefs fire JS events. If this is something you have extensive experience with, please apply! Make sure you have an excellent command of the three requisite technologies before applying. I am looking for one or more people to whom I can assign many such automated data harvesting tasks of varying degrees of complexity. Please base your quote on the particular example described above.
Project ID: 22247611

About the project

27 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
27 freelancers are bidding on average $147 USD for this job
User Avatar
I have huge Python and web scraping experience (check my reviews) that's why I'm sure that you'll be impressed with my work. I can provide you a Python Selenium based (but there is no need to use it for above website) scraper that will parse each company detail page and output into CSV file. You'll get a working program in less than 2 days for just $200.
$200 USD in 2 days
4.9 (519 reviews)
7.9
7.9
User Avatar
Hi there,I am Python Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$175 USD in 3 days
4.9 (169 reviews)
7.9
7.9
User Avatar
Hello, I'd be glad to develop a web scraping tool that retrieves stock exchange data as per your requirements. The tool will be developped in Python using the powerful libraries of BS4 and selnium headless chrome driver. Looking forward to chat with you soon for more details. Best regards.
$95 USD in 2 days
5.0 (180 reviews)
7.5
7.5
User Avatar
hey, I have checked the website you mentioned. I can make a PYTHON script to extract the data you mentioned in your description. Would like to talk more details with you in chat. Thanks!
$70 USD in 1 day
5.0 (173 reviews)
6.5
6.5
User Avatar
I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest quality expectations. Looking forward to work on your project. Thank you.
$100 USD in 5 days
4.8 (73 reviews)
6.5
6.5
User Avatar
Hi I'm a python Coder with experience of Selenium, Requests, and BS4. I have have done a number of scraping projects in the past, and am very familiar with html and Javascript frameworks, thus can decode what is needed from what. I also have no issue coding and storing in JSON as I'm very experienced in API creation and data gathering. Thanks Marc Nealer
$250 USD in 5 days
4.9 (14 reviews)
6.1
6.1
User Avatar
Hi there, Thank You for reviewing my job proposal. As per your job description I am glad to let you know that I can create a python selenium script to scrap required data from the above mentioned website URL. I have more than 3 years of experience in web scraping and can scrap almost any type of website. Please check my freelancer profile for reference of past projects and client's feedback. If you have any questions or doubts please feel free to contact me via inbox. Regards Karim
$55 USD in 1 day
5.0 (56 reviews)
5.7
5.7
User Avatar
Hi! I've done a lot of scraping projects using precisely python 2.x (and 3.x), Selenium and bs4 (but have also worked with Scrapy and plain requests to extract the data from the sites). For example, I scraped the data on the voting records in the Council of the EU for my own research using precisely the technologies you listed in your project description, but I also worked on other websites, the most complex of which were Amazon and LinkedIn. This particular site you mentioned in your project description doesn't appear to be too difficult, so I don't expect it to take me more than 8 hours. Since my hourly rate is USD 15, once the fee is calculated in, my bid is USD 134. You can contact me over chat at any time if you want to talk about scraping projects, and I'll respond as soon as I can. I'm also into data analysis, so if you need some work of the sort, let me know, I may be able to help. :) Best, Milos
$134 USD in 4 days
5.0 (18 reviews)
5.4
5.4
User Avatar
Hello, sir Thank you for your job posting. I read your project description and I am an expert with your required skills. I have read your post. I am an expert who have many experiences in Web scraping with python selenium, scrapy and bs4, PHP and nightmarejs.. In particular, I had great experiences in Realtor, Yelp, Amazon, Cinemark, LinkedIn, FB, so if you hire me, I can complete this project in short time as you want. I am available for now and I can start working right now. I guarantee the best quality and high accuracy of my working. I'd like to discuss more in detail via chat. Best regards
$200 USD in 7 days
4.9 (19 reviews)
4.9
4.9
User Avatar
Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! This is my quote for the example that you state on your description. I hope to work with you!
$210 USD in 7 days
5.0 (7 reviews)
4.5
4.5
User Avatar
Hey, I'm Arnav I'm an experienced Python Fullstack Developer with a skillset comprising of web development (frontend & backend), machine learning, deep learning, data mining, data analysis, database architecture and database management. I have previously worked with various Python libraries, and am comfortable using, such as numpy, pandas, tensorflow, pytorch, pyqt, matplotlib, etc. I'm also fairly skilled in jQuery, AJAX and NodeJS. Having said that, I believe I can deliver you the project in 1-2 days. Looking forward to hearing from you in the future. Thank you
$30 USD in 1 day
4.4 (25 reviews)
4.5
4.5
User Avatar
I have done a lot of webscraping using BeautifulSoup and Selenium. I would love to chat more about your project! I have found a few things while researching it. The project can be done fully with just the use of BeautifulSoup. I researched the site and found it is actually loading data from a different site. Grabbing that data stream makes it so that Selenium is not required. If you do wish to use selenium, regardless of the finding, I could work up a solution that utilizes that as well. Please feel free to message me with any questions! Thank you for your time and consideration. -Jake
$100 USD in 1 day
5.0 (3 reviews)
2.5
2.5
User Avatar
Hi, My name is Dylan McClelland, and although I am new to freelancer, I have been a professional full stack software engineer since 2015. Now I'm looking to take on a few small side jobs to get used to freelancing and build up my profile. I take pride in writing clean, easy to understand code and picking up new skills where needed to finish out a task. I first wrote scraping code in college as part of a project to build a database of nba players. The site was all dynamic javascript, so that was also when i learned about headless browsers and selenium. Since, I have frequently used selenium for functional testing. The linked site's layout is clean and its elements are consistently named, so scraping it won't be a problem. looking forward to hearing from you, Dylan
$150 USD in 1 day
5.0 (1 review)
2.2
2.2
User Avatar
Dear concern, I must say that's a very interesting and challenging automation for any automation lover. I have previous experience automating Facebook, Amazon and Google map too. I can surely help you with this one. Mostly i work with python 3, yet i will follow the mentioned python version happily. I can assure you 100% proper work in shortest time possible. Also, if you wish to use scrapy with splash i can help you with that too of course. Please do ask any questions you have in mind. Eagerly waiting to hear from you. Regards
$150 USD in 5 days
5.0 (6 reviews)
2.1
2.1
User Avatar
Dear , I give you business website in low price with creative design. I will provide you very high quality work .Please assign this work to my team. We will give full satisfaction. We have experience of 7+ years, We have developed a wide range of websites ,Softwares and mobile Application .With creative design and 100%satisfaction . Hello, I am interested to work with you and I am absolutely sure that I can do the project very well in the shortest possible time. lets discuss details. I'm a professional web developer which not only uses techniques in creating things, but also much creativity. I have been working as a professional web developer for the last 8 years + and have done many sites. I am fluent in several of the most popular languages for website development and dynamic website creation. Based on my long time experience i can guarantee your 100% satisfaction. I would like to implement my expertise and experience in your project. I can design/develop your website with such professionalism and creativity! In order to attract more the users and increase the user experience. My expertise includes Web Design/Development ,Bootstrap, HTML5, PHP, Wordpress, WooCommerce, E-commerce, Shopify, JavaScript, Jquery,Responsive, Opencart, I will show you project progress and talk to you regularly so that you can see how the project going on and provide me your feedback. I can ensure you 100% functional and bug free site.
$140 USD in 7 days
0.0 (1 review)
1.0
1.0
User Avatar
Hi, I'm intrested in working with you and I have been working on the same technologies using selenium, python
$277 USD in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi Sir, I am an expert on web-scraping with Python bs4 and selenium Please share the details . Thanks
$277 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, You're exactly the type of client that I love to work with - that is, someone who exactly knows what they want and describes it well, you also said you're looking for people to whom you can assign such tasks, which makes me even more interested because I'm new on this website and having a regular client would be very useful for raising my reputation here. As for the technologies, I have extensive knowledge of all the technologies you listed. Feel free to message if you're interested in working with me :) cheers.
$200 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello! I'm highly productive with my time and can handle it pretty easily as I have developed many applications viz. scraping betting sites, banking sites, ecommerce sites. Looking forward to hearing from you!
$150 USD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Olympia, United States
5.0
1
Payment method verified
Member since Apr 14, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.