Python Data Scraping

₹1500-12500 INR

Cancelled

Posted

about 3 years ago

₹1500-12500 INR

Paid on delivery

Hi, I have a python code to scrape a website and analyze it. There is an option to top up the incremental changes if needed. Right now it uses a single process to fetch the data. I have used selenium and bs4 for it. I need an expert to optimize it, structure the code properly and use multithreading / parallel processing to fetch the data in lesser time. The website throws error if there are multiple requests in a very less time, so there is a need to bypass that as well. Currently, the bottleneck is that we can send a single request every second to that website. Website is [login to view URL] After the optimization, we need you to host it on heroku or any optimal cloud platform and program it to run at times according to certain data points that are to be fetched from another part of the website. Some part of the code has to be parameterized so that we can change some parameters from the heroku terminal directly. The fetched data has to be saved on a set folder in Microsoft Onedrive.

Project ID: 30124649

About the project

5 proposals

Remote project

Active 3 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

5 freelancers are bidding on average ₹9,200 INR for this job

@albabahmadkhan

Hi! I'm 5 years experienced Data Scientist with theoretical and practical experience in Data Science, Machine Learning & Deep Learning ready to do your work in an efficient way with strong analytical and logical reasoning skills. My Core Skills are: Data analysis - Data Mining-Forecasting using Python, R, SPSS, Excel, KNIME, and SAS Enterprise Miner. Machine learning - Classification, Regression, Association Rule Mining, Clustering & Dimensionality Reduction. Deep Learning - Fully Connected Networks, Convolutional Neural Networks, Recurrent Neural Networks, Long Short Term Memory Networks, Generative Adversarial Networks & Reinforcement Learning. Databases: Teradata-SQL, MySQL, Mongo DB

₹12,000 INR in 2 days

4.3

(9 reviews)

4.2

@engrfarooq04

Hi Dear Employer, At first take my respect. I am python programmer backgrounder. I read your project description. I understand you want help regarding Python Web Scraping Scrapy Data Scraping Please leave me on massage on my chat box. Then we will discuss others and start working right now. https://www.freelancer.com/u/engrfarooq04 Gratefulness spark tech

₹9,000 INR in 7 days

4.7

(2 reviews)

3.4

@miqueasburzum

I can give you a week of my work per 10000INR(+120USD). Contact if you want. Hi, my name is Miqueas Aguirre. I am fullstack developer(1+ year) with: FRONTEND: 1. Angular 2. Vanilla JS 3. Bulma 4. HTML/CSS/Less BACKEND: 1. Nodejs + Express 2. Django 3. Firebase DATABASE: 1. MySQL 4. sqlite 5. Mongodb and Python(1+ year): 1. Web Scraping 2. Cron Jobs 3. BOTS 4. Data Science and Machine Learning(Numpy, Pandas, ETC) I am currently working in various projects. I learn fast. Whatever that you want and you need. I know Algorithms, Calculus, Algebra and Statistics. I like to hard work. Regards, Miqueas.

₹10,000 INR in 7 days