Find Jobs
Hire Freelancers

Programmer needed for Web Scraping Application

$250-750 USD

Closed
Posted over 3 years ago

$250-750 USD

Paid on delivery
I have a web application that is built using Machine Learning and scrapes and collects information from different websites with captchas etc. and cross checks with other information that is found online. It works well. However, at the moment it takes too long. At present one search using the application can take 10 days to complete returnin 200 results for example. I'm looking for someone to reduce this time, perhaps using cross-threading, perhaps using load-balancing, but overall making the system much more efficient - most searches should only tkae a few hours, rather than 10 days. The candidate should be a programmer familiar with python, scrapy, flask as well as various server technologies.
Project ID: 28294185

About the project

28 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
28 freelancers are bidding on average $627 USD for this job
User Avatar
Hi there! I have read what you exactly need, however I would like to ask you a few questions. I do work smart and do not rest until I get the job done. Please feel free to ping me anytime so we can have a detailed discussion. If I can deliver I will deliver in best possible way. Thanks My portfolio: https://www.freelancer.com/u/AwaisChaudhry?w=f
$750 USD in 10 days
4.9 (67 reviews)
7.9
7.9
User Avatar
Thank you for looking at our bid. Is there any way we can test this search feature. Maybe the backend is already using threads/forks, maybe waiting on some condition. Kindly check out my Freelancer portfolio https://freelancer.com/u/fleetways.html for previous work. It would be great if we can get an opportunity to discuss this project further. Please disregard our timeline and estimates for now, we can discuss this going forward.
$850 USD in 15 days
4.9 (64 reviews)
7.7
7.7
User Avatar
Hi there, I'm bidding on your project "Programmer needed for Web Scraping Application" I am a data scientist and Being an expert machine learning and artificial intelligence I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .
$750 USD in 4 days
5.0 (39 reviews)
7.2
7.2
User Avatar
Dear Sir, I'm expert in web scraping and automation, also expert in machine learning techniques. I can re write your automation software using java, I can guarantee to make it perfect in performance. Please ping me and share more details, we can start your project right now right away. Thanks & Regards
$500 USD in 7 days
4.9 (52 reviews)
6.8
6.8
User Avatar
Hi Richard S. I've check your project description carefully. I think It is the problem with multi-threading. I would like to check more about the scraper. I can start right now. PS: I am python scraping expert with scrapy, selenium, requests. Kindly send me a message for discussing about the project. Thanks.
$250 USD in 2 days
4.9 (23 reviews)
6.4
6.4
User Avatar
Hi. I am very interested in your proposal. I can instantly help you with your starting project with a successful completion. As a professional python developer, I ensure for a perfect ongoing project. You will never be disappointed in me for sure. Looking forward to meeting you on chat. Good luck. Thank you.
$750 USD in 7 days
5.0 (13 reviews)
6.0
6.0
User Avatar
Hi there, ★★★ Python / Scrapping / Selenium Expert ★★★ 8+ Years of Experience ★★★ I've read requirements and ready to make program efficient so it takes less time to give results. I'll be glad to discuss project before start so let's chat. Thanks for your consideration. Best Regards, TechPlus Team
$750 USD in 7 days
4.8 (32 reviews)
6.3
6.3
User Avatar
Hi, Thanks for your job posting in advance and I am interesting to your project. As you can see my profile, This is a senior python programmer and Machine Learning, Data Science Expert, and have rich experiences with Scraping, Flask Web App and Rest API. Also I have expertise with multi-threading and multi-processing. I am sure I can improve your app and I'd like to discuss the details over chat. Regards. Vadim N.
$600 USD in 7 days
5.0 (23 reviews)
5.8
5.8
User Avatar
----- Pro Python/Scraping/Algorithm/ Machine Learning Expert! -------- Hi, Dear Your project is very attracting my mind because I have rich experiences and high skills on this project. I have been completed many similar projects before and am working in these branches for 8+ years. If given a chance, I am highly confident in my ability to deliver the highest quality. I look forward to hearing from you. Kind Regards
$500 USD in 7 days
5.0 (17 reviews)
5.3
5.3
User Avatar
Dear. Thanks for your job posting. I am a senior software engineer from Bulgaria. I have strong experience in web automation, scraping and crawling based on selenium, scrapy. I hope we will discuss in more detail about your project. Kind regards.
$350 USD in 4 days
5.0 (11 reviews)
5.0
5.0
User Avatar
Hi, We at Tecogno Solutions are a team of Passionate Data Science and Full Stack professionals having more than five years of combined experience in multiple areas including Backend, Frontend, Machine learning (ML) and Artificial Intelligence (AI). We have developed multiple projects for Scraping. We have a strong command over Python, Flask, Django, Scrapy, Beautiful Soup, Node.js, Google Dialogflow, Spacy, Rasa, Twilio, NLP, CNN, Bert, Albert, Google API's etc. Thus we are capable of building a Web Scraping Application. For further information please refer to our Profile or visit or website. Thanks!
$750 USD in 21 days
5.0 (2 reviews)
5.1
5.1
User Avatar
Hi there I have just read the description and I am very interesting about this project. From the description, I can realize the application should be optimized. As you know from my work history, I am very good at python, scrapy and flask. And ML as well. So I can figure out the reason that takes so long time to search. Please drop message. I am ready to discuss and starting working. Happy to hear back from you soon. Sincerely. Maksim
$750 USD in 7 days
5.0 (12 reviews)
4.9
4.9
User Avatar
Hi, Mr Richard S. I am an IT veteran who has 6+ years professional experience on both machine learning and deep learning development with python. Worked as a full stack developer in software team and IT company. Has a good sense of analysis, research, problem solving, development and maintenance of digital products. Self-motivated, passionate, detail focused, and customer oriented developer. I can work with you in your time zone. I really hope work with you. please contact with me. Best regards. from your lovely Anton P.
$250 USD in 5 days
5.0 (6 reviews)
4.5
4.5
User Avatar
Hi there, I have good experience in python and web scrapping. i can provide you the results quickly. Message me and lets take this forward. Thanks
$500 USD in 7 days
5.0 (26 reviews)
4.6
4.6
User Avatar
Hi, I have skills in python, Django , web scarping and Machine learning. I can build the whole thing again and will reduce the 10 days to hours. I think that takes that much time during the scraping. Would like to discuss more in detail.
$590 USD in 7 days
5.0 (6 reviews)
4.5
4.5
User Avatar
I'm Joel - a professional python developer with good experience with flask, scrapy. I will deliver your project to success. I can reduce the time to get results.
$500 USD in 7 days
5.0 (10 reviews)
4.2
4.2
User Avatar
Hello, Hope you're doing good.! I am a Data scientist with over 4 years of working experience and have done many projects on AI for clients. Some of them are Sentiment Analysis, Image Classification, Text Classification, Chatbots, Price prediction system, Text summarisation, Article spinner and so on. The technologies I work upon are Machine learning, Deep learning, Computer vision, NLP, Chatbots etc. I have a experience of 4 years in working on django and flask frameworks as well. I have integrated almost all my projects on django and flask for web applications. I have worked on data mining for extraction of data from multiple sources using selenium, requests and beautiful soup. I have read your requirements and can definitely help you out with this one. Let's talk in detail about what you need and start working on it. Looking forward to hear from you.
$700 USD in 7 days
4.9 (7 reviews)
4.2
4.2
User Avatar
Greetings, I think here you are looking for Programmer needed for Web Scraping Application. I understood your project description. I am an expert in Python, Web Scraping, Software Architecture, Server, and I am interested in your project. I am confident that I can do this with 100% accuracy and ready to start now! But I want to know more about your project. So, can we discuss more? Regards.
$650 USD in 7 days
5.0 (13 reviews)
3.7
3.7
User Avatar
Hey! I have read about your project Programmer needed for Web Scraping Application I am professional in Web Scraping, Server, Python and Software Architecture, so I'am totally sure I can deliver Your project ! Please contact me to discuss more about this project. Thanks
$555 USD in 3 days
5.0 (2 reviews)
2.2
2.2
User Avatar
Hello, Hope you are doing well.. I've experienced SCRAPED data from 13 websites. So I'm very comfortable with helping you with this project. I am ready to start full-time work immediately and assure you to provide high-quality results in a given time frame. I have strong 5 years of experience in Python, Django, Odoo, Docker along with front-end, back-end technologies including: - Python / Django / Django REST Framework / Flask - JavaScript / React / Material-Ui - HTML5 / CSS3 / Bootstrap - PostgreSQL / SQLite - Heroku / AWS S3 - GitHub / Git Moreover, - Python-based APIs, Django REST-Framework, Django REST Swagger (OpenAPI) & Custom Authentication. - Test-Driven Development: PyTest, Mixer, Mock, Django Request Factory, Django REST-Framework APIClient & Coverage. My previous work in Scrapping:- -> SCRAPE NEWS FROM 13 WEBSITES AND ADD TO OUR WEBSITE Scraping of posted news from 13 other websites and perform semantic analysis , if news looks positive then only post to the client new portal (Technologies Used:- Python, Selenium, ReactJs Postgresql) Aslo have Experience scraping eCommerce sites & Experience with IP rotation Please text me for deep discussion. Regards, Neha.
$500 USD in 7 days
4.8 (1 review)
2.0
2.0

About the client

Flag of UNITED KINGDOM
Blackburn, United Kingdom
5.0
22
Member since Apr 24, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.