Find Jobs
Hire Freelancers

Data minning with Scrapy framework

$30-250 USD

Completed
Posted over 10 years ago

$30-250 USD

Paid on delivery
We need a custom bot for scraping a site and insert the information directly to a EXISTING mysql database. one of the requirements is that you must avoid inserting duplicate content, because the bot will be running every 3 days. Also, we require to retrive geo encoding lat-long using the values address extraced. we use google maps API: [login to view URL],+66637+Apodaca,+Nuevo+Le%C3%B3n&components=country:MX&sensor=false Another point, the bot must be able to use a proxy list for crawl/scrap the website and for geo encoding connections for avoid ip banning... For some extracted info (email, email and phone number), we require using regex. Scrap website is: w**.[login to view URL] The total number of fields to extract is: 17 The total number of values inserted into DB is: 28 the bot must crawl all the listings... we suggest 3 milestones... 20% for start project 50% for 90% project finished 30% for full bot finished with no bugs...
Project ID: 4759110

About the project

18 proposals
Remote project
Active 11 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi. I already have experience with such projects, we can start the work.
$206 USD in 2 days
4.9 (13 reviews)
5.2
5.2
18 freelancers are bidding on average $211 USD for this job
User Avatar
Hi.. Expert web scraper/Data Minor here. Interested in your project. I assure you 100% accurate and good quality work. Ready to start. have a look at PM. Regards
$210 USD in 3 days
4.9 (50 reviews)
5.7
5.7
User Avatar
hi sir.i have a list , pls check my sample at message inbox
$147 USD in 3 days
4.9 (28 reviews)
5.1
5.1
User Avatar
Thank you for invitation. I can do it in a higher budget.
$515 USD in 7 days
5.0 (18 reviews)
4.9
4.9
User Avatar
I can do that professiona
$111 USD in 3 days
4.8 (8 reviews)
3.5
3.5
User Avatar
Hello sir, I am kindly interested in this type of project works I will perfectly finish the work within the stipulated time kindly give me an offer to work for you I expect your cordial relationship in the due course and for the long term also. Hope to hear from you very soon. Best regards
$144 USD in 3 days
4.7 (13 reviews)
3.6
3.6
User Avatar
Hola, somos una empresa española con 6 años de experiencia en desarrollo web y aplicaciones para mobiles. Somos expertos en modulos para joomla/wordpress, prestashop, pasarelas de pago, etc.. Confie en nosotros para llevar a termino su proyecto.
$631 USD in 16 days
5.0 (2 reviews)
3.3
3.3
User Avatar
hello, I am good at web scraping.
$120 USD in 2 days
5.0 (6 reviews)
3.1
3.1
User Avatar
Hi Sir, Thanks for inviting me, I can do this job with ease. I can rotate the proxies and user-agents, and can do the work as you needed. Thanks and regards
$166 USD in 3 days
5.0 (7 reviews)
2.8
2.8
User Avatar
I can make this. Thanks.
$222 USD in 3 days
5.0 (2 reviews)
2.7
2.7
User Avatar
Let's start
$69 USD in 7 days
5.0 (6 reviews)
2.5
2.5
User Avatar
Can help you right now.
$247 USD in 14 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I can do this for you.
$333 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am an expert in python scripting and well experienced with crawling/scrapping web pages. i guarantee a well maintainable and efficient code.
$155 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Please see your pm.
$53 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
..please check PMB for more detail....
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, i have already worked on a similar project before and can deliver as u have mentioned we already have similar work experience and have worked on similar projects in the past and can deliver u as u have specified in your requirements I have checked your requirements. We have right skills to work on this assignment. We are a team of professionals including experienced analysts, designers, project managers, developers and QA people having great expertise in web applications development mainly on core PHP, PHP with open sources (Joomla, Wordpress, Codeigniter, Cake PHP), .NET, Asp.NET, Vb.NET, HTML 5 etc. and mobile applications on ios and Android platform. Links of Portfolio - can u provide your contact details for further discussion about the project I am ready to discuss with you Regards xavient tech
$205 USD in 12 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of MEXICO
monterrey, Mexico
5.0
5
Payment method verified
Member since Sep 29, 2008

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.