Scraper for real estate websites

Closed Posted 5 years ago Paid on delivery
Closed Paid on delivery

Guidelines:

1. Build a scraper using Python to scrap 13 similar looking real estate websites

2. Clean data using regex etc. (number, text etc. formats)

3. Store the data in our MySQL database in our Contabo VPS cloud (Linux)

4. Setup VPS cloud database and server.

5. Schedule crawler to scrape data every day

6. Write a code to automatically to update the database (sometimes the data is updated, edited or deleted on the source website from where the data is scraped, so these changes should be reflected in our MySQL database after every crawl)

7. Do not have duplicate data in the database

8. Intelligently rotate IP to avoid getting banned

9. Run the crawler and the database from the VPS

10. Provide detailed explanation on how to use the scrapper and database in the VPS.

Deadline: 6 days

More information in the docx.

Linux MySQL Python Software Development Web Scraping

Project ID: #17311413

About the project

38 proposals Remote project Active 5 years ago

38 freelancers are bidding on average $514 for this job

gangabass

I can provide you 13 Scrapy spiders (one per site). Each spider will visit website, crawl it and save information into MySQL database just like you want. I can complete it in less than 5 days for just $750.

$750 USD in 5 days
(559 Reviews)
7.9
mingxiao2008

Dear,Sir How are you? I am very interested in your project and am ready for starting your project for now. I have experienced in developing Linux, MySQL, Python, Software Development, Web Scraping. I will work very More

$555 USD in 10 days
(75 Reviews)
7.8
mhmhz

Hi if you like i can do in in C# instead of python Thanks

$833 USD in 4 days
(144 Reviews)
7.8
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$722 USD in 6 days
(168 Reviews)
7.9
schoudhary1553

Hi there..... Warm Greetings We came along with your request for Scraper for real estate websites and we reviewed your project description. We'd like to help you with confidence and satisfying results... We ha More

$600 USD in 6 days
(107 Reviews)
7.2
mmadi

Hi jeevan0923, Just gone through your job post "Scraper for real estate websites" and understood your needs. Although I am here but I have a team of 10+ web and mobile application developers. We can definitely More

$525 USD in 12 days
(21 Reviews)
6.7
uzafar99

Hi, I can write a scraper for you. Do you have your own IPs or can we use an external rotation service? Web scraping and automation are one of my core skills and I will not waste your time. I can also offer the quickes More

$555 USD in 3 days
(50 Reviews)
6.8
topithub

Scraper for real estate websites I've been developing such systems for more than 6 years, and I can handle it professionally, do contact me to discuss further. thanks

$250 USD in 5 days
(18 Reviews)
6.8
sunmoon25

Hi Can we discuss please. Here is high quality web scraping expert. I have done many more difficult scraping projects. Before start the work, I will show you sample. I ensure I will complete the project perfectly on t More

$666 USD in 8 days
(78 Reviews)
6.5
vincentong07

Hi! I'm python script developer that can retrieve data with automation. Speed & 100% accuracy guaranteed! Scrapoxy won't work on Contabo VPS. It only support AWS, DigitalOcean, OVH, Vscale. So maybe we should use c More

$400 USD in 5 days
(115 Reviews)
6.4
ranveersarya

Hi There, Greetings from TheWebcoders! we are a small team of developers with expertise in Website Development, Hybrid Application (Android & iOS), Web Scraping/Crawling and Data Entry using Bootstrap, Angular, PHP, More

$722 USD in 6 days
(23 Reviews)
6.0
osmanaydin

Hello sir, I have completed web/data scraping jobs for many times. I am interested in your project as well. I would like to discuss details via pm. I am looking forward to hear from you soon. Best Regards,

$250 USD in 10 days
(55 Reviews)
6.0
farooq4161

I can complete your Project within 5 days with complete testing. 1) 2 days,I will write all 13 websites Scrappers within 2 days, 2) 1 day,I will integrate scrapers with databases on cloud 3) Testing the data 4) add More

$750 USD in 5 days
(65 Reviews)
6.3
Stephenrajs

Hi there, I can do it. I have done many related projects like this. If you are provide this work, it will help my career also. Give me a chance to do this. Waiting for your precious reply. i can complete with in 6 More

$555 USD in 6 days
(127 Reviews)
5.8
AhmadSameer

Hey there I downloaded the attached document and checked it. I had done many scraping projects using Python. I'm a System Engineer with coding skills. I can help.

$555 USD in 10 days
(45 Reviews)
5.7
rishiajmera

Hello, Greetings! With a proven track record of successful achievements, I am pleased to present my application for your consideration as a Freelancer. Please have a look at my profile and portfolio to get an More

$555 USD in 10 days
(57 Reviews)
5.6
DarkKnight2206

Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.

$375 USD in 2 days
(40 Reviews)
5.6
fabest

Dear, we are Team of French + US. I checked your project description, I can scrap your data. I will focus on user friendly interface. As you can see I have very good rate, you can be sure I am serious. Regards, Fa More

$277 USD in 10 days
(9 Reviews)
5.8
kkc1985612

Hello. I have read your job description. I have high skills in Web scraping and Data Entry and I have 6+ years of experience working as a scraping developer. I have module to scrape website and store into mysql, csv More

$555 USD in 10 days
(22 Reviews)
5.4
iwebphpdeveloper

Hello Dear, Greetings I have a team of researchers, developers, content writers, web scrappers who are well versed in their work and are proficient in timely delivery We are an established IT company with industr More

$333 USD in 10 days
(10 Reviews)
5.0