Completed

Data Scrape of a Dynamic Website using Unix/CentOS

Goal : Scrape a website after the page has loaded, and grab the data variable and output it to a flat file.

The website displays a 'estimated wait time' during business hours, and the word "Closed" when closed. I want to parse the number (IE 3, 24, 30, etc) to a text file or the word Closed if they are closed.

Requirements :

1. Script must run on CentOS/FreePBX operating system.

2. Must be able to run as a unix cron job (background process I can tell to run and update the text file every ~5 minutes.

3. I plan on scraping multiple pages of the main URL's (same exact main website, just different stores/locations - so it scrapes identical, no need to write different code) - so the code you write I need to be able to duplicate it so I can change the URL and run it in a separate cron file that outputs to a different text file. (IE [login to view URL], [login to view URL], etc)

4. IF you plan on using something like NodeJS, please note that CentOS7 and this OS distribution is somewhat limited and certain libraries/resources may be unobtainable despite the fact I have full root/control over the OS.

5. This is an EXPEDITED project and needs to be completed within 24/48 hours tops.

6. I tip... so if the project is clean, done fast, and works well, I will pay more than the job's final price. I appreciate good speedy work. Thank you.

Skills: Python, Linux, Shell Script, Web Scraping, UNIX

See more: dynamic website using joomla, creating dynamic website using joomla, creating dynamic website using php, create dynamic website using php mysql, creating dynamic website using phpmysql ajax, scrape dynamic website, dynamic website using php, ordering system dynamic website using php, dynamic website using java struts2 hibernate, excel database the extracts data from a website using a live lookup -- 2, excel database the extracts data from a website using a live lookup 2, how to develop a dynamic website using php, how to create a dynamic website using html, how to create a dynamic website using python, how to create a dynamic website using wordpress, how to create a dynamic website using php, how to create a dynamic website using php mysql in windows, how to crawl data from a website using php, scrape data from dynamic website

About the Employer:
( 7 reviews ) San Antonio, United States

Project ID: #25436508

Awarded to:

vincentong07

Hi! I'm script developer that can retrieve data & do tasks with AUTOMATION.100% ACCURATE! Can you tell me the website URL? I will write Python 3 and, i'm going to use Python PYPI registered modules. NO SELENIUM (it's More

$50 USD in 2 days
(94 Reviews)
6.0

3 freelancers are bidding on average $23 for this job

Awan005

I work in a co-working environment so I can complete this project with speed & accuracy. I will done your project in full professional way according to your requirements and my creative ideas. I am doing development fr More

$10 USD in 2 days
(0 Reviews)
0.0
umarzaki1000

Hello. I am a developer with knowledge of php, java, python frameworks and so on. I am sure I can do your work perfectly. I can give you demo and start work before order . I hope to discuss with you in chat. Thank you More

$10 USD in 1 day
(0 Reviews)
0.0