Creating a database on cloud server and automating cron job

In Progress Posted Sep 21, 2014 Paid on delivery
In Progress Paid on delivery

Hi,

I would like to build a MySQL database of scraped data from various websites for which I already have working code.

This same code will need to checked for errors, optimised and organised by you as well.

A database will need to be setup on Digital Ocean or Linode.

The server will need to perform a cron job for each website (3-7 websites) and the intervals will be specified by me.

My working code will require you to be highly proficient in python and especially the packages: lxml, threading.

You will also need to be experienced with database design and MySQL.

Thank you.

I would also like if you can make a clean way of connecting the database with Python so that easy analysis can me made my me using libraries such as numpy, scipy, scikit-learn and pandas.

Data Mining MySQL Python Web Hosting

Project ID: #6485369

About the project

12 proposals Remote project Active Oct 1, 2014

Awarded to:

gstragand

Hello, We are trading messages regarding this project - Python code using lxml to parse HTML pages. Sincerely, --George

$194 AUD in 3 days
(0 Reviews)
0.0

12 freelancers are bidding on average $172 for this job

bogdesl

Hello, Is your existing Python code already "talking" to a MySQL server? If not, do you want the scripts changed so they put data into MySQL, or just parse their output with a different script and add data to MySQL? More

$244 AUD in 5 days
(29 Reviews)
5.5
anuyadav1

A proposal has not yet been provided

$250 AUD in 5 days
(33 Reviews)
5.3
dabing1205

Good at python/scrapy/database design. $#############$#############$#############$#############$#############$#############$#############$#############$#############$#############$#############$#############$######### More

$277 AUD in 7 days
(17 Reviews)
4.2
cnkei

Hi, I'm a experienced Python programmer and Linux system administrator. The project I'm doing at work uses MySQL, so I'm also very familiar with MySQL and ORMs such as SQLAlchemy and peewee. Server configuration won More

$200 AUD in 5 days
(9 Reviews)
4.1
kotiantal

Még nem kapott javaslatot

$155 AUD in 3 days
(4 Reviews)
3.8
lecyberian

Hi there, I am expert with UNIX / Linux system administration, Networking and Network Security. Please review my past projects. Let me know if you have any questions. Thanks

$100 AUD in 3 days
(3 Reviews)
3.6
mamer67

A proposal has not yet been provided

$100 AUD in 3 days
(3 Reviews)
3.6
stonedev

Hello, Please give me access to the Cloud Service and give me the scraped code. I'm free now. I can start off now. Thanks.

$66 AUD in 3 days
(2 Reviews)
1.8
sarathkrishnasr

A proposal has not yet been provided

$155 AUD in 3 days
(0 Reviews)
0.0