Automate mySQL Database Daily FTP

Closed Posted Oct 17, 2006 Paid on delivery
Closed Paid on delivery

Our real estate website downloads data on homes for sale from several MLS (Multiple Listing Services). The data generally comes from an FTP site in pipe delimited format. We need a company to maintain the data and associated photos on our website on a daily basis. Ideally the process would be automated to

1) FTP and download the data and photos each day

2) Import it into databases (one for each MLS)

3) Maintain the database and delete associated image files as properties are sold and removed from the data feed.

Each of the 7 current MLSs has a little variance in the way the data is formatted. Most deliver the data and images by FTP, however, one uses the RETS system ([url removed, login to view]). The data files are sometimes quite large and require us to import the file into Quattro Pro (which doesn't have the 256 column limitation of MS EXCEL) and convert the file into smaller CSV files for upload. You may know of a better way to do this. Currently we are doing this manually using php myAdmin and it is quite time consuming.

Most of the data feeds are complete dumps each day, so we just EMPTY the table and import the new data each day. However, one is an incremental dump that comes with a reference file. The reference contains the Listing ID numbers of the properties that are currently for sale. It needs to be compared to the table and the listings that no longer have associated reference numbers in the reference file need to be deleted.

The photo images need to be compared by MLS number or Listing ID to the records in the current property data file. Those that no longer have associated active listing need to be deleted.

We plan to add additional MLS data feeds over the coming months.

Project ID: #98525

About the project

3 proposals Remote project Active Dec 7, 2006

3 freelancers are bidding on average $100 for this job

Shattenjagger

Hello, please check the PMB.

$100 USD in 3 days
(40 Reviews)
1.4
AJAXguru

I can help you out. I have worked with rets before and I am an expert with MySQL. A server side script to handle the ftp and the databases is what you need. Unfortunalty, I cannot do all this for $100. If you can offer More

$100 USD in 2 days
(0 Reviews)
0.0
jsubbu

Hi, I have implemented several projects similar to your exact requirements. I have tremendous experience in mysql and with its related tools. I will definitely come up with a better script which can definitely simpl More

$100 USD in 3 days
(0 Reviews)
0.0