We currently have a PHP script which downloads and imports about 50 separate CSV files (They all using the exact same column format) into one large database (Roughly 250,000 records):
This script however is running slow 20 records per second. (mysql_query(INSERT INTO))
Initially we'd like someone to look through the script and make any obvious improvements in the code to speed things up (inc suggestions to database structure, use of primary, indexes etc) and also perhaps [url removed, login to view] tweaks.
Longer term we'd like to look into swapping over to LOAD DATA LOCAL INFILE, and also adding a number of rules so we can add product categories based on product name, store name etc.
We see this very much as a 2 stage project and would like to build a long term relationship for further work on the websites which use the product database.
52 freelancers are bidding on average £26/hour for this job
Hi, We are recommended Freelancer by freelancer.com on basis of our feedback history and [login to view URL] once read our [login to view URL] are really interested to work on this project :) Thanks Regards DreamSolutions
Hello. LOAD DATA LOCAL INFILE do magic. With this method you will be able upload your data in minutes (should be allowed in [login to view URL]). I think I can complete this task in 2-3 hours. Thanks, Vitaliy.