Create CSV cleanup and formatting script

Completed Posted 5 years ago Paid on delivery
Completed Paid on delivery

We need you to write a standalone program to cleanup existing CSV spreadsheets. This will involve reading data from existing CSV files, and writing new CSV files that are RFC4180 compliant, as well as converting any poorly formatted data from the starting CSV files into cleaned up data for the new CSV files.

For example, we need custom cleanup rules like this:

- replace 'N/A' with NULL

- replace '#VALUE!' with NULL

- trim values to maximum length (if needed)

- remove X number of rows at top of CSV file (headers)

- reorder columns (if needed)

- delete columns (if needed)

- remove blank rows

- remove special formatting characters (eg: $)

- convert number formats to a set standard (eg: change "1,250.75" to "1250.75")

We will provide a specific list of cleanup rules. We anticipate roughly 50 rules, and should have final set ready to go before project starts, but are open to suggested revisions.

Your program needs to be POSIX compliant as we use Linux and BSD infrastructure. Your program will likely be run non-interactively and needs to support such for easily integrating into Cron jobs and scripts.

We think Sed and Awk are the best tools for this, so experience is preferred; however we are open to discussion of other tools.

The final, clean CSV will be 3 columns of data with no header, but in this order:

SKU | QTY IN STOCK | PRICE

example:

"AB53101","32","29.950000"

"AB53107","0","29.950000"

"AB53108","0","35.950000"

"AB55103","250","9.950000"

"AB55105","-5","9.950000"

"0099107","0","9.950000"

"0099108","10","12.950000"

Data Entry Data Processing Excel PHP Software Architecture

Project ID: #18459806

About the project

21 proposals Remote project Active 5 years ago

Awarded to:

cplaiasu

Hi, I have experience with bash scritps and csv processing. I thing the best way to clean those csv files is to use a shell script that you can run on linux/BSD and run it as cronjob if you need. All sed and awk More

$100 USD in 3 days
(67 Reviews)
5.0

21 freelancers are bidding on average $111 for this job

rinsadsl

Hi, I can write a stand alone application to read your csv file and apply the rules you mentioned and output as you expect with the 3 columns. I am very much interested in this job and looking forward to work with you

$94 USD in 2 days
(1323 Reviews)
9.6
rajeshsonisl

Hi there, I have good experience manipulating textual data using plain PHP (can be run without user intervention via CRON, etc.) Do you have a list of "cleanup rules" and several CSV input files? I understand how More

$222 USD in 3 days
(1092 Reviews)
8.9
FASTGuru

Hi Sir! I'm the expert developer. you can check my profile here https://www.freelancer.com/u/FASTGuru.html .with 6 years of experience I assure you the highest quality of the work. Please discuss details in message. th More

$55 USD in 1 day
(240 Reviews)
8.4
datakillers

Hi I have good Microsoft Excel skills with years of experience as well as I have complete number of projects for Excel to manage data and sorting. You can check my profile feedback section and you will know what my More

$30 USD in 0 days
(842 Reviews)
8.6
schoudhary1553

Hello, I have the good knowledge of Create CSV cleanup and formatting script. I have more than 5 years of experience in Data Entry, Data Processing, Excel, PHP, Software Architecture. I have reviewed your job and ca More

$250 USD in 3 days
(686 Reviews)
8.7
gangabass

I can provide you Perl, Python or PHP script that will work exactly like you want. It will read CSV file (or files), parse each row and generate another CSV according to your list of rules.

$90 USD in 1 day
(726 Reviews)
8.0
Mickelson

Hi Nice to meet you. I'm python expert and my last project on freelancer.com is also python scraping task. My past works: Youtube comment scrapping Real estate property list to csv Job-site content to csv And sc More

$100 USD in 3 days
(139 Reviews)
7.0
rinabuoy13

Hello, I am experienced excel expert. I can help with this task with quick turnaorund. Looking to hearing from you. Kind regards

$40 USD in 3 days
(173 Reviews)
6.9
lightingdavid

Hello. I have good skills in Data Entry, Data Processing, Excel, PHP, Software Architecture. I have read your project description carefully and i 'm clear with 90%. I can do your project. Contact me please. Thank More

$155 USD in 1 day
(172 Reviews)
6.5
TechnoGuruu

Hello, I have expertise in Excel and VBA macros, I have done this type of job before in data processing and filtering etc using macro from excel data. I will write the one for you as per description. Please allow me More

$99 USD in 3 days
(110 Reviews)
6.5
BHARATBEURA

Hello, Myself Bharat. I’ve read your project details & can see that you’d like to have a Virtual Assistant for your day-to-day business activities. I have been working as a full-time freelancer (Virtual Assistant) sinc More

$90 USD in 2 days
(81 Reviews)
6.0
HaxArt

Hello, I'm working as PHP developer for over 10 years. I can start the works today. Contact me for details, lets talk about choosen technology. Regards

$115 USD in 3 days
(31 Reviews)
5.6
brobb07

1. Excel expert with extensive vba programming experience. I can write you a script or routine that will open your CSV files, read them and clean up the data based on criteria you would need. 2. I have worked for More

$155 USD in 3 days
(1 Review)
3.8
manjunatha1108

Hi, I can create Excel VBA macro to do the CSV clean up and generate clean CSV file as per the details given in job description. I have done similar job, to clean up csv file, update column data applying rul More

$50 USD in 2 days
(1 Review)
1.5
nievesab12

I have a fresh M.S. in Analytics and can start the project right away. Happy to discuss this opportunity with you.

$155 USD in 3 days
(0 Reviews)
0.0
phpindia1

Hi, I am able to develop this type of application. Please see below detail. @@ Technology - it will be web base application - Development language Core PHP - DataBase MySQL - Required Linux web server for PHP More

$150 USD in 3 days
(0 Reviews)
0.0
mchidhambaram

Had 8+ years of Java Experience in IT industry. Good experience on batch and cron job as well. Interested to work on this project.

$60 USD in 2 days
(0 Reviews)
0.0
gsingh9408

Hands on experience of 3 years in python and data manipulation and formatting. Working in a reputed MNC and such tasks are a part of my core job Hence have experience in such tasks

$166 USD in 5 days
(0 Reviews)
0.0
samsulh89

I read your requirement, hope I can do the clean up activity as you requested. I will deliver the result as soon as possible.

$50 USD in 6 days
(0 Reviews)
0.0
webscraper24

"Greetings! According to your stated project description you need an Google sheet and excel expert. I read your job description and understood. Yes, my experienced service will help you all about MS program. Just se More

$100 USD in 3 days
(2 Reviews)
0.0