Find Jobs
Hire Freelancers

Nifi (CSV to Database)

$10-30 CAD

Closed
Posted over 3 years ago

$10-30 CAD

Paid on delivery
I am looking for a Nifi programmer (it came be Java or Python). The task is as the following: 1. Read new files from an FTP folder (today’s files only) 2. Unzip the files 3. Parse the csv files (separator: |) 4. Check the first field on every line/record to identify the type of record (about 10 variations. For example, if the first word is SUM, it will generate a query to add the line to a table called SUM). The lines are not all identical but all SUM lines are the same. All TAX lines are the same ... 5. Read all value from the csv to build the query depending on the identifier in 4 6. Send the query to MySQL 7. Send the query to Hive 8. Log transaction in a logger object
Project ID: 27696670

About the project

5 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
5 freelancers are bidding on average $60 CAD for this job
User Avatar
Hi, I am a certified bigdata developer and used NiFI most of our data pipelines. I integrated with kafka, mq, FTP and elasticssearch and hadoop. Not only used many other process to deal with the data in the pipeline. I have a very good confidence to help you out here. Please let’s connect and discuss more on your requirements. Thank you, Naresh.
$167 CAD in 5 days
5.0 (8 reviews)
4.5
4.5
User Avatar
hello, It an Interesting project. If you consider my proposal I will select python. let me know if you consider my proposal. also share some example file so I can play around. thanks.
$35 CAD in 3 days
4.8 (7 reviews)
3.1
3.1
User Avatar
Hi, Can help you with the provided instructions in Java. Please send all the variants of type of records (10 as mentioned above) and any other related information. I am humbly waiting to hear from you. Thanking you Harinda S.
$30 CAD in 9 days
5.0 (1 review)
0.6
0.6
User Avatar
I think I can write such a script like that in python for you, however I'm not familiar with Hive databases, but there are python modules for it.
$29 CAD in 6 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there, I wonder why you mentioned Java/Python. Do you expect the freelancer to build the processor, use ExecuteScript processor or what? The latter actually support JS or Groovy. Does such tech nuances matter to support the script in future or totally on discretion of the freelancer? It also would be helpful to see the format of the CSV to estimate the project. Feel free to contact to discuss the details
$40 CAD in 20 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CANADA
montreal, Canada
4.8
5
Payment method verified
Member since Apr 4, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.