Find Jobs
Hire Freelancers

Need to write scripts to check when ftp finishes and load data into redshift after ftp ends.

$10-30 USD

Closed
Posted over 5 years ago

$10-30 USD

Paid on delivery
Need 3 process scripts and 1 modifications to existing python code to load data into redshift. - a process to pick up data that has been uploaded, once the upload is terminated (we could ask them to upload a dummy file at the end of the process, typically a manifest with all the expected file size, or even a md5sum) - a process to check the uploaded data, and clean it, then move it to S3 (what we do with other existing stores) - a process to report on error (for now, it crashes and send an email using SNS, which I'm the only one to subscribe to) - then naturally, run all the ETLs, most of those should be written already, or needsmodifications. If you are not familiar with the technologies above, please don't bid. If you are knowledgeable, tell me what version of what database is Amazon Redshift is based on. If you don't answer this in the first sentence then I know you are a robot bidder or a copy paste bidder that don't understand English instructions and will overlook your bid.
Project ID: 18543780

About the project

6 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
6 freelancers are bidding on average $60 USD for this job
User Avatar
Hi, Redshift is based on Postgre SQL version 8.0.2, just to answer your question. I am interested in your project, very experienced with python but not so expirienced with Redshift. If you would like to make this per hour project please contact me. Best regards, Jurica
$40 USD in 1 day
5.0 (19 reviews)
3.9
3.9
User Avatar
Hi, Amazon Redshift is based on PostgreSQL 8.0.2 Honestly speaking, I have googled this information. I'm great with python but haven't had hands-on experience with Redshift. I believe I could create the processes for you. I'm confident in my ability to adapt to new confrontations. Also, would you mind elaborating this part: "- a process to check the uploaded data, and clean it, then move it to S3 (what we do with other existing stores)" Here, what would the process clean? I have mentioned my experiences and honest shortcomings above. If you would like to discuss this matter any further, shoot me a message! Thank you and kind regards.
$100 USD in 3 days
5.0 (4 reviews)
3.9
3.9
User Avatar
Hi there, I've read your post decription and mentioned points carefully. I've understood my work very well. I can write any type of script in python boundries. Please come over the chat for further discussion. Thanks Seema-P
$25 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Chicago, United States
4.9
50
Payment method verified
Member since May 20, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.