Find Jobs
Hire Freelancers

aws data pipeline

$30-250 USD

Completed
Posted about 10 years ago

$30-250 USD

Paid on delivery
the project is to create a data pipeline. This should be a simple project for someone who is familiar with aws. The objective is to look at an S3 folder every hour. If there is a file in that folder copy it to another folder. Failures will send or log a notification. Thank you.
Project ID: 5279927

About the project

6 proposals
Remote project
Active 10 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello! I've done almost same thing few years ago (it was video encoding related project) and can help you with yours! Thanks, Alex
$75 USD in 3 days
5.0 (16 reviews)
5.0
5.0
6 freelancers are bidding on average $55 USD for this job
User Avatar
Hi I'll use AWS S3 SDK to create the program. The program will be scheduled to run every hour via crontab. I'm confident enough to finish it within 2-3 hours at max. THanks Joy
$30 USD in 0 day
4.9 (62 reviews)
6.6
6.6
User Avatar
I can write a program for you in Java that will check an S3 folder every hour and copy any files in that folder to another folder. I have used the Amazon AWS API for Java for a couple of S3 projects here before, so I am familiar with it. Let me know if you're interested. Hope to hear from you soon. Regards, Christopher (andrewscm)
$50 USD in 5 days
5.0 (2 reviews)
2.1
2.1
User Avatar
Should be simple enough, get s3 bucket objects, store list, cron job, compare with stored list, copy content to another folder, sns if failed. In what language you expect it to work? bash script, ruby, python, php or what script?
$40 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, Could you please PM to discuss your requirements further? I can get this done for you within a day. Ex-AWS developer here. Cheers. Nishant
$40 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
San Diego, United States
5.0
128
Payment method verified
Member since Dec 7, 2007

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.