aws project related to data

$8-15 USD / hour

Closed

Posted

over 3 years ago

$8-15 USD / hour

1) Peform ETL S3 ( HDFS file) as source and Redshift as target Technical Environment : EC2,EMR, Pyspark & Hive 2) Peform ETL across S3, AWS noSQL database using Glue 3) One sample Python AWS Lambda function to run AWS Redshift SQL scripts 4) One sample on realtime streaming ( preferably Kafka( producer) + Pyspark( Consumer) 5) Executing bash commands ( jobs ) via Airflow ( or AWS equivalent) Need walkthrough of above at urgent basis. Even if you can solve some points , that is fine.

Project ID: 27922225

About the project

11 proposals

Remote project

Active 3 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

11 freelancers are bidding on average $14 USD/hour for this job

@helmot

Hello. I have 12+ years of experience in Python and have worked on a lot of Django, Flask, AI/ML, ... projects. I can share some demos if you are interested. Also, I work as a fulltime freelancer and have enough time to assign to your project. Thanks, Helmot

$12 USD in 40 days

4.9

(155 reviews)

7.8

@WeblogySphere

hello- I am a 15year experienced professional having hands on experience working with AWS. I am interested to work on your task. lets discuss.

$15 USD in 40 days

4.9

(2 reviews)

2.6

@vipulmpctec

hi, i have majorly worked with aws, s3, hadoop, pyspark, hive, shell script. i have little knowledge on no sql and kafka. but i can work on these technology peices. i would like to work on your project. please reply back so that we can connect further.

$22 USD in 20 days

5.0

(2 reviews)

2.2

@shashanksharma55

I am certified aws data engineer in aws services- Aws lambda Aws glue Aws step function Aws sagemaker Aws lake formation Aws athena Aws redahift Aws dynomo db programing languages- python, pyspark, sql I can surely help you with this project.. looking forward to connect to you..

$13 USD in 14 days

0.0

(0 reviews)

0.0

@roshnimuthu97

Hi, I've an aws data engineer with 2+ years of experience. I'm been majorly working with aws glue for performing ETL, with s3 as a data source. I'm pretty much worked on the following services as well - EMR, EC2, Lambda, RDS, Redshift, DynamoDb. you're project seems interesting, and I'll be more than happy to assist you on this

$9 USD in 5 days

0.0

(0 reviews)

0.0

@abhijitcaps

I have good experience of over 2 years in designing and developing ETL solutions using AWS services like DMS, Glue, Lambda, Athena and Redshift.

$11 USD in 10 days

0.0

(2 reviews)

0.0

@adityagtiwari92

Hello , I am professional AWS cloud and PYTHON BigData Developer with an experience of 6 plus years. I have so far worked on multiple AWS services and have a good hands-on as well as architectural design knowledge on AWS based services and data pipeline. I will be really very happy to collaborate with you on this engagement and you can trust me with the task.

$17 USD in 20 days

0.0

(0 reviews)

0.0

@freelancergrp1

I am BigData engineer with vast experience in various tools like spark(pyspark), Hadoop, yarn, Hive, kafka and Python, shell scripting. Have good experience in designing and implementing ETL pipelines using pyspark with source and destinations being S3, Hive, Mysql, Kafka and Redshift. Will be able to handle huge datasets and different data transformations.

$10 USD in 20 days