Looking for hadoop developer with java, scala and spark backgroudn

$10-900 USD

Closed

Posted

about 5 years ago

$10-900 USD

Paid on delivery

I am looking for a Hadoop developer with Java and scala experience. Looking for someone who have good experience and can take the pressure. This is a full time support and looking for someone who can work remotely new York standard time from Mon thru Friday from 10 to 5 eastern time. Looking for someone who have good knowledge of Bash scripting. Please don't waste my time and your time, if you are not serious. I need following skills: -Scala -Spark -Hive -Teradata -Bash Scripting -Infowork(can get train while on the job) -Good troubleshooting experience

Project ID: 19247691

About the project

4 proposals

Remote project

Active 5 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

4 freelancers are bidding on average $689 USD for this job

@eaglepoint

Hi I am data engineer with 4+ years of industry experience. Have been designing and deploying analytics solutions for both batch and streaming processing. Can work with you but for limited time slot Relevant Skills and Experience Expertise in 1. Spark , spark streaming, nifi, hive, mapreduce 2. Airflow, oozie, bash, 3. Aws analytics stack Looking forward to hearing from you

$1,000 USD in 30 days

4.9

(21 reviews)

4.9

@fatihuludag

I am a PhD student and working on Big Data I have research paper and professionally working at University IT.

$505 USD in 10 days

0.0

(1 review)

0.0

@Nisha012

Professional Summary: • 3.7 years of IT experience in Big Data and Hadoop Ecosystems. • Experience in providing Big Data solutions using Hadoop and its components like HDFS, Sqoop, Flume, Hive, SparkSQL, Spark Streaming, Kafka, Cassandra, Scala, AWS, MapReduce, Yarn, Apache Drill, Hbase, Oozie • Experience in processing real time streaming data using AWS ecosystem like Kinesis, IoT Core, EMR, Lambda, S3, Glue, RDS, EC2, IAM, DynamoDB, Elastic Cache. • Written Hive queries for creating managed/external tables, data preprocessing, data transformation and analysis. • Implemented partitioning, bucketing in Hive to optimize performance. • Importing and exporting data into HDFS from RDBMS and vice versa using Sqoop. • Worked with RDDs, dataframes, datasets, SparkSQL using Scala. • Queried Hive tables using SparkSQL. • Good understanding of Hadoop architecture, MapReduce programming model, HDFS, various file formats. • Optimized Spark and Hive using various optimization techniques.

$472 USD in 15 days