Closed

BIG DATA HADOOP

Please find details about training /consulting requirement

Kindly find theContents:

Read Kafka data and put into HDFS using Scala and spark streaming

 Read Mysql data and put into HDFS using spark and Scala streaming

 Hadoop Production Resource Allocation

 Druid

 Oozie scheduler and The JAVA API/framework integration with the Hadoop cluster

More details:

Is it real time data processing or batch processing? There is no real-time data processing here.

• Spark streaming Job -> which reads data from Kafka and loads into HDFS using Spark & Scala

• Spark Batch Job -> which reads data from MySql and loads into HDFS using Spark & Scala

• Oozie -> used for scheduling both the kind of jobs.

2. More detail on data ingestion part - After loading data into HDFS using the above jobs there is a Druid server which does indexing part.

3. Experience of Audience in BigData - None of the Audience as experience in BigData apart from couple of Team Members with Java programming background

Skills: Big Data Sales, Hadoop, Java, Map Reduce

See more: big data hadoop tutorial, what is hadoop used for, difference between big data and hadoop, big data hadoop pdf, what is hadoop technology, big data hadoop certification, big data hadoop training, big data hadoop wiki, big data hadoop spark python, big data hadoop \\, big data,hadoop, big data hadoop training, big data hadoop,hive,pig, big data hadoop spark, big data hadoop developer

About the Employer:
( 0 reviews ) India

Project ID: #16059158

17 freelancers are bidding on average $176 for this job

khannanav

We are a team of experts with more than 8 years of rich cloud experience in Hadoop [login to view URL], we have worked extensively on Machine Learning. We have developed recommendation/statistical engines, web scrapers/crawl More

$155 USD in 3 days
(6 Reviews)
5.4
deytps86

I understand some of your requirements. Can we talk further? Thanks Relevant Skills and Experience Spark Scala Streaming Kafka Bigdata.

$500 USD in 5 days
(14 Reviews)
4.0
ubfapps

A proposal has not yet been provided

$250 USD in 5 days
(6 Reviews)
3.5
dineshrajputit

I have 6 years exp in bigdata hadoop and spark. done good project on spark, kafka, nifi, dataware house end to end implementation with admin+development.

$30 USD in 1 day
(2 Reviews)
0.6
jitendrajha21

What do you need ? Please specify, I think our team can do it.

$30 USD in 1 day
(0 Reviews)
0.0
lakshmanmalekar

A proposal has not yet been provided

$155 USD in 3 days
(0 Reviews)
0.0
karthikgolagani

i have worked with similar scenarios. i can complete your project easily or within the specified time.

$222 USD in 3 days
(0 Reviews)
0.0
kuramahapatro

Experienced in real time data processing using spark streaming through kafka. Having around 4 years of experience as Hadoop/Spark Developer. Already given training to new Joiner. Skills - Java,Scala,Hadoop,Hive,Pig, More

$166 USD in 12 days
(0 Reviews)
0.0
datavidhya

Hi, I have 6 years of experience in spark, scala, hive, pig, sqoop, Kafka etc. I have worked on hadoop migration project. That will help me to implement your solution. thank you

$222 USD in 5 days
(0 Reviews)
0.0
captainSpark

Have experience in spark streaming to read from kafka topic. Pls contact for further discussion. .

$250 USD in 5 days
(0 Reviews)
0.0
nmogilip

Cloudera Certified Developer for Apache Hadoop (CCDH) I have 9+ years of experience as an big-data application developer. I am comfortable operating on a different environments in HADOOP eco-system and can offer y More

$155 USD in 3 days
(0 Reviews)
0.0
namvit

I am building big data platform for Newyork city downtown using Confluent. Before, we use ELK for monitoring and alerting web servers. I am working with big data+ cloud computing+machine learning. Relevant Skills an More

$155 USD in 3 days
(0 Reviews)
0.0
aa1993agarwal

I have worked in bigbdata application for some time. My last application included reading input from kafka, analyzing the data using spark and hive and finally storing in mysql.

$166 USD in 5 days
(0 Reviews)
0.0
akshayvpawar42

A proposal has not yet been provided

$111 USD in 7 days
(0 Reviews)
0.0
$155 USD in 3 days
(0 Reviews)
0.0
$111 USD in 3 days
(0 Reviews)
0.0
bigdatabear

I am big data professional having 11 years of experience in developing solution for big data using hadoop,spark,scala,Kafka using java programming.I can complete you task as per your requirement. Regards, B.K Sankhla

$166 USD in 5 days
(0 Reviews)
0.0