Custom Google App Engine Mapreduce Output Writer in Python

$250-750 SGD

Completed

Posted

over 9 years ago

$250-750 SGD

Paid on delivery

The Google App Engine Mapreduce library provides standard input readers and output writers, as shown in the following link: [login to view URL] I currently have a mapreduce pipeline written in Python to process data from Google NDB Datastore (using Datastore input reader). And I need the mapreduce output to be written into NDB Datastore. But Google do not have standard Mapreduce output writer to write the output into Datastore. I would need a custom Google App Engine Mapreduce Output Writer written in Python, whereby it will write the output of Google Mapreduce pipeline job into the specific entity_kind , as specific in the pipeline parameters. I need explanation on each code written in the output writer to help me understand the Python codes (as Remarks in the code, and simple instructions on how to set the parameters in pipeline)

Google App Engine

Map Reduce

Python

Project ID: 6308901

About the project

9 proposals

Remote project

Active 10 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@bogdansulima

I am a python expert working with GAE since its first public beta, i know GAE's Map-Reduce framework and have rich experience Map-Reducing Terabytes of data on EMR. Additionally i am doing internal trainings (for my employer) in fields of python testing and data wrangling with python - so i will explain you details of implementation and teach missing parts of map-reduce and python.

$500 SGD in 8 days

0.0

(0 reviews)

0.0

9 freelancers are bidding on average $708 SGD for this job

@anuyadav1

A proposal has not yet been provided

$555 SGD in 10 days

4.9

(27 reviews)

5.1

@letshappy

hello i am red hat certified engineer and i am expert in python and java i easily can do this tasks i am ready to start now i need a chance to prove my skills to you ready to start now thanks

$444 SGD in 8 days

5.0

(3 reviews)

2.4

@waqasvj

Hi I have my assignments using Mapreduce where task was to process twitter data along with dictionary output. Can you give some details on the pipiline you wrote? Perhaps a skype session to dicuss things in more detail? And what is the nature of the data from NDB store? Apprently you need the mapreduce extended to write the output in the NDB. All of the rest requirement you mentioned can be managed. It will take atleast 1-3 weeks to implement, test and then make documentation and comments for it. Thanks for reading it. Looking forward to hear from you. Regards

$833 SGD in 10 days

0.0

(0 reviews)

0.0

@Sibext

A proposal has not yet been provided

$1,500 SGD in 12 days

0.0

(0 reviews)

0.0

@kantorvw

A proposal has not yet been provided

$666 SGD in 10 days

0.0

(0 reviews)

0.0

@closure

Greetings! I’m a cloud developer. an ex-Googler with 3.5 years of experience. I’ve prior experience with Google App Engine and have N number of mapreduces. As you might know that mapreduce is originally from Google and I'm quite familiar with the concepts of it and can help you design the solution. I strictly believe in maintaining high quality and efficiency in the code I write. One of the things we follow in Google is clean code and readable code. So I can assure on the comments/remarks on the code. Apart from the timely completion of the project. Looking forward to the opportunity, Goodbye

$666 SGD in 10 days