Experimenting with MapReduce 2.0 by Ahmed Radwan.
In Building and Deploying MR2, we presented a brief introduction to MapReduce in Hadoop 0.23 and focused on the steps to setup a single-node cluster. In MapReduce 2.0 in Hadoop 0.23, we discussed the new architectural aspects of the MapReduce 2.0 design. This blog post highlights the main issues to consider when migrating from MapReduce 1.0 to MapReduce 2.0. Note that both MapReduce 1.0 and MapReduce 2.0 are included in CDH4.
It is important to note that, at the time of writing this blog post, MapReduce 2.0 is still Alpha, and it is not recommended to use it in production.
In the rest of this post, we shall first discuss the Client API, followed by configurations and testing considerations, and finally commenting on the new changes related to the Job History Server and Web Servlets. We will use the terms MR1 and MR2 to refer to MapReduce in Hadoop 1.0 and Hadoop 2.0, respectively.
How long MapReduce 2.0 remains in alpha is anyone’s guess. Suggest we start to learn about it before that status passes.
[…] Experimenting with MapReduce 2.0 #topicmaps #hadoop #mapreduce #mapreduce2.0 – http://t.co/F1AvloZE… […]
Pingback by Experimenting with MapReduce 2.0 | #Play! #Scala in #PaaS and in #Hadoop | Scoop.it — July 17, 2012 @ 1:36 am