Apache Hadoop YARN – NodeManager by Vinod Kumar Vavilapalli
From the post:
In the previous post, we briefly covered the internals of Apache Hadoop YARN’s ResourceManager. In this post, which is the fourth in the multi-part YARN blog series, we are going to dig deeper into the NodeManager internals and some of the key-features that NodeManager exposes. Part one, two and three are available.
Introduction
The NodeManager (NM) is YARN’s per-node agent, and takes care of the individual compute nodes in a Hadoop cluster. This includes keeping up-to date with the ResourceManager (RM), overseeing containers’ life-cycle management; monitoring resource usage (memory, CPU) of individual containers, tracking node-health, log’s management and auxiliary services which may be exploited by different YARN applications.
Administration isn’t high on the “exciting” list, although without good administration, things can get very “exciting.”
NodeManager gives you the monitoring tools to help avoid the latter form of excitement.
[…] Apache Hadoop YARN – NodeManager #topicmaps #hadoop #yarn #nodemanager – http://t.co/woSxEU1q… […]
Pingback by Apache Hadoop YARN – NodeManager | #Play! #Scala in #PaaS and in #Hadoop | Scoop.it — September 12, 2012 @ 11:09 pm