Hi Daniel,
The RM will list only NodeManagers and not the datanodes. You can view the
datanodes on the NameNode page (eg. 192.168.51.4:50070).
The one node you see on the RM page 'Nodes' list is from this:
hadoop@hadoop-master:~$ jps24641 SecondaryNameNode24435 DataNode24261
NameNode24791 Resourc
I was able to get the jobs submitting to the cluster by adding the
following property to mapred-site.xml
mapreduce.framework.name
yarn
I also had to add the following properties to yarn-site.xml
yarn.nodemanager.aux-services
mapreduce_shuffle
yarn.nodemanager
I'm not sure if this is related, but I'm seeing some errors
in hadoop-hadoop-namenode-hadoop-master.log
2015-09-23 19:56:27,798 WARN
org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager:
Unresolved datanode registration: hostname cannot be resolved
(ip=192.168.51.1, hostname=192.168.51.1)
Hi,
I have deployed a multi-node cluster with one master and two data nodes.
Here's what jps shows:
hadoop@hadoop-master:~$ jps
24641 SecondaryNameNode
24435 DataNode
24261 NameNode
24791 ResourceManager
25483 Jps
24940 NodeManager
hadoop@hadoop-data1:~$ jps
15556 DataNode
16198 NodeManager
1639
