Multinode cluster only recognizes 1 node
Hi, I just set up a 2 node POC cluster and I am currently having an issue with it. I ran a wordcount MR test on my cluster to see if it was working and noticed that the Web ui at localhost:50030 showed that I only have 1 live node. I followed the tutorial step by step and I cannot seem to figure out my problem. When I ran start-all.sh all of the daemons on my master node and my slave node start up perfectly fine. If you have any suggestions please let me know. -Sean
Re: Multinode cluster only recognizes 1 node
Can you paste the information when you execute . start-all.sh in kernal.. when you do ssh on slave .. whether it is working fine... On Jul 27, 2012 4:50 AM, "Barry, Sean F" wrote: > Hi, > > I just set up a 2 node POC cluster and I am currently having an issue with > it. I ran a wordcount MR test on my cluster to see if it was working and > noticed that the Web ui at localhost:50030 showed that I only have 1 live > node. I followed the tutorial step by step and I cannot seem to figure out > my problem. When I ran start-all.sh all of the daemons on my master node > and my slave node start up perfectly fine. If you have any suggestions > please let me know. > > -Sean >
Re: Multinode cluster only recognizes 1 node
Sean, Most of the times I've found this to be related to two issues: 1. NN and JT have been bound to to localhost or a 127.0.0.1-resolving hostname, leading to the other nodes never being able to connect to its ports, as it never listens over the true network interface. 2. Failure in turning off, or in reconfiguring the firewall. On Fri, Jul 27, 2012 at 4:50 AM, Barry, Sean F wrote: > Hi, > > I just set up a 2 node POC cluster and I am currently having an issue with > it. I ran a wordcount MR test on my cluster to see if it was working and > noticed that the Web ui at localhost:50030 showed that I only have 1 live > node. I followed the tutorial step by step and I cannot seem to figure out my > problem. When I ran start-all.sh all of the daemons on my master node and my > slave node start up perfectly fine. If you have any suggestions please let me > know. > > -Sean -- Harsh J
RE: Multinode cluster only recognizes 1 node
After a good number of hours trying to tinker with my set up I am still am only seeing results for 1, not 2 nodes. This is the tut I followed http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ After executing ./start-all.sh starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-master.out slave: starting datanode, logging to /usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-slave.out master: starting datanode, logging to /usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-master.out master: starting secondarynamenode, logging to /usr/local/hadoop/bin/../logs/hadoop-hduser-secondarynamenode-master.out starting jobtracker, logging to /usr/local/hadoop/logs/hadoop-hduser-jobtracker-master.out slave: starting tasktracker, logging to /usr/local/hadoop/bin/../logs/hadoop-hduser-tasktracker-slave.out master: starting tasktracker, logging to /usr/local/hadoop/bin/../logs/hadoop-hduser-tasktracker-master.out -Original Message- From: syed kather [mailto:in.ab...@gmail.com] Sent: Thursday, July 26, 2012 6:06 PM To: common-user@hadoop.apache.org Subject: Re: Multinode cluster only recognizes 1 node Can you paste the information when you execute . start-all.sh in kernal.. when you do ssh on slave .. whether it is working fine... On Jul 27, 2012 4:50 AM, "Barry, Sean F" wrote: > Hi, > > I just set up a 2 node POC cluster and I am currently having an issue > with it. I ran a wordcount MR test on my cluster to see if it was > working and noticed that the Web ui at localhost:50030 showed that I > only have 1 live node. I followed the tutorial step by step and I > cannot seem to figure out my problem. When I ran start-all.sh all of > the daemons on my master node and my slave node start up perfectly > fine. If you have any suggestions please let me know. > > -Sean >
Re: Multinode cluster only recognizes 1 node
Sean Can you paste the name node and jobtracker logs. It could be something as simple as disabling the firewall. Raj > > From: "Barry, Sean F" >To: "common-user@hadoop.apache.org" >Sent: Tuesday, July 31, 2012 1:23 PM >Subject: RE: Multinode cluster only recognizes 1 node > >After a good number of hours trying to tinker with my set up I am still am >only seeing results for 1, not 2 nodes. > >This is the tut I followed >http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ > >After executing ./start-all.sh > >starting namenode, logging to >/usr/local/hadoop/logs/hadoop-hduser-namenode-master.out >slave: starting datanode, logging to >/usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-slave.out >master: starting datanode, logging to >/usr/local/hadoop/bin/../logs/hadoop-hduser-datanode-master.out >master: starting secondarynamenode, logging to >/usr/local/hadoop/bin/../logs/hadoop-hduser-secondarynamenode-master.out >starting jobtracker, logging to >/usr/local/hadoop/logs/hadoop-hduser-jobtracker-master.out >slave: starting tasktracker, logging to >/usr/local/hadoop/bin/../logs/hadoop-hduser-tasktracker-slave.out >master: starting tasktracker, logging to >/usr/local/hadoop/bin/../logs/hadoop-hduser-tasktracker-master.out > > > > > >-Original Message- >From: syed kather [mailto:in.ab...@gmail.com] >Sent: Thursday, July 26, 2012 6:06 PM >To: common-user@hadoop.apache.org >Subject: Re: Multinode cluster only recognizes 1 node > >Can you paste the information when you execute . start-all.sh in kernal.. >when you do ssh on slave .. whether it is working fine... >On Jul 27, 2012 4:50 AM, "Barry, Sean F" wrote: > >> Hi, >> >> I just set up a 2 node POC cluster and I am currently having an issue >> with it. I ran a wordcount MR test on my cluster to see if it was >> working and noticed that the Web ui at localhost:50030 showed that I >> only have 1 live node. I followed the tutorial step by step and I >> cannot seem to figure out my problem. When I ran start-all.sh all of >> the daemons on my master node and my slave node start up perfectly >> fine. If you have any suggestions please let me know. >> >> -Sean >> > > >
答复: Multinode cluster only recognizes 1 node
You'd better check the dead node's log. By default, the logs are in
${HADOOP_HOME}/logs directory.
Liyin
-邮件原件-
发件人: Barry, Sean F [mailto:sean.f.ba...@intel.com]
发送时间: 2012年7月27日 7:20
收件人: common-user@hadoop.apache.org
主题: Multinode cluster only recognizes 1 node
Hi,
I just set up a 2 node POC cluster and I am currently having an issue with
it. I ran a wordcount MR test on my cluster to see if it was working and
noticed that the Web ui at localhost:50030 showed that I only have 1 live
node. I followed the tutorial step by step and I cannot seem to figure out
my problem. When I ran start-all.sh all of the daemons on my master node and
my slave node start up perfectly fine. If you have any suggestions please
let me know.
-Sean
