Re: Adding first datanode isn't working
Firewall of ubuntu box. 2011/6/2 jagaran das jagaran_...@yahoo.co.in ufw From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 3:37:23 PM Subject: Re: Adding first datanode isn't working OK found my issue. Turned off ufw and it sees the datanode. So I need to fix my ufw setup. 2011/6/1 MilleBii mille...@gmail.com Thx, already did that so I can ssh phraseless master to master and master to slave1. Same as before datanode tasktracker are starting up/shuting down well on slave1 2011/6/1 jagaran das jagaran_...@yahoo.co.in Check the password less SSH is working or not Regards, Jagaran From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 12:28:54 PM Subject: Adding first datanode isn't working Newbie on hadoop clusters. I have setup my two nodes conf as described by M. G. Noll http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ / The data node has datanode tasktracker running (jps command shows them), which means start-dfs.sh and start-mapred.sh worked fine. I can also shut them down gracefully. However in the WEB UI I only see one node for the DFS Live Node : 1 Dead Node : 0 Same thing on the MapRed WEB interface. Datanode logs on slave are just empty. Did check the network settings both nodes have access to each other on relevant ports. Did make sure namespaceID are the same ( https://issues.apache.org/jira/browse/HDFS-107) I did try to put data in the DFS worked but no data seemed to arrive in the slave datanode. Also tried a small MapRed only master node has been actually working, but that could be because there is only data in the master. Right ? -- -MilleBii- -- -MilleBii- -- -MilleBii- -- -MilleBii-
Adding first datanode isn't working
Newbie on hadoop clusters. I have setup my two nodes conf as described by M. G. Noll http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ The data node has datanode tasktracker running (jps command shows them), which means start-dfs.sh and start-mapred.sh worked fine. I can also shut them down gracefully. However in the WEB UI I only see one node for the DFS Live Node : 1 Dead Node : 0 Same thing on the MapRed WEB interface. Datanode logs on slave are just empty. Did check the network settings both nodes have access to each other on relevant ports. Did make sure namespaceID are the same ( https://issues.apache.org/jira/browse/HDFS-107) I did try to put data in the DFS worked but no data seemed to arrive in the slave datanode. Also tried a small MapRed only master node has been actually working, but that could be because there is only data in the master. Right ? -- -MilleBii-
Re: Adding first datanode isn't working
Check the password less SSH is working or not Regards, Jagaran From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 12:28:54 PM Subject: Adding first datanode isn't working Newbie on hadoop clusters. I have setup my two nodes conf as described by M. G. Noll http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ The data node has datanode tasktracker running (jps command shows them), which means start-dfs.sh and start-mapred.sh worked fine. I can also shut them down gracefully. However in the WEB UI I only see one node for the DFS Live Node : 1 Dead Node : 0 Same thing on the MapRed WEB interface. Datanode logs on slave are just empty. Did check the network settings both nodes have access to each other on relevant ports. Did make sure namespaceID are the same ( https://issues.apache.org/jira/browse/HDFS-107) I did try to put data in the DFS worked but no data seemed to arrive in the slave datanode. Also tried a small MapRed only master node has been actually working, but that could be because there is only data in the master. Right ? -- -MilleBii-
Re: Adding first datanode isn't working
Thx, already did that so I can ssh phraseless master to master and master to slave1. Same as before datanode tasktracker are starting up/shuting down well on slave1 2011/6/1 jagaran das jagaran_...@yahoo.co.in Check the password less SSH is working or not Regards, Jagaran From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 12:28:54 PM Subject: Adding first datanode isn't working Newbie on hadoop clusters. I have setup my two nodes conf as described by M. G. Noll http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ The data node has datanode tasktracker running (jps command shows them), which means start-dfs.sh and start-mapred.sh worked fine. I can also shut them down gracefully. However in the WEB UI I only see one node for the DFS Live Node : 1 Dead Node : 0 Same thing on the MapRed WEB interface. Datanode logs on slave are just empty. Did check the network settings both nodes have access to each other on relevant ports. Did make sure namespaceID are the same ( https://issues.apache.org/jira/browse/HDFS-107) I did try to put data in the DFS worked but no data seemed to arrive in the slave datanode. Also tried a small MapRed only master node has been actually working, but that could be because there is only data in the master. Right ? -- -MilleBii- -- -MilleBii-
Re: Adding first datanode isn't working
OK found my issue. Turned off ufw and it sees the datanode. So I need to fix my ufw setup. 2011/6/1 MilleBii mille...@gmail.com Thx, already did that so I can ssh phraseless master to master and master to slave1. Same as before datanode tasktracker are starting up/shuting down well on slave1 2011/6/1 jagaran das jagaran_...@yahoo.co.in Check the password less SSH is working or not Regards, Jagaran From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 12:28:54 PM Subject: Adding first datanode isn't working Newbie on hadoop clusters. I have setup my two nodes conf as described by M. G. Noll http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ The data node has datanode tasktracker running (jps command shows them), which means start-dfs.sh and start-mapred.sh worked fine. I can also shut them down gracefully. However in the WEB UI I only see one node for the DFS Live Node : 1 Dead Node : 0 Same thing on the MapRed WEB interface. Datanode logs on slave are just empty. Did check the network settings both nodes have access to each other on relevant ports. Did make sure namespaceID are the same ( https://issues.apache.org/jira/browse/HDFS-107) I did try to put data in the DFS worked but no data seemed to arrive in the slave datanode. Also tried a small MapRed only master node has been actually working, but that could be because there is only data in the master. Right ? -- -MilleBii- -- -MilleBii- -- -MilleBii-
Re: Adding first datanode isn't working
ufw From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 3:37:23 PM Subject: Re: Adding first datanode isn't working OK found my issue. Turned off ufw and it sees the datanode. So I need to fix my ufw setup. 2011/6/1 MilleBii mille...@gmail.com Thx, already did that so I can ssh phraseless master to master and master to slave1. Same as before datanode tasktracker are starting up/shuting down well on slave1 2011/6/1 jagaran das jagaran_...@yahoo.co.in Check the password less SSH is working or not Regards, Jagaran From: MilleBii mille...@gmail.com To: common-user@hadoop.apache.org Sent: Wed, 1 June, 2011 12:28:54 PM Subject: Adding first datanode isn't working Newbie on hadoop clusters. I have setup my two nodes conf as described by M. G. Noll http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ / The data node has datanode tasktracker running (jps command shows them), which means start-dfs.sh and start-mapred.sh worked fine. I can also shut them down gracefully. However in the WEB UI I only see one node for the DFS Live Node : 1 Dead Node : 0 Same thing on the MapRed WEB interface. Datanode logs on slave are just empty. Did check the network settings both nodes have access to each other on relevant ports. Did make sure namespaceID are the same ( https://issues.apache.org/jira/browse/HDFS-107) I did try to put data in the DFS worked but no data seemed to arrive in the slave datanode. Also tried a small MapRed only master node has been actually working, but that could be because there is only data in the master. Right ? -- -MilleBii- -- -MilleBii- -- -MilleBii-
