Hi Edward, I thought the default value of HAMA_MANAGES_ZK is set to false and if we want Hama to start its own ZK then we should set this value to true (the configuration description seemed to be suggesting this). Thanks for pointing this out. I will set this value to false and try running Hama again.
Himanshu On Mon, Jul 11, 2011 at 5:29 PM, Edward J. Yoon <[email protected]> wrote: > Hi, > > Did you set to false to disable Hama ZK? > > conf/hama-env.sh: > > # export HAMA_MANAGES_ZK=true > > On Tue, Jul 12, 2011 at 9:00 AM, Himanshu Gahlot > <[email protected]> wrote: >> Hi, >> >> I am trying to run hama in distributed mode using an already running >> zookeeper quorum. Whenever I try to run start-bspd.sh it is unable to >> use the existing zookeeper and tries to start a new instance of >> zookeeper which fails by throwing "Address already in use error". >> >> Here is the stdout: >> >> -bash-3.2$ bin/start-bspd.sh >> Enter passphrase for key '/home/hgahlot/.ssh/id_dsa': Enter passphrase >> for key '/home/hgahlot/.ssh/id_dsa': Enter passphrase for key >> '/home/hgahlot/.ssh/id_dsa': >> <worker1>.cnet.com: starting zookeeper, logging to >> /home/hgahlot/graph/hama/hama-trunk/bin/../logs/<worker1>.cnet.com.out >> >> Nothing happens after this. The hama-zookeeper log is as follows: >> >> -bash-3.2$ cat logs/hama-hgahlot-<worker1>.cnet.com.log >> 2011-07-11 16:47:27,935 INFO >> org.apache.zookeeper.server.quorum.QuorumPeerConfig: Defaulting to >> majority quorums >> 2011-07-11 16:47:28,198 INFO >> org.apache.zookeeper.server.quorum.QuorumPeerMain: Starting quorum >> peer >> 2011-07-11 16:47:28,468 INFO >> org.apache.zookeeper.server.NIOServerCnxn: binding to port >> 0.0.0.0/0.0.0.0:2181 >> 2011-07-11 16:47:28,469 ERROR org.apache.hama.zookeeper.QuorumPeer: >> Exception during ZooKeeper startup - exiting... >> java.net.BindException: Address already in use >> at sun.nio.ch.Net.bind(Native Method) >> at >> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119) >> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) >> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:52) >> at >> org.apache.zookeeper.server.NIOServerCnxn$Factory.<init>(NIOServerCnxn.java:144) >> at >> org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:121) >> at >> org.apache.hama.zookeeper.QuorumPeer.runZKServer(QuorumPeer.java:80) >> at org.apache.hama.zookeeper.QuorumPeer.run(QuorumPeer.java:70) >> at org.apache.hama.ZooKeeperRunner.run(ZooKeeperRunner.java:36) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) >> at org.apache.hama.ZooKeeperRunner.main(ZooKeeperRunner.java:41) >> >> The hama-site.xml config is as follows: >> >> <configuration> >> <property> >> <name>bsp.master.address</name> >> <value>localhost</value> >> <description>The address of the bsp master server. Either the >> literal string "local" or a host:port for distributed mode >> </description> >> </property> >> >> <property> >> <name>fs.default.name</name> >> <value><hdfs-host:port>/</value> >> <description> >> The name of the default file system. Either the literal string >> "local" or a host:port for HDFS. >> </description> >> </property> >> >> <property> >> <name>hama.zookeeper.quorum</name> >> <value><worker1>.cnet.com,<worker2>.cnet.com,<worker3>.cnet.com</value> >> <description>Comma separated list of servers in the ZooKeeper Quorum. >> For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com". >> By default this is set to localhost for local and pseudo-distributed modes >> of operation. For a fully-distributed setup, this should be set to a full >> list of ZooKeeper quorum servers. If HAMA_MANAGES_ZK is set in hama-env.sh >> this is the list of servers which we will start/stop zookeeper on. >> </description> >> </property> >> <property> >> <name>hama.zookeeper.property.clientPort</name> >> <value>2181</value> >> </property> >> </configuration> >> >> Why is hama trying to invoke an instance of zookeeper instead of using >> the already running zookeeper ? >> >> Thanks, >> Himanshu >> > > > > -- > Best Regards, Edward J. Yoon > @eddieyoon >
