Zookeeper is required. That being said, you can have an external
Zookeeper or Giraph can start one for you. It's your choice.
Eli is the one to contact regarding Giraph on Hadoop 2.0.5. Any
thoughts Eli?
Avery
On 6/24/13 5:22 PM, Chuan Lei wrote:
It is not clear to me that whether Zookeeper is required or optional
to Giraph. I wonder if it is possible to run Giraph without Zookeeper.
If not the case, would the default Zookeeper work with Giraph? Is
there anything has to be changed on Zookeeper.
Another question is that I have the following error message when I ran
Giraph on Hadoop-2.0.5 when I ran the PageRankBenchmark program. I saw
similar posts on the mailing list, but it seems no clear answer to it
yet. I would be grateful if someone can answer my question and resolve
the issue.
Error: java.lang.IllegalStateException: run: Caught an unrecoverable
exception java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not
exist. at
org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:757) at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:339) at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:396) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1478)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153) Caused
by: java.lang.RuntimeException: java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not
exist. at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:790)
at
org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java:357)
at
org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:188)
at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:60) at
org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:90) ... 7
more Caused by: java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1372108933881_0002/_zkServer does not
exist. at
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:405)
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:749)
... 11 more
Regards,
Chuan
