Did you compile with the appropriate flags?
From the README:
- Apache Hadoop 0.23.1
You may tell maven to use this version with "mvn -Phadoop_0.23 <goals>".
On 5/25/12 9:24 AM, Roman Shaposhnik wrote:
Hi!
I'm trying to run Giraph trunk on top of Hadoop 2.0.0 and I'm getting
the following error while submitting an example job:
$ hadoop jar /usr/lib/giraph/giraph-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 3 -V 100000 -w 3
Now, if I look at the state of HDFS right after the job fails I see that
the job has created file structure all the way up to
_bsp/_defaultZkManagerDir/job_1337959594450_0002/
I even see
_bsp/_defaultZkManagerDir/job_1337959594450_0002/zkServerList_ahmed-laptop 0
so it is unlikely to be file permission problems or anything like that.
Could you, please, suggest a way to debug it from here?
Oh, and here's the exception I'm getting:
2012-05-25 08:31:34,335 INFO [IPC Server handler 16 on 33249]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1337959594450_0002_m_000001_3: Error:
java.lang.RuntimeException: java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1337959594450_0002/_zkServer does not
exist.
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:748)
at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:424)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.io.FileNotFoundException: File
_bsp/_defaultZkManagerDir/job_1337959594450_0002/_zkServer does not
exist.
at
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:365)
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:707)
... 9 more
Thanks,
Roman.
