Have you tried running it via the giraph cmd line entry point? As in: $ HADOOP_HOME=XXX $ HADOOP_CONF_DIR=YYY $ PATH=$GIRAPH_HOME/bin:$HADOOP_HOME/bin:$PATH $ giraph $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/puneet/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/puneet/output/shortestpaths -w 1
The reason I'm asking is because it seems to be working for me. Thanks, Roman. On Tue, Nov 25, 2014 at 7:35 AM, Puneet Agarwal <puagar...@yahoo.com> wrote: > On Hadoop 1.2.1, and Giraph 1.1.0 > I tried following command > > hadoop jar > $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar > org.apache.giraph.GiraphRunner > org.apache.giraph.examples.SimpleShortestPathsComputation -vif > org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip > /user/puneet/input/tiny_graph.txt -vof > org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op > /user/puneet/output/shortestpaths -w 1 > > It fails with following log messages. > Please help. > > Logs in the Worker Thread ( last three lines) > ================================ > > 2014-11-25 20:55:13,583 INFO org.apache.giraph.comm.netty.NettyClient: > waitAllRequests: Finished all requests. MBytes/sec received = 0, > MBytesReceived = 0, ave received req MBytes = 0, secs waited = 1.41692902E9 > MBytes/sec sent = 0, MBytesSent = 0, ave sent req MBytes = 0, secs waited = > 1.41692902E9 > 2014-11-25 20:55:13,583 INFO org.apache.giraph.worker.BspServiceWorker: > setup: Finally loaded a total of (v=5, e=12) > > > Logs in the Master > ============== > > 2014-11-25 20:55:13,445 INFO org.apache.giraph.comm.netty.NettyClient: Using > Netty without authentication. > 2014-11-25 20:55:13,452 INFO org.apache.giraph.comm.netty.NettyClient: > connectAllAddresses: Successfully added 1 connections, (1 total connected) 0 > failed, 0 failures total. > 2014-11-25 20:55:13,454 INFO org.apache.giraph.partition.PartitionUtils: > computePartitionCount: Creating 1, default would have been 1 partitions. > 2014-11-25 20:55:13,491 INFO org.apache.giraph.master.BspServiceMaster: > barrierOnWorkerList: 0 out of 1 workers finished on superstep -1 on path > /_hadoopBsp/job_201411251752_0003/_vertexInputSplitDoneDir > 2014-11-25 20:55:13,493 INFO org.apache.giraph.master.BspServiceMaster: > barrierOnWorkerList: Waiting on [01hw789772_1] > 2014-11-25 20:55:13,503 INFO org.apache.giraph.comm.netty.NettyServer: > start: Using Netty without authentication. > 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.BspServiceMaster: > barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772, > MRtaskID=1, port=30001)] on superstep -1 > 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread: > masterThread: Master algorithm failed with IllegalStateException > java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed > during input split (currently not supported) > at > org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483) > at > org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650) > at org.apache.giraph.master.MasterThread.run(MasterThread.java:124) > 2014-11-25 20:55:13,591 FATAL org.apache.giraph.graph.GraphTaskManager: > uncaughtException: OverrideExceptionHandler on thread > org.apache.giraph.master.MasterThread, msg = > java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed > during input split (currently not supported), exiting... > java.lang.IllegalStateException: java.lang.IllegalStateException: > coordinateVertexInputSplits: Worker failed during input split (currently not > supported) > at org.apache.giraph.master.MasterThread.run(MasterThread.java:194) > Caused by: java.lang.IllegalStateException: coordinateVertexInputSplits: > Worker failed during input split (currently not supported) > at > org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483) > at > org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650) > at org.apache.giraph.master.MasterThread.run(MasterThread.java:124) > 2014-11-25 20:55:13,591 WARN org.apache.giraph.zk.ZooKeeperManager: > logZooKeeperOutput: Dumping up to last 100 lines of the ZooKeeper process > STDOUT and STDERR. > > -Puneet > >
