Hey guys, I am constantly getting the error below on a worker as soon as superstep 1 begins. Can anyone explain what it means and how I can fix it.
Thanks, Simon Command: hadoop jar lib/GiraphTest.jar org.apache.giraph.GiraphRunner -Dgiraph.zkList=10.10.5.103:2181,10.10.5.104:2181,10.10.5.105:2181-Dgiraph.checkpointFrequency=1 -Dgiraph.useOutOfCoreGraph=true -Dgiraph.useOutOfCoreMessages=true -Dgiraph.numComputeThreads=4 -Dgiraph.maxPartitionsInMemory=1 -Dgiraph.numOutputThreads=4 -Dgiraph.maxMessagesInMemory=100000 -Dgiraph.messagesDirectory=/storage/giraph/messages/ -Dgiraph.partitionsDirectory=/storage/giraph/partitions/ com.mycompany.tarantula.batchlayer.giraph.run.UndirectedFeaturesVertex -eif com.mycompany.tarantula.batchlayer.giraph.io.CustomInputFormat -eip /user/simon/input/ -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/simon/output -w 10 Error: java.lang.IllegalStateException: run: Caught an unrecoverable exception resolveMutations: Already has missing vertex on this worker for 957442 at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.IllegalStateException: resolveMutations: Already has missing vertex on this worker for 9574422 at org.apache.giraph.comm.netty.NettyWorkerServer.resolveMutations(NettyWorkerServer.java:184) at org.apache.giraph.comm.netty.NettyWorkerServer.prepareSuperstep(NettyWorkerServer.java:152) at org.apache.giraph.worker.BspServiceWorker.startSuperstep(BspServiceWorker.java:677) at org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:249) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:92) ... 7 more