Hi, I used one worker per node and that worked for smaller files. When the file size was more than 25 MB, I got this strange exception. I tried using 2 nodes and 3 nodes, the result is the same.
**ERROR** [org.apache.giraph.master.MasterThread] master.BspServiceMaster (BspServiceMaster.java:barrierOnWorkerList(1415)) - barrierOnWorkerList:**Missing chosen workers**[Worker(hostname=comet-10-68.sdsc.edu, MRtaskID=2, port=30002)] on superstep 2 **FATAL** [org.apache.giraph.master.MasterThread] master.BspServiceMaster (BspServiceMaster.java:getLastGoodCheckpoint(1291)) - getLastGoodCheckpoint: No last good checkpoints can be found, killing the job. java.io.FileNotFoundException: File hdfs://comet-10-33.ibnet:54310/user/saiganes/_bsp/_checkpoints/giraph_yarn_application_1488002378889_0001 does not exist. at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:697) at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105)