[ https://issues.apache.org/jira/browse/GIRAPH-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13100564#comment-13100564 ]
Avery Ching commented on GIRAPH-25: ----------------------------------- Patch worked nicely. I added a unittest and tweaked an error message. Here's some example output I got (looks much better). ... 2011-09-08 11:20:35,203 INFO org.apache.giraph.graph.BspServiceMaster: checkWorkers: Only found 0 responses of 32767 needed to start superstep -1. Sleeping for 1 msecs and used 0 of 1 attempts. 2011-09-08 11:20:35,203 ERROR org.apache.giraph.graph.BspServiceMaster: checkWorkers: Did not receive enough processes in time (only 0 of 32767 required). This occurs if you do not have enough map tasks available simultaneously on your Hadoop instance to fulfill the number of requested workers. 2011-09-08 11:20:35,276 INFO org.apache.giraph.graph.BspServiceMaster: setJobState: {"_stateKey":"FAILED","_applicationAttemptKey":-1,"_superstepKey":-1} on superstep -1 2011-09-08 11:20:35,333 FATAL org.apache.giraph.graph.BspServiceMaster: failJob: Killing job job_201109080935_0009 2011-09-08 11:20:35,619 INFO org.apache.giraph.graph.BspServiceMaster: cleanup: Notifying master its okay to cleanup with /_hadoopBsp/job_201109080935_0009/_cleanedUpDir/0_master 2011-09-08 11:20:35,620 INFO org.apache.giraph.graph.BspServiceMaster: cleanUpZooKeeper: Node /_hadoopBsp/job_201109080935_0009/_cleanedUpDir already exists, no need to create. 2011-09-08 11:20:35,621 INFO org.apache.giraph.graph.BspServiceMaster: cleanUpZooKeeper: Got 1 of 32768 desired children from /_hadoopBsp/job_201109080935_0009/_cleanedUpDir 2011-09-08 11:20:35,621 INFO org.apache.giraph.graph.BspServiceMaster: cleanedUpZooKeeper: Waiting for the children of /_hadoopBsp/job_201109080935_0009/_cleanedUpDir to change since only got 1 nodes. 2011-09-08 11:20:38,182 WARN org.apache.giraph.zk.ZooKeeperManager: onlineZooKeeperServers: Forced a shutdown hook kill of the ZooKeeper process. I'll upload the minor changes and then commit it on your behalf. I ran unittests in local mode and also on a small Hadoop instance. Thanks! > NPE in BspServiceMaster when failing a job > ------------------------------------------ > > Key: GIRAPH-25 > URL: https://issues.apache.org/jira/browse/GIRAPH-25 > Project: Giraph > Issue Type: Bug > Reporter: Dmitriy V. Ryaboy > Priority: Minor > Attachments: GIRAPH-25.2.patch, GIRAPH-25.patch > > > When BspServiceMaster times out waiting for all workers to check in, it dies > with a NullPointerException. > This can perhaps be handled a bit more gracefully. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira