[
https://issues.apache.org/jira/browse/GIRAPH-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560008#comment-13560008
]
Eli Reisman commented on GIRAPH-488:
------------------------------------
This code has recently been modified to take each thread ID for split reading
threads into account when generating the locality lists and the offset into the
input split list for each thread to iterate from. Its easy to introduce these
sorts of errors. I will take a quick peek to see what happened. You might roll
back to the commit just before that change to the split path organizer, run the
same job, and see if it comes out OK?
> ArrayOutOfBoundsException in org.apache.giraph.worker.InputSplitPathOrganizer
> -----------------------------------------------------------------------------
>
> Key: GIRAPH-488
> URL: https://issues.apache.org/jira/browse/GIRAPH-488
> Project: Giraph
> Issue Type: Bug
> Affects Versions: 0.2.0
> Reporter: Sebastian Schelter
>
> I ran into a strange exception when testing the RandomWalkVertex on a cluster
> of 26 machines running Hadoop 1.0.4
> {noformat}
> java.lang.IllegalStateException: run: Caught an unrecoverable exception
> Index: 225, Size: 205
> at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:735)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 225, Size: 205
> at java.util.ArrayList.rangeCheckForAdd(ArrayList.java:612)
> at java.util.ArrayList.addAll(ArrayList.java:554)
> at
> org.apache.giraph.worker.InputSplitPathOrganizer.prioritizeLocalInputSplits(InputSplitPathOrganizer.java:140)
> at
> org.apache.giraph.worker.InputSplitPathOrganizer.<init>(InputSplitPathOrganizer.java:93)
> at
> org.apache.giraph.worker.InputSplitsCallable.<init>(InputSplitsCallable.java:140)
> at
> org.apache.giraph.worker.VertexInputSplitsCallable.<init>(VertexInputSplitsCallable.java:97)
> at
> org.apache.giraph.worker.VertexInputSplitsCallableFactory.newCallable(VertexInputSplitsCallableFactory.java:86)
> at
> org.apache.giraph.worker.BspServiceWorker.loadInputSplits(BspServiceWorker.java:266)
> at
> org.apache.giraph.worker.BspServiceWorker.loadVertices(BspServiceWorker.java:310)
> at
> org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:483)
> at org.apache.giraph.graph.GraphMapper.map(GraphMapper.java:525)
> at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:723)
> ... 7 more
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
