Re: Array exception when using out-of-core graph

2013-07-04 Thread Han JU
Sorry guys, it was my bad ... The debug message fooled me ... Really sorry for bothering. 2013/7/4 Avery Ching ach...@apache.org Claudio, any thoughts? On 7/3/13 3:52 AM, Han JU wrote: Hi, I've been testing some algorithm using the out-of-core feature, and I have an strange

Re: Global factory for vertex IDs?

2013-07-04 Thread Claudio Martella
you can make use of a WorkerContext. There is one per worker, and you can put your factory there. The factory can make use of the Mapper.Context class from getContext(), and make use of the methods inherited from the TaskAttemptContext class (e.g. the unique task id) to get some form of worker id.

Re: MapWritable messages in Giraph

2013-07-04 Thread Pasupathy Mahalingam
Hi, Thanks Avery Ching. I get the following exception java.lang.IllegalStateException: run: Caught an unrecoverable exception waitFor: ExecutionException occurred while waiting for org.apache.giraph.utils.ProgressableUtils$FutureWaitable@381eb0c6 at

Re: MapWritable messages in Giraph

2013-07-04 Thread Avery Ching
Looks like the serialization/descrialization has a problem. If you want to see an example of a Trove primitive map, see LongDoubleArrayEdges. On 7/4/13 7:06 AM, Pasupathy Mahalingam wrote: Hi, Thanks Avery Ching. I get the following exception java.lang.IllegalStateException: run: Caught an

Re: Failed to compile Giraph for Hadoop YARN

2013-07-04 Thread Eli Reisman
Yes, glad this was brought up, I'll post to the site wiki with my explicit apologies for not doing it sooner. I posted the most recent correct way to build pure-YARN Giraph against any hadoop version on GIRAPH-688 here: https://issues.apache.org/jira/browse/GIRAPH-688 The trick is, you have to