Re: Error when using ArrayListWritableText as message

2013-10-17 Thread Simon McGloin
Thanks for the advice Manuel. I created a TextArrayListMessage object to use as a message between supersteps. I had to include a line to wipe the ArrayList during the readFields method or else during the next superstep the array would have unwanted Text objects in it. It seemed like the

Re: how to use out of core options

2013-10-17 Thread Jianqiang Ou
Thanks very much, so are you saying if I use Dgiraph.maxPartitionsInMemory and Dgiraph.maxMessagesInMemory to make them both smaller number, then it might work? Thanks again, Jian On Thu, Oct 17, 2013 at 12:56 AM, Jyotirmoy Sundi sundi...@gmail.comwrote: You need to tune it per your cluster.

Re: How to specify parameters in order to run giraph job in parallel

2013-10-17 Thread Claudio Martella
It actually depends on the setup of your cluster. Ideally, with 15 nodes (tasktrackers) you'd want 1 mapper slot per node (ideally to run giraph), so that you would have 14 workers, one per computing node, plus one for master+zookeeper. Once that is reached, you would have a number of compute

Re: knowing about the vertex id of the sender of the message.

2013-10-17 Thread Claudio Martella
No, you'll have to add it to the message data. On Thu, Oct 17, 2013 at 6:10 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Hi.. In vertex computation code,at the start of the superstep every vertex processes its received messages.. Is there any way for the vertex to know who is the sender

Re: how to use out of core options

2013-10-17 Thread Jyotirmoy Sundi
apart from these you might also want to check permissions of the dir path where offloading of vertices and messages happen. Ideally giraph is not meant for out-of-core if you graph is much bigger then the cluster can handle in memory, using giraph defeats the purpose in this case. On Thu, Oct