Re: OutOfMemoryError: Java heap space during Large graph running

2016-11-07 Thread Xenia Demetriou
Hi Panagioti, This really help me. Thanks for your help! Regards, Xenia 2016-11-06 10:15 GMT+02:00 Panagiotis Liakos : > Hi Xenia, > > The value in mapred-site.xml would be used in case you submitted the > giraph job through hadoop, e.g., with hadoop jar > > With your code I believe all you nee

Re: Out of core computation fails with KryoException: Buffer underflow

2016-11-07 Thread Hassan Eslami
Hi Denis, Thanks for bringing up the issue. In the previous conversation thread, the similar problem is reported even with a simpler example connected component calculation. Although, back then, we were developing other performance-critical components of OOC. Let's debug this issue together to ma

Out of core computation fails with KryoException: Buffer underflow

2016-11-07 Thread Denis Dudinski
Hello, We are trying to calculate PageRank on huge graph, which does not fit into memory. For calculation to succeed we tried to turn on OutOfCore feature of Giraph, but every launch we tried resulted in com.esotericsoftware.kryo.KryoException: Buffer underflow. Each time it happens on different s