OOC is used also at input superstep. try to decrease the number of partitions kept in memory.
On Sat, Sep 7, 2013 at 1:37 AM, Alexander Asplund <alexaspl...@gmail.com>wrote: > Hi, > > I'm trying to process a graph that is about 3 times the size of > available memory. On the other hand, there is plenty of disk space. I > have enabled the giraph.useOutOfCoreGraph property, but it still > crashes with outOfMemoryError: GC limit exceeded when I try running my > job. > > I'm wondering of the spilling is supposed to work during the input > step. If so, are there any additional steps that must be taken to > ensure it functions? > > Regards, > Alexander Asplund > -- Claudio Martella claudio.marte...@gmail.com
