I also encounter that failures in running hama-0.6.0 . I think there are
two problem in hama.
(1) because hama loads data into memory to process.To large data,that may
cause jvm memory overflow. the sulotion is that you can configure the
"bsp.child.java.opts"
as large as your computer allows in hama-site.xml .for examples,
<property>
<name>bsp.child.java.opts</name>
<value>-Xmx4096m</value>
</property>
(2) To pagerank, one BSPPeer may send larger messages than SSSP after
finishing one SuperStep(as you can see, to the same data largeEWD,SSSP
is successful but PageRank is failed), and the User-defined combiner is not
used to reduce the message amount when sending messages,so the RPC may
occur error because of large amount messages.
the solution is that you can modify the
org.apache.hama.graph.GraphJobRunner class and org.apache.hama.graph.Vertex
to add an combiner when sending messages.
By the above two methods, i have solved the large big data problem.
good luckļ¼
On Mon, Jan 13, 2014 at 12:14 AM, Tommaso Teofili <[email protected]
> wrote:
> by the way: is there anyone aware of what kind of failures were related to
> PageRank failures highlighted in the mentioned slides (or know who can we
> ask)?
>
> Tommaso
>
>
> 2014/1/10 Edward J. Yoon <[email protected]>
>
> > Just FYI,
> >
> > https://cs.uwaterloo.ca/~kdaudjee/courses/cs848/slides/proj/F13/JPV.pdf
> >
> > --
> > Best Regards, Edward J. Yoon
> > @eddieyoon
> >
>
