Re: Graph stats in giraph.

2014-04-02 Thread Suijian Zhou
Hi, Lukas, Thanks for your info! To my understand, these sent messages are all across machines, i.e. they are communications among different machines? Best Regards, Suijian 2014-04-02 10:39 GMT-05:00 Lukas Nalezenec : > Hi, > > IMHO its sum of bytes sent in messages in all iterations.

Re: Graph stats in giraph.

2014-04-02 Thread Lukas Nalezenec
Hi, If you want to reduce the number, you can replace hash partitioning with range partitioning. You can also add some cache to your computation and combine messages. Regards, Lukas On 2.4.2014 17:36, Suijian Zhou wrote: Hi, Does anybody know what "Aggregate sent message message bytes" me

Re: Graph stats in giraph.

2014-04-02 Thread Lukas Nalezenec
Hi, IMHO its sum of bytes sent in messages in all iterations. It is possible, it depends on number of edges in your graph, size of messages and number of iterations. Regards, Lukas On 2.4.2014 17:36, Suijian Zhou wrote: Hi, Does anybody know what "Aggregate sent message message bytes" mean

Graph stats in giraph.

2014-04-02 Thread Suijian Zhou
Hi, Does anybody know what "Aggregate sent message message bytes" means in the giraph log file? I'm processing a ~500MB size of graph with 4 worker nodes. While I see "Aggregate sent message message bytes=33120305280" in the output, would a ~500MB graph generate ~30GB messages communication on 4

Graph stats in giraph.

2014-03-27 Thread Suijian Zhou
Hi, Does anybody know what "Aggregate sent message message bytes" means in the giraph log file? I'm processing a ~500MB size of graph with 4 worker nodes. While I see "Aggregate sent message message bytes=33120305280" in the output, would a ~500MB graph generate ~30GB messages communication on 4