[ 
https://issues.apache.org/jira/browse/GIRAPH-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995854#comment-13995854
 ] 

Sergey Edunov commented on GIRAPH-895:
--------------------------------------

Pavan, I just finished performance testing, on one of ours benchmark and got 
these results:

                                                              Before            
          After
Heap size after last GC in bytes     9,176,439,073,872      7,810,490,235,960
MAP_CPU_MILLISECONDS          7,091,177,150             6,557,590,760
Total time of GC in milliseconds     135,191,357                127,354,579
Total number of GC                         38,219                         32,283



> Trim the edges in Giraph
> ------------------------
>
>                 Key: GIRAPH-895
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-895
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>    Affects Versions: 1.1.0
>            Reporter: Sergey Edunov
>             Fix For: 1.1.0
>
>         Attachments: GIRAPH-895.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In many Giraph applications, graphs are immutable, but edges are never 
> trimmed to the proper size, after input phase. This means that on average we 
> often use 1.5x memory for storing them. Considering we are often memory 
> bounded, adding an option to trim the edges after the input phase will help 
> reduce this excess memory usage. For mutable graphs, we can also provide an 
> option for the same method to be called after each superstep.
> Review request: https://reviews.apache.org/r/21119/



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to