[
https://issues.apache.org/jira/browse/GIRAPH-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16029759#comment-16029759
]
ASF GitHub Bot commented on GIRAPH-1148:
----------------------------------------
GitHub user majakabiljo opened a pull request:
https://github.com/apache/giraph/pull/39
[GIRAPH-1148] Connected components - make calculate sizes work with l…
…arge number of components
Summary: Currently if we have a graph with large number of connected
components, calculating connected components sizes fails because reducer
becomes too large. Use array of handles instead.
Test Plan: Successfully ran the job which was failing without this change
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/majakabiljo/giraph cc
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/giraph/pull/39.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #39
----
commit 0b9ef9415a67737122e6fb6caeca5307df9632a1
Author: Maja Kabiljo <majakabi...@fb.com>
Date: 2017-05-30T17:10:17Z
[GIRAPH-1148] Connected components - make calculate sizes work with large
number of components
Summary: Currently if we have a graph with large number of connected
components, calculating connected components sizes fails because reducer
becomes too large. Use array of handles instead.
Test Plan: Successfully ran the job which was failing without this change
----
> Connected components - make calculate sizes work with large number of
> components
> --------------------------------------------------------------------------------
>
> Key: GIRAPH-1148
> URL: https://issues.apache.org/jira/browse/GIRAPH-1148
> Project: Giraph
> Issue Type: Improvement
> Reporter: Maja Kabiljo
> Assignee: Maja Kabiljo
>
> Currently if we have a graph with large number of connected components,
> calculating connected components sizes fails because reducer becomes too
> large. Use array of handles instead.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
