[
https://issues.apache.org/jira/browse/GIRAPH-359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13471910#comment-13471910
]
Avery Ching commented on GIRAPH-359:
------------------------------------
Yes, I'm talking about the final dump to HDFS (VertexOutputFormat), but this
same technique could be used to dump checkpoints as well. In a few of our
apps, writing could take between 15 - 100 % of the other time. Ouch.
> Parallelize the input (loading) / output (storing)
> --------------------------------------------------
>
> Key: GIRAPH-359
> URL: https://issues.apache.org/jira/browse/GIRAPH-359
> Project: Giraph
> Issue Type: Improvement
> Reporter: Avery Ching
> Assignee: Avery Ching
>
> Often we find that our write rates aren't great. This could likely be
> improved by parallelizing the input/output with multi-threading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
