[
https://issues.apache.org/jira/browse/HAMA-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward J. Yoon updated HAMA-870:
--------------------------------
Attachment: runtimecompression.patch
With this patch, the message will be compressed if message is larger than
threshold bytes in size. This will helps to reduce the memory usage and network
traffic.
I've tested on my cluster. I'll commit this patch today.
> Runtime message compression in Bundle
> -------------------------------------
>
> Key: HAMA-870
> URL: https://issues.apache.org/jira/browse/HAMA-870
> Project: Hama
> Issue Type: Improvement
> Components: bsp core
> Affects Versions: 0.6.3
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.7.0
>
> Attachments: runtimecompression.patch
>
>
> Original compression flow was like below:
> 1) Bundles messages in outgoing queue
> 2) Serializes bundle object to byte array
> 3) Compresses byte array to new byte array
> 4) Creates BSPCompressedBundle object for RPC communication
> So, it was extremely slow!
> Since BSPMessageBundle handles messages in byte array now, we can runtime
> compress the messages during bundling.
> We don't need BSPCompressedBundle class anymore.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
