[
https://issues.apache.org/jira/browse/GIRAPH-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pavan Kumar updated GIRAPH-713:
-------------------------------
Attachment: GIRAPH-713_1.patch
currently netty has native support for jdkzlib & snappy
I think jdkzlib might be better because if it is on hotpatch then jdk can
replace it with native methods, since it is uses jdk.zip for deflater &
inflater. On the other hand lz4 is a really fast algorithm for
compression-decompression, but not sure how it pans out against a native (which
jdk zip can potentially use instead of just making changes at the java
application level)
I am attaching a patch that I used to do a few test runs on the cluster.
It works for snappy, as well as for no compression, but fails with an exception
for jdkzlib decoder
If some one would like to work on it, please feel free to start off with the
patch. Thanks.
> Provide an option to do request compression
> -------------------------------------------
>
> Key: GIRAPH-713
> URL: https://issues.apache.org/jira/browse/GIRAPH-713
> Project: Giraph
> Issue Type: New Feature
> Reporter: Maja Kabiljo
> Attachments: GIRAPH-713.patch, GIRAPH-713_1.patch
>
>
> In some cases, network is much slower than all the computation stuff we do,
> and we could benefit from compressing requests.
> https://reviews.apache.org/r/12377/
--
This message was sent by Atlassian JIRA
(v6.2#6252)
