[ http://issues.apache.org/jira/browse/HADOOP-538?page=all ]
Arun C Murthy updated HADOOP-538:
---------------------------------
Attachment: HADOOP-538_20061011.tgz
Here's another patch incorporating all features listed here:
http://issues.apache.org/jira/browse/HADOOP-538#action_12439996 with a few
additions:
* org.apache.hadoop.io.compress.zlib.{Com|Decom}pressor classes can now
encode/decode both zlib and gzip formats. This is used in GzipCodec now.
* I have added a switch: 'hadoop.native.library' in hadoop-default.xml to let
users control whether or not they wish to use the native code.
* Fixed an issue with autom4te which generated autom4te.cache in src/native
Doug - could you please copy the attached libhadoop-linux-i386.so in
trunk/lib/native first before attempting to build native-hadoop? It will need
to be committed also... thanks!
> Implement a nio's 'direct buffer' based wrapper over zlib to improve
> performance of java.util.zip.{De|In}flater as a 'custom codec'
> -----------------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-538
> URL: http://issues.apache.org/jira/browse/HADOOP-538
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.6.1
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.8.0
>
> Attachments: HADOOP-538.patch, HADOOP-538_20061005.tgz,
> HADOOP-538_20061011.tgz, HADOOP-538_benchmarks.tgz
>
>
> There has been more than one instance where java.util.zip's {De|In}flater
> classes perform unreliably, a simple wrapper over zlib-1.2.3 (latest stable)
> using java.nio.ByteBuffer (i.e. direct buffers) should go a long way in
> alleviating these woes.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
