GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/9439
[SPARK-10949] Update Snappy version to 1.1.2
This is an updated version of #8995 by @a-roberts. Original description
follows:
Snappy now supports concatenation of serialized streams, this patch
contains a version number change and the "does not support" test is now a
"supports" test.
Snappy 1.1.2 changelog mentions:
> snappy-java-1.1.2 (22 September 2015)
> This is a backward compatible release for 1.1.x.
> Add AIX (32-bit) support.
> There is no upgrade for the native libraries of the other platforms.
> A major change since 1.1.1 is a support for reading concatenated results
of SnappyOutputStream(s)
> snappy-java-1.1.2-RC2 (18 May 2015)
> Fix #107: SnappyOutputStream.close() is not idempotent
> snappy-java-1.1.2-RC1 (13 May 2015)
> SnappyInputStream now supports reading concatenated compressed results of
SnappyOutputStream
> There has been no compressed format change since 1.0.5.x. So You can read
the compressed results > interchangeablly between these versions.
> Fixes a problem when java.io.tmpdir does not exist.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark update-snappy
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9439.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9439
----
commit 352bb3d3c4ba72276e8fc869d1f47d79df83d032
Author: Adam Roberts <arobe...@uk.ibm.com>
Date: 2015-10-06T16:19:05Z
Update Snappy version to 1.1.2 and modify test case as concatenation of
serialized streams is now supported
commit ae13aa82242107ce428c7e729fa241c24e9a3f5d
Author: Adam Roberts <arobe...@uk.ibm.com>
Date: 2015-10-17T12:41:02Z
Update CompressionCodec.scala
Add known compression codecs that support concatenation of serialized
streams
commit 3d650c82eda1c6a3b826be8c8b052db5e3b95fc3
Author: Adam Roberts <arobe...@uk.ibm.com>
Date: 2015-10-17T12:43:39Z
Update UnsafeShuffleWriter.java
Update fastMergeIsSupported so we can support concatenation of serialized
streams
commit 1949bcb017579de53b891f369ecf00087b3541b6
Author: Adam Roberts <arobe...@uk.ibm.com>
Date: 2015-10-17T23:10:05Z
Update CompressionCodec.scala
Scalastyle fixes for whitespace
commit 0f870521d1ed2183e4fe5ee0b8e4dc633ccb3cb5
Author: Adam Roberts <arobe...@uk.ibm.com>
Date: 2015-10-19T11:59:57Z
Whitespace
commit f9a021bd7d75992d8a0f9c82ba33efa60a5df55b
Author: Josh Rosen <joshro...@databricks.com>
Date: 2015-11-03T18:03:18Z
Merge remote-tracking branch 'origin/master' into update-snappy
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
