[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9439 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8995 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-04 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153883067 I'm going to merge this. Hopefully it will be OK -- in the past snappy change isn't always the most robust. --- If your project is set up for it, you can reply to this em

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153533385 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153533381 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153533167 **[Test build #44958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44958/consoleFull)** for PR 9439 at commit [`f9a021b`](https://git

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153496753 **[Test build #44958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44958/consoleFull)** for PR 9439 at commit [`f9a021b`](https://gith

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153494546 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153494516 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153494447 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153444255 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153444262 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-153439396 I've opened #9439 to take this over. @a-roberts, do you mind closing this one for now? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153439471 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9439#issuecomment-153439539 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-11-03 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/9439 [SPARK-10949] Update Snappy version to 1.1.2 This is an updated version of #8995 by @a-roberts. Original description follows: Snappy now supports concatenation of serialized streams, this

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-28 Thread a-roberts
Github user a-roberts commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-151978162 Hi, have been enjoying Spark Summit Europe, better for somebody else to take it over; looks like the files I changed have moved around since the testing so I imagine i

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-27 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-151623475 I'd really like to get this in; @a-roberts, could you let us know if you no longer plan to work on this so that someone else could take over? --- If your project is s

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-27 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-151616865 @a-roberts are you still working on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-22 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-15040 Hey @a-roberts, any chance that you could fix the merge conflicts here so that I can re-test? I'd like to get this patch in soon so that users can benefit from the fas

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149673620 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149673623 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149673094 **[Test build #43992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43992/consoleFull)** for PR 8995 at commit [`0f87052`](https://git

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149631386 **[Test build #43992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43992/consoleFull)** for PR 8995 at commit [`0f87052`](https://gith

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149627411 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149627365 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-20 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149625880 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149388241 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149388242 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149387994 **[Test build #43944 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43944/consoleFull)** for PR 8995 at commit [`0f87052`](https://git

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149366110 **[Test build #43944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43944/consoleFull)** for PR 8995 at commit [`0f87052`](https://gith

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149363591 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149363568 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149363063 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-19 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149363083 (I'll try to see if I can get Jenkins to just auto-retest this...) --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149039453 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149039450 [Test build #43899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43899/console) for PR 8995 at commit [`1949bcb`](https://github.

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149039452 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149039291 [Test build #43899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43899/consoleFull) for PR 8995 at commit [`1949bcb`](https://gith

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149038205 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149038195 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-18 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-149037941 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958855 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958851 [Test build #43890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43890/console) for PR 8995 at commit [`3d650c8`](https://github.

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958854 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958776 [Test build #43890 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43890/consoleFull) for PR 8995 at commit [`3d650c8`](https://gith

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958362 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958357 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-17 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148958174 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-15 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148504304 That plan sounds fine to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-14 Thread a-roberts
Github user a-roberts commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-148102036 Cheers Josh, makes sense, I'm going to test this on our systems before updating the PR with the changes, here's what I've added (the last parts of each code block).

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-13 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-147872165 Hey @a-roberts, How about this: - Add a `private[spark]` method to the `private[spark]` `CompressionCodec` companion object and have that method main

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-13 Thread a-roberts
Github user a-roberts commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-147657380 Josh, apologies for the late response here and making sure I'm understanding your proposal For your first comment the naive way would to be add SnappyCompressi

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-146982705 Any update here? Will you have time to address my comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-145967325 [Test build #1845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1845/console) for PR 8995 at commit [`352bb3d`](https://github

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-06 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-145927459 By the way, in addition to the changes here we need to update code elsewhere in order to benefit from the concatenation of serialized streams. For the Tungsten shuffle

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-06 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-145926286 Snappy upgrades have historically been a cause of bugs in the past, so I'm going to veto putting this into 1.5.2. Let's definitely consider it for Spark 1.6, though.

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-145919186 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8995#issuecomment-145918613 [Test build #1845 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1845/consoleFull) for PR 8995 at commit [`352bb3d`](https://git

[GitHub] spark pull request: [SPARK-10949] Update Snappy version to 1.1.2

2015-10-06 Thread a-roberts
GitHub user a-roberts opened a pull request: https://github.com/apache/spark/pull/8995 [SPARK-10949] Update Snappy version to 1.1.2 Snappy now supports concatenation of serialized streams, this patch contains a version number change and the "does not support" test is now a "support