[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-10-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22551 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-10-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22551 @maropu as far as I can tell, 1.4 was based on lz4 'r128', a couple years old. https://github.com/lz4/lz4-java/issues/74#issuecomment-216426061 ---

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-10-06 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/22551 @maropu `lz4 v1.8.3` is maintenance release. So the official does not provide benchmark: https://github.com/lz4/lz4/releases/tag/v1.8.3 @srowen Yes, I think this can go in 3.0. There is a

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-10-06 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/22551 WDYT @wangyum ? I think this can go in 3.0 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96632/ Test PASSed. ---

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22551 **[Test build #96632 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96632/testReport)** for PR 22551 at commit

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/22551 Thank you for update, but could you update one more, @wangyum ? - Please mention that 1.8.2 data corruption issue clearly and write that 1.8.3 is recommended. - Is the copied `General

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22551 **[Test build #96632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96632/testReport)** for PR 22551 at commit

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/22551 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/22551 Thanks @dongjoon-hyun I updated the PR description. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96602/ Test FAILed. ---

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22551 **[Test build #96602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96602/testReport)** for PR 22551 at commit

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22551 **[Test build #96602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96602/testReport)** for PR 22551 at commit

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22551: [SPARK-25539][BUILD] Upgrade lz4-java to 1.5.0 get speed...

2018-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22551 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional