[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88706/testReport)** for PR 20915 at commit [`8f6bc28`](https://github.com/apache/spark/commit/8f

[GitHub] spark issue #20914: [SPARK-23802][SQL] PropagateEmptyRelation can leave quer...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20914 **[Test build #88705 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88705/testReport)** for PR 20914 at commit [`d9a2ee8`](https://github.com/apache/spark/commit/d9

[GitHub] spark pull request #20922: Roll forward "[SPARK-23096][SS] Migrate rate sour...

2018-03-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/20922#discussion_r178027822 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/RateStreamProvider.scala --- @@ -0,0 +1,125 @@ +/* + * License

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread xuanyuanking
Github user xuanyuanking commented on the issue: https://github.com/apache/spark/pull/20930 cc @jerryshao @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mai

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88697/ Test PASSed. ---

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20930 **[Test build #88697 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88697/testReport)** for PR 20930 at commit [`2907075`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #20850: [SPARK-23713][SQL] Cleanup UnsafeWriter and Buffe...

2018-03-29 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/20850#discussion_r178025700 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -32,141 +30,133 @@ */ pu

[GitHub] spark pull request #20850: [SPARK-23713][SQL] Cleanup UnsafeWriter and Buffe...

2018-03-29 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/20850#discussion_r178025468 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriter.java --- @@ -17,17 +17,86 @@ package org.apache

[GitHub] spark issue #20935: [SPARK-23819][SQL] Fix InMemoryTableScanExec complex typ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20935 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20935: [SPARK-23819][SQL] Fix InMemoryTableScanExec complex typ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20935 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1833/ Tes

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20934 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20934 **[Test build #88704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88704/testReport)** for PR 20934 at commit [`0b9ae9f`](https://github.com/apache/spark/commit/0b

[GitHub] spark pull request #20935: [SPARK-23819][SQL] Fix InMemoryTableScanExec comp...

2018-03-29 Thread pwoody
GitHub user pwoody opened a pull request: https://github.com/apache/spark/pull/20935 [SPARK-23819][SQL] Fix InMemoryTableScanExec complex type pruning ## What changes were proposed in this pull request? This PR allows recording of upper/lower bound values in ColumnStats if t

[GitHub] spark pull request #20850: [SPARK-23713][SQL] Cleanup UnsafeWriter and Buffe...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20850#discussion_r178023931 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriter.java --- @@ -17,17 +17,86 @@ package org.apache.

[GitHub] spark pull request #20850: [SPARK-23713][SQL] Cleanup UnsafeWriter and Buffe...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20850#discussion_r178023366 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -32,141 +30,133 @@ */ pub

[GitHub] spark pull request #20850: [SPARK-23713][SQL] Cleanup UnsafeWriter and Buffe...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20850#discussion_r178023178 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java --- @@ -32,141 +30,133 @@ */ pub

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88702/ Test FAILed. ---

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #88702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88702/testReport)** for PR 20933 at commit [`40b33c3`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #20850: [SPARK-23713][SQL] Cleanup UnsafeWriter and Buffe...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20850#discussion_r178022637 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -31,24 +31,24 @@ * for each incomin

[GitHub] spark pull request #20922: Roll forward "[SPARK-23096][SS] Migrate rate sour...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20922#discussion_r178021180 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/RateStreamProvider.scala --- @@ -0,0 +1,125 @@ +/* + * License

[GitHub] spark pull request #19222: [SPARK-10399][CORE][SQL] Introduce multiple Memor...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19222#discussion_r178020801 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -250,6 +246,7 @@ public long getPrefix() { }

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20934 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20934 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88703/ Test FAILed. ---

[GitHub] spark pull request #19222: [SPARK-10399][CORE][SQL] Introduce multiple Memor...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/19222#discussion_r178020710 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/memory/OnHeapMemoryBlock.java --- @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20934 **[Test build #88703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88703/testReport)** for PR 20934 at commit [`d582675`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20934 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20934 **[Test build #88703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88703/testReport)** for PR 20934 at commit [`d582675`](https://github.com/apache/spark/commit/d5

[GitHub] spark issue #20934: [SPARK-23818][SQL][WIP] an official UDF interface for Sp...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1832/ Tes

[GitHub] spark pull request #20934: [SPARK-23818][SQL][WIP] an official UDF interface...

2018-03-29 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/20934 [SPARK-23818][SQL][WIP] an official UDF interface for Spark SQL ## What changes were proposed in this pull request? API: (to be discussed), use 2-args as example: ``` UDFR

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88698/ Test PASSed. ---

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20915 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88698/testReport)** for PR 20915 at commit [`cb36012`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #20902: [SPARK-23770][R] Exposes repartitionByRange in Sp...

2018-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20902 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20902: [SPARK-23770][R] Exposes repartitionByRange in SparkR

2018-03-29 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20902 Merged to master. Thanks for reviewing and approving this, @felixcheung and @viirya. --- - To unsubscribe, e-mail: r

[GitHub] spark issue #20849: [SPARK-23723] New charset option for json datasource

2018-03-29 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20849 Please give me few days to check your comments. I happen to be super busy for a personal reason. --- - To unsubscribe, e-mai

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20771 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20771 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88696/ Test PASSed. ---

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20771 **[Test build #88696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88696/testReport)** for PR 20771 at commit [`f0ba614`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-03-29 Thread sujith71955
Github user sujith71955 commented on the issue: https://github.com/apache/spark/pull/20611 @wzhfy Actually its not a behavior change , i think this condition was working in other spark 2.x versions. Some time back a PR is been added for load command hdfs path validation, in this PR

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20933 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1831/ Tes

[GitHub] spark issue #20933: [SPARK-23817][SQL]Migrate ORC file format read path to d...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20933 **[Test build #88702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88702/testReport)** for PR 20933 at commit [`40b33c3`](https://github.com/apache/spark/commit/40

[GitHub] spark pull request #20933: [SPARK-23817][SQL]Migrate ORC file format read pa...

2018-03-29 Thread gengliangwang
GitHub user gengliangwang opened a pull request: https://github.com/apache/spark/pull/20933 [SPARK-23817][SQL]Migrate ORC file format read path to data source V2 ## What changes were proposed in this pull request? Migrate ORC file format read path to data source V2. ###

[GitHub] spark pull request #20862: [SPARK-23744][CORE]Fix memory leak in ReadableCha...

2018-03-29 Thread 10110346
Github user 10110346 commented on a diff in the pull request: https://github.com/apache/spark/pull/20862#discussion_r177993186 --- Diff: core/src/test/scala/org/apache/spark/storage/DiskStoreSuite.scala --- @@ -197,7 +197,7 @@ class DiskStoreSuite extends SparkFunSuite { w

[GitHub] spark pull request #20862: [SPARK-23744][CORE]Fix memory leak in ReadableCha...

2018-03-29 Thread 10110346
Github user 10110346 commented on a diff in the pull request: https://github.com/apache/spark/pull/20862#discussion_r177992858 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskStore.scala --- @@ -301,7 +301,10 @@ private class ReadableChannelFileRegion(source: ReadableByt

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19222 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19222 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1830/ Tes

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19222 **[Test build #88701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88701/testReport)** for PR 19222 at commit [`b69cb64`](https://github.com/apache/spark/commit/b6

[GitHub] spark issue #20851: [SPARK-23727][SQL] Support for pushing down filters for ...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20851 **[Test build #88700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88700/testReport)** for PR 20851 at commit [`759f468`](https://github.com/apache/spark/commit/75

[GitHub] spark issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous ...

2018-03-29 Thread yucai
Github user yucai commented on the issue: https://github.com/apache/spark/pull/19788 Have synced with @cloud-fan , I will update this, thanks very much! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-03-29 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19222 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #12922: [SPARK-15145][ML]:port binary classification evaluator t...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12922 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1829/ Tes

[GitHub] spark issue #12922: [SPARK-15145][ML]:port binary classification evaluator t...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12922 Build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-

[GitHub] spark pull request #20922: Roll forward "[SPARK-23096][SS] Migrate rate sour...

2018-03-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/20922#discussion_r177989371 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/RateStreamProvider.scala --- @@ -0,0 +1,125 @@ +/* + * License

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20860 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88695/ Test FAILed. ---

[GitHub] spark pull request #20924: [SPARK-23806] Broadcast.unpersist can cause fatal...

2018-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20924 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20860 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20860 **[Test build #88695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88695/testReport)** for PR 20860 at commit [`2ea9b7a`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #20924: [SPARK-23806] Broadcast.unpersist can cause fatal except...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20924 thanks, merging to master/2.3! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-ma

[GitHub] spark pull request #20924: [SPARK-23806] Broadcast.unpersist can cause fatal...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20924#discussion_r177987175 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -192,11 +192,15 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #20862: [SPARK-23744][CORE]Fix memory leak in ReadableCha...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20862#discussion_r177986789 --- Diff: core/src/test/scala/org/apache/spark/storage/DiskStoreSuite.scala --- @@ -197,7 +197,7 @@ class DiskStoreSuite extends SparkFunSuite {

[GitHub] spark pull request #20862: [SPARK-23744][CORE]Fix memory leak in ReadableCha...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20862#discussion_r177986757 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskStore.scala --- @@ -301,7 +301,10 @@ private class ReadableChannelFileRegion(source: ReadableBy

[GitHub] spark issue #20902: [SPARK-23770][R] Exposes repartitionByRange in SparkR

2018-03-29 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20902 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache

[GitHub] spark pull request #20922: Roll forward "[SPARK-23096][SS] Migrate rate sour...

2018-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20922#discussion_r177984724 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/RateStreamProvider.scala --- @@ -0,0 +1,125 @@ +/* + * License

[GitHub] spark issue #20858: [SPARK-23736][SQL] Extending the concat function to supp...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20858 **[Test build #88699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88699/testReport)** for PR 20858 at commit [`067c2db`](https://github.com/apache/spark/commit/06

[GitHub] spark issue #20862: [SPARK-23744][CORE]Fix memory leak in ReadableChannelFil...

2018-03-29 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/20862 cc @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@

[GitHub] spark issue #20932: [SPARK-23812][SQL] DFS should be removed from unsupporte...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20932 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20932: [SPARK-23812][SQL] DFS should be removed from unsupporte...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20932 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20924: [SPARK-23806] Broadcast.unpersist can cause fatal...

2018-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20924#discussion_r177975397 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -192,11 +192,15 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #20932: [SPARK-23812]DFS should be removed from unsupport...

2018-03-29 Thread wangtao605
GitHub user wangtao605 opened a pull request: https://github.com/apache/spark/pull/20932 [SPARK-23812]DFS should be removed from unsupportedHiveNativeCommands in SqlBase.g4 ## What changes were proposed in this pull request? Dfs command has been supported,but SqlBase.g4

[GitHub] spark issue #20785: [SPARK-23640][CORE] Fix hadoop config may override spark...

2018-03-29 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/20785 Ping @vanzin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spa

[GitHub] spark pull request #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20915#discussion_r177973464 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -50,6 +51,80 @@ import org.apache.spark.sql.exe

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20930 **[Test build #88697 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88697/testReport)** for PR 20930 at commit [`2907075`](https://github.com/apache/spark/commit/29

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1828/ Tes

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20915 **[Test build #88698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88698/testReport)** for PR 20915 at commit [`cb36012`](https://github.com/apache/spark/commit/cb

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread xuanyuanking
Github user xuanyuanking commented on the issue: https://github.com/apache/spark/pull/20930 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revie

[GitHub] spark issue #20915: [SPARK-23803][SQL] Support bucket pruning

2018-03-29 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20915 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h.

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20771 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20771 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1827/ Tes

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20860 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1826/ Tes

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20860 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20920 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20920 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1825/ Tes

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20920 **[Test build #88694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88694/testReport)** for PR 20920 at commit [`35ecbf9`](https://github.com/apache/spark/commit/35

[GitHub] spark issue #20771: [SPARK-23587][SQL] Add interpreted execution for MapObje...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20771 **[Test build #88696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88696/testReport)** for PR 20771 at commit [`f0ba614`](https://github.com/apache/spark/commit/f0

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20860 **[Test build #88695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88695/testReport)** for PR 20860 at commit [`2ea9b7a`](https://github.com/apache/spark/commit/2e

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20860 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20920 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20920 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1824/ Tes

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20920 Jenkins, retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail

[GitHub] spark issue #20920: [SPARK-23040][CORE][FOLLOW-UP] Avoid double wrap result ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20920 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20860 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88692/ Test FAILed. ---

[GitHub] spark issue #20860: [SPARK-23743][SQL] Changed a comparison logic from conta...

2018-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20860 **[Test build #88692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88692/testReport)** for PR 20860 at commit [`2ea9b7a`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19222 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #19222: [SPARK-10399][CORE][SQL] Introduce multiple MemoryBlocks...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19222 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88689/ Test FAILed. ---

[GitHub] spark issue #20930: [SPARK-23811][Core] Same tasks' FetchFailed event comes ...

2018-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20930 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

<    1   2   3   4   5   >