[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322317 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322294 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
SparkQA commented on issue #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993#issuecomment-537322064 **[Test build #111667 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1116

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537322074 **[Test build #111669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111669/testReport)**

[GitHub] [spark] SparkQA commented on issue #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-10-01 Thread GitBox
SparkQA commented on issue #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#issuecomment-537322067 **[Test build #111668 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] maropu commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992#discussion_r330361486 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,58 +2,3 @@ Ben

[GitHub] [spark] HyukjinKwon opened a new pull request #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build

2019-10-01 Thread GitBox
HyukjinKwon opened a new pull request #25993: [DO-NOT-MERGE][R] Install Arrow and test Arrow optimization in AppVeyor build URL: https://github.com/apache/spark/pull/25993 ### What changes were proposed in this pull request? This PR proposes to install Arrow and test Arrow optimizati

[GitHub] [spark] cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#discussion_r330361239 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V1F

[GitHub] [spark] cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#discussion_r330361189 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/write/WriteInf

[GitHub] [spark] cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25990: [SPARK-29248][SQL][WIP] Pass in number of partitions to WriteBuilder URL: https://github.com/apache/spark/pull/25990#discussion_r330361054 ## File path: external/avro/src/main/scala/org/apache/spark/sql/v2/avro/AvroTable.scala

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537321407 @brkyvz and @cloud-fan . Is this change intentional? ---

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-10-01 Thread GitBox
gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#discussion_r330360852 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sq

[GitHub] [spark] dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25988: [SPARK-29313][SQL] Fix failure on writing to `noop` in benchmarks URL: https://github.com/apache/spark/pull/25988#issuecomment-537321016 I'm not sure about this. For me, we need to fix the root cause inside DSv2.

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-10-01 Thread GitBox
gaborgsomogyi commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#discussion_r330360862 ## File path: external/kafka-0-10-token-provider/src/main/scala/org/apac

[GitHub] [spark] cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP)

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP) URL: https://github.com/apache/spark/pull/25955#discussion_r330360645 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V

[GitHub] [spark] cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP)

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown (WIP) URL: https://github.com/apache/spark/pull/25955#discussion_r330360144 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Opt

[GitHub] [spark] viirya commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-10-01 Thread GitBox
viirya commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#discussion_r330359786 ## File path: sql/core/src/main/scala/org/apache/spark/sql/dynamicpruning/PartitionPruning.scala ## @@ -

[GitHub] [spark] maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25666: [SPARK-28962][SQL] Provide index argument to filter lambda functions URL: https://github.com/apache/spark/pull/25666#discussion_r330358827 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higher

[GitHub] [spark] cloud-fan commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-10-01 Thread GitBox
cloud-fan commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-537316802 I think it's ready to go. @imback82 can you fix the conflict? thanks! --

[GitHub] [spark] cloud-fan commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning

2019-10-01 Thread GitBox
cloud-fan commented on a change in pull request #25600: [SPARK-11150][SQL] Dynamic Partition Pruning URL: https://github.com/apache/spark/pull/25600#discussion_r330356993 ## File path: sql/core/src/main/scala/org/apache/spark/sql/dynamicpruning/PartitionPruning.scala ## @

[GitHub] [spark] cloud-fan closed pull request #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
cloud-fan closed pull request #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985 This is an automated message from the Apach

[GitHub] [spark] cloud-fan commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
cloud-fan commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537315968 thanks, merging to master!

[GitHub] [spark] SparkQA commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
SparkQA commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311325 **[Test build #111664 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Sp

[GitHub] [spark] SparkQA removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307379 **[Test build #111664 has started](https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311371 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311369 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311371 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537311369 Merged build finished. Test PASSed. ---

[GitHub] [spark] maropu commented on a change in pull request #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
maropu commented on a change in pull request #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#discussion_r330352484 ## File path: sql/hive-thriftserver/src/main/scala/org/a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537310434 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537310439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537310439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537310434 Merged build finished. Test PASSed. This is an automa

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-537310152 **[Test build #111666 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111666/testReport)**

[GitHub] [spark] nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-10-01 Thread GitBox
nvander1 commented on a change in pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#discussion_r330352005 ## File path: sql/core/src/test/java/test/org/apache/spark/sql/JavaHigherOrderFunctionsSuite.java

[GitHub] [spark] AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309130 Test FAILed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] HyukjinKwon commented on issue #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1)

2019-10-01 Thread GitBox
HyukjinKwon commented on issue #25992: [SPARK-29320][TESTS] Compare `sql/core` module in JDK8/11 (Part 1) URL: https://github.com/apache/spark/pull/25992#issuecomment-537309426 Woah .. huge PR but +1 from a cursory look This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309066 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309124 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537308799 **[Test build #111665 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309062 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309130 Test FAILed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309124 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
SparkQA commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309116 **[Test build #111665 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309062 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537309066 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] HyukjinKwon commented on issue #25991: [MINOR][BUILD] Decode output of commands during merge script as UTF-8 consistently

2019-10-01 Thread GitBox
HyukjinKwon commented on issue #25991: [MINOR][BUILD] Decode output of commands during merge script as UTF-8 consistently URL: https://github.com/apache/spark/pull/25991#issuecomment-537308750 cc @WeichenXu123 This is an aut

[GitHub] [spark] SparkQA commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-01 Thread GitBox
SparkQA commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-537308799 **[Test build #111665 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] HyukjinKwon closed pull request #25991: [MINOR][BUILD] Decode output of commands during merge script as UTF-8 consistently

2019-10-01 Thread GitBox
HyukjinKwon closed pull request #25991: [MINOR][BUILD] Decode output of commands during merge script as UTF-8 consistently URL: https://github.com/apache/spark/pull/25991 This is an automated message from the Apache Git Serv

[GitHub] [spark] HyukjinKwon commented on issue #25991: [MINOR][BUILD] Decode output of commands during merge script as UTF-8 consistently

2019-10-01 Thread GitBox
HyukjinKwon commented on issue #25991: [MINOR][BUILD] Decode output of commands during merge script as UTF-8 consistently URL: https://github.com/apache/spark/pull/25991#issuecomment-537308768 Merged to master. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307624 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307635 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307624 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307635 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] SparkQA commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
SparkQA commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307379 **[Test build #111664 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] LantaoJin commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution

2019-10-01 Thread GitBox
LantaoJin commented on issue #25960: [SPARK-29283][SQL] Error message is hidden when query from JDBC, especially enabled adaptive execution URL: https://github.com/apache/spark/pull/25960#issuecomment-537307012 @juliuszsompolski fixed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537306429 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537306436 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] HyukjinKwon closed pull request #25986: [SPARK-29311][SQL] Return seconds with fraction from `date_part()` and `extract`

2019-10-01 Thread GitBox
HyukjinKwon closed pull request #25986: [SPARK-29311][SQL] Return seconds with fraction from `date_part()` and `extract` URL: https://github.com/apache/spark/pull/25986 This is an automated message from the Apache Git Servic

[GitHub] [spark] AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537306436 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] HyukjinKwon commented on issue #25986: [SPARK-29311][SQL] Return seconds with fraction from `date_part()` and `extract`

2019-10-01 Thread GitBox
HyukjinKwon commented on issue #25986: [SPARK-29311][SQL] Return seconds with fraction from `date_part()` and `extract` URL: https://github.com/apache/spark/pull/25986#issuecomment-537306454 Merged to master. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537306429 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
SparkQA commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537306071 **[Test build #111660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] SparkQA removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537276103 **[Test build #111660 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-10-01 Thread GitBox
SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-537305903 **[Test build #111663 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111663/testReport)** for PR 25670 at

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#discussion_r330345894 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/date

[GitHub] [spark] dongjoon-hyun commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-01 Thread GitBox
dongjoon-hyun commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#issuecomment-537304760 The only remaining concern is the potential exceptional cases on exotic cases. Do you think we need to run a brief

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#discussion_r330346163 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/inte

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#discussion_r330346094 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/inte

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#discussion_r330345894 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/date

[GitHub] [spark] SparkQA commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
SparkQA commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537301414 **[Test build #111662 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111662/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537300060 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537300052 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537300060 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537300052 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] HyukjinKwon commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
HyukjinKwon commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-537299977 Let me check https://github.com/apache/spark/pull/24898#discussion_r330343904 and get back in few days. I rebased

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

2019-10-01 Thread GitBox
HyukjinKwon commented on a change in pull request #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#discussion_r330343904 ## File path: python/pyspark/ml/tests/test_wrapper.py ## @@ -28,6 +29,11 @@ c

[GitHub] [spark] AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537296351 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537296340 Merged build finished. Test FAILed. This is an automat

[GitHub] [spark] SparkQA removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537292385 **[Test build #111661 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111661/testReport)** f

[GitHub] [spark] AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537296351 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] SparkQA commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
SparkQA commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537296313 **[Test build #111661 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111661/testReport)** for PR 2

[GitHub] [spark] AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537296340 Merged build finished. Test FAILed. This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537292647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537292643 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537292647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537292643 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] SparkQA commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1)

2019-10-01 Thread GitBox
SparkQA commented on issue #25816: [SPARK-29107][SQL][TESTS] Port window.sql (Part 1) URL: https://github.com/apache/spark/pull/25816#issuecomment-537292385 **[Test build #111661 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111661/testReport)** for PR 25

[GitHub] [spark] DylanGuedes opened a new pull request #25817: [SPARK-29108][SQL][TESTS] Port window.sql (Part 2)

2019-10-01 Thread GitBox
DylanGuedes opened a new pull request #25817: [SPARK-29108][SQL][TESTS] Port window.sql (Part 2) URL: https://github.com/apache/spark/pull/25817 ### What changes were proposed in this pull request? This PR ports window.sql from PostgreSQL regression tests https://github.com/postgres

[GitHub] [spark] DylanGuedes closed pull request #25817: [SPARK-29108][SQL][TESTS] Port window.sql (Part 2)

2019-10-01 Thread GitBox
DylanGuedes closed pull request #25817: [SPARK-29108][SQL][TESTS] Port window.sql (Part 2) URL: https://github.com/apache/spark/pull/25817 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] vanzin commented on issue #25823: [SPARK-28211][Core][Shuffle] Propose Shuffle Driver Components API

2019-10-01 Thread GitBox
vanzin commented on issue #25823: [SPARK-28211][Core][Shuffle] Propose Shuffle Driver Components API URL: https://github.com/apache/spark/pull/25823#issuecomment-537289062 Probably need to merge your branch with master. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537276385 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537276377 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537276385 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
AmplabJenkins commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537276377 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

2019-10-01 Thread GitBox
SparkQA commented on issue #25985: [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask() URL: https://github.com/apache/spark/pull/25985#issuecomment-537276103 **[Test build #111660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] yifeih commented on issue #25823: [SPARK-28211][Core][Shuffle] Propose Shuffle Driver Components API

2019-10-01 Thread GitBox
yifeih commented on issue #25823: [SPARK-28211][Core][Shuffle] Propose Shuffle Driver Components API URL: https://github.com/apache/spark/pull/25823#issuecomment-537275729 The tests are failing due to a maven compile error: ``` [ERROR] [Error] /home/runner/work/spark/spark/core/src/

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537271549 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537271543 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] SparkQA removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2019-10-01 Thread GitBox
SparkQA removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-537236524 **[Test build #111657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111657/testReport)** fo

<    1   2   3   4   5   6   >