[GitHub] [spark] HyukjinKwon commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
HyukjinKwon commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-914973285 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [spark] HyukjinKwon commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
HyukjinKwon commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-914973473 Jenkins, test this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] cloud-fan commented on a change in pull request #33888: [SPARK-36634][SQL] Support access and read parquet file by column ordinal

2021-09-08 Thread GitBox
cloud-fan commented on a change in pull request #33888: URL: https://github.com/apache/spark/pull/33888#discussion_r704109578 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala ## @@ -901,6 +901,91 @@ abstract class

[GitHub] [spark] pan3793 commented on pull request #33913: [SPARK-36669][BUILD] Revert to non-shaded Hadoop client library

2021-09-08 Thread GitBox
pan3793 commented on pull request #33913: URL: https://github.com/apache/spark/pull/33913#issuecomment-914978643 Does this help for snappy-java? > Fixed the pure-java Snappy fallback logic when no native library for your platform is found. https://github.com/xerial/snappy-java

[GitHub] [spark] SparkQA commented on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
SparkQA commented on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-914980115 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47575/ -- This

[GitHub] [spark] SparkQA commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
SparkQA commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-914982353 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47574/ -- This is an automated message from the Apache

[GitHub] [spark] viirya commented on a change in pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
viirya commented on a change in pull request #33803: URL: https://github.com/apache/spark/pull/33803#discussion_r704118124 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/filter/In.java ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Soft

[GitHub] [spark] SparkQA commented on pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
SparkQA commented on pull request #33930: URL: https://github.com/apache/spark/pull/33930#issuecomment-914983432 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47573/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYSPARK] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-914983653 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47571/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
SparkQA commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-914983809 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47572/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33911: [SPARK-36653][PYTHON] implement Series.__xor__ and Series.__rxor__

2021-09-08 Thread GitBox
SparkQA commented on pull request #33911: URL: https://github.com/apache/spark/pull/33911#issuecomment-914987113 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47569/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
SparkQA commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-914987587 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47574/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
SparkQA commented on pull request #33930: URL: https://github.com/apache/spark/pull/33930#issuecomment-914988192 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47573/ -- This is an automated message from the A

[GitHub] [spark] HeartSaVioR commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
HeartSaVioR commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-91494 I'm going to merge this as this is a simple replacement on deprecated API. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] SparkQA commented on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
SparkQA commented on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-914989359 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47576/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33911: [SPARK-36653][PYTHON] implement Series.__xor__ and Series.__rxor__

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33911: URL: https://github.com/apache/spark/pull/33911#issuecomment-914990033 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47569/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-914990035 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47574/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-914990031 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47575/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33930: URL: https://github.com/apache/spark/pull/33930#issuecomment-914990036 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47573/ -- T

[GitHub] [spark] SparkQA commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
SparkQA commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-914990317 **[Test build #143070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143070/testReport)** for PR 33933 at commit [`7389ba3`](https://github.co

[GitHub] [spark] viirya commented on pull request #33913: [SPARK-36669][BUILD] Revert to non-shaded Hadoop client library

2021-09-08 Thread GitBox
viirya commented on pull request #33913: URL: https://github.com/apache/spark/pull/33913#issuecomment-914990449 > Does this help for snappy-java? > > > Fixed the pure-java Snappy fallback logic when no native library for your platform is found. > > https://github.com/xerial/sn

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33911: [SPARK-36653][PYTHON] implement Series.__xor__ and Series.__rxor__

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33911: URL: https://github.com/apache/spark/pull/33911#issuecomment-914990033 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47569/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33930: URL: https://github.com/apache/spark/pull/33930#issuecomment-914990036 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47573/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-914990035 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47574/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-914990031 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47575/

[GitHub] [spark] AmplabJenkins commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-914990621 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143070/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-914990621 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143070/ -

[GitHub] [spark] SparkQA removed a comment on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
SparkQA removed a comment on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-914957904 **[Test build #143070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143070/testReport)** for PR 33933 at commit [`7389ba3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-914991048 **[Test build #143075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143075/testReport)** for PR 32583 at commit [`007d469`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-843285239 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] viirya edited a comment on pull request #33913: [SPARK-36669][BUILD] Revert to non-shaded Hadoop client library

2021-09-08 Thread GitBox
viirya edited a comment on pull request #33913: URL: https://github.com/apache/spark/pull/33913#issuecomment-914990449 > Does this help for snappy-java? > > > Fixed the pure-java Snappy fallback logic when no native library for your platform is found. > > https://github.com/xe

[GitHub] [spark] SparkQA commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
SparkQA commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-914993227 **[Test build #143076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143076/testReport)** for PR 33928 at commit [`56df04c`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-914994407 **[Test build #143077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143077/testReport)** for PR 32583 at commit [`007d469`](https://github.com

[GitHub] [spark] pan3793 commented on pull request #33913: [SPARK-36669][BUILD] Revert to non-shaded Hadoop client library

2021-09-08 Thread GitBox
pan3793 commented on pull request #33913: URL: https://github.com/apache/spark/pull/33913#issuecomment-914994516 What if force set `org.apache.hadoop.shaded.org.xerial.snappy.purejava = true`? ``` try { if (Boolean.parseBoolean(System.getProperty("org.apache.hadoop.shaded.org.

[GitHub] [spark] HeartSaVioR closed pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
HeartSaVioR closed pull request #33933: URL: https://github.com/apache/spark/pull/33933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-un

[GitHub] [spark] HeartSaVioR commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
HeartSaVioR commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-915000563 Thanks @LuciferYang for contribution! I merged this into master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYSPARK] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915002768 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47577/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYSPARK] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915008792 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47571/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
SparkQA commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-915009486 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47572/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYSPARK] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915010404 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47577/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
SparkQA commented on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-915015610 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47576/ -- This is an automated message from the A

[GitHub] [spark] AngersZhuuuu opened a new pull request #33935: [SPARK-36692][CORE] Improve Error statement when requesting thread dump while executor already stopped

2021-09-08 Thread GitBox
AngersZh opened a new pull request #33935: URL: https://github.com/apache/spark/pull/33935 ### What changes were proposed in this pull request? For now, when user check thread dump for a executor while this executor is stopped, the error log shows following might disturb users.

[GitHub] [spark] AngersZhuuuu commented on pull request #33935: [SPARK-36692][CORE] Improve Error statement when requesting thread dump while executor already stopped

2021-09-08 Thread GitBox
AngersZh commented on pull request #33935: URL: https://github.com/apache/spark/pull/33935#issuecomment-915017208 ping @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33935: [SPARK-36692][CORE] Improve Error statement when requesting thread dump while executor already stopped

2021-09-08 Thread GitBox
HyukjinKwon commented on a change in pull request #33935: URL: https://github.com/apache/spark/pull/33935#discussion_r704157864 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -694,8 +694,14 @@ class SparkContext(config: SparkConf) extends Logging {

[GitHub] [spark] HyukjinKwon commented on a change in pull request #33877: [SPARK-36625][SPARK-36661][PYTHON] Support TimestampNTZ in pandas API on Spark

2021-09-08 Thread GitBox
HyukjinKwon commented on a change in pull request #33877: URL: https://github.com/apache/spark/pull/33877#discussion_r704158782 ## File path: python/pyspark/pandas/data_type_ops/datetime_ops.py ## @@ -58,15 +66,18 @@ def sub(self, left: IndexOpsLike, right: Any) -> SeriesOrInd

[GitHub] [spark] HyukjinKwon commented on pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
HyukjinKwon commented on pull request #33930: URL: https://github.com/apache/spark/pull/33930#issuecomment-915022505 cc @cloud-fan @sunchao @dbtsai FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915027261 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47579/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
SparkQA commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-915029246 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47578/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-915029442 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47572/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33934: [SPARK-36691][PYSPARK] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915029441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [spark] AmplabJenkins commented on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-915029445 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47576/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33934: [SPARK-36691][PYSPARK] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915029441 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33803: [SPARK-36556][SQL] Add DSV2 filters

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33803: URL: https://github.com/apache/spark/pull/33803#issuecomment-915029445 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47576/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-915029442 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47572/

[GitHub] [spark] SparkQA commented on pull request #33935: [SPARK-36692][CORE] Improve Error statement when requesting thread dump while executor already stopped

2021-09-08 Thread GitBox
SparkQA commented on pull request #33935: URL: https://github.com/apache/spark/pull/33935#issuecomment-915031718 **[Test build #143078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143078/testReport)** for PR 33935 at commit [`d4b0bd6`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915033024 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47579/ -- T

[GitHub] [spark] SparkQA commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915032957 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47579/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915033024 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47579/

[GitHub] [spark] LuciferYang commented on pull request #33933: [SPARK-36690][SS] Clean up deprecated api usage after upgrade commons-pool2 to 2.11.1

2021-09-08 Thread GitBox
LuciferYang commented on pull request #33933: URL: https://github.com/apache/spark/pull/33933#issuecomment-915034048 Thanks @HeartSaVioR @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [spark] gyogal opened a new pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
gyogal opened a new pull request #33936: URL: https://github.com/apache/spark/pull/33936 ### What changes were proposed in this pull request? Add a shell timeout feature via a configuration value that closes spark-shell and the context unless new lines are entered for a set amount of

[GitHub] [spark] AmplabJenkins commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915036618 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] cloud-fan commented on a change in pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
cloud-fan commented on a change in pull request #33930: URL: https://github.com/apache/spark/pull/33930#discussion_r704180322 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -441,6 +456,24 @@ object BooleanSimplificatio

[GitHub] [spark] hypercubestart commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
hypercubestart commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-915037943 > The bug is pretty obvious, may not be worth an end-to-end test. It's still better to give a real query in the PR description to demonstrate the bug. thanks for re

[GitHub] [spark] cloud-fan commented on a change in pull request #33930: [SPARK-36665][SQL] Add more Not operator simplifications

2021-09-08 Thread GitBox
cloud-fan commented on a change in pull request #33930: URL: https://github.com/apache/spark/pull/33930#discussion_r704181087 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala ## @@ -441,6 +456,24 @@ object BooleanSimplificatio

[GitHub] [spark] attilapiros commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
attilapiros commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915040138 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915036618 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] SparkQA commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915042055 **[Test build #143077 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143077/testReport)** for PR 32583 at commit [`007d469`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915042231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143077/ -- This

[GitHub] [spark] SparkQA commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
SparkQA commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915042155 **[Test build #143079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143079/testReport)** for PR 33936 at commit [`d19003c`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA removed a comment on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-914994407 **[Test build #143077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143077/testReport)** for PR 32583 at commit [`007d469`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915042231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143077/ -

[GitHub] [spark] attilapiros commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
attilapiros commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915047136 Apache Spark leverages the resources of GitHub Actions in your forked repository to test your PR. Please enable it, see also https://github.com/apache/spark/pull/33936/check

[GitHub] [spark] SparkQA commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
SparkQA commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915053220 **[Test build #143079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143079/testReport)** for PR 33936 at commit [`d19003c`](https://github.co

[GitHub] [spark] dgd-contributor commented on pull request #33878: [SPARK-36303][SQL] Refactor fourthteenth set of 20 query execution errors to use error classes

2021-09-08 Thread GitBox
dgd-contributor commented on pull request #33878: URL: https://github.com/apache/spark/pull/33878#issuecomment-915058312 Thanks for your comments @karenfeng , can you review it again? -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [spark] attilapiros commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
attilapiros commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915059558 As I see this is your first PR for Apache Spark welcome here and thank you for your contribution! -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] SparkQA commented on pull request #33935: [SPARK-36692][CORE] Improve Error statement when requesting thread dump while executor already stopped

2021-09-08 Thread GitBox
SparkQA commented on pull request #33935: URL: https://github.com/apache/spark/pull/33935#issuecomment-915062346 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47580/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
SparkQA removed a comment on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915042155 **[Test build #143079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143079/testReport)** for PR 33936 at commit [`d19003c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
SparkQA commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-915070703 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47578/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-915072323 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47578/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915072321 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143079/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915072321 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143079/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-915072323 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47578/

[GitHub] [spark] SparkQA commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

2021-09-08 Thread GitBox
SparkQA commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-915075351 **[Test build #143080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143080/testReport)** for PR 32583 at commit [`7ec3ccc`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
SparkQA commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915079267 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47581/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915079395 **[Test build #143074 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143074/testReport)** for PR 33934 at commit [`6da39fd`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA removed a comment on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-914969142 **[Test build #143074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143074/testReport)** for PR 33934 at commit [`6da39fd`](https://gi

[GitHub] [spark] wangyum commented on a change in pull request #33914: [SPARK-32268][SQL] Dynamic bloom filter join pruning

2021-09-08 Thread GitBox
wangyum commented on a change in pull request #33914: URL: https://github.com/apache/spark/pull/33914#discussion_r704250838 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -353,6 +353,23 @@ object SQLConf { .checkValue(ratio =

[GitHub] [spark] AmplabJenkins commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915080908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143074/ -- This

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915081053 **[Test build #143069 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143069/testReport)** for PR 33934 at commit [`5ade9f0`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915080908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143074/ -

[GitHub] [spark] SparkQA removed a comment on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
SparkQA removed a comment on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-914957902 **[Test build #143069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143069/testReport)** for PR 33934 at commit [`5ade9f0`](https://gi

[GitHub] [spark] wangyum commented on pull request #33914: [SPARK-32268][SQL] Dynamic bloom filter join pruning

2021-09-08 Thread GitBox
wangyum commented on pull request #33914: URL: https://github.com/apache/spark/pull/33914#issuecomment-915082161 > I think we should probably at least have a design doc to explain this .. from a cursory look the change looks huge. I’m still doing an evaluation in our production envir

[GitHub] [spark] AmplabJenkins commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915082819 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143069/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-915082819 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143069/ -

[GitHub] [spark] wangyum commented on a change in pull request #33914: [SPARK-32268][SQL] Dynamic bloom filter join pruning

2021-09-08 Thread GitBox
wangyum commented on a change in pull request #33914: URL: https://github.com/apache/spark/pull/33914#discussion_r704258121 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -353,6 +353,23 @@ object SQLConf { .checkValue(ratio =

[GitHub] [spark] SparkQA commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
SparkQA commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915087793 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47581/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
AmplabJenkins commented on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915087860 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47581/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33936: [SPARK-36693][REPL] Implement spark-shell idle timeouts

2021-09-08 Thread GitBox
AmplabJenkins removed a comment on pull request #33936: URL: https://github.com/apache/spark/pull/33936#issuecomment-915087860 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47581/

[GitHub] [spark] wangyum commented on a change in pull request #33914: [SPARK-32268][SQL] Dynamic bloom filter join pruning

2021-09-08 Thread GitBox
wangyum commented on a change in pull request #33914: URL: https://github.com/apache/spark/pull/33914#discussion_r704260274 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -353,6 +353,23 @@ object SQLConf { .checkValue(ratio =

[GitHub] [spark] SparkQA commented on pull request #33928: [SPARK-36686][SQL] Fix SimplifyConditionalsInPredicate to be null-safe

2021-09-08 Thread GitBox
SparkQA commented on pull request #33928: URL: https://github.com/apache/spark/pull/33928#issuecomment-915092303 **[Test build #143076 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143076/testReport)** for PR 33928 at commit [`56df04c`](https://github.co

  1   2   3   4   5   6   >