[GitHub] [spark] dchvn commented on a change in pull request #34819: [SPARK-37478][SQL][TESTS] Unify v1 and v2 DROP NAMESPACE tests

2021-12-20 Thread GitBox
dchvn commented on a change in pull request #34819: URL: https://github.com/apache/spark/pull/34819#discussion_r772897342 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/DropNamespaceSuite.scala ## @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache

[GitHub] [spark] SparkQA commented on pull request #34961: [SPARK-37695][CORE][SHUFFLE] Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread GitBox
SparkQA commented on pull request #34961: URL: https://github.com/apache/spark/pull/34961#issuecomment-998546654 **[Test build #146427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146427/testReport)** for PR 34961 at commit [`ce42f59`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34967: [MINOR][UI] Fix Duration tips of Stage Table on UI

2021-12-20 Thread GitBox
SparkQA commented on pull request #34967: URL: https://github.com/apache/spark/pull/34967#issuecomment-998546603 **[Test build #146426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146426/testReport)** for PR 34967 at commit [`63bce7f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34968: [DONNOTMERGE][DO NOT APPROVE] test on workflow approve

2021-12-20 Thread GitBox
SparkQA commented on pull request #34968: URL: https://github.com/apache/spark/pull/34968#issuecomment-998546596 **[Test build #146425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146425/testReport)** for PR 34968 at commit [`b815e86`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #34881: [SPARK-37628][BUILD] Upgrade Netty from 4.1.68 to 4.1.72

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34881: URL: https://github.com/apache/spark/pull/34881#issuecomment-998544843 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50894/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998544844 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146424/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998544847 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50893/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998544846 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [spark] Yaohua628 commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
Yaohua628 commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772894338 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala ## @@ -57,11 +66,15 @@ case class PartitionedFile(

[GitHub] [spark] SparkQA commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998543264 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50896/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
SparkQA commented on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998543214 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50893/ -- This is an automated message from the A

[GitHub] [spark] cloud-fan commented on a change in pull request #34819: [SPARK-37478][SQL][TESTS] Unify v1 and v2 DROP NAMESPACE tests

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34819: URL: https://github.com/apache/spark/pull/34819#discussion_r772893136 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/DropNamespaceSuite.scala ## @@ -0,0 +1,33 @@ +/* + * Licensed to the Ap

[GitHub] [spark] Yikun opened a new pull request #34968: [DONNOTMERGE][DO NOT APPROVE] test on workflow approve

2021-12-20 Thread GitBox
Yikun opened a new pull request #34968: URL: https://github.com/apache/spark/pull/34968 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was t

[GitHub] [spark] SparkQA commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998541802 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50895/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

2021-12-20 Thread GitBox
SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-998541746 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50897/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998541484 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50898/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34881: [SPARK-37628][BUILD] Upgrade Netty from 4.1.68 to 4.1.72

2021-12-20 Thread GitBox
SparkQA commented on pull request #34881: URL: https://github.com/apache/spark/pull/34881#issuecomment-998539744 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50894/ -- This is an automated message from the A

[GitHub] [spark] cloud-fan commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772888602 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala ## @@ -103,6 +116,108 @@ class FileScanRDD(

[GitHub] [spark] cloud-fan commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772195408 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala ## @@ -57,11 +66,15 @@ case class PartitionedFile(

[GitHub] [spark] dchvn commented on a change in pull request #34819: [SPARK-37478][SQL][TESTS] Unify v1 and v2 DROP NAMESPACE tests

2021-12-20 Thread GitBox
dchvn commented on a change in pull request #34819: URL: https://github.com/apache/spark/pull/34819#discussion_r772887958 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/DropNamespaceSuite.scala ## @@ -0,0 +1,33 @@ +/* + * Licensed to the Apache

[GitHub] [spark] yaooqinn commented on pull request #34961: [SPARK-37695][CORE][SHUFFLE] Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread GitBox
yaooqinn commented on pull request #34961: URL: https://github.com/apache/spark/pull/34961#issuecomment-998533653 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] SparkQA commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998533174 **[Test build #146424 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146424/testReport)** for PR 34963 at commit [`3b0b2d8`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998524156 **[Test build #146424 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146424/testReport)** for PR 34963 at commit [`3b0b2d8`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998518453 **[Test build #146423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146423/testReport)** for PR 34966 at commit [`f8a911e`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772881079 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala ## @@ -103,6 +116,108 @@ class FileScanRDD(

[GitHub] [spark] SparkQA commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998530243 **[Test build #146423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146423/testReport)** for PR 34966 at commit [`f8a911e`](https://github.co

[GitHub] [spark] yaooqinn opened a new pull request #34967: [MINOR][UI] Fix Duration tips of Stage Table on UI

2021-12-20 Thread GitBox
yaooqinn opened a new pull request #34967: URL: https://github.com/apache/spark/pull/34967 ### What changes were proposed in this pull request? After https://github.com/apache/spark/commit/c07a50b86254578625be777b1890ff95e832ac6e the duration of a stage on UI does not displa

[GitHub] [spark] SparkQA removed a comment on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998516576 **[Test build #146420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146420/testReport)** for PR 34966 at commit [`687505e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998528415 **[Test build #146420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146420/testReport)** for PR 34966 at commit [`687505e`](https://github.co

[GitHub] [spark] Yaohua628 commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
Yaohua628 commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772876762 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SchemaPruning.scala ## @@ -164,7 +164,12 @@ object SchemaPruning exten

[GitHub] [spark] Yaohua628 commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
Yaohua628 commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772876145 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala ## @@ -103,6 +116,108 @@ class FileScanRDD(

[GitHub] [spark] SparkQA commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998524156 **[Test build #146424 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146424/testReport)** for PR 34963 at commit [`3b0b2d8`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998518453 **[Test build #146423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146423/testReport)** for PR 34966 at commit [`f8a911e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

2021-12-20 Thread GitBox
SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-998516884 **[Test build #146422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146422/testReport)** for PR 34695 at commit [`34e1bf7`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998516602 **[Test build #146421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146421/testReport)** for PR 34965 at commit [`0ac57d6`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
SparkQA commented on pull request #34966: URL: https://github.com/apache/spark/pull/34966#issuecomment-998516576 **[Test build #146420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146420/testReport)** for PR 34966 at commit [`687505e`](https://github.com

[GitHub] [spark] cloud-fan commented on a change in pull request #34729: [SPARK-37475][SQL] Add scale parameter to floor and ceil functions

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34729: URL: https://github.com/apache/spark/pull/34729#discussion_r772868021 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala ## @@ -249,9 +249,9 @@ case class Cbrt(child:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998515536 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146418/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998515539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146417/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998515536 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146418/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998515539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146417/ -- This

[GitHub] [spark] SparkQA commented on pull request #34881: [SPARK-37628][BUILD] Upgrade Netty from 4.1.68 to 4.1.72

2021-12-20 Thread GitBox
SparkQA commented on pull request #34881: URL: https://github.com/apache/spark/pull/34881#issuecomment-998512140 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50894/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772862245 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala ## @@ -103,6 +116,108 @@ class FileScanRDD(

[GitHub] [spark] SparkQA commented on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
SparkQA commented on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998509791 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50893/ -- This is an automated message from the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772861339 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SchemaPruning.scala ## @@ -164,7 +164,12 @@ object SchemaPruning exten

[GitHub] [spark] xinrong-databricks opened a new pull request #34966: [SPARK-37701][PYTHON] Implement `ps.to_timedelta` method

2021-12-20 Thread GitBox
xinrong-databricks opened a new pull request #34966: URL: https://github.com/apache/spark/pull/34966 ### What changes were proposed in this pull request? Implement `ps.to_timedelta` method ### Why are the changes needed? To be consistent with pandas ### Does this PR intro

[GitHub] [spark] cloud-fan commented on a change in pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34575: URL: https://github.com/apache/spark/pull/34575#discussion_r772861339 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SchemaPruning.scala ## @@ -164,7 +164,12 @@ object SchemaPruning exten

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

2021-12-20 Thread GitBox
AngersZh commented on a change in pull request #34695: URL: https://github.com/apache/spark/pull/34695#discussion_r772860072 ## File path: core/src/main/resources/org/apache/spark/ui/static/executorspage.js ## @@ -160,6 +170,149 @@ function reselectCheckboxesBasedOnTaskTabl

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

2021-12-20 Thread GitBox
AngersZh commented on a change in pull request #34695: URL: https://github.com/apache/spark/pull/34695#discussion_r772859056 ## File path: core/src/main/resources/org/apache/spark/ui/static/executorspage.js ## @@ -160,6 +170,149 @@ function reselectCheckboxesBasedOnTaskTabl

[GitHub] [spark] pgandhi999 commented on a change in pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

2021-12-20 Thread GitBox
pgandhi999 commented on a change in pull request #34695: URL: https://github.com/apache/spark/pull/34695#discussion_r772855422 ## File path: core/src/main/resources/org/apache/spark/ui/static/executorspage.js ## @@ -160,6 +170,149 @@ function reselectCheckboxesBasedOnTaskTableS

[GitHub] [spark] SparkQA removed a comment on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998490726 **[Test build #146418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146418/testReport)** for PR 34931 at commit [`9949275`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
SparkQA commented on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998501184 **[Test build #146418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146418/testReport)** for PR 34931 at commit [`9949275`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998446176 **[Test build #146417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146417/testReport)** for PR 34965 at commit [`47cffb9`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-998495313 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146413/ -

[GitHub] [spark] SparkQA commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998496727 **[Test build #146417 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146417/testReport)** for PR 34965 at commit [`47cffb9`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-998495313 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146413/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-998377570 **[Test build #146413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146413/testReport)** for PR 34575 at commit [`f780bf2`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
SparkQA commented on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-998492888 **[Test build #146413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146413/testReport)** for PR 34575 at commit [`f780bf2`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34881: [SPARK-37628][BUILD] Upgrade Netty from 4.1.68 to 4.1.72

2021-12-20 Thread GitBox
SparkQA commented on pull request #34881: URL: https://github.com/apache/spark/pull/34881#issuecomment-998490766 **[Test build #146419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146419/testReport)** for PR 34881 at commit [`8994d5e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34931: [SPARK-37657][PYTHON] Support str and timestamp for (Series|DataFrame).describe()

2021-12-20 Thread GitBox
SparkQA commented on pull request #34931: URL: https://github.com/apache/spark/pull/34931#issuecomment-998490726 **[Test build #146418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146418/testReport)** for PR 34931 at commit [`9949275`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998490007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50892/

[GitHub] [spark] AmplabJenkins commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998490007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50892/ -- T

[GitHub] [spark] SparkQA commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998484412 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50892/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998467422 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146415/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998467423 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146414/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-998467426 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146409/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998467425 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50891/

[GitHub] [spark] AmplabJenkins commented on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998467422 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146415/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-998467426 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146409/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998467425 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50891/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998467423 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146414/ -- This

[GitHub] [spark] itholic commented on a change in pull request #34957: [SPARK-37668][PYTHON] 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread GitBox
itholic commented on a change in pull request #34957: URL: https://github.com/apache/spark/pull/34957#discussion_r772822395 ## File path: python/pyspark/pandas/frame.py ## @@ -3989,9 +3989,14 @@ def insert( ) if is_name_like_tuple(column): -i

[GitHub] [spark] itholic commented on a change in pull request #34957: [SPARK-37668][PYTHON] 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread GitBox
itholic commented on a change in pull request #34957: URL: https://github.com/apache/spark/pull/34957#discussion_r772819228 ## File path: python/pyspark/pandas/frame.py ## @@ -3989,9 +3989,14 @@ def insert( ) if is_name_like_tuple(column): -i

[GitHub] [spark] SparkQA removed a comment on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998401647 **[Test build #146414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146414/testReport)** for PR 34919 at commit [`56127c6`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
SparkQA commented on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998465530 **[Test build #146414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146414/testReport)** for PR 34919 at commit [`56127c6`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998463121 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50892/ -- This is an automated message from the Apache

[GitHub] [spark] itholic commented on a change in pull request #34957: [SPARK-37668][PYTHON] 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread GitBox
itholic commented on a change in pull request #34957: URL: https://github.com/apache/spark/pull/34957#discussion_r772819228 ## File path: python/pyspark/pandas/frame.py ## @@ -3989,9 +3989,14 @@ def insert( ) if is_name_like_tuple(column): -i

[GitHub] [spark] itholic commented on a change in pull request #34957: [SPARK-37668][PYTHON] 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread GitBox
itholic commented on a change in pull request #34957: URL: https://github.com/apache/spark/pull/34957#discussion_r772818854 ## File path: python/pyspark/pandas/frame.py ## @@ -3989,9 +3989,14 @@ def insert( ) if is_name_like_tuple(column): -i

[GitHub] [spark] SparkQA commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998460821 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50891/ -- This is an automated message from the A

[GitHub] [spark] cloud-fan commented on a change in pull request #34819: [SPARK-37478][SQL][TESTS] Unify v1 and v2 DROP NAMESPACE tests

2021-12-20 Thread GitBox
cloud-fan commented on a change in pull request #34819: URL: https://github.com/apache/spark/pull/34819#discussion_r772816330 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/DropNamespaceSuite.scala ## @@ -0,0 +1,33 @@ +/* + * Licensed to the Ap

[GitHub] [spark] SparkQA removed a comment on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998405991 **[Test build #146415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146415/testReport)** for PR 34964 at commit [`c4e47cc`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
SparkQA commented on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998454628 **[Test build #146415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146415/testReport)** for PR 34964 at commit [`c4e47cc`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-998326692 **[Test build #146409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146409/testReport)** for PR 32875 at commit [`1b6b809`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

2021-12-20 Thread GitBox
SparkQA commented on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-998450700 **[Test build #146409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146409/testReport)** for PR 32875 at commit [`1b6b809`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
SparkQA commented on pull request #34965: URL: https://github.com/apache/spark/pull/34965#issuecomment-998446176 **[Test build #146417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146417/testReport)** for PR 34965 at commit [`47cffb9`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998445777 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50890/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998445779 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50889/

[GitHub] [spark] AmplabJenkins commented on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998445777 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50890/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998445779 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50889/ -- T

[GitHub] [spark] SparkQA commented on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
SparkQA commented on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998444694 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50890/ -- This is an automated message from the A

[GitHub] [spark] viirya opened a new pull request #34965: [SPARK-37700][CORE][TEST] Add LoggingSuite and some improvements

2021-12-20 Thread GitBox
viirya opened a new pull request #34965: URL: https://github.com/apache/spark/pull/34965 ### What changes were proposed in this pull request? This patch proposes to add `LoggingSuite` back and also refactors some logging related code. ### Why are the changes needed

[GitHub] [spark] SparkQA commented on pull request #34919: [SPARK-37659][UI] Fix FsHistoryProvider race condition between list and delet log info

2021-12-20 Thread GitBox
SparkQA commented on pull request #34919: URL: https://github.com/apache/spark/pull/34919#issuecomment-998443544 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50889/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998441527 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50891/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998428592 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146416/ -

[GitHub] [spark] SparkQA removed a comment on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA removed a comment on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998423074 **[Test build #146416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146416/testReport)** for PR 34963 at commit [`7482780`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
AmplabJenkins commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998428592 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146416/ -- This

[GitHub] [spark] SparkQA commented on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
SparkQA commented on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998428476 **[Test build #146416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146416/testReport)** for PR 34963 at commit [`7482780`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34964: [WIP][SPARK-37681][SQL] Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread GitBox
SparkQA commented on pull request #34964: URL: https://github.com/apache/spark/pull/34964#issuecomment-998423541 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50890/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34575: [SPARK-37273][SQL] Support hidden file metadata columns in Spark SQL

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34575: URL: https://github.com/apache/spark/pull/34575#issuecomment-998422740 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50888/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34963: [SPARK-37699][K8S][TEST] Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread GitBox
AmplabJenkins removed a comment on pull request #34963: URL: https://github.com/apache/spark/pull/34963#issuecomment-998422738 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50887/

  1   2   3   4   5   >