[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714245801 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34735/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

AmplabJenkins removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-714244069 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

AmplabJenkins removed a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714244076 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

AmplabJenkins commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-714244069 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

AmplabJenkins commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714244076 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714241762 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714243831 **[Test build #130129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130129/testReport)** for PR 30128 at commit

[GitHub] [spark] allisonwang-db commented on a change in pull request #30093: [SPARK-33183][SQL] Fix EliminateSorts bug when removing global sorts

allisonwang-db commented on a change in pull request #30093: URL: https://github.com/apache/spark/pull/30093#discussion_r509892889 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/EliminateSortsSuite.scala ## @@ -97,12 +97,27 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA removed a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714187612 **[Test build #130120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130120/testReport)** for PR 30127 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

SparkQA removed a comment on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-714073513 **[Test build #130112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130112/testReport)** for PR 30097 at commit

[GitHub] [spark] SparkQA commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714243577 **[Test build #130120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130120/testReport)** for PR 30127 at commit

[GitHub] [spark] SparkQA commented on pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

SparkQA commented on pull request #30097: URL: https://github.com/apache/spark/pull/30097#issuecomment-714243299 **[Test build #130112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130112/testReport)** for PR 30097 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

HeartSaVioR commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-714243009 I'll let the PR around 2 days to see whether others have additional comments. If no further comment is provided I'll merge this probably in this weekend. cc. @viirya

[GitHub] [spark] AmplabJenkins commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714242195 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins removed a comment on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714241856 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714242183 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34732/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins removed a comment on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714241846 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714241753 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

HyukjinKwon commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714242030 I rebased few times here because I reverted and backported some more changes in branch-2.4. This is an

[GitHub] [spark] AmplabJenkins commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714241846 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714241753 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA removed a comment on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714150588 **[Test build #130116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130116/testReport)** for PR 30018 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

AmplabJenkins removed a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714241455 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

AmplabJenkins commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714241455 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA removed a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714190019 **[Test build #130121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130121/testReport)** for PR 30127 at commit

[GitHub] [spark] otterc commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

otterc commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r509888618 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed to

[GitHub] [spark] SparkQA commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714241351 **[Test build #130116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130116/testReport)** for PR 30018 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

AmplabJenkins removed a comment on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714234553 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714240938 **[Test build #130121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130121/testReport)** for PR 30127 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29999: [SPARK-33045][SQL] Support build-in function like_all and fix StackOverflowError issue.

AmplabJenkins removed a comment on pull request #2: URL: https://github.com/apache/spark/pull/2#issuecomment-714237121 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

SparkQA removed a comment on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714185475 **[Test build #130119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130119/testReport)** for PR 29817 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30054: [SPARK-32247][INFRA] Install and test scipy with PyPy in GitHub Actions

HyukjinKwon commented on pull request #30054: URL: https://github.com/apache/spark/pull/30054#issuecomment-714240706 I also back ported this to branch-3.0 and branch-2.4. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714232234 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

AmplabJenkins removed a comment on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714192268 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] otterc commented on a change in pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

otterc commented on a change in pull request #30062: URL: https://github.com/apache/spark/pull/30062#discussion_r509888618 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -0,0 +1,915 @@ +/* + * Licensed to

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714238457 **[Test build #130128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130128/testReport)** for PR 30128 at commit

[GitHub] [spark] SparkQA commented on pull request #29999: [SPARK-33045][SQL] Support build-in function like_all and fix StackOverflowError issue.

SparkQA commented on pull request #2: URL: https://github.com/apache/spark/pull/2#issuecomment-714237099 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34730/

[GitHub] [spark] AmplabJenkins commented on pull request #29999: [SPARK-33045][SQL] Support build-in function like_all and fix StackOverflowError issue.

AmplabJenkins commented on pull request #2: URL: https://github.com/apache/spark/pull/2#issuecomment-714237121 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

AmplabJenkins commented on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714234549 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714234038 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34732/

[GitHub] [spark] SparkQA commented on pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

SparkQA commented on pull request #29817: URL: https://github.com/apache/spark/pull/29817#issuecomment-714233903 **[Test build #130119 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130119/testReport)** for PR 29817 at commit

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714232788 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34734/

[GitHub] [spark] AmplabJenkins commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714232806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714232210 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34733/

[GitHub] [spark] AmplabJenkins commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714232234 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ScrapCodes commented on a change in pull request #30025: [SPARK-33095][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MySQL dialect)

ScrapCodes commented on a change in pull request #30025: URL: https://github.com/apache/spark/pull/30025#discussion_r509881835 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/jdbc/JDBCTableCatalog.scala ## @@ -139,7 +139,10 @@ class

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714228291 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34734/

[GitHub] [spark] SparkQA commented on pull request #29999: [SPARK-33045][SQL] Support build-in function like_all and fix StackOverflowError issue.

SparkQA commented on pull request #2: URL: https://github.com/apache/spark/pull/2#issuecomment-714227951 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34730/

[GitHub] [spark] cloud-fan commented on a change in pull request #30093: [SPARK-33183][SQL] Fix EliminateSorts bug when removing global sorts

cloud-fan commented on a change in pull request #30093: URL: https://github.com/apache/spark/pull/30093#discussion_r509880688 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1052,11 +1052,11 @@ object CombineFilters

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins removed a comment on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714226565 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714226557 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

AmplabJenkins removed a comment on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714226557 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA removed a comment on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714136318 **[Test build #130115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130115/testReport)** for PR 30018 at commit

[GitHub] [spark] SparkQA commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714226171 **[Test build #130115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130115/testReport)** for PR 30018 at commit

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714225714 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34733/

[GitHub] [spark] cloud-fan commented on a change in pull request #30025: [SPARK-33095][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: add, update type and nullability of columns (MySQL dialect)

cloud-fan commented on a change in pull request #30025: URL: https://github.com/apache/spark/pull/30025#discussion_r509878979 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/jdbc/JDBCTableCatalog.scala ## @@ -139,7 +139,10 @@ class

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714221112 **[Test build #130127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130127/testReport)** for PR 30128 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

AmplabJenkins removed a comment on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-714218932 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714218864 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714218844 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

AmplabJenkins removed a comment on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-714218927 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714218833 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714218515 **[Test build #130126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130126/testReport)** for PR 30128 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

AmplabJenkins commented on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-714218927 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714218829 **[Test build #130126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130126/testReport)** for PR 30128 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714216053 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins removed a comment on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714216046 Build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714218515 **[Test build #130126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130126/testReport)** for PR 30128 at commit

[GitHub] [spark] SparkQA commented on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

SparkQA commented on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-714218065 **[Test build #130118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130118/testReport)** for PR 30126 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

AmplabJenkins removed a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714211996 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

SparkQA removed a comment on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-714173134 **[Test build #130118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130118/testReport)** for PR 30126 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #30114: [SPARK-31964][PYTHON][FOLLOW-UP] Use is_categorical_dtype instead of deprecated is_categorical

HyukjinKwon commented on pull request #30114: URL: https://github.com/apache/spark/pull/30114#issuecomment-714217080 Thanks, @BryanCutler and @srowen. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

HyukjinKwon commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714216392 I also reverted SPARK-33190 and SPARK-33189 in branch-2.4. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

AmplabJenkins commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714216046 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] sunchao commented on pull request #29843: [SPARK-33212][BUILD] Move to shaded clients for Hadoop 3.x profile

sunchao commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-714216106 Great! Thank you all! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #29999: [SPARK-33045][SQL] Support build-in function like_all and fix StackOverflowError issue.

SparkQA commented on pull request #2: URL: https://github.com/apache/spark/pull/2#issuecomment-714215550 **[Test build #130125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130125/testReport)** for PR 2 at commit

[GitHub] [spark] SparkQA commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

SparkQA commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-714215491 **[Test build #130124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130124/testReport)** for PR 30018 at commit

[GitHub] [spark] SparkQA commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

SparkQA commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714215494 **[Test build #130123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130123/testReport)** for PR 30128 at commit

[GitHub] [spark] HyukjinKwon opened a new pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

HyukjinKwon opened a new pull request #30128: URL: https://github.com/apache/spark/pull/30128 ### What changes were proposed in this pull request? This PR proposes to set the upper bound of PyArrow and Pandas versions to 1.2.0 and 1.0.0 respectively.

[GitHub] [spark] HyukjinKwon commented on pull request #30128: [SPARK-33217][INFRA][PYTHON][2.4] Set upper bound of Pandas and PyArrow version in GitHub Actions in branch-2.4

HyukjinKwon commented on pull request #30128: URL: https://github.com/apache/spark/pull/30128#issuecomment-714213784 cc @dongjoon-hyun FYI. I confess that I haven't ran the tests with this combination yet but I am pretty sure this PR fixes.

[GitHub] [spark] AmplabJenkins commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

AmplabJenkins commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714211996 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714211970 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34729/

[GitHub] [spark] HyukjinKwon closed pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

HyukjinKwon closed pull request #30127: URL: https://github.com/apache/spark/pull/30127 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

HyukjinKwon commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714209051 @dongjoon-hyun, I will open another PR with picking your commits - seems it fails. This is an automated

[GitHub] [spark] SparkQA commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714207750 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34729/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

AmplabJenkins removed a comment on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-714203992 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

AmplabJenkins commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-714203992 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] jkleckner commented on a change in pull request #29533: [SPARK-24266][K8S][3.0] Restart the watcher when we receive a version changed from k8s

jkleckner commented on a change in pull request #29533: URL: https://github.com/apache/spark/pull/29533#discussion_r509863669 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesSuite.scala ## @@

[GitHub] [spark] SparkQA removed a comment on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

SparkQA removed a comment on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-713922731 **[Test build #130110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130110/testReport)** for PR 30076 at commit

[GitHub] [spark] SparkQA commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

SparkQA commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-714203437 **[Test build #130110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130110/testReport)** for PR 30076 at commit

[GitHub] [spark] cloud-fan commented on pull request #30108: [SPARK-33197][SQL] Make changes to spark.sql.analyzer.maxIterations take effect at runtime

cloud-fan commented on pull request #30108: URL: https://github.com/apache/spark/pull/30108#issuecomment-714202893 what's the cost here? does it mean we need to re-create the rule/batch instances every time we run a query?

[GitHub] [spark] SparkQA commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

SparkQA commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714201874 **[Test build #130122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130122/testReport)** for PR 30127 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

dongjoon-hyun commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714200852 Thank you for investigating all the stuff and guiding this, @HyukjinKwon ! This is an automated message

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

HyukjinKwon edited a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714200325 I discussed offline with @dongjoon-hyun. It requires port at least two PRs https://github.com/apache/spark/commit/07a9885f2792be1353f4a923d649e90bc431cb38 and

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

HyukjinKwon edited a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714200325 I discussed offline with @dongjoon-hyun. It requires to port at least two PRs https://github.com/apache/spark/commit/07a9885f2792be1353f4a923d649e90bc431cb38 and

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

HyukjinKwon edited a comment on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714200325 I discussed offline with @dongjoon-hyun. It requires port two PRs https://github.com/apache/spark/commit/07a9885f2792be1353f4a923d649e90bc431cb38 and

[GitHub] [spark] HyukjinKwon commented on pull request #30127: [SPARK-33216][INFRA][PYTHON][2.4] Set upper bound of Pandas version in GitHub Actions

HyukjinKwon commented on pull request #30127: URL: https://github.com/apache/spark/pull/30127#issuecomment-714200325 I discussed offline. It requires port two PRs https://github.com/apache/spark/commit/07a9885f2792be1353f4a923d649e90bc431cb38 and

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30124: [SPARK-33189][FOLLOWUP][2.4] Fix syntax error in python/run-tests.py

AmplabJenkins removed a comment on pull request #30124: URL: https://github.com/apache/spark/pull/30124#issuecomment-714191828 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #29817: [SPARK-32850][CORE][K8S] Simplify the RPC message flow of decommission

cloud-fan commented on a change in pull request #29817: URL: https://github.com/apache/spark/pull/29817#discussion_r509859829 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -465,72 +464,50 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

AmplabJenkins removed a comment on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-714193726 Test FAILed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   8   >