[GitHub] [spark] AmplabJenkins removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988581718 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50474/

[GitHub] [spark] AmplabJenkins commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988581718 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50474/ --

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988581692 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50474/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32769: [SPARK-35630][SQL] ExpandExec should not introduce unnecessary exchanges

SparkQA commented on pull request #32769: URL: https://github.com/apache/spark/pull/32769#issuecomment-988581168 **[Test build #146004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146004/testReport)** for PR 32769 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

AmplabJenkins removed a comment on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988580128 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50473/

[GitHub] [spark] AmplabJenkins commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

AmplabJenkins commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988580128 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50473/ --

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988580230 **[Test build #146003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146003/testReport)** for PR 34830 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988580143 **[Test build #146002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146002/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988580095 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50473/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34800: [SPARK-37538][SQL] Replace single projection expand

AmplabJenkins removed a comment on pull request #34800: URL: https://github.com/apache/spark/pull/34800#issuecomment-988577627 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50471/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988577628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #34800: [SPARK-37538][SQL] Replace single projection expand

AmplabJenkins commented on pull request #34800: URL: https://github.com/apache/spark/pull/34800#issuecomment-988577627 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50471/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988577630 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988576855 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50474/ -- This is an automated message from the Apache

[GitHub] [spark] huaxingao commented on a change in pull request #34799: [SPARK-37527][SQL] Translate more standard aggregate functions for pushdown

huaxingao commented on a change in pull request #34799: URL: https://github.com/apache/spark/pull/34799#discussion_r764617946 ## File path: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala ## @@ -208,6 +208,9 @@ abstract class JdbcDialect extends

[GitHub] [spark] SparkQA commented on pull request #34800: [SPARK-37538][SQL] Replace single projection expand

SparkQA commented on pull request #34800: URL: https://github.com/apache/spark/pull/34800#issuecomment-988574257 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50471/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

SparkQA commented on pull request #34821: URL: https://github.com/apache/spark/pull/34821#issuecomment-988573184 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50476/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988570952 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50475/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988570616 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50472/ -- This is an automated message from the

[GitHub] [spark] beliefer commented on pull request #34799: [SPARK-37527][SQL] Translate more standard aggregate functions for pushdown

beliefer commented on pull request #34799: URL: https://github.com/apache/spark/pull/34799#issuecomment-988568065 ping @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] beliefer commented on pull request #34738: [SPARK-37483][SQL] Support push down top N to JDBC data source V2

beliefer commented on pull request #34738: URL: https://github.com/apache/spark/pull/34738#issuecomment-988567892 ping @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988560504 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50470/ -- This is an automated message from the

[GitHub] [spark] LuciferYang commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

LuciferYang commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988560310 > When change to our internal hadoop version and failed to donwload the hadoop version, then fallback to 2.7.4. > > Hmm here may should be when hadoop version start

[GitHub] [spark] AngersZhuuuu commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AngersZh commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988559680 > When change to our internal hadoop version and failed to donwload the hadoop version, then fallback to 2.7.4. > > Hmm here may should be when hadoop version start

[GitHub] [spark] beliefer commented on a change in pull request #34779: [SPARK-37518][SQL] Inject a early scan pushdown rule

beliefer commented on a change in pull request #34779: URL: https://github.com/apache/spark/pull/34779#discussion_r764564803 ## File path: sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExtensions.scala ## @@ -42,6 +42,7 @@ import

[GitHub] [spark] beliefer commented on a change in pull request #34779: [SPARK-37518][SQL] Inject a early scan pushdown rule

beliefer commented on a change in pull request #34779: URL: https://github.com/apache/spark/pull/34779#discussion_r764564803 ## File path: sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExtensions.scala ## @@ -42,6 +42,7 @@ import

[GitHub] [spark] SparkQA removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988548580 **[Test build #145998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145998/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988556566 **[Test build #145998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145998/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

SparkQA removed a comment on pull request #34821: URL: https://github.com/apache/spark/pull/34821#issuecomment-988548671 **[Test build #146000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146000/testReport)** for PR 34821 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AmplabJenkins commented on pull request #34821: URL: https://github.com/apache/spark/pull/34821#issuecomment-988556473 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146000/ -- This

[GitHub] [spark] SparkQA commented on pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

SparkQA commented on pull request #34821: URL: https://github.com/apache/spark/pull/34821#issuecomment-988556237 **[Test build #146000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146000/testReport)** for PR 34821 at commit

[GitHub] [spark] SparkQA commented on pull request #34800: [SPARK-37538][SQL] Replace single projection expand

SparkQA commented on pull request #34800: URL: https://github.com/apache/spark/pull/34800#issuecomment-988550569 **[Test build #146001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146001/testReport)** for PR 34800 at commit

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988548851 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50473/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

SparkQA commented on pull request #34821: URL: https://github.com/apache/spark/pull/34821#issuecomment-988548671 **[Test build #146000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146000/testReport)** for PR 34821 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988548580 **[Test build #145998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145998/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988548579 **[Test build #145999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145999/testReport)** for PR 34830 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988546899 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145996/

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988547067 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50472/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988546899 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145996/ -- This

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764589312 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] SparkQA commented on pull request #34800: [SPARK-37538][SQL] Replace single projection expand

SparkQA commented on pull request #34800: URL: https://github.com/apache/spark/pull/34800#issuecomment-988543868 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50471/ -- This is an automated message from the Apache

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764587205 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764585381 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764584923 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764584736 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764584652 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988540070 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50470/ -- This is an automated message from the Apache

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764583923 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764583523 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764583261 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764582471 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

AngersZh commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764581331 ## File path: docs/index.md ## @@ -111,6 +111,7 @@ options for deployment: * [GraphX](graphx-programming-guide.html): processing graphs *

[GitHub] [spark] AngersZhuuuu commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AngersZh commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988535918 > @AngersZh Can you describe how to reproduce this issue in pr description? When change to our internal hadoop version and failed to donwload the hadoop

[GitHub] [spark] AngersZhuuuu commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AngersZh commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988535244 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988525801 **[Test build #145996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145996/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988532885 **[Test build #145996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145996/testReport)** for PR 34832 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988529271 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145994/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988522146 **[Test build #145994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145994/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988529101 **[Test build #145994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145994/testReport)** for PR 34832 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

AmplabJenkins removed a comment on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988529271 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145994/

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988528024 **[Test build #145997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145997/testReport)** for PR 34695 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988525801 **[Test build #145996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145996/testReport)** for PR 34832 at commit

[GitHub] [spark] SparkQA commented on pull request #34800: [SPARK-37538][SQL] Replace single projection expand

SparkQA commented on pull request #34800: URL: https://github.com/apache/spark/pull/34800#issuecomment-988523863 **[Test build #145995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145995/testReport)** for PR 34800 at commit

[GitHub] [spark] SparkQA commented on pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

SparkQA commented on pull request #34832: URL: https://github.com/apache/spark/pull/34832#issuecomment-988522146 **[Test build #145994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145994/testReport)** for PR 34832 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AmplabJenkins removed a comment on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988520512 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

AmplabJenkins removed a comment on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988520513 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145992/

[GitHub] [spark] AmplabJenkins commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AmplabJenkins commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988520514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

AmplabJenkins commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988520513 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145992/ -- This

[GitHub] [spark] dongjoon-hyun opened a new pull request #34832: [SPARK-37576][K8S] Support built-in K8s executor rolling plugin

dongjoon-hyun opened a new pull request #34832: URL: https://github.com/apache/spark/pull/34832 ### What changes were proposed in this pull request? This PR aims to add a built-in plugin for K8s executor rolling decommission via the following. ```

[GitHub] [spark] beliefer commented on a change in pull request #34779: [SPARK-37518][SQL] Inject a early scan pushdown rule

beliefer commented on a change in pull request #34779: URL: https://github.com/apache/spark/pull/34779#discussion_r764564803 ## File path: sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExtensions.scala ## @@ -42,6 +42,7 @@ import

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988514566 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50469/ -- This is an automated message from the

[GitHub] [spark] dongjoon-hyun commented on pull request #34827: [SPARK-37565][TESTS] Upgrade mysql-connector-java to 8.0.27

dongjoon-hyun commented on pull request #34827: URL: https://github.com/apache/spark/pull/34827#issuecomment-988513479 @LuciferYang . Yes, for JDK issue, please file a deprecation JIRA updating the following Spark website. If there is a reason, as you pointed out, we can discuss and bump

[GitHub] [spark] SparkQA removed a comment on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA removed a comment on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988449398 **[Test build #145992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145992/testReport)** for PR 34695 at commit

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988510379 **[Test build #145992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145992/testReport)** for PR 34695 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA removed a comment on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988474075 **[Test build #145993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145993/testReport)** for PR 34830 at commit

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988506276 **[Test build #145993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145993/testReport)** for PR 34830 at commit

[GitHub] [spark] cloud-fan commented on pull request #34823: [SPARK-37392][SQL] Fix the performance bug when inferring constraints for Generate

cloud-fan commented on pull request #34823: URL: https://github.com/apache/spark/pull/34823#issuecomment-988503275 thanks for the view, merging to master/3.2/3.1! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [spark] cloud-fan closed pull request #34823: [SPARK-37392][SQL] Fix the performance bug when inferring constraints for Generate

cloud-fan closed pull request #34823: URL: https://github.com/apache/spark/pull/34823 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] LuciferYang commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

LuciferYang commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988501906 @AngersZh Can you describe how to reproduce this issue in pr description? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon commented on pull request #34212: [SPARK-36402][PYTHON] Implement Series.combine

HyukjinKwon commented on pull request #34212: URL: https://github.com/apache/spark/pull/34212#issuecomment-988500748 cc @itholic @xinrong-databricks @Yikun would you mind reviewing this when you find some time please  -- This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon closed pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

HyukjinKwon closed pull request #34774: URL: https://github.com/apache/spark/pull/34774 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] LuciferYang commented on pull request #34829: [WIP][SPARK-23607][CORE] Use HDFS extended attributes to store application summary information in SHS

LuciferYang commented on pull request #34829: URL: https://github.com/apache/spark/pull/34829#issuecomment-988499023 > Improves the performance of the History Server listing page Can you show the performance comparison before and after this pr? -- This is an automated

[GitHub] [spark] HyukjinKwon commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

HyukjinKwon commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-988498834 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins commented on pull request #34831: [SPARK-37574][CORE][SHUFFLE] Simplify fetchBlocks w/o retry

AmplabJenkins commented on pull request #34831: URL: https://github.com/apache/spark/pull/34831#issuecomment-988497551 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

AmplabJenkins removed a comment on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988496878 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50468/

[GitHub] [spark] AmplabJenkins commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

AmplabJenkins commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988496878 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50468/ --

[GitHub] [spark] pan3793 opened a new pull request #34831: [SPARK-37574][CORE][SHUFFLE] Simplify fetchBlocks w/o retry

pan3793 opened a new pull request #34831: URL: https://github.com/apache/spark/pull/34831 ### What changes were proposed in this pull request? Simplify code of fetchBlocks w/o retry ### Why are the changes needed? Simplify code. The original code added in

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988491706 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50469/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988491693 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50468/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

SparkQA commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988474075 **[Test build #145993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145993/testReport)** for PR 34830 at commit

[GitHub] [spark] AngersZhuuuu opened a new pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AngersZh opened a new pull request #34830: URL: https://github.com/apache/spark/pull/34830 ### What changes were proposed in this pull request? When profile is `hadoop-3`, in current code it still fallback to `2.7.4` and throw below exception ``` [info]

[GitHub] [spark] AngersZhuuuu commented on pull request #34830: [SPARK-37573][SQL] IsolatedClientLoader should fallback to related version, not always hadoop-2.7.4

AngersZh commented on pull request #34830: URL: https://github.com/apache/spark/pull/34830#issuecomment-988473418 ping @sunchao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] stczwd commented on a change in pull request #34810: [SPARK-37549][SQL] Support set parallel through data source properties

stczwd commented on a change in pull request #34810: URL: https://github.com/apache/spark/pull/34810#discussion_r764528223 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -608,7 +608,8 @@ case class FileSourceScanExec(

[GitHub] [spark] beliefer commented on a change in pull request #34799: [SPARK-37527][SQL] Translate more standard aggregate functions for pushdown

beliefer commented on a change in pull request #34799: URL: https://github.com/apache/spark/pull/34799#discussion_r764527964 ## File path: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala ## @@ -208,6 +208,9 @@ abstract class JdbcDialect extends

[GitHub] [spark] LuciferYang commented on a change in pull request #34829: [WIP][SPARK-23607][CORE] Use HDFS extended attributes to store application summary information in SHS

LuciferYang commented on a change in pull request #34829: URL: https://github.com/apache/spark/pull/34829#discussion_r764527144 ## File path: core/src/main/scala/org/apache/spark/deploy/history/EventLogFileWriters.scala ## @@ -229,6 +232,15 @@ class SingleEventLogFileWriter(

[GitHub] [spark] SparkQA commented on pull request #34695: [SPARK-32446][CORE] Add percentile distribution REST API & UI of peak memory metrics for all executors

SparkQA commented on pull request #34695: URL: https://github.com/apache/spark/pull/34695#issuecomment-988468822 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50468/ -- This is an automated message from the Apache

[GitHub] [spark] srowen commented on a change in pull request #34821: [SPARK-37558][DOC] Improve spark sql cli document

srowen commented on a change in pull request #34821: URL: https://github.com/apache/spark/pull/34821#discussion_r764520505 ## File path: docs/sql-distributed-sql-engine-spark-sql-cli.md ## @@ -0,0 +1,185 @@ +--- +layout: global +title: Spark SQL CLI +displayTitle: Spark SQL

[GitHub] [spark] LuciferYang edited a comment on pull request #34827: [SPARK-37565][TESTS] Upgrade mysql-connector-java to 8.0.27

LuciferYang edited a comment on pull request #34827: URL: https://github.com/apache/spark/pull/34827#issuecomment-988454118 @wangyum @dongjoon-hyun From - https://dev.mysql.com/doc/connector-j/8.0/en/connector-j-versions.html -

[GitHub] [spark] LuciferYang edited a comment on pull request #34827: [SPARK-37565][TESTS] Upgrade mysql-connector-java to 8.0.27

LuciferYang edited a comment on pull request #34827: URL: https://github.com/apache/spark/pull/34827#issuecomment-988454118 From - https://dev.mysql.com/doc/connector-j/8.0/en/connector-j-versions.html - https://dev.mysql.com/doc/connector-j/5.1/en/connector-j-versions.html

[GitHub] [spark] LuciferYang commented on pull request #34827: [SPARK-37565][TESTS] Upgrade mysql-connector-java to 8.0.27

LuciferYang commented on pull request #34827: URL: https://github.com/apache/spark/pull/34827#issuecomment-988454118 Can the client of mysql 8.x be used to connect to the server of mysql 5.x? -- This is an automated message from the Apache Git Service. To respond to the message,

  1   2   3   >