[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894616247 **[Test build #142188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142188/testReport)** for PR 33650 at commit [`4d2c4e1`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

SparkQA commented on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894619835 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46699/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894620736 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46700/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33667: [SPARK-36339][SQL][3.1] References to grouping that not part of aggregation should be replaced

AmplabJenkins commented on pull request #33667: URL: https://github.com/apache/spark/pull/33667#issuecomment-894621631 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins commented on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

AmplabJenkins commented on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894621626 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46699/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

AmplabJenkins removed a comment on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894621626 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46699/

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894624421 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46700/ -- T

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894624416 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46700/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894624421 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46700/

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894626604 **[Test build #142188 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142188/testReport)** for PR 33650 at commit [`4d2c4e1`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

SparkQA removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894616247 **[Test build #142188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142188/testReport)** for PR 33650 at commit [`4d2c4e1`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33669: [SPARK-36339][SQL][3.0] References to grouping that not part of aggregation should be replaced

SparkQA commented on pull request #33669: URL: https://github.com/apache/spark/pull/33669#issuecomment-894626791 **[Test build #142186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142186/testReport)** for PR 33669 at commit [`504fe8c`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33669: [SPARK-36339][SQL][3.0] References to grouping that not part of aggregation should be replaced

SparkQA removed a comment on pull request #33669: URL: https://github.com/apache/spark/pull/33669#issuecomment-894605713 **[Test build #142186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142186/testReport)** for PR 33669 at commit [`504fe8c`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894627462 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142188/ -- This

[GitHub] [spark] SparkQA commented on pull request #33583: [SPARK-36352][SQL] Spark should check result plan's output schema name

SparkQA commented on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-894627463 **[Test build #142185 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142185/testReport)** for PR 33583 at commit [`e1485f6`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #33669: [SPARK-36339][SQL][3.0] References to grouping that not part of aggregation should be replaced

AmplabJenkins commented on pull request #33669: URL: https://github.com/apache/spark/pull/33669#issuecomment-894627461 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142186/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33583: [SPARK-36352][SQL] Spark should check result plan's output schema name

SparkQA removed a comment on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-894602083 **[Test build #142185 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142185/testReport)** for PR 33583 at commit [`e1485f6`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in pushFilters

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894627462 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142188/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33669: [SPARK-36339][SQL][3.0] References to grouping that not part of aggregation should be replaced

AmplabJenkins removed a comment on pull request #33669: URL: https://github.com/apache/spark/pull/33669#issuecomment-894615938 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins commented on pull request #33583: [SPARK-36352][SQL] Spark should check result plan's output schema name

AmplabJenkins commented on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-894627740 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142185/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33583: [SPARK-36352][SQL] Spark should check result plan's output schema name

AmplabJenkins removed a comment on pull request #33583: URL: https://github.com/apache/spark/pull/33583#issuecomment-894627740 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142185/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33659: [SPARK-36433][WEBUI] Fix log message in WebUI

AmplabJenkins commented on pull request #33659: URL: https://github.com/apache/spark/pull/33659#issuecomment-894633750 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] SparkQA commented on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

SparkQA commented on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894639278 **[Test build #142187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142187/testReport)** for PR 33651 at commit [`6f28a37`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

SparkQA removed a comment on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894611001 **[Test build #142187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142187/testReport)** for PR 33651 at commit [`6f28a37`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

AmplabJenkins commented on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894639483 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142187/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33651: [SPARK-36424][SQL] Support eliminate limits in AQE Optimizer

AmplabJenkins removed a comment on pull request #33651: URL: https://github.com/apache/spark/pull/33651#issuecomment-894639483 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142187/ -

[GitHub] [spark] Shockang opened a new pull request #33674: [WIP][Spark-36328][SQL] Reuse the FileSystem delegation token while querying partitioned hive table.

Shockang opened a new pull request #33674: URL: https://github.com/apache/spark/pull/33674 ### What changes were proposed in this pull request? Add the credentials from previous JobConf into the new JobConf to reuse the FileSystem Delegation Token. ### Why are the changes need

[GitHub] [spark] AmplabJenkins commented on pull request #33674: [WIP][Spark-36328][CORE][SQL] Reuse the FileSystem delegation token while querying partitioned hive table.

AmplabJenkins commented on pull request #33674: URL: https://github.com/apache/spark/pull/33674#issuecomment-894652060 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] this edited a comment on pull request #33656: [SPARK-36432][BUILD] Upgrade Jetty version to 9.4.43

this edited a comment on pull request #33656: URL: https://github.com/apache/spark/pull/33656#issuecomment-894471577 @dongjoon-hyun I'm a newbie to the Spark project, so thank you very much for informing me about the process :) I wasn't sure about who will/should do the PR merging, that's

[GitHub] [spark] planga82 commented on a change in pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

planga82 commented on a change in pull request #33672: URL: https://github.com/apache/spark/pull/33672#discussion_r684642394 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ## @@ -470,6 +474,14 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] [spark] planga82 commented on a change in pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

planga82 commented on a change in pull request #33672: URL: https://github.com/apache/spark/pull/33672#discussion_r684643101 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ## @@ -449,6 +452,7 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] [spark] dongjoon-hyun commented on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

dongjoon-hyun commented on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894673676 Retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [spark] SparkQA commented on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

SparkQA commented on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894674229 **[Test build #142189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142189/testReport)** for PR 33624 at commit [`f768a3f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

SparkQA commented on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894678066 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46701/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

AmplabJenkins commented on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894679070 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46701/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

AmplabJenkins removed a comment on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894679070 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46701/

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894687177 **[Test build #142190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142190/testReport)** for PR 33650 at commit [`1d3a3ef`](https://github.com

[GitHub] [spark] mridulm commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

mridulm commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894691457 Ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894692213 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46702/ -- This is an automated message from the Apache

[GitHub] [spark] akpatnam25 commented on pull request #33644: [SPARK-36419][CORE]: Optionally move final aggregation in RDD.treeAggregate to executor

akpatnam25 commented on pull request #33644: URL: https://github.com/apache/spark/pull/33644#issuecomment-894693640 for example, below is a snippet of a case that we would want to safeguard against: ``` def createValue() = new Array[Byte](180 * 1024 * 1024) def createRdd(n: Int) =

[GitHub] [spark] akpatnam25 removed a comment on pull request #33644: [SPARK-36419][CORE]: Optionally move final aggregation in RDD.treeAggregate to executor

akpatnam25 removed a comment on pull request #33644: URL: https://github.com/apache/spark/pull/33644#issuecomment-894693640 for example, below is a snippet of a case that we would want to safeguard against: ``` def createValue() = new Array[Byte](180 * 1024 * 1024) def createRdd(n

[GitHub] [spark] akpatnam25 commented on pull request #33644: [SPARK-36419][CORE]: Optionally move final aggregation in RDD.treeAggregate to executor

akpatnam25 commented on pull request #33644: URL: https://github.com/apache/spark/pull/33644#issuecomment-894694073 for example, below is a snippet of a case that we would want to safeguard against: ``` def createValue() = new Array[Byte](180 * 1024 * 1024) def createRdd(n: Int) =

[GitHub] [spark] SparkQA commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

SparkQA commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894694385 **[Test build #142191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142191/testReport)** for PR 33613 at commit [`51841e4`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

AmplabJenkins removed a comment on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-891405357 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894698762 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46702/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

SparkQA commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894699650 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46703/ -- This is an automated message from the Apache

[GitHub] [spark] haodemon opened a new pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

haodemon opened a new pull request #33675: URL: https://github.com/apache/spark/pull/33675 ### What changes were proposed in this pull request? This change allows a spark user to provide a class which implements fabric's OAuthTokenProvider to refresh tokens throughout the life of the

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894700816 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46702/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

AmplabJenkins commented on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894700846 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894700816 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46702/

[GitHub] [spark] AmplabJenkins commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

AmplabJenkins commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894703394 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46703/ -- T

[GitHub] [spark] SparkQA commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

SparkQA commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894703389 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46703/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

AmplabJenkins removed a comment on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894703394 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46703/

[GitHub] [spark] SparkQA commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

SparkQA commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894705920 **[Test build #142191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142191/testReport)** for PR 33613 at commit [`51841e4`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

SparkQA removed a comment on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894694385 **[Test build #142191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142191/testReport)** for PR 33613 at commit [`51841e4`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

SparkQA commented on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894706001 **[Test build #142189 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142189/testReport)** for PR 33624 at commit [`f768a3f`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

SparkQA removed a comment on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894674229 **[Test build #142189 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142189/testReport)** for PR 33624 at commit [`f768a3f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894706284 **[Test build #142190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142190/testReport)** for PR 33650 at commit [`1d3a3ef`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894687177 **[Test build #142190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142190/testReport)** for PR 33650 at commit [`1d3a3ef`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894706359 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142190/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

AmplabJenkins commented on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894706363 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142189/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

AmplabJenkins commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894706364 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142191/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33624: [SPARK-35881][SQL][FOLLOWUP] Add a boolean flag in AdaptiveSparkPlanExec to ask for columnar output

AmplabJenkins removed a comment on pull request #33624: URL: https://github.com/apache/spark/pull/33624#issuecomment-894706363 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142189/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

AmplabJenkins removed a comment on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894706364 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142191/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-894706359 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142190/ -

[GitHub] [spark] Victsm commented on pull request #33613: [SPARK-36378][SHUFFLE] Switch to using RPCResponse to communicate common block push failures to the client.

Victsm commented on pull request #33613: URL: https://github.com/apache/spark/pull/33613#issuecomment-894707454 The test failure does not seem related to this patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [spark] github-actions[bot] closed pull request #32341: [SPARK-35212][Spark Core][DStreams] Another way to added PreferRandom for the scenario that topic partitions need to be randomly distri

github-actions[bot] closed pull request #32341: URL: https://github.com/apache/spark/pull/32341 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: re

[GitHub] [spark] imback82 opened a new pull request #33676: [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check duplicates for the user specified columns

imback82 opened a new pull request #33676: URL: https://github.com/apache/spark/pull/33676 ### What changes were proposed in this pull request? Currently, v2 ALTER TABLE REPLACE COLUMNS does not check duplicates for the user specified columns. For example, ``` spark.sq

[GitHub] [spark] imback82 commented on a change in pull request #33676: [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check duplicates for the user specified columns

imback82 commented on a change in pull request #33676: URL: https://github.com/apache/spark/pull/33676#discussion_r684720046 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala ## @@ -940,26 +940,33 @@ trait CheckAnalysis extend

[GitHub] [spark] SparkQA commented on pull request #33676: [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check duplicates for the user specified columns

SparkQA commented on pull request #33676: URL: https://github.com/apache/spark/pull/33676#issuecomment-894748639 **[Test build #142192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142192/testReport)** for PR 33676 at commit [`e91d7f9`](https://github.com

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

dongjoon-hyun commented on a change in pull request #33675: URL: https://github.com/apache/spark/pull/33675#discussion_r684721028 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -147,6 +147,15 @@ private[spark] obje

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

dongjoon-hyun commented on a change in pull request #33675: URL: https://github.com/apache/spark/pull/33675#discussion_r684721042 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -147,6 +147,15 @@ private[spark] obje

[GitHub] [spark] dongjoon-hyun commented on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

dongjoon-hyun commented on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894749304 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

AmplabJenkins removed a comment on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894700846 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] SparkQA commented on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

SparkQA commented on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894749571 **[Test build #142193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142193/testReport)** for PR 33675 at commit [`7b0f6c3`](https://github.com

[GitHub] [spark] imback82 opened a new pull request #33677: [SPARK-36450][SQL] Remove unused UnresolvedV2Relation

imback82 opened a new pull request #33677: URL: https://github.com/apache/spark/pull/33677 ### What changes were proposed in this pull request? Now that all the commands that use `UnresolvedV2Relation` have been migrated to use `UnresolvedTable` and `UnresolvedView` (e.g, #33

[GitHub] [spark] SparkQA commented on pull request #33677: [SPARK-36450][SQL] Remove unused UnresolvedV2Relation

SparkQA commented on pull request #33677: URL: https://github.com/apache/spark/pull/33677#issuecomment-894750421 **[Test build #142194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142194/testReport)** for PR 33677 at commit [`d63e882`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

SparkQA commented on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894750748 **[Test build #142193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142193/testReport)** for PR 33675 at commit [`7b0f6c3`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

SparkQA removed a comment on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894749571 **[Test build #142193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142193/testReport)** for PR 33675 at commit [`7b0f6c3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33676: [SPARK-36449][SQL] v2 ALTER TABLE REPLACE COLUMNS should check duplicates for the user specified columns

SparkQA commented on pull request #33676: URL: https://github.com/apache/spark/pull/33676#issuecomment-894752348 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46704/ -- This is an automated message from the Apache

[GitHub] [spark] viirya commented on a change in pull request #33583: [SPARK-36352][SQL] Spark should check result plan's output schema name

viirya commented on a change in pull request #33583: URL: https://github.com/apache/spark/pull/33583#discussion_r684726566 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SchemaPruning.scala ## @@ -143,15 +145,15 @@ object SchemaPruning extends

[GitHub] [spark] SparkQA commented on pull request #33675: [SPARK-27997][K8S] Add support for kubernetes OAuth Token refresh

SparkQA commented on pull request #33675: URL: https://github.com/apache/spark/pull/33675#issuecomment-894753259 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46705/ -- This is an automated message from the Apache