[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728339734 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35776/ ---

[GitHub] [spark] HeartSaVioR commented on pull request #30366: [WIP][SPARK-33440][CORE] Separate the calculation for the next renewal date for each delegation token

HeartSaVioR commented on pull request #30366: URL: https://github.com/apache/spark/pull/30366#issuecomment-728339051 Ah yes you're right. I should have clarified the boundary of change - HadoopFS provider is only affected. Let me add the information in PR title. Regarding considering

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728338407 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728338399 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728338399 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728334100 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728334094 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728334094 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728334075 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35775/ ---

[GitHub] [spark] HeartSaVioR commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

HeartSaVioR commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r524584305 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class Un

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728327420 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35776/ -

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728323043 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35775/ -

[GitHub] [spark] dongjoon-hyun commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

dongjoon-hyun commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-728314803 Sorry for the delay, @ScrapCodes . This feature and the related JIRAs are targeting at Apache Spark 3.1, right? --

[GitHub] [spark] dongjoon-hyun commented on pull request #29843: [SPARK-33212][BUILD] Move to shaded clients for Hadoop 3.x profile

dongjoon-hyun commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-728312121 If that's the Hadoop community's recommendation, +1 for 3.2.2. This is an automated message from the Apach

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728301817 **[Test build #131176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131176/testReport)** for PR 29959 at commit [`cb76047`](https://github.com

[GitHub] [spark] cloud-fan commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

cloud-fan commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-728300096 Hi @rdblue , I created a PR against your branch to address my review comments (PR: https://github.com/rdblue/spark/pull/8), to save your time and speed up the progress here. C

[GitHub] [spark] sunchao commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

sunchao commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728298851 @holdenk sure - it's done. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728295434 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728298010 **[Test build #131175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131175/testReport)** for PR 29959 at commit [`be1517e`](https://github.com

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524541577 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728294989 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] holdenk commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

holdenk commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728295596 Can you rebase this? This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728294979 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728294979 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728295428 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] holdenk commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

holdenk commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728294558 Jenkins retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524527610 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524527610 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] sunchao commented on pull request #29843: [SPARK-33212][BUILD] Move to shaded clients for Hadoop 3.x profile

sunchao commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-728282002 Thanks @steveloughran for sharing the info! Totally agree. Yes my current plan is to wait until 3.2.2 comes out and then upgrade Spark to use that, and hope community will agree

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30386: [SPARK-33460][SQL] Accessing map values should fail if key is not found

AmplabJenkins removed a comment on pull request #30386: URL: https://github.com/apache/spark/pull/30386#issuecomment-728278125 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30386: [SPARK-33460][SQL] Accessing map values should fail if key is not found

AmplabJenkins commented on pull request #30386: URL: https://github.com/apache/spark/pull/30386#issuecomment-728278125 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #30386: [SPARK-33460][SQL] Accessing map values should fail if key is not found

SparkQA removed a comment on pull request #30386: URL: https://github.com/apache/spark/pull/30386#issuecomment-728105138 **[Test build #131165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131165/testReport)** for PR 30386 at commit [`9e29957`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30386: [SPARK-33460][SQL] Accessing map values should fail if key is not found

SparkQA commented on pull request #30386: URL: https://github.com/apache/spark/pull/30386#issuecomment-728277078 **[Test build #131165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131165/testReport)** for PR 30386 at commit [`9e29957`](https://github.co

[GitHub] [spark] tgravescs commented on pull request #30375: [SPARK-33288][YARN][FOLLOW-UP][test-hadoop2.7] Fix type mismatch error

tgravescs commented on pull request #30375: URL: https://github.com/apache/spark/pull/30375#issuecomment-728270233 sorry missed your comment @mridulm yeah we can just use int since this are all MiB, I'll file a followup and put up a PR.

[GitHub] [spark] mridulm commented on pull request #30375: [SPARK-33288][YARN][FOLLOW-UP][test-hadoop2.7] Fix type mismatch error

mridulm commented on pull request #30375: URL: https://github.com/apache/spark/pull/30375#issuecomment-728255740 @tgravescs any thoughts on this [comment](https://github.com/apache/spark/pull/30375#issuecomment-727223861) ? This probably got merged before you got to it. ---

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524493885 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -69,6 +69,10 @@ private[mesos] class M

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524493206 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class Dr

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524492997 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class DriverPa

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524492958 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class Dr

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-728247476 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-728247471 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-728166990 **[Test build #131171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131171/testReport)** for PR 30145 at commit [`6fa8115`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-728247471 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524486298 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class DriverPa

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-728246949 **[Test build #131171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131171/testReport)** for PR 30145 at commit [`6fa8115`](https://github.co

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524486298 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class DriverPa

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524482948 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -374,6 +389,16 @@ p

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524484197 ## File path: resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala ## @@ -591,18 +591,1

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524482682 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -374,6 +389,16 @@ p

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524482948 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -374,6 +389,16 @@ p

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524481281 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -131,6 +132,8 @@ pr

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524480032 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -99,6 +103,12 @@ private[mesos]

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524480114 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -99,6 +103,12 @@ private[mesos]

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524479806 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -69,6 +69,10 @@ private[mesos] c

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524479062 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -69,6 +69,10 @@ private[mesos] c

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524478849 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class Dr

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

AmplabJenkins removed a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728234617 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

AmplabJenkins commented on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728234617 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

SparkQA removed a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728128590 **[Test build #131168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131168/testReport)** for PR 30234 at commit [`2f37009`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

SparkQA commented on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728233353 **[Test build #131168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131168/testReport)** for PR 30234 at commit [`2f37009`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

AmplabJenkins removed a comment on pull request #30299: URL: https://github.com/apache/spark/pull/30299#issuecomment-728229716 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins removed a comment on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728229489 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

AmplabJenkins commented on pull request #30299: URL: https://github.com/apache/spark/pull/30299#issuecomment-728229716 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728229489 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728229465 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35774/ ---

[GitHub] [spark] SparkQA removed a comment on pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

SparkQA removed a comment on pull request #30299: URL: https://github.com/apache/spark/pull/30299#issuecomment-727959594 **[Test build #131159 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131159/testReport)** for PR 30299 at commit [`99619e3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

SparkQA commented on pull request #30299: URL: https://github.com/apache/spark/pull/30299#issuecomment-728228508 **[Test build #131159 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131159/testReport)** for PR 30299 at commit [`99619e3`](https://github.co

[GitHub] [spark] holdenk commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

holdenk commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728227862 I meant to merge this awhile ago, my bad. Let's make sure everything still passes in CI. Jenkins retest this please. --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30389: [WIP][SPARK-33143][PYTHON] Add configurable timeout to python server and client

AmplabJenkins removed a comment on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-728227730 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30389: [WIP][SPARK-33143][PYTHON] Add configurable timeout to python server and client

AmplabJenkins removed a comment on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-728227722 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #30389: [WIP][SPARK-33143][PYTHON] Add configurable timeout to python server and client

AmplabJenkins commented on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-728227722 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30389: [WIP][SPARK-33143][PYTHON] Add configurable timeout to python server and client

SparkQA commented on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-728226970 **[Test build #131170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131170/testReport)** for PR 30389 at commit [`17d357b`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins removed a comment on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-728220162 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30389: [WIP][SPARK-33143][PYTHON] Add configurable timeout to python server and client

SparkQA removed a comment on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-728138231 **[Test build #131170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131170/testReport)** for PR 30389 at commit [`17d357b`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

SparkQA removed a comment on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-727959570 **[Test build #131158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131158/testReport)** for PR 30336 at commit [`a788234`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-728220162 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] huaxingao commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

huaxingao commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-728219896 @rf972 Hi Robert, I have the fix in. Could you continue your TPC benchmark testing? Please let me know if there are any issues. -

[GitHub] [spark] SparkQA commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

SparkQA commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-728219046 **[Test build #131158 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131158/testReport)** for PR 30336 at commit [`a788234`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728217003 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35774/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

AmplabJenkins removed a comment on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728208625 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

AmplabJenkins removed a comment on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728208610 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

AmplabJenkins commented on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728208610 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] pgillet commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728208235 > BTW, quick questions, @pgillet . Which Mesos versions are you using with Spark? Mesos 1.9.0 This is an

[GitHub] [spark] SparkQA removed a comment on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

SparkQA removed a comment on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728109783 **[Test build #131166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131166/testReport)** for PR 30309 at commit [`0f04af7`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

SparkQA commented on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728207722 **[Test build #131166 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131166/testReport)** for PR 30309 at commit [`0f04af7`](https://github.co

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30388: [WIP][SPARK-32222][K8s] Add K8s IT for conf propagation

dongjoon-hyun commented on a change in pull request #30388: URL: https://github.com/apache/spark/pull/30388#discussion_r524441719 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/SparkConfPropagateSuite.scala #

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30388: [WIP][SPARK-32222][K8s] Add K8s IT for conf propagation

dongjoon-hyun commented on a change in pull request #30388: URL: https://github.com/apache/spark/pull/30388#discussion_r524439977 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesSuite.scala ## @@

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30388: [WIP][SPARK-32222][K8s] Add K8s IT for conf propagation

dongjoon-hyun edited a comment on pull request #30388: URL: https://github.com/apache/spark/pull/30388#issuecomment-728203026 :) You are hitting at the known security breaking change from Minikube side. It occurs long time ago. Please try to do the following as a workaround, @ScrapCodes .

[GitHub] [spark] dongjoon-hyun commented on pull request #30388: [WIP][SPARK-32222][K8s] Add K8s IT for conf propagation

dongjoon-hyun commented on pull request #30388: URL: https://github.com/apache/spark/pull/30388#issuecomment-728203026 :) You are hitting at the known security breaking change from Minikube side. It occurs long time ago. Please try to do the following as a workaround, @ScrapCodes . It will

[GitHub] [spark] dongjoon-hyun commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728200808 BTW, quick questions, @pgillet . Which Mesos versions are you using with Spark? This is an automated mess

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

AmplabJenkins removed a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728198844 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728199022 Thank you so much for your updating, @pgillet . This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins commented on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

AmplabJenkins commented on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728198844 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins removed a comment on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728198181 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA removed a comment on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728190476 **[Test build #131172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131172/testReport)** for PR 30352 at commit [`93250a7`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728198181 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728197936 **[Test build #131172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131172/testReport)** for PR 30352 at commit [`93250a7`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

SparkQA removed a comment on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728045367 **[Test build #131162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131162/testReport)** for PR 30234 at commit [`664b464`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

SparkQA commented on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-728197176 **[Test build #131162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131162/testReport)** for PR 30234 at commit [`664b464`](https://github.co

[GitHub] [spark] viirya commented on a change in pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

viirya commented on a change in pull request #30368: URL: https://github.com/apache/spark/pull/30368#discussion_r524429611 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1452,11 +1452,27 @@ object PushPredicateThroughJo

<    1   2   3   4   5   6   7   8   9   10   >