[GitHub] [spark] Ngone51 commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external

Ngone51 commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524830528 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,44 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

HyukjinKwon commented on a change in pull request #30351: URL: https://github.com/apache/spark/pull/30351#discussion_r524830616 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala ## @@ -894,10 +893,6 @@ trait ScalaReflection extends L

[GitHub] [spark] AmplabJenkins commented on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

AmplabJenkins commented on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-728629465 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

AmplabJenkins removed a comment on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-728629465 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu edited a comment on pull request #30342: [MINOR][GRAPHX][3.0] Correct typos in the sub-modules: graphx, external, and examples

maropu edited a comment on pull request #30342: URL: https://github.com/apache/spark/pull/30342#issuecomment-728628039 > @maropu do you really think we need to backport? that is generally only for bug fixes. It's not a huge deal either way but not sure we should do that in general.

[GitHub] [spark] SparkQA commented on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

SparkQA commented on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-728629452 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35784/ ---

[GitHub] [spark] maropu commented on pull request #30300: [SPARK-33399][SQL] Normalize output partitioning and sortorder with respect to aliases to avoid unneeded exchange/sort nodes

maropu commented on pull request #30300: URL: https://github.com/apache/spark/pull/30300#issuecomment-728629017 Thanks! Merged to master. This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [spark] maropu closed pull request #30300: [SPARK-33399][SQL] Normalize output partitioning and sortorder with respect to aliases to avoid unneeded exchange/sort nodes

maropu closed pull request #30300: URL: https://github.com/apache/spark/pull/30300 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] maropu edited a comment on pull request #30342: [MINOR][GRAPHX][3.0] Correct typos in the sub-modules: graphx, external, and examples

maropu edited a comment on pull request #30342: URL: https://github.com/apache/spark/pull/30342#issuecomment-728628039 > @maropu do you really think we need to backport? that is generally only for bug fixes. It's not a huge deal either way but not sure we should do that in general.

[GitHub] [spark] maropu commented on pull request #30342: [MINOR][GRAPHX][3.0] Correct typos in the sub-modules: graphx, external, and examples

maropu commented on pull request #30342: URL: https://github.com/apache/spark/pull/30342#issuecomment-728628039 > @maropu do you really think we need to backport? that is generally only for bug fixes. It's not a huge deal either way but not sure we should do that in general. Ah, I s

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

AmplabJenkins removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-728626793 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle serv

SparkQA commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-728626727 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35783/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffl

AmplabJenkins commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-728626793 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30335: [SPARK-33422][DOC] Fix the correct display of left menu item

HyukjinKwon commented on a change in pull request #30335: URL: https://github.com/apache/spark/pull/30335#discussion_r524824100 ## File path: docs/css/main.css ## @@ -325,6 +325,7 @@ a.anchorjs-link:hover { text-decoration: none; } border-bottom-width: 0px; margin-top: 0p

[GitHub] [spark] SparkQA commented on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

SparkQA commented on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728615285 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35785/ -

[GitHub] [spark] SparkQA commented on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

SparkQA commented on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-728589772 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35784/ -

[GitHub] [spark] SparkQA commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle serv

SparkQA commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-728587660 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35783/ -

[GitHub] [spark] SparkQA commented on pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

SparkQA commented on pull request #30341: URL: https://github.com/apache/spark/pull/30341#issuecomment-728582517 **[Test build #131184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131184/testReport)** for PR 30341 at commit [`db115d6`](https://github.com

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r524815671 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/SubExprEvaluationRuntimeSuite.scala ## @@ -0,0 +1,99 @@ +/* + * Licens

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r524808901 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SubExprEvaluationRuntime.scala ## @@ -0,0 +1,126 @@ +/* + * Licensed t

[GitHub] [spark] dongjoon-hyun commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728570306 You are added to the Apache Spark contributor group and SPARK-23499 is assigned to you. Welcome to the Apache Spark community.

[GitHub] [spark] dongjoon-hyun closed pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

dongjoon-hyun closed pull request #30352: URL: https://github.com/apache/spark/pull/30352 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] maropu commented on pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

maropu commented on pull request #30381: URL: https://github.com/apache/spark/pull/30381#issuecomment-728559747 Thanks for adding it, @viirya ! This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [spark] maropu commented on a change in pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

maropu commented on a change in pull request #30368: URL: https://github.com/apache/spark/pull/30368#discussion_r524811988 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1452,11 +1452,27 @@ object PushPredicateThroughJo

[GitHub] [spark] SparkQA commented on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

SparkQA commented on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728541193 **[Test build #131183 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131183/testReport)** for PR 30309 at commit [`0f04af7`](https://github.com

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r524808901 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SubExprEvaluationRuntime.scala ## @@ -0,0 +1,126 @@ +/* + * Licensed t

[GitHub] [spark] HyukjinKwon commented on pull request #30309: [SPARK-33407][PYTHON] Simplify the exception message from Python UDFs (disabled by default)

HyukjinKwon commented on pull request #30309: URL: https://github.com/apache/spark/pull/30309#issuecomment-728534343 retest this please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] github-actions[bot] closed pull request #29018: [SPARK-32202][ML][WIP] tree models auto infer compact integer type

github-actions[bot] closed pull request #29018: URL: https://github.com/apache/spark/pull/29018 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [spark] github-actions[bot] closed pull request #28846: [SPARK-32012][SQL] Incrementally create and materialize query stage to avoid unnecessary local shuffle

github-actions[bot] closed pull request #28846: URL: https://github.com/apache/spark/pull/28846 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r524808398 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SubExprEvaluationRuntime.scala ## @@ -0,0 +1,126 @@ +/* + * Licensed t

[GitHub] [spark] ulysses-you commented on a change in pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

ulysses-you commented on a change in pull request #30368: URL: https://github.com/apache/spark/pull/30368#discussion_r524803284 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1452,11 +1452,27 @@ object PushPredicateThro

[GitHub] [spark] venkata91 commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

venkata91 commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524805840 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] SparkQA commented on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

SparkQA commented on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-728499246 **[Test build #131182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131182/testReport)** for PR 30368 at commit [`2f8f139`](https://github.com

[GitHub] [spark] ulysses-you commented on a change in pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

ulysses-you commented on a change in pull request #30368: URL: https://github.com/apache/spark/pull/30368#discussion_r524804089 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1452,11 +1452,27 @@ object PushPredicateThro

[GitHub] [spark] ulysses-you commented on a change in pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

ulysses-you commented on a change in pull request #30368: URL: https://github.com/apache/spark/pull/30368#discussion_r524803284 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1452,11 +1452,27 @@ object PushPredicateThro

[GitHub] [spark] viirya commented on a change in pull request #30341: [SPARK-33427][SQL] Add subexpression elimination for interpreted expression evaluation

viirya commented on a change in pull request #30341: URL: https://github.com/apache/spark/pull/30341#discussion_r524801521 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/SubExprEvaluationRuntimeSuite.scala ## @@ -0,0 +1,99 @@ +/* + * Licens

[GitHub] [spark] zero323 commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

zero323 commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-728483722 Off-topic: Does any of you have any thoughts about [http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-R-Adding-magrittr-as-a-dependency-for-SparkR-td30246.html](A

[GitHub] [spark] SparkQA commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle serv

SparkQA commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-728483251 **[Test build #131181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131181/testReport)** for PR 30164 at commit [`e320ac0`](https://github.com

[GitHub] [spark] zero323 edited a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

zero323 edited a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-728475705 In isolation it seems sensible. What bothers me though, is that `mutate` and `select` have different behavior. ```r > select(sql("SELECT * FROM range(1)"

[GitHub] [spark] zero323 commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

zero323 commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-728475705 In isolation it seems sensible. What bothers me though, is that `mutate` and `select` have different behavior. ```r > select(sql("SELECT * FROM range(1)"), log(

[GitHub] [spark] zero323 commented on a change in pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

zero323 commented on a change in pull request #28386: URL: https://github.com/apache/spark/pull/28386#discussion_r524793009 ## File path: R/pkg/R/DataFrame.R ## @@ -3444,7 +3445,8 @@ setMethod("as.data.frame", #' @note attach since 1.6.0 setMethod("attach", Review comment:

[GitHub] [spark] HeartSaVioR edited a comment on pull request #30366: [WIP][SPARK-33440][CORE] Separate the calculation for the next renewal date for each delegation token

HeartSaVioR edited a comment on pull request #30366: URL: https://github.com/apache/spark/pull/30366#issuecomment-728469839 FYI, fixing S3 identifier's invalid issue date is tracked via https://issues.apache.org/jira/browse/HADOOP-17379 The question remains, would we still want to ma

[GitHub] [spark] HeartSaVioR commented on pull request #30366: [WIP][SPARK-33440][CORE] Separate the calculation for the next renewal date for each delegation token

HeartSaVioR commented on pull request #30366: URL: https://github.com/apache/spark/pull/30366#issuecomment-728469839 FYI, fixing S3 identifier's invalid issue date is tracked via https://issues.apache.org/jira/browse/HADOOP-17379 The question remains, would we still want to make the

[GitHub] [spark] venkata91 commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

venkata91 commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524774597 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728443890 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35782/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins removed a comment on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728443964 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728443964 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728408290 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35782/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

AmplabJenkins removed a comment on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-728404969 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-728404911 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35781/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

AmplabJenkins commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-728404969 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

AmplabJenkins removed a comment on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728389362 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

AmplabJenkins commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728389362 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728389338 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35780/ ---

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-728384427 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35781/ -

[GitHub] [spark] SparkQA removed a comment on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA removed a comment on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728377294 **[Test build #131180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131180/testReport)** for PR 30352 at commit [`72e3966`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins removed a comment on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728381825 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

AmplabJenkins commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728381825 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728381692 **[Test build #131180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131180/testReport)** for PR 30352 at commit [`72e3966`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728380202 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35780/ -

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524705434 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -69,6 +69,10 @@ private[mesos] class M

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524705192 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/MesosClusterPage.scala ## @@ -99,6 +103,12 @@ private[mesos] class

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524705722 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala ## @@ -153,6 +153,11 @@ private[ui] class DriverPa

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524704610 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -131,6 +132,8 @@ private[

[GitHub] [spark] SparkQA commented on pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

SparkQA commented on pull request #30352: URL: https://github.com/apache/spark/pull/30352#issuecomment-728377294 **[Test build #131180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131180/testReport)** for PR 30352 at commit [`72e3966`](https://github.com

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524702208 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -374,6 +389,16 @@ private

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524701965 ## File path: resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala ## @@ -374,6 +389,16 @@ private

[GitHub] [spark] pgillet commented on a change in pull request #30352: [SPARK-23499][MESOS] Support for priority queues in Mesos scheduler

pgillet commented on a change in pull request #30352: URL: https://github.com/apache/spark/pull/30352#discussion_r524701699 ## File path: resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala ## @@ -591,18 +591,138 @@

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728376495 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728376486 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728301817 **[Test build #131176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131176/testReport)** for PR 29959 at commit [`cb76047`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728375583 **[Test build #131176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131176/testReport)** for PR 29959 at commit [`cb76047`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

AmplabJenkins removed a comment on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728372962 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

AmplabJenkins removed a comment on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728372948 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

AmplabJenkins commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728372948 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728372934 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35778/ ---

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-728367778 **[Test build #131179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131179/testReport)** for PR 29695 at commit [`da0be52`](https://github.com

[GitHub] [spark] HeartSaVioR commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

HeartSaVioR commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r524642595 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class Un

[GitHub] [spark] huaxingao commented on a change in pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

huaxingao commented on a change in pull request #29695: URL: https://github.com/apache/spark/pull/29695#discussion_r524675070 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2ScanRelationPushDown.scala ## @@ -73,33 +77,25 @@ object V2ScanRe

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728364429 **[Test build #131178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131178/testReport)** for PR 30347 at commit [`dfdfe42`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728362930 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35778/ -

[GitHub] [spark] c21 commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

c21 commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r524664948 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class Unsupporte

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728356886 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30390: [SPARK-33463][SQL] Spark Thrift Server, keep Job Id when using incremental collect

AmplabJenkins removed a comment on pull request #30390: URL: https://github.com/apache/spark/pull/30390#issuecomment-728356505 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728356803 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30390: [SPARK-33463][SQL] Spark Thrift Server, keep Job Id when using incremental collect

AmplabJenkins commented on pull request #30390: URL: https://github.com/apache/spark/pull/30390#issuecomment-728357007 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] SparkQA removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728298010 **[Test build #131175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131175/testReport)** for PR 29959 at commit [`be1517e`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728356803 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

SparkQA commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728356364 **[Test build #131175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131175/testReport)** for PR 29959 at commit [`be1517e`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #30390: [SPARK-33463][SQL] Spark Thrift Server, keep Job Id when using incremental collect

AmplabJenkins commented on pull request #30390: URL: https://github.com/apache/spark/pull/30390#issuecomment-728356505 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] gumartinm opened a new pull request #30390: [SPARK-33463][SQL] Spark Thrift Server, keep Job Id when using incremental collect

gumartinm opened a new pull request #30390: URL: https://github.com/apache/spark/pull/30390 ### What changes were proposed in this pull request? When enabling **spark.sql.thriftServer.incrementalCollect** Job Ids get lost and tracing queries in Spark Thrift Server ends up being too c

[GitHub] [spark] HeartSaVioR commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

HeartSaVioR commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r524642595 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class Un

[GitHub] [spark] HeartSaVioR commented on a change in pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

HeartSaVioR commented on a change in pull request #30336: URL: https://github.com/apache/spark/pull/30336#discussion_r524638775 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatisticsPage.scala ## @@ -199,49 +201,99 @@ private[ui] class

[GitHub] [spark] rf972 commented on a change in pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

rf972 commented on a change in pull request #29695: URL: https://github.com/apache/spark/pull/29695#discussion_r524623692 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2ScanRelationPushDown.scala ## @@ -73,33 +77,25 @@ object V2ScanRelati

[GitHub] [spark] SparkQA commented on pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

SparkQA commented on pull request #30347: URL: https://github.com/apache/spark/pull/30347#issuecomment-728342942 **[Test build #131177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131177/testReport)** for PR 30347 at commit [`f6fb679`](https://github.com

[GitHub] [spark] HeartSaVioR commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

HeartSaVioR commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r524609192 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class Un

[GitHub] [spark] HeartSaVioR commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

HeartSaVioR commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r524609192 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class Un

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728339770 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins removed a comment on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728339763 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29959: [SPARK-32381][CORE][SQL][FOLLOWUP] More cleanup on HadoopFSUtils

AmplabJenkins commented on pull request #29959: URL: https://github.com/apache/spark/pull/29959#issuecomment-728339763 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

<    1   2   3   4   5   6   7   8   9   10   >