[GitHub] [spark] SparkQA commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727806593 **[Test build #131140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131140/testReport)** for PR 29497 at commit

[GitHub] [spark] xuanyuanking commented on a change in pull request #30347: [SPARK-33209][SS] Refactor unit test of stream-stream join in UnsupportedOperationsSuite

xuanyuanking commented on a change in pull request #30347: URL: https://github.com/apache/spark/pull/30347#discussion_r523951738 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala ## @@ -414,209 +412,135 @@ class

[GitHub] [spark] cloud-fan commented on a change in pull request #30380: [SPARK-27421][SQL] Fix filter for int column and value class java.lang.String when pruning partition column

cloud-fan commented on a change in pull request #30380: URL: https://github.com/apache/spark/pull/30380#discussion_r523951682 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ## @@ -729,6 +729,7 @@ private[client] class Shim_v0_13 extends

[GitHub] [spark] MaxGekk commented on a change in pull request #30377: [SPARK-33453][SQL][TESTS] Unify v1 and v2 SHOW PARTITIONS tests

MaxGekk commented on a change in pull request #30377: URL: https://github.com/apache/spark/pull/30377#discussion_r523950223 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/ShowPartitionsSuite.scala ## @@ -0,0 +1,198 @@ +/* + * Licensed to the

[GitHub] [spark] SparkQA commented on pull request #30384: [SPARK-33456][SQL][TEST][FOLLOWUP] Fix SUBEXPRESSION_ELIMINATION_ENABLED config name

SparkQA commented on pull request #30384: URL: https://github.com/apache/spark/pull/30384#issuecomment-727800909 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35740/

[GitHub] [spark] SparkQA commented on pull request #30300: [SPARK-33399][SQL] Normalize output partitioning and sortorder with respect to aliases to avoid unneeded exchange/sort nodes

SparkQA commented on pull request #30300: URL: https://github.com/apache/spark/pull/30300#issuecomment-727799605 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35739/

[GitHub] [spark] cloud-fan commented on a change in pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

cloud-fan commented on a change in pull request #29497: URL: https://github.com/apache/spark/pull/29497#discussion_r523946524 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/QueryCompilationErrors.scala ## @@ -0,0 +1,164 @@ +/* + * Licensed to the Apache

[GitHub] [spark] cloud-fan commented on a change in pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

cloud-fan commented on a change in pull request #29497: URL: https://github.com/apache/spark/pull/29497#discussion_r523946122 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/QueryCompilationErrors.scala ## @@ -0,0 +1,164 @@ +/* + * Licensed to the Apache

[GitHub] [spark] luluorta commented on a change in pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

luluorta commented on a change in pull request #30299: URL: https://github.com/apache/spark/pull/30299#discussion_r523940307 ## File path: sql/core/src/test/resources/sql-tests/inputs/datetime.sql ## @@ -149,7 +149,7 @@ select to_timestamp('2019-10-06 A', '-MM-dd G');

[GitHub] [spark] cloud-fan commented on a change in pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

cloud-fan commented on a change in pull request #30299: URL: https://github.com/apache/spark/pull/30299#discussion_r523944573 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala ## @@ -172,7 +172,7 @@ case class HiveTableScanExec(

[GitHub] [spark] luluorta commented on a change in pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

luluorta commented on a change in pull request #30299: URL: https://github.com/apache/spark/pull/30299#discussion_r523940307 ## File path: sql/core/src/test/resources/sql-tests/inputs/datetime.sql ## @@ -149,7 +149,7 @@ select to_timestamp('2019-10-06 A', '-MM-dd G');

[GitHub] [spark] SparkQA commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727796003 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35738/

[GitHub] [spark] luluorta commented on a change in pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

luluorta commented on a change in pull request #30299: URL: https://github.com/apache/spark/pull/30299#discussion_r523940307 ## File path: sql/core/src/test/resources/sql-tests/inputs/datetime.sql ## @@ -149,7 +149,7 @@ select to_timestamp('2019-10-06 A', '-MM-dd G');

[GitHub] [spark] SparkQA commented on pull request #30299: [SPARK-33389][SQL] Make internal classes of SparkSession always using active SQLConf

SparkQA commented on pull request #30299: URL: https://github.com/apache/spark/pull/30299#issuecomment-727791622 **[Test build #131139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131139/testReport)** for PR 30299 at commit

[GitHub] [spark] SparkQA commented on pull request #30364: [SPARK-33140][SQL][FOLLOW-UP] Revert code that not use passed-in SparkSession to get SQLConf.

SparkQA commented on pull request #30364: URL: https://github.com/apache/spark/pull/30364#issuecomment-727788257 **[Test build #131138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131138/testReport)** for PR 30364 at commit

[GitHub] [spark] cloud-fan closed pull request #30383: [SPARK-33458][SQL] Hive partition pruning support Contains, StartsWith and EndsWith predicate

cloud-fan closed pull request #30383: URL: https://github.com/apache/spark/pull/30383 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #30383: [SPARK-33458][SQL] Hive partition pruning support Contains, StartsWith and EndsWith predicate

cloud-fan commented on pull request #30383: URL: https://github.com/apache/spark/pull/30383#issuecomment-727786769 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #30384: [SPARK-33456][SQL][TEST][FOLLOWUP] Fix SUBEXPRESSION_ELIMINATION_ENABLED config name

SparkQA commented on pull request #30384: URL: https://github.com/apache/spark/pull/30384#issuecomment-727784817 **[Test build #131137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131137/testReport)** for PR 30384 at commit

[GitHub] [spark] cloud-fan closed pull request #30358: [SPARK-33394][SQL][TESTS] Throw `NoSuchNamespaceException` for not existing namespace in `InMemoryTableCatalog.listTables()`

cloud-fan closed pull request #30358: URL: https://github.com/apache/spark/pull/30358 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #30358: [SPARK-33394][SQL][TESTS] Throw `NoSuchNamespaceException` for not existing namespace in `InMemoryTableCatalog.listTables()`

cloud-fan commented on pull request #30358: URL: https://github.com/apache/spark/pull/30358#issuecomment-727782490 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] viirya commented on a change in pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

viirya commented on a change in pull request #30381: URL: https://github.com/apache/spark/pull/30381#discussion_r523932172 ## File path: sql/core/src/test/resources/sql-tests/inputs/subexp-elimination.sql ## @@ -0,0 +1,37 @@ +-- Test for subexpression elimination. + +--SET

[GitHub] [spark] viirya opened a new pull request #30384: [SPARK-33456][SQL][TEST][FOLLOWUP] Fix SUBEXPRESSION_ELIMINATION_ENABLED config name

viirya opened a new pull request #30384: URL: https://github.com/apache/spark/pull/30384 ### What changes were proposed in this pull request? To fix wrong config name in `subexp-elimination.sql`. ### Why are the changes needed? `CONFIG_DIM` should use

[GitHub] [spark] cloud-fan commented on a change in pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

cloud-fan commented on a change in pull request #30368: URL: https://github.com/apache/spark/pull/30368#discussion_r523931544 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -1452,11 +1452,27 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

AmplabJenkins removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727779872 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

SparkQA removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727774687 **[Test build #131135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131135/testReport)** for PR 27735 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

AmplabJenkins removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727779863 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

AmplabJenkins commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727779863 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727779713 **[Test build #131135 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131135/testReport)** for PR 27735 at commit

[GitHub] [spark] viirya commented on a change in pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

viirya commented on a change in pull request #30381: URL: https://github.com/apache/spark/pull/30381#discussion_r523929393 ## File path: sql/core/src/test/resources/sql-tests/inputs/subexp-elimination.sql ## @@ -0,0 +1,37 @@ +-- Test for subexpression elimination. + +--SET

[GitHub] [spark] SparkQA commented on pull request #30300: [SPARK-33399][SQL] Normalize output partitioning and sortorder with respect to aliases to avoid unneeded exchange/sort nodes

SparkQA commented on pull request #30300: URL: https://github.com/apache/spark/pull/30300#issuecomment-727778057 **[Test build #131136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131136/testReport)** for PR 30300 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

HyukjinKwon commented on a change in pull request #30381: URL: https://github.com/apache/spark/pull/30381#discussion_r523929112 ## File path: sql/core/src/test/resources/sql-tests/inputs/subexp-elimination.sql ## @@ -0,0 +1,37 @@ +-- Test for subexpression elimination. +

[GitHub] [spark] cloud-fan commented on a change in pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

cloud-fan commented on a change in pull request #30381: URL: https://github.com/apache/spark/pull/30381#discussion_r523929310 ## File path: sql/core/src/test/resources/sql-tests/inputs/subexp-elimination.sql ## @@ -0,0 +1,37 @@ +-- Test for subexpression elimination. + +--SET

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727774065 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727774055 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

AmplabJenkins removed a comment on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727774994 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins removed a comment on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727775302 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] MaxGekk commented on a change in pull request #30358: [SPARK-33394][SQL][TESTS] Throw `NoSuchNamespaceException` for not existing namespace in `InMemoryTableCatalog.listTables()`

MaxGekk commented on a change in pull request #30358: URL: https://github.com/apache/spark/pull/30358#discussion_r523928527 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTableCatalog.scala ## @@ -181,9 +181,21 @@ class InMemoryTableCatalog

[GitHub] [spark] AmplabJenkins commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727775302 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

AmplabJenkins commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727774994 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727775287 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35736/

[GitHub] [spark] SparkQA commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

SparkQA commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727774961 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35735/

[GitHub] [spark] SparkQA commented on pull request #27735: [SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-727774687 **[Test build #131135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131135/testReport)** for PR 27735 at commit

[GitHub] [spark] viirya commented on pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

viirya commented on pull request #30381: URL: https://github.com/apache/spark/pull/30381#issuecomment-727774217 Thanks @HyukjinKwon @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727774014 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35737/

[GitHub] [spark] AmplabJenkins commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727774055 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon closed pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

HyukjinKwon closed pull request #30381: URL: https://github.com/apache/spark/pull/30381 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30381: [SPARK-33456][SQL][TEST] Add end-to-end test for subexpression elimination

HyukjinKwon commented on pull request #30381: URL: https://github.com/apache/spark/pull/30381#issuecomment-727773690 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] MichaelChirico commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

MichaelChirico commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727768929 @HyukjinKwon test added, please have a look This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on pull request #29797: [SPARK-32932][SQL] Do not use local shuffle reader at final stage on write command

cloud-fan commented on pull request #29797: URL: https://github.com/apache/spark/pull/29797#issuecomment-727768565 I'm reading the classdoc of `OptimizeLocalShuffleReader`, and I do feel the design is a bit hacky. We add local shuffle reader if 1. the shuffle is the root node of a query

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

AmplabJenkins removed a comment on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-727767077 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

AmplabJenkins commented on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-727767077 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

SparkQA removed a comment on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-727680480 **[Test build #131118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131118/testReport)** for PR 30368 at commit

[GitHub] [spark] SparkQA commented on pull request #30368: [SPARK-33442][SQL] Change Combine Limit to Eliminate limit using max row

SparkQA commented on pull request #30368: URL: https://github.com/apache/spark/pull/30368#issuecomment-727766024 **[Test build #131118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131118/testReport)** for PR 30368 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727764812 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727750806 **[Test build #131134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131134/testReport)** for PR 28386 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727764812 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

SparkQA commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727764668 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35735/

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727764685 **[Test build #131134 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131134/testReport)** for PR 28386 at commit

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727763827 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35737/

[GitHub] [spark] SparkQA commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727762739 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35736/

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727758955 Yay! Thank you, @viirya and @HyukjinKwon !  This is an automated message from the Apache Git Service.

[GitHub] [spark] HyukjinKwon closed pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

HyukjinKwon closed pull request #30378: URL: https://github.com/apache/spark/pull/30378 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

HyukjinKwon commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727757148 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727751358 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727751358 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727751348 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35733/

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727750806 **[Test build #131134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131134/testReport)** for PR 28386 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727750403 Could you approve once more please? This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727750221 Now, the new job is green. 

[GitHub] [spark] Ngone51 commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle serv

Ngone51 commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-727749010 LGTM if all tests pass. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727749128 Sorry for the rebasing after your approval, @HyukjinKwon , @wangyum , @viirya . It was inevitable to bring the latest master branch. (I didn't notice that GitHub Action

[GitHub] [spark] Ngone51 commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external

Ngone51 commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523909743 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

HyukjinKwon commented on a change in pull request #30378: URL: https://github.com/apache/spark/pull/30378#discussion_r523909079 ## File path: .github/workflows/build_and_test.yml ## @@ -14,6 +14,28 @@ on: required: true jobs: + # This is on the top to give the

[GitHub] [spark] SparkQA commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727745405 **[Test build #131133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131133/testReport)** for PR 29497 at commit

[GitHub] [spark] SparkQA commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

SparkQA commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727745360 **[Test build #131132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131132/testReport)** for PR 30378 at commit

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727743297 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35733/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins removed a comment on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727741699 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA removed a comment on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727740247 **[Test build #131131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131131/testReport)** for PR 29497 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins removed a comment on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727741364 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727741674 **[Test build #131131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131131/testReport)** for PR 29497 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727741693 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins removed a comment on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727741355 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

AmplabJenkins commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727741355 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] wangyum commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

wangyum commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727740477 Thank you @dongjoon-hyun. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727740466 It's weird. The new code is not consumed at the GitHub Action re-trigger. I'll rebase this to the master~ ``` [error]

[GitHub] [spark] SparkQA commented on pull request #29497: [WIP][SPARK-32670][SQL]Group exception messages in Catalyst Analyzer in one file

SparkQA commented on pull request #29497: URL: https://github.com/apache/spark/pull/29497#issuecomment-727740247 **[Test build #131131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131131/testReport)** for PR 29497 at commit

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun edited a comment on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727739673 Thank you, @wangyum . I'm looking at both this PR and vanilla master branch, too. The previous failure might happen by another unknown reason instead of the

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727739673 Thank you, @wangyum . I'm looking at both this PR and vanilla master branch, too. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727739056 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727739053 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun edited a comment on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727738689 BTW, @HyukjinKwon . Do you still want to use Java 8 in this PR? `Scala 2.13 build` job is also using Java 11.

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727739036 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35732/

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun edited a comment on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727738689 BTW, @HyukjinKwon . Do you still want to use Java 8 in this PR? For Scala 2.13 build, I also use Java 11.

[GitHub] [spark] Ngone51 commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external

Ngone51 commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523903398 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,38 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] AmplabJenkins commented on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727739053 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727738689 BTW, @HyukjinKwon . Do you still want to use Java 8 in this PR? This is an automated message from the

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on a change in pull request #30378: URL: https://github.com/apache/spark/pull/30378#discussion_r523902143 ## File path: .github/workflows/build_and_test.yml ## @@ -14,6 +14,28 @@ on: required: true jobs: + # This is on the top to give the

[GitHub] [spark] dongjoon-hyun commented on pull request #30378: [SPARK-33454][INFRA] Add GitHub Action job for Hadoop 2

dongjoon-hyun commented on pull request #30378: URL: https://github.com/apache/spark/pull/30378#issuecomment-727737781 It seems that there exists some delay on GitHub Action. I retriggered GitHub Action because the previous run fails with compilation error again.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727737091 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] Fix strategy for handling ... names in mutate

SparkQA removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-727728851 **[Test build #131130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131130/testReport)** for PR 28386 at commit

  1   2   3   4   5   >