[GitHub] [spark] cloud-fan commented on a change in pull request #31258: [SPARK-34168] [SQL] Support DPP in AQE when the join is Broadcast hash join at the beginning

2021-02-01 Thread GitBox
cloud-fan commented on a change in pull request #31258: URL: https://github.com/apache/spark/pull/31258#discussion_r567813998 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SubqueryAdaptiveBroadcastExec.scala ## @@ -0,0 +1,42 @@ +/* + * Licensed to the Ap

[GitHub] [spark] cloud-fan closed pull request #31364: [SPARK-34266][SQL][DOCS] Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-02-01 Thread GitBox
cloud-fan closed pull request #31364: URL: https://github.com/apache/spark/pull/31364 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] cloud-fan commented on pull request #31364: [SPARK-34266][SQL][DOCS] Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-02-01 Thread GitBox
cloud-fan commented on pull request #31364: URL: https://github.com/apache/spark/pull/31364#issuecomment-770843672 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] cloud-fan commented on pull request #31399: [SPARK-34259][SQL] Don't attempt to parse file-based partitions as special timestamps

2021-02-01 Thread GitBox
cloud-fan commented on pull request #31399: URL: https://github.com/apache/spark/pull/31399#issuecomment-770841866 The partition value should be a constant, while something like `NOW` works more like a function. I agree we should disallow it. The bug described by @MaxGekk seems true

[GitHub] [spark] SparkQA commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
SparkQA commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770840122 **[Test build #134734 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134734/testReport)** for PR 31407 at commit [`7893201`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #31384: [SPARK-31816][SQL] Added high level description about JDBC connection providers for users/developers

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31384: URL: https://github.com/apache/spark/pull/31384#issuecomment-770838341 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134724/ -

[GitHub] [spark] cloud-fan commented on a change in pull request #31403: [SPARK-34301][SQL] Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

2021-02-01 Thread GitBox
cloud-fan commented on a change in pull request #31403: URL: https://github.com/apache/spark/pull/31403#discussion_r567805248 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala ## @@ -446,9 +446,9 @@ class CatalogImpl(sparkSession: SparkSessi

[GitHub] [spark] SparkQA removed a comment on pull request #31384: [SPARK-31816][SQL] Added high level description about JDBC connection providers for users/developers

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31384: URL: https://github.com/apache/spark/pull/31384#issuecomment-770685835 **[Test build #134724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134724/testReport)** for PR 31384 at commit [`560ea36`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31384: [SPARK-31816][SQL] Added high level description about JDBC connection providers for users/developers

2021-02-01 Thread GitBox
SparkQA commented on pull request #31384: URL: https://github.com/apache/spark/pull/31384#issuecomment-770837204 **[Test build #134724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134724/testReport)** for PR 31384 at commit [`560ea36`](https://github.co

[GitHub] [spark] maropu commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
maropu commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770833171 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770832837 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39312/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31418: [SPARK-34310][CORE][SQL][3.0] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31418: URL: https://github.com/apache/spark/pull/31418#issuecomment-770832841 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39316/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770832838 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39318/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770798941 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #31418: [SPARK-34310][CORE][SQL][3.0] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31418: URL: https://github.com/apache/spark/pull/31418#issuecomment-770832841 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39316/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770832840 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134731/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770832837 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39312/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770832838 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39318/ -

[GitHub] [spark] maropu commented on a change in pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

2021-02-01 Thread GitBox
maropu commented on a change in pull request #31413: URL: https://github.com/apache/spark/pull/31413#discussion_r567798637 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -591,20 +590,34 @@ case class FileSourceScanExec(

[GitHub] [spark] cloud-fan commented on pull request #31395: [SPARK-33599][SQL] Restore the assert-like in catalyst/analysis

2021-02-01 Thread GitBox
cloud-fan commented on pull request #31395: URL: https://github.com/apache/spark/pull/31395#issuecomment-770830089 I think we want to centralize user-facing error messages, but assert-like errors are more developer-facing, and the indirection is not helpful here. -

[GitHub] [spark] SparkQA commented on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
SparkQA commented on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770829728 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39319/ -

[GitHub] [spark] cloud-fan commented on a change in pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

2021-02-01 Thread GitBox
cloud-fan commented on a change in pull request #31286: URL: https://github.com/apache/spark/pull/31286#discussion_r567795360 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1559,6 +1559,14 @@ object SQLConf { .booleanConf

[GitHub] [spark] cloud-fan commented on a change in pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

2021-02-01 Thread GitBox
cloud-fan commented on a change in pull request #31286: URL: https://github.com/apache/spark/pull/31286#discussion_r567795011 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1763,6 +1763,21 @@ class Analyzer(override val c

[GitHub] [spark] cloud-fan commented on a change in pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

2021-02-01 Thread GitBox
cloud-fan commented on a change in pull request #31286: URL: https://github.com/apache/spark/pull/31286#discussion_r567794818 ## File path: docs/sql-migration-guide.md ## @@ -49,6 +49,8 @@ license: | * and the method `spark.catalog.refreshTable` In Spark 3.1 and earlier

[GitHub] [spark] SparkQA removed a comment on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770766090 **[Test build #134731 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134731/testReport)** for PR 31417 at commit [`0fcfea2`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770819592 **[Test build #134731 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134731/testReport)** for PR 31417 at commit [`0fcfea2`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
SparkQA commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770816952 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39312/ ---

[GitHub] [spark] maropu commented on a change in pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

2021-02-01 Thread GitBox
maropu commented on a change in pull request #31413: URL: https://github.com/apache/spark/pull/31413#discussion_r567779787 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -591,20 +590,34 @@ case class FileSourceScanExec(

[GitHub] [spark] SparkQA commented on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770808212 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39318/ ---

[GitHub] [spark] SparkQA commented on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
SparkQA commented on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770808003 **[Test build #134733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134733/testReport)** for PR 31414 at commit [`413ebc4`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #31362: [SPARK-34263][SQL] Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31362: URL: https://github.com/apache/spark/pull/31362#issuecomment-770622320 **[Test build #134716 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134716/testReport)** for PR 31362 at commit [`cd8e765`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #31412: [SPARK-34308][SQL] Escape meta-characters in printSchema

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31412: URL: https://github.com/apache/spark/pull/31412#issuecomment-770622181 **[Test build #134713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134713/testReport)** for PR 31412 at commit [`bbab015`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770685713 **[Test build #134722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134722/testReport)** for PR 31414 at commit [`c148b86`](https://gi

[GitHub] [spark] maropu commented on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
maropu commented on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770804961 The fix is trivial and it looks fine. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] maropu commented on a change in pull request #31412: [SPARK-34308][SQL] Escape meta-characters in printSchema

2021-02-01 Thread GitBox
maropu commented on a change in pull request #31412: URL: https://github.com/apache/spark/pull/31412#discussion_r567767319 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/util/SchemaUtils.scala ## @@ -271,4 +271,18 @@ private[spark] object SchemaUtils { }

[GitHub] [spark] AmplabJenkins commented on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770801684 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134722/ -

[GitHub] [spark] SparkQA commented on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
SparkQA commented on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770801039 **[Test build #134722 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134722/testReport)** for PR 31414 at commit [`c148b86`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #31412: [SPARK-34308][SQL] Escape meta-characters in printSchema

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31412: URL: https://github.com/apache/spark/pull/31412#issuecomment-770799655 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134713/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770798941 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39317/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31362: [SPARK-34263][SQL] Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31362: URL: https://github.com/apache/spark/pull/31362#issuecomment-770798938 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134716/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-770798937 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39313/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-770798940 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39315/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31359: [SPARK-34083][SQL][3.1] Using TPCDS original definitions for char/varchar colums

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31359: URL: https://github.com/apache/spark/pull/31359#issuecomment-770798936 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39314/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-770798933 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134717/ -

[GitHub] [spark] SparkQA commented on pull request #31412: [SPARK-34308][SQL] Escape meta-characters in printSchema

2021-02-01 Thread GitBox
SparkQA commented on pull request #31412: URL: https://github.com/apache/spark/pull/31412#issuecomment-770798550 **[Test build #134713 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134713/testReport)** for PR 31412 at commit [`bbab015`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31362: [SPARK-34263][SQL] Simplify the code for treating unicode/octal/escaped characters in string literals

2021-02-01 Thread GitBox
SparkQA commented on pull request #31362: URL: https://github.com/apache/spark/pull/31362#issuecomment-770796375 **[Test build #134716 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134716/testReport)** for PR 31362 at commit [`cd8e765`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770792285 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39318/ -

[GitHub] [spark] SparkQA commented on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770788362 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39317/ ---

[GitHub] [spark] SparkQA removed a comment on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-770627350 **[Test build #134717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134717/testReport)** for PR 31413 at commit [`cd90f0a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31413: [SPARK-32985][SQL] Decouple bucket scan and bucket filter pruning for data source v1

2021-02-01 Thread GitBox
SparkQA commented on pull request #31413: URL: https://github.com/apache/spark/pull/31413#issuecomment-770786624 **[Test build #134717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134717/testReport)** for PR 31413 at commit [`cd90f0a`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770779617 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39317/ -

[GitHub] [spark] SparkQA commented on pull request #31359: [SPARK-34083][SQL][3.1] Using TPCDS original definitions for char/varchar colums

2021-02-01 Thread GitBox
SparkQA commented on pull request #31359: URL: https://github.com/apache/spark/pull/31359#issuecomment-77042 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39314/ ---

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

2021-02-01 Thread GitBox
SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-770777398 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39313/ ---

[GitHub] [spark] SparkQA commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

2021-02-01 Thread GitBox
SparkQA commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-770776569 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39315/ ---

[GitHub] [spark] attilapiros commented on pull request #30751: [SPARK-32617][K8S][TESTS] Configure kubernetes client based on kubeconfig settings in kubernetes integration tests

2021-02-01 Thread GitBox
attilapiros commented on pull request #30751: URL: https://github.com/apache/spark/pull/30751#issuecomment-770776320 gentle ping @holdenk @Ngone51 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] SparkQA commented on pull request #31418: [SPARK-34310][CORE][SQL][3.0] Replaces map and flatten with flatMap #31416

2021-02-01 Thread GitBox
SparkQA commented on pull request #31418: URL: https://github.com/apache/spark/pull/31418#issuecomment-770773803 **[Test build #134730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134730/testReport)** for PR 31418 at commit [`a86ef11`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770772162 **[Test build #134732 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134732/testReport)** for PR 31416 at commit [`886c2b9`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31273: [Spark-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-770763435 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134707/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31409: [SPARK-34307][SQL] TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31409: URL: https://github.com/apache/spark/pull/31409#issuecomment-770763425 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134709/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770649788 **[Test build #134718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134718/testReport)** for PR 31407 at commit [`6fc94bc`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-770763426 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39311/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770763432 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770763436 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39308/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31408: [SPARK-34306][SQL][PYTHON][R] Use Snake naming rule across the function APIs

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31408: URL: https://github.com/apache/spark/pull/31408#issuecomment-770763423 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31024: [SPARK-33979][SQL] Reorder predicate

2021-02-01 Thread GitBox
AmplabJenkins removed a comment on pull request #31024: URL: https://github.com/apache/spark/pull/31024#issuecomment-770763427 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134708/ -

[GitHub] [spark] SparkQA commented on pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
SparkQA commented on pull request #31417: URL: https://github.com/apache/spark/pull/31417#issuecomment-770766090 **[Test build #134731 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134731/testReport)** for PR 31417 at commit [`0fcfea2`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770764320 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134718/ -

[GitHub] [spark] SparkQA commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
SparkQA commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770763839 **[Test build #134718 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134718/testReport)** for PR 31407 at commit [`6fc94bc`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
SparkQA commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770763663 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39312/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31414: [SPARK-34303][SQL] Migrate ALTER TABLE .. SET LOCATION to new resolution framework

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31414: URL: https://github.com/apache/spark/pull/31414#issuecomment-770763436 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39308/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770763432 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134711/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-770763426 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39311/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31409: [SPARK-34307][SQL] TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31409: URL: https://github.com/apache/spark/pull/31409#issuecomment-770763425 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134709/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31273: [Spark-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-770763435 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134707/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31024: [SPARK-33979][SQL] Reorder predicate

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31024: URL: https://github.com/apache/spark/pull/31024#issuecomment-770763427 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134708/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31408: [SPARK-34306][SQL][PYTHON][R] Use Snake naming rule across the function APIs

2021-02-01 Thread GitBox
AmplabJenkins commented on pull request #31408: URL: https://github.com/apache/spark/pull/31408#issuecomment-770763424 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] LuciferYang commented on pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
LuciferYang commented on pull request #31416: URL: https://github.com/apache/spark/pull/31416#issuecomment-770762871 For other branch: - branch-3.0: https://github.com/apache/spark/pull/31418 - branch-2.4: https://github.com/apache/spark/pull/31417 ---

[GitHub] [spark] LuciferYang opened a new pull request #31418: [SPARK-34310][CORE][SQL][3.0] Replaces map and flatten with flatMap #31416

2021-02-01 Thread GitBox
LuciferYang opened a new pull request #31418: URL: https://github.com/apache/spark/pull/31418 ### What changes were proposed in this pull request? Replaces `collection.map(f1).flatten(f2)` with `collection.flatMap` if possible. it's semantically consistent, but looks simpler. ###

[GitHub] [spark] LuciferYang opened a new pull request #31417: [SPARK-34310][CORE][SQL][2.4] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
LuciferYang opened a new pull request #31417: URL: https://github.com/apache/spark/pull/31417 ### What changes were proposed in this pull request? Replaces `collection.map(f1).flatten(f2)` with `collection.flatMap` if possible. it's semantically consistent, but looks simpler. ###

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

2021-02-01 Thread GitBox
SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-770761712 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39313/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31408: [SPARK-34306][SQL][PYTHON][R] Use Snake naming rule across the function APIs

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31408: URL: https://github.com/apache/spark/pull/31408#issuecomment-770596916 **[Test build #134710 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134710/testReport)** for PR 31408 at commit [`bb23512`](https://gi

[GitHub] [spark] LuciferYang opened a new pull request #31416: [SPARK-34310][CORE][SQL] Replaces map and flatten with flatMap

2021-02-01 Thread GitBox
LuciferYang opened a new pull request #31416: URL: https://github.com/apache/spark/pull/31416 ### What changes were proposed in this pull request? Replaces `collection.map(f1).flatten(f2)` with `collection.flatMap` if possible. it's semantically consistent, but looks simpler. ###

[GitHub] [spark] SparkQA commented on pull request #31408: [SPARK-34306][SQL][PYTHON][R] Use Snake naming rule across the function APIs

2021-02-01 Thread GitBox
SparkQA commented on pull request #31408: URL: https://github.com/apache/spark/pull/31408#issuecomment-770760965 **[Test build #134710 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134710/testReport)** for PR 31408 at commit [`bb23512`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #31409: [SPARK-34307][SQL] TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31409: URL: https://github.com/apache/spark/pull/31409#issuecomment-770597884 **[Test build #134709 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134709/testReport)** for PR 31409 at commit [`097d1f9`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #31273: [Spark-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-770594667 **[Test build #134707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134707/testReport)** for PR 31273 at commit [`a0ba508`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31273: [Spark-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-01 Thread GitBox
SparkQA commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-770760593 **[Test build #134707 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134707/testReport)** for PR 31273 at commit [`a0ba508`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31409: [SPARK-34307][SQL] TakeOrderedAndProjectExec avoid shuffle if input rdd has single partition

2021-02-01 Thread GitBox
SparkQA commented on pull request #31409: URL: https://github.com/apache/spark/pull/31409#issuecomment-770760338 **[Test build #134709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134709/testReport)** for PR 31409 at commit [`097d1f9`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31359: [SPARK-34083][SQL][3.1] Using TPCDS original definitions for char/varchar colums

2021-02-01 Thread GitBox
SparkQA commented on pull request #31359: URL: https://github.com/apache/spark/pull/31359#issuecomment-770759000 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39314/ -

[GitHub] [spark] SparkQA commented on pull request #31286: [SPARK-34199][SQL] Block `table.*` inside function to follow ANSI standard and other SQL engines

2021-02-01 Thread GitBox
SparkQA commented on pull request #31286: URL: https://github.com/apache/spark/pull/31286#issuecomment-770758041 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39315/ -

[GitHub] [spark] yangmou commented on pull request #31415: 修改队列,可自己指定队列

2021-02-01 Thread GitBox
yangmou commented on pull request #31415: URL: https://github.com/apache/spark/pull/31415#issuecomment-770757838 1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [spark] yangmou closed pull request #31415: 修改队列,可自己指定队列

2021-02-01 Thread GitBox
yangmou closed pull request #31415: URL: https://github.com/apache/spark/pull/31415 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] beliefer commented on pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

2021-02-01 Thread GitBox
beliefer commented on pull request #31316: URL: https://github.com/apache/spark/pull/31316#issuecomment-770757140 cc @allisonwang-db This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] yangmou opened a new pull request #31415: 修改队列,可自己指定队列

2021-02-01 Thread GitBox
yangmou opened a new pull request #31415: URL: https://github.com/apache/spark/pull/31415 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was

[GitHub] [spark] AngersZhuuuu commented on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

2021-02-01 Thread GitBox
AngersZh commented on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-770743091 gentle ping @HyukjinKwon @cloud-fan @maropu This is an automated message from the Apache Git Service. To re

[GitHub] [spark] AngersZhuuuu removed a comment on pull request #31378: [SPARK-34240][SQL] Unify output of SHOW TBLPROPERTIES pass output attribute properly

2021-02-01 Thread GitBox
AngersZh removed a comment on pull request #31378: URL: https://github.com/apache/spark/pull/31378#issuecomment-769529029 FYI @cloud-fan @HyukjinKwon This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] AngersZhuuuu commented on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

2021-02-01 Thread GitBox
AngersZh commented on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-770742844 gentle ping @HyukjinKwon @cloud-fan @maropu This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AngersZhuuuu removed a comment on pull request #31377: [SPARK-34239][SQL] Unify output of SHOW COLUMNS pass output attributes properly

2021-02-01 Thread GitBox
AngersZh removed a comment on pull request #31377: URL: https://github.com/apache/spark/pull/31377#issuecomment-769535011 FYI @cloud-fan This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] SparkQA commented on pull request #31402: [SPARK-34296][SQL] AggregateWindowFunction frame should not always use UnboundedPreceding

2021-02-01 Thread GitBox
SparkQA commented on pull request #31402: URL: https://github.com/apache/spark/pull/31402#issuecomment-770739723 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39311/ ---

[GitHub] [spark] SparkQA removed a comment on pull request #31407: [SPARK-34233][SQL][3.1] FIX NPE for char padding in binary comparison

2021-02-01 Thread GitBox
SparkQA removed a comment on pull request #31407: URL: https://github.com/apache/spark/pull/31407#issuecomment-770593258 **[Test build #134711 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/134711/testReport)** for PR 31407 at commit [`53c5f56`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31408: [SPARK-34306][SQL][PYTHON][R] Use Snake naming rule across the function APIs

2021-02-01 Thread GitBox
SparkQA commented on pull request #31408: URL: https://github.com/apache/spark/pull/31408#issuecomment-770739581 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39309/ ---

<    1   2   3   4   5   6   7   8   >