[GitHub] [spark] AmplabJenkins removed a comment on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

AmplabJenkins removed a comment on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828270400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

SparkQA commented on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828309862 **[Test build #138039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138039/testReport)** for PR 32232 at commit

[GitHub] [spark] SparkQA commented on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

SparkQA commented on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828309720 **[Test build #138038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138038/testReport)** for PR 32261 at commit

[GitHub] [spark] SparkQA commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828309624 **[Test build #138037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138037/testReport)** for PR 32377 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

AmplabJenkins removed a comment on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828306752 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AmplabJenkins removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828306748 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42555/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

AmplabJenkins removed a comment on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828306753 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

AmplabJenkins removed a comment on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828306750 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138031/

[GitHub] [spark] AmplabJenkins commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

AmplabJenkins commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828306752 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42553/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

AmplabJenkins commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828306753 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42552/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

AmplabJenkins commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828306750 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138031/ -- This

[GitHub] [spark] SparkQA commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

SparkQA commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828305808 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828304442 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42555/ -- This is an automated message from the

[GitHub] [spark] yaooqinn commented on a change in pull request #32364: [SPARK-35242][SQL] Support change catalog default database for spark

yaooqinn commented on a change in pull request #32364: URL: https://github.com/apache/spark/pull/32364#discussion_r621989624 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala ## @@ -37,6 +37,12 @@ object StaticSQLConf {

[GitHub] [spark] SparkQA removed a comment on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA removed a comment on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828221022 **[Test build #138031 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138031/testReport)** for PR 32374 at commit

[GitHub] [spark] SparkQA commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828300830 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42555/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828300015 **[Test build #138031 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138031/testReport)** for PR 32374 at commit

[GitHub] [spark] SparkQA commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

SparkQA commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828296237 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] yaooqinn commented on pull request #32364: [SPARK-35242][SQL] Support change catalog default database for spark

yaooqinn commented on pull request #32364: URL: https://github.com/apache/spark/pull/32364#issuecomment-828293337 > Permission denied: user [spark] does not have [SELECT] privilege on [spark_test]) Can you detail the context or operation that leads to this exception? It looks

[GitHub] [spark] cloud-fan commented on a change in pull request #32082: [SPARK-34981][SQL] Implement V2 function resolution and evaluation

cloud-fan commented on a change in pull request #32082: URL: https://github.com/apache/spark/pull/32082#discussion_r621972605 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/functions/ScalarFunction.java ## @@ -23,17 +23,67 @@ /** *

[GitHub] [spark] cloud-fan commented on a change in pull request #32301: [SPARK-35194][SQL] Refactor nested column aliasing for readability

cloud-fan commented on a change in pull request #32301: URL: https://github.com/apache/spark/pull/32301#discussion_r621969848 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -23,78 +23,149 @@ import

[GitHub] [spark] cloud-fan commented on a change in pull request #32364: [SPARK-35242][SQL] Support change catalog default database for spark

cloud-fan commented on a change in pull request #32364: URL: https://github.com/apache/spark/pull/32364#discussion_r621969421 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala ## @@ -42,13 +42,14 @@ import

[GitHub] [spark] cloud-fan commented on pull request #32364: [SPARK-35242][SQL] Support change catalog default database for spark

cloud-fan commented on pull request #32364: URL: https://github.com/apache/spark/pull/32364#issuecomment-828286966 cc @yaooqinn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] cloud-fan commented on a change in pull request #32364: [SPARK-35242][SQL] Support change catalog default database for spark

cloud-fan commented on a change in pull request #32364: URL: https://github.com/apache/spark/pull/32364#discussion_r621968124 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala ## @@ -37,6 +37,12 @@ object StaticSQLConf {

[GitHub] [spark] cloud-fan commented on a change in pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

cloud-fan commented on a change in pull request #32049: URL: https://github.com/apache/spark/pull/32049#discussion_r621963019 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/SupportsPushDownAggregates.java ## @@ -0,0 +1,44 @@ +/* + * Licensed to

[GitHub] [spark] SparkQA removed a comment on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

SparkQA removed a comment on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828264509 **[Test build #138033 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138033/testReport)** for PR 32379 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

SparkQA removed a comment on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828264500 **[Test build #138034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138034/testReport)** for PR 32378 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA removed a comment on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828265183 **[Test build #138035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138035/testReport)** for PR 32377 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32373: [SPARK-35248] Spark shall load system class first in IsolatedClientLoader

SparkQA removed a comment on pull request #32373: URL: https://github.com/apache/spark/pull/32373#issuecomment-828184115 **[Test build #138028 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138028/testReport)** for PR 32373 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

AmplabJenkins commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828276587 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138034/ -- This

[GitHub] [spark] gaborgsomogyi commented on pull request #31944: [SPARK-34854][SQL][SS] Expose source metrics via progress report and add Kafka use-case to report delay.

gaborgsomogyi commented on pull request #31944: URL: https://github.com/apache/spark/pull/31944#issuecomment-828276415 @viirya please make judgement how fits into the whole picture since I'm not involved in the metrics API development. -- This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

SparkQA commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828276286 **[Test build #138034 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138034/testReport)** for PR 32378 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32373: [SPARK-35248] Spark shall load system class first in IsolatedClientLoader

AmplabJenkins commented on pull request #32373: URL: https://github.com/apache/spark/pull/32373#issuecomment-828276034 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138028/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

AmplabJenkins commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828274956 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138033/ -- This

[GitHub] [spark] SparkQA commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

SparkQA commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828274601 **[Test build #138033 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138033/testReport)** for PR 32379 at commit

[GitHub] [spark] SparkQA commented on pull request #32373: [SPARK-35248] Spark shall load system class first in IsolatedClientLoader

SparkQA commented on pull request #32373: URL: https://github.com/apache/spark/pull/32373#issuecomment-828274459 **[Test build #138028 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138028/testReport)** for PR 32373 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621950903 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,78 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621949845 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,78 @@ case class

[GitHub] [spark] maropu commented on pull request #32350: [SPARK-35231][SQL] logical.Range override maxRowsPerPartition

maropu commented on pull request #32350: URL: https://github.com/apache/spark/pull/32350#issuecomment-828272169 Yea, please add tests in `CombiningLimitsSuite`. The fix itself looks fine. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] AmplabJenkins commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

AmplabJenkins commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828270400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828270240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828265183 **[Test build #138035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138035/testReport)** for PR 32377 at commit

[GitHub] [spark] SparkQA commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828264571 **[Test build #138036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138036/testReport)** for PR 32365 at commit

[GitHub] [spark] SparkQA commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

SparkQA commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828264500 **[Test build #138034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138034/testReport)** for PR 32378 at commit

[GitHub] [spark] SparkQA commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

SparkQA commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828264509 **[Test build #138033 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138033/testReport)** for PR 32379 at commit

[GitHub] [spark] maropu commented on a change in pull request #32355: [SPARK-35221][SQL] Add join hint build side check

maropu commented on a change in pull request #32355: URL: https://github.com/apache/spark/pull/32355#discussion_r621937979 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/hints.scala ## @@ -200,6 +201,11 @@ trait HintErrorHandler { */

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32344: [SPARK-35226][SQL] Support refreshKrb5Config option in JDBC datasources

AmplabJenkins removed a comment on pull request #32344: URL: https://github.com/apache/spark/pull/32344#issuecomment-828262289 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138024/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AmplabJenkins removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828226864 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

AmplabJenkins removed a comment on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828262386 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

AmplabJenkins removed a comment on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828262389 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42551/

[GitHub] [spark] AmplabJenkins commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

AmplabJenkins commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828262388 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AmplabJenkins commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828262390 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138020/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

AmplabJenkins commented on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828262389 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42551/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32344: [SPARK-35226][SQL] Support refreshKrb5Config option in JDBC datasources

AmplabJenkins commented on pull request #32344: URL: https://github.com/apache/spark/pull/32344#issuecomment-828262289 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138024/ -- This

[GitHub] [spark] SparkQA commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828261902 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42550/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32344: [SPARK-35226][SQL] Support refreshKrb5Config option in JDBC datasources

SparkQA removed a comment on pull request #32344: URL: https://github.com/apache/spark/pull/32344#issuecomment-828158392 **[Test build #138024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138024/testReport)** for PR 32344 at commit

[GitHub] [spark] SparkQA commented on pull request #32344: [SPARK-35226][SQL] Support refreshKrb5Config option in JDBC datasources

SparkQA commented on pull request #32344: URL: https://github.com/apache/spark/pull/32344#issuecomment-828260492 **[Test build #138024 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138024/testReport)** for PR 32344 at commit

[GitHub] [spark] SparkQA commented on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

SparkQA commented on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828258713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AngersZhuuuu commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

AngersZh commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828258677 FYI @maropu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AngersZhuuuu opened a new pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

AngersZh opened a new pull request #32379: URL: https://github.com/apache/spark/pull/32379 ### What changes were proposed in this pull request? Extract common doc about hive format for `sql-ref-syntax-ddl-create-table-hiveformat.md` and `sql-ref-syntax-qry-select-transform.md` to

[GitHub] [spark] AngersZhuuuu commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

AngersZh commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828258204 FYI @maropu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AngersZhuuuu opened a new pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

AngersZh opened a new pull request #32378: URL: https://github.com/apache/spark/pull/32378 ### What changes were proposed in this pull request? Extract common doc about hive format for `sql-ref-syntax-ddl-create-table-hiveformat.md` and `sql-ref-syntax-qry-select-transform.md` to

[GitHub] [spark] SparkQA removed a comment on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA removed a comment on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828184066 **[Test build #138027 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138027/testReport)** for PR 32374 at commit

[GitHub] [spark] SparkQA commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828254622 **[Test build #138027 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138027/testReport)** for PR 32374 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AngersZh commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621924639 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AngersZh commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621924361 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AngersZh commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621924059 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AngersZh commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621923506 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AngersZh commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621923162 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AngersZh commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621923044 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] beliefer opened a new pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

beliefer opened a new pull request #32377: URL: https://github.com/apache/spark/pull/32377 ### What changes were proposed in this pull request? This PR group exception messages in `sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog`. ### Why are the changes

[GitHub] [spark] maropu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

maropu commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621918709 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621918261 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621917938 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

maropu commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621917707 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621917084 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621916628 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] cloud-fan commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

cloud-fan commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621916208 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

maropu commented on a change in pull request #32365: URL: https://github.com/apache/spark/pull/32365#discussion_r621915888 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala ## @@ -2649,3 +2652,84 @@ case class

[GitHub] [spark] maropu commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

maropu commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828242678 Please describe more about what the differences are in the PR description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828115625 **[Test build #138020 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138020/testReport)** for PR 32365 at commit

[GitHub] [spark] SparkQA commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828240759 **[Test build #138020 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138020/testReport)** for PR 32365 at commit

[GitHub] [spark] maropu closed pull request #32328: [SPARK-35214][SQL] OptimizeSkewedJoin support ShuffledHashJoinExec

maropu closed pull request #32328: URL: https://github.com/apache/spark/pull/32328 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] maropu commented on pull request #32328: [SPARK-35214][SQL] OptimizeSkewedJoin support ShuffledHashJoinExec

maropu commented on pull request #32328: URL: https://github.com/apache/spark/pull/32328#issuecomment-828238814 Thanks! Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828100462 **[Test build #138019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138019/testReport)** for PR 32365 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

cloud-fan commented on a change in pull request #32303: URL: https://github.com/apache/spark/pull/32303#discussion_r621909386 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala ## @@ -1037,6 +1057,10 @@ trait CheckAnalysis

[GitHub] [spark] maropu commented on pull request #32375: [SPARK-33976][SQL][DOCS][3.0] Add a SQL doc page for a TRANSFORM clause

maropu commented on pull request #32375: URL: https://github.com/apache/spark/pull/32375#issuecomment-828236738 Merged to branch-3.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] maropu closed pull request #32375: [SPARK-33976][SQL][DOCS][3.0] Add a SQL doc page for a TRANSFORM clause

maropu closed pull request #32375: URL: https://github.com/apache/spark/pull/32375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] maropu commented on pull request #32376: [SPARK-33976][SQL][DOCS][3.1] Add a SQL doc page for a TRANSFORM clause

maropu commented on pull request #32376: URL: https://github.com/apache/spark/pull/32376#issuecomment-828234996 Looks fine. Merged to branch-3.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] maropu closed pull request #32376: [SPARK-33976][SQL][DOCS][3.1] Add a SQL doc page for a TRANSFORM clause

maropu closed pull request #32376: URL: https://github.com/apache/spark/pull/32376 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] cloud-fan commented on a change in pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

cloud-fan commented on a change in pull request #32303: URL: https://github.com/apache/spark/pull/32303#discussion_r621906079 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -2234,6 +2260,76 @@ class Analyzer(override val

[GitHub] [spark] LucaCanali closed pull request #26953: [SPARK-30306][CORE][PYTHON][WIP] Instrument Python UDF execution time and throughput metrics using Spark Metrics system

LucaCanali closed pull request #26953: URL: https://github.com/apache/spark/pull/26953 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] LucaCanali commented on pull request #26953: [SPARK-30306][CORE][PYTHON][WIP] Instrument Python UDF execution time and throughput metrics using Spark Metrics system

LucaCanali commented on pull request #26953: URL: https://github.com/apache/spark/pull/26953#issuecomment-828231831 I am closing this as the implementation should be refactored, what looks like a better way to implement this is to first work on the correctponding SQL metrics as in

[GitHub] [spark] maropu commented on pull request #32257: [SPARK-33976][SQL][DOCS][FOLLOWUP] Fix syntax error in select doc page

maropu commented on pull request #32257: URL: https://github.com/apache/spark/pull/32257#issuecomment-828230835 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] maropu closed pull request #32257: [SPARK-33976][SQL][DOCS][FOLLOWUP] Fix syntax error in select doc page

maropu closed pull request #32257: URL: https://github.com/apache/spark/pull/32257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] AmplabJenkins commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

AmplabJenkins commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828230757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42549/ --

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828230369 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42549/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #32373: [SPARK-35248] Spark shall load system class first in IsolatedClientLoader

AmplabJenkins commented on pull request #32373: URL: https://github.com/apache/spark/pull/32373#issuecomment-828228167 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42547/ --

[GitHub] [spark] SparkQA commented on pull request #32373: [SPARK-35248] Spark shall load system class first in IsolatedClientLoader

SparkQA commented on pull request #32373: URL: https://github.com/apache/spark/pull/32373#issuecomment-828228045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AmplabJenkins commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828226864 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138019/ -- This

<    1   2   3   4   5   6   >