[GitHub] [spark] AmplabJenkins commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

AmplabJenkins commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828505015 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42564/ --

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AngersZh commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622238616 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -92,6 +92,36 @@ object IntervalUtils { }

[GitHub] [spark] SparkQA commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828504162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] cloud-fan closed pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

cloud-fan closed pull request #32380: URL: https://github.com/apache/spark/pull/32380 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] cloud-fan commented on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

cloud-fan commented on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828479213 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] cloud-fan commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

cloud-fan commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622206825 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -92,6 +92,36 @@ object IntervalUtils { }

[GitHub] [spark] cloud-fan commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

cloud-fan commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622206277 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -92,6 +92,36 @@ object IntervalUtils { }

[GitHub] [spark] cloud-fan commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

cloud-fan commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622204367 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -92,6 +92,36 @@ object IntervalUtils { }

[GitHub] [spark] cloud-fan commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

cloud-fan commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622203816 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -92,6 +92,36 @@ object IntervalUtils { }

[GitHub] [spark] cloud-fan commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

cloud-fan commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622202234 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -92,6 +92,36 @@ object IntervalUtils { }

[GitHub] [spark] cloud-fan commented on a change in pull request #32370: [SPARK-35244][SQL] Invoke should throw the original exception

cloud-fan commented on a change in pull request #32370: URL: https://github.com/apache/spark/pull/32370#discussion_r622197627 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -129,7 +129,12 @@ trait InvokeLike

[GitHub] [spark] SparkQA commented on pull request #32374: [WIP][SPARK-35253][BUILD][SQL] Upgrade Janino from 3.0.16 to 3.1.3

SparkQA commented on pull request #32374: URL: https://github.com/apache/spark/pull/32374#issuecomment-828459208 **[Test build #138045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138045/testReport)** for PR 32374 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32383: [SPARK-35255][Build]Automated formatting for Scala Code for Blank Lines

AmplabJenkins commented on pull request #32383: URL: https://github.com/apache/spark/pull/32383#issuecomment-828458768 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

AmplabJenkins removed a comment on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828391255 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

AmplabJenkins removed a comment on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828458067 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138037/

[GitHub] [spark] AmplabJenkins commented on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

AmplabJenkins commented on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828458068 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138042/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

AmplabJenkins commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828458067 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138037/ -- This

[GitHub] [spark] lipzhu opened a new pull request #32383: [SPARK-35255][Build]Automated formatting for Scala Code for Blank Lines

lipzhu opened a new pull request #32383: URL: https://github.com/apache/spark/pull/32383 ### What changes were proposed in this pull request? https://github.com/databricks/scala-style-guide#blanklines

[GitHub] [spark] SparkQA removed a comment on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

SparkQA removed a comment on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828348579 **[Test build #138042 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138042/testReport)** for PR 32381 at commit

[GitHub] [spark] SparkQA commented on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

SparkQA commented on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828443444 **[Test build #138042 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138042/testReport)** for PR 32381 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA removed a comment on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828309624 **[Test build #138037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138037/testReport)** for PR 32377 at commit

[GitHub] [spark] SparkQA commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828434899 **[Test build #138037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138037/testReport)** for PR 32377 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

AmplabJenkins removed a comment on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828419041 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138032/

[GitHub] [spark] AmplabJenkins commented on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

AmplabJenkins commented on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828419041 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138032/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

SparkQA removed a comment on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828221150 **[Test build #138032 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138032/testReport)** for PR 32367 at commit

[GitHub] [spark] SparkQA commented on pull request #32367: [SPARK-35020][SQL] Group exception messages in catalyst/util

SparkQA commented on pull request #32367: URL: https://github.com/apache/spark/pull/32367#issuecomment-828417354 **[Test build #138032 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138032/testReport)** for PR 32367 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32382: [SPARK-35254][Build]Upgrade SBT to 1.5.1

AmplabJenkins commented on pull request #32382: URL: https://github.com/apache/spark/pull/32382#issuecomment-828417247 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828416291 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138041/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

AmplabJenkins removed a comment on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828416289 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138038/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

AmplabJenkins removed a comment on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828416293 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138039/

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828416291 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138041/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

AmplabJenkins commented on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828416289 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138038/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

AmplabJenkins commented on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828416293 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138039/ -- This

[GitHub] [spark] yaooqinn commented on a change in pull request #32370: [SPARK-35244][SQL] Invoke should throw the original exception

yaooqinn commented on a change in pull request #32370: URL: https://github.com/apache/spark/pull/32370#discussion_r622124890 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala ## @@ -129,7 +129,12 @@ trait InvokeLike

[GitHub] [spark] sadhen edited a comment on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

sadhen edited a comment on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-828405772 I tried to turn off `verifySchema` by default: ``` -def createDataFrame(self, data, schema=None, samplingRatio=None, verifySchema=True): +def

[GitHub] [spark] SparkQA removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828310166 **[Test build #138041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138041/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828406676 **[Test build #138041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138041/testReport)** for PR 31517 at commit

[GitHub] [spark] sadhen commented on pull request #32332: [SPARK-35211][PYTHON] verify inferred schema for _create_dataframe

sadhen commented on pull request #32332: URL: https://github.com/apache/spark/pull/32332#issuecomment-828405772 I tried to turn off `verifySchema` by default: ``` -def createDataFrame(self, data, schema=None, samplingRatio=None, verifySchema=True): +def

[GitHub] [spark] dmsolow commented on pull request #31887: [SPARK-34794][SQL] Fix nested transform issue

dmsolow commented on pull request #31887: URL: https://github.com/apache/spark/pull/31887#issuecomment-828405375 > > @maropu I won't be able to work on this until June 1, other duties are getting in the way. > > Ah, I see. Is it okay that I take this over? Go ahead. --

[GitHub] [spark] SparkQA removed a comment on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

SparkQA removed a comment on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828309862 **[Test build #138039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138039/testReport)** for PR 32232 at commit

[GitHub] [spark] SparkQA commented on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

SparkQA commented on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828404198 **[Test build #138039 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138039/testReport)** for PR 32232 at commit

[GitHub] [spark] lipzhu opened a new pull request #32382: [SPARK-35254][Build]Upgrade SBT to 1.5.1

lipzhu opened a new pull request #32382: URL: https://github.com/apache/spark/pull/32382 ### What changes were proposed in this pull request? This PR aims to upgrade SBT to 1.5.1. ### Why are the changes needed? https://github.com/sbt/sbt/releases/tag/v1.5.1

[GitHub] [spark] SparkQA removed a comment on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

SparkQA removed a comment on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828309720 **[Test build #138038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138038/testReport)** for PR 32261 at commit

[GitHub] [spark] SparkQA commented on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

SparkQA commented on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828401464 **[Test build #138038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138038/testReport)** for PR 32261 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #32361: [SPARK-35240][SS] Use CheckpointFileManager for checkpoint file manipulation

cloud-fan commented on a change in pull request #32361: URL: https://github.com/apache/spark/pull/32361#discussion_r622103974 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/CheckpointFileManager.scala ## @@ -83,6 +83,9 @@ trait

[GitHub] [spark] AmplabJenkins commented on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

AmplabJenkins commented on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828391255 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42561/ --

[GitHub] [spark] SparkQA commented on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

SparkQA commented on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828391195 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

AmplabJenkins removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828386175 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138029/

[GitHub] [spark] AmplabJenkins commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

AmplabJenkins commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828386175 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138029/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

AmplabJenkins removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828230757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42549/

[GitHub] [spark] SparkQA removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

SparkQA removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828184326 **[Test build #138029 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138029/testReport)** for PR 32049 at commit

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-828384720 **[Test build #138029 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138029/testReport)** for PR 32049 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AmplabJenkins removed a comment on pull request #32266: URL: https://github.com/apache/spark/pull/32266#issuecomment-828381373 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42563/

[GitHub] [spark] AmplabJenkins commented on pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AmplabJenkins commented on pull request #32266: URL: https://github.com/apache/spark/pull/32266#issuecomment-828381373 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42563/ --

[GitHub] [spark] SparkQA commented on pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

SparkQA commented on pull request #32266: URL: https://github.com/apache/spark/pull/32266#issuecomment-828381339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

AmplabJenkins removed a comment on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828380251 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42562/

[GitHub] [spark] AmplabJenkins commented on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

AmplabJenkins commented on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828380251 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42562/ --

[GitHub] [spark] SparkQA commented on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

SparkQA commented on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828378538 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42562/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

AmplabJenkins removed a comment on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828351231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42557/

[GitHub] [spark] AmplabJenkins commented on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

AmplabJenkins commented on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828351231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42557/ --

[GitHub] [spark] SparkQA commented on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

SparkQA commented on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828351206 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42557/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31776: [SPARK-34661][SQL] Clean up `OriginalType` and `DecimalMetadata ` usage in Parquet related code

AmplabJenkins removed a comment on pull request #31776: URL: https://github.com/apache/spark/pull/31776#issuecomment-828348565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42559/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

AmplabJenkins removed a comment on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828348497 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42556/

[GitHub] [spark] SparkQA commented on pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

SparkQA commented on pull request #32266: URL: https://github.com/apache/spark/pull/32266#issuecomment-828348780 **[Test build #138044 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138044/testReport)** for PR 32266 at commit

[GitHub] [spark] SparkQA commented on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

SparkQA commented on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828348617 **[Test build #138043 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138043/testReport)** for PR 32380 at commit

[GitHub] [spark] SparkQA commented on pull request #32381: [SPARK-35229][WEBUI] Limit the maximum number of items on the timeline view.

SparkQA commented on pull request #32381: URL: https://github.com/apache/spark/pull/32381#issuecomment-828348579 **[Test build #138042 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138042/testReport)** for PR 32381 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

AmplabJenkins commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828348497 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42556/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31776: [SPARK-34661][SQL] Clean up `OriginalType` and `DecimalMetadata ` usage in Parquet related code

AmplabJenkins commented on pull request #31776: URL: https://github.com/apache/spark/pull/31776#issuecomment-828348565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42559/ --

[GitHub] [spark] SparkQA commented on pull request #32377: [SPARK-35021][SQL] Group exception messages in connector/catalog

SparkQA commented on pull request #32377: URL: https://github.com/apache/spark/pull/32377#issuecomment-828348442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #31776: [SPARK-34661][SQL] Clean up `OriginalType` and `DecimalMetadata ` usage in Parquet related code

SparkQA commented on pull request #31776: URL: https://github.com/apache/spark/pull/31776#issuecomment-828348520 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] ulysses-you commented on a change in pull request #32355: [SPARK-35221][SQL] Add join hint build side check

ulysses-you commented on a change in pull request #32355: URL: https://github.com/apache/spark/pull/32355#discussion_r622046617 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HintErrorLogger.scala ## @@ -42,6 +45,17 @@ object HintErrorLogger

[GitHub] [spark] SparkQA commented on pull request #32261: [SPARK-35151][BUILD] Add compile arg to suppress `symbol literal is deprecated` compilation warnings in Scala 2.13

SparkQA commented on pull request #32261: URL: https://github.com/apache/spark/pull/32261#issuecomment-828347575 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42557/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828347005 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42560/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AmplabJenkins removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828347004 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138036/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

AmplabJenkins removed a comment on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828347003 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42558/

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828347005 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42560/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

AmplabJenkins commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828347004 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/138036/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

AmplabJenkins commented on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828347003 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/42558/ --

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828345076 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32232: [SPARK-35135][CORE] Turn the `WritablePartitionedIterator` from a trait into a default implementation class

SparkQA commented on pull request #32232: URL: https://github.com/apache/spark/pull/32232#issuecomment-828344365 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42558/ --

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AngersZh commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622041722 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -93,13 +95,22 @@ object IntervalUtils {

[GitHub] [spark] SparkQA removed a comment on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA removed a comment on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828264571 **[Test build #138036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138036/testReport)** for PR 32365 at commit

[GitHub] [spark] SparkQA commented on pull request #32365: [SPARK-35228][SQL] Add expression ToPrettyString for keep consistent between hive/spark format in df.show and transform

SparkQA commented on pull request #32365: URL: https://github.com/apache/spark/pull/32365#issuecomment-828337390 **[Test build #138036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138036/testReport)** for PR 32365 at commit

[GitHub] [spark] maropu closed pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

maropu closed pull request #32378: URL: https://github.com/apache/spark/pull/32378 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] maropu commented on pull request #32378: [SPARK-35159][SQL][DOCS][3.0] Extract hive format doc

maropu commented on pull request #32378: URL: https://github.com/apache/spark/pull/32378#issuecomment-828337225 Merged to branch-3.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] sarutak commented on pull request #32372: [SPARK-35247][SQL] Add `mask` built-in function as a data masking function

sarutak commented on pull request #32372: URL: https://github.com/apache/spark/pull/32372#issuecomment-828336591 > The Hive data masking functions were removed in #21786 oh... I didn't notice. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AngersZh commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622032465 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala ## @@ -1774,6 +1774,45 @@ class CastSuite

[GitHub] [spark] maropu closed pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

maropu closed pull request #32379: URL: https://github.com/apache/spark/pull/32379 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] maropu commented on pull request #32379: [SPARK-35159][SQL][DOCS][3.1] Extract hive format doc

maropu commented on pull request #32379: URL: https://github.com/apache/spark/pull/32379#issuecomment-828336152 Merged to branch-3.1. Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] ulysses-you commented on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

ulysses-you commented on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828335326 @maropu thank you for the so quick speed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] sarutak opened a new pull request #32381: [SPARK-35229][SQL] Limit the maximum number of items on the timeline view.

[GitHub] [spark] ulysses-you commented on pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

ulysses-you commented on pull request #32380: URL: https://github.com/apache/spark/pull/32380#issuecomment-828333562 cc @maropu @cloud-fan @c21 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AngersZh commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622029023 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala ## @@ -93,13 +95,22 @@ object IntervalUtils {

[GitHub] [spark] ulysses-you opened a new pull request #32380: [SPARK-34781][SQL][FOLLOWUP] Adjust the order of AQE optimizer rules

ulysses-you opened a new pull request #32380: URL: https://github.com/apache/spark/pull/32380 ### What changes were proposed in this pull request? Reorder `DemoteBroadcastHashJoin` and `EliminateUnnecessaryJoin`. ### Why are the changes needed? Skip unnecessary

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #32266: [SPARK-35111][SQL] Support Cast string to year-month interval

AngersZh commented on a change in pull request #32266: URL: https://github.com/apache/spark/pull/32266#discussion_r622028747 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala ## @@ -1774,6 +1774,45 @@ class CastSuite

[GitHub] [spark] ulysses-you commented on pull request #32328: [SPARK-35214][SQL] OptimizeSkewedJoin support ShuffledHashJoinExec

ulysses-you commented on pull request #32328: URL: https://github.com/apache/spark/pull/32328#issuecomment-828322637 thank you all ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] hvanhovell commented on pull request #32198: [SPARK-26164][SQL] Allow concurrent writers for writing dynamic partitions and bucket table

hvanhovell commented on pull request #32198: URL: https://github.com/apache/spark/pull/32198#issuecomment-828320490 One more thing, how much does this improve the write? Local sorts before the write are typically not too bad if you look at the cycles spend during the write. A much bigger

[GitHub] [spark] hvanhovell commented on pull request #32198: [SPARK-26164][SQL] Allow concurrent writers for writing dynamic partitions and bucket table

hvanhovell commented on pull request #32198: URL: https://github.com/apache/spark/pull/32198#issuecomment-828317277 @c21 this doesn't do any sort of memory tracking right? How do you avoid OOMs? -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #31517: [SPARK-34309][BUILD][CORE][SQL][K8S]Use Caffeine instead of Guava Cache

SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-828310166 **[Test build #138041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138041/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #31776: [SPARK-34661][SQL] Clean up `OriginalType` and `DecimalMetadata ` usage in Parquet related code

SparkQA commented on pull request #31776: URL: https://github.com/apache/spark/pull/31776#issuecomment-828310099 **[Test build #138040 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/138040/testReport)** for PR 31776 at commit

<    1   2   3   4   5   6   >