[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733202278 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

AmplabJenkins commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-733202287 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

AmplabJenkins commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733202292 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733202282 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

AmplabJenkins commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-733202296 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733202277 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733202279 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] xkrogen commented on a change in pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

xkrogen commented on a change in pull request #29966: URL: https://github.com/apache/spark/pull/29966#discussion_r529838764 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2980,6 +2980,75 @@ private[spark] object Utils extends Logging {

[GitHub] [spark] xkrogen commented on a change in pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

xkrogen commented on a change in pull request #29966: URL: https://github.com/apache/spark/pull/29966#discussion_r529837613 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2980,6 +2980,75 @@ private[spark] object Utils extends Logging {

[GitHub] [spark] otterc commented on a change in pull request #30433: [SPARK-32916][SHUFFLE][test-maven][test-hadoop2.7] Ensure the number of chunks in meta file and index file are equal

otterc commented on a change in pull request #30433: URL: https://github.com/apache/spark/pull/30433#discussion_r529837473 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -827,13 +833,16 @@ void

[GitHub] [spark] imback82 commented on a change in pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

imback82 commented on a change in pull request #30490: URL: https://github.com/apache/spark/pull/30490#discussion_r529836248 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -467,25 +467,13 @@ class

[GitHub] [spark] imback82 opened a new pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

imback82 opened a new pull request #30490: URL: https://github.com/apache/spark/pull/30490 ### What changes were proposed in this pull request? This PR proposes to migrate `SHOW COLUMNS` to use `UnresolvedTableOrView` to resolve the table/view identifier. This allows

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r529831878 ## File path: core/src/main/scala/org/apache/spark/shuffle/ShuffleWriter.scala ## @@ -17,18 +17,466 @@ package org.apache.spark.shuffle -import

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r529831293 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1992,4 +1992,32 @@ package object config {

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r529830847 ## File path: core/src/main/scala/org/apache/spark/shuffle/PushShuffleWriterComponent.scala ## @@ -0,0 +1,464 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r529830296 ## File path: core/src/main/scala/org/apache/spark/shuffle/PushShuffleWriterComponent.scala ## @@ -0,0 +1,464 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] SparkQA removed a comment on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

SparkQA removed a comment on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-733113801 **[Test build #131682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131682/testReport)** for PR 29000 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733112768 **[Test build #131679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131679/testReport)** for PR 30478 at commit

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r529830075 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1992,4 +1992,32 @@ package object config {

[GitHub] [spark] SparkQA commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733189691 **[Test build #131679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131679/testReport)** for PR 30478 at commit

[GitHub] [spark] otterc commented on a change in pull request #30312: [SPARK-32917][SHUFFLE][CORE] Adds support for executors to push shuffle blocks after successful map task completion

otterc commented on a change in pull request #30312: URL: https://github.com/apache/spark/pull/30312#discussion_r529829788 ## File path: core/src/main/scala/org/apache/spark/shuffle/PushShuffleWriterComponent.scala ## @@ -0,0 +1,464 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] SparkQA commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

SparkQA commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-733189434 **[Test build #131682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131682/testReport)** for PR 29000 at commit

[GitHub] [spark] zero323 commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

zero323 commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r529829185 ## File path: python/pyspark/mllib/util.py ## @@ -273,24 +317,30 @@ def convertVectorColumnsFromML(dataset, *cols): return

[GitHub] [spark] rf972 commented on a change in pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

rf972 commented on a change in pull request #29695: URL: https://github.com/apache/spark/pull/29695#discussion_r529825209 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2ScanRelationPushDown.scala ## @@ -73,33 +77,25 @@ object

[GitHub] [spark] viirya commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

viirya commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733185335 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] zero323 commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

zero323 commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r529824599 ## File path: python/pyspark/mllib/stat/_statistics.py ## @@ -65,11 +65,19 @@ def colStats(rdd): """ Computes column-wise summary

[GitHub] [spark] MaxGekk commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

MaxGekk commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733184440 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] otterc commented on a change in pull request #30433: [SPARK-32916][SHUFFLE][test-maven][test-hadoop2.7] Ensure the number of chunks in meta file and index file are equal

otterc commented on a change in pull request #30433: URL: https://github.com/apache/spark/pull/30433#discussion_r529823126 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java ## @@ -827,13 +833,16 @@ void

[GitHub] [spark] SparkQA removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733112980 **[Test build #131681 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131681/testReport)** for PR 30403 at commit

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733183154 **[Test build #131681 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131681/testReport)** for PR 30403 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733180683 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733180683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

AmplabJenkins removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733179070 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

AmplabJenkins commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733179070 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733173446 **[Test build #131691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131691/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733175455 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] jkleckner commented on pull request #30283: [SPARK-24266][K8S][2.4] Restart the watcher when we receive a version changed from k8s

jkleckner commented on pull request #30283: URL: https://github.com/apache/spark/pull/30283#issuecomment-733175795 Thank you, @dongjoon-hyun ! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733175437 **[Test build #131691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131691/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733175455 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733174299 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733174299 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

SparkQA commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733173573 **[Test build #131692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131692/testReport)** for PR 30427 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

AmplabJenkins removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733173015 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

AmplabJenkins removed a comment on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733173014 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733173446 **[Test build #131691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131691/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

AmplabJenkins removed a comment on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733173016 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

AmplabJenkins removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733173017 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

AmplabJenkins commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733173017 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

AmplabJenkins commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733173015 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

AmplabJenkins commented on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733173014 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

AmplabJenkins commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733173016 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

SparkQA removed a comment on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733115921 **[Test build #131684 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131684/testReport)** for PR 30468 at commit

[GitHub] [spark] SparkQA commented on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

SparkQA commented on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-733163795 **[Test build #131684 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131684/testReport)** for PR 30468 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

dongjoon-hyun commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733156769 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

SparkQA removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733123537 **[Test build #131686 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131686/testReport)** for PR 30475 at commit

[GitHub] [spark] SparkQA commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

SparkQA commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-733156509 **[Test build #131686 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131686/testReport)** for PR 30475 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

AmplabJenkins removed a comment on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-733150165 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

AmplabJenkins removed a comment on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-733149740 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30487: [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in run-tests-jenkins script

AmplabJenkins removed a comment on pull request #30487: URL: https://github.com/apache/spark/pull/30487#issuecomment-733149187 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun closed pull request #30283: [SPARK-24266][K8S][2.4] Restart the watcher when we receive a version changed from k8s

dongjoon-hyun closed pull request #30283: URL: https://github.com/apache/spark/pull/30283 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30283: [SPARK-24266][K8S][2.4] Restart the watcher when we receive a version changed from k8s

dongjoon-hyun commented on a change in pull request #30283: URL: https://github.com/apache/spark/pull/30283#discussion_r529783873 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatusWatcher.scala ## @@ -42,13

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30283: [SPARK-24266][K8S][2.4] Restart the watcher when we receive a version changed from k8s

dongjoon-hyun commented on a change in pull request #30283: URL: https://github.com/apache/spark/pull/30283#discussion_r529783812 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesClientApplication.scala ## @@ -230,7

[GitHub] [spark] AmplabJenkins commented on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

AmplabJenkins commented on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-733150165 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

AmplabJenkins commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-733149740 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30487: [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in run-tests-jenkins script

AmplabJenkins commented on pull request #30487: URL: https://github.com/apache/spark/pull/30487#issuecomment-733149187 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

SparkQA commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733148850 **[Test build #131690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131690/testReport)** for PR 30336 at commit

[GitHub] [spark] SparkQA commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

SparkQA commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733148701 **[Test build #131689 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131689/testReport)** for PR 30408 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733146296 **[Test build #131687 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131687/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733147893 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30487: [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in run-tests-jenkins script

SparkQA removed a comment on pull request #30487: URL: https://github.com/apache/spark/pull/30487#issuecomment-733031613 **[Test build #131669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131669/testReport)** for PR 30487 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733147893 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733147874 **[Test build #131687 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131687/testReport)** for PR 30480 at commit

[GitHub] [spark] SparkQA commented on pull request #30487: [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in run-tests-jenkins script

SparkQA commented on pull request #30487: URL: https://github.com/apache/spark/pull/30487#issuecomment-733147816 **[Test build #131669 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131669/testReport)** for PR 30487 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

AmplabJenkins removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733146882 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

dongjoon-hyun commented on a change in pull request #30483: URL: https://github.com/apache/spark/pull/30483#discussion_r529778176 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -765,6 +765,11 @@ object SQLConf { .booleanConf

[GitHub] [spark] AmplabJenkins commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

AmplabJenkins commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733146882 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

SparkQA removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732993024 **[Test build #131664 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131664/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

SparkQA commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733146375 **[Test build #131664 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131664/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

SparkQA commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733146296 **[Test build #131687 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131687/testReport)** for PR 30480 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

AmplabJenkins removed a comment on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-732756039 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733146309 **[Test build #131688 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131688/testReport)** for PR 30478 at commit

[GitHub] [spark] wangyum commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

wangyum commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733146199 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] dongjoon-hyun commented on pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

dongjoon-hyun commented on pull request #30480: URL: https://github.com/apache/spark/pull/30480#issuecomment-733145845 ok to test This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30480: [SPARK-32921][SHUFFLE][test-maven][test-hadoop2.7] MapOutputTracker extensions to support push-based shuffle

dongjoon-hyun commented on a change in pull request #30480: URL: https://github.com/apache/spark/pull/30480#discussion_r529776436 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -1011,4 +1333,47 @@ private[spark] object MapOutputTracker extends

[GitHub] [spark] viirya commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

viirya commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r529776310 ## File path: python/pyspark/mllib/util.py ## @@ -313,24 +363,30 @@ def convertMatrixColumnsToML(dataset, *cols): return

[GitHub] [spark] viirya commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

viirya commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r529776085 ## File path: python/pyspark/mllib/util.py ## @@ -273,24 +317,30 @@ def convertVectorColumnsFromML(dataset, *cols): return

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

AmplabJenkins removed a comment on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-733143722 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

AmplabJenkins removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733143719 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

AmplabJenkins removed a comment on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-733143723 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30467: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

AmplabJenkins removed a comment on pull request #30467: URL: https://github.com/apache/spark/pull/30467#issuecomment-733143724 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

AmplabJenkins commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-733143722 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

AmplabJenkins commented on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-733143723 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

AmplabJenkins commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733143719 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30467: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

AmplabJenkins commented on pull request #30467: URL: https://github.com/apache/spark/pull/30467#issuecomment-733143724 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

gaborgsomogyi commented on a change in pull request #30336: URL: https://github.com/apache/spark/pull/30336#discussion_r529772096 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatisticsPage.scala ## @@ -199,49 +209,100 @@ private[ui]

[GitHub] [spark] viirya commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

viirya commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r529771614 ## File path: python/pyspark/mllib/stat/_statistics.py ## @@ -65,11 +65,19 @@ def colStats(rdd): """ Computes column-wise summary

[GitHub] [spark] dongjoon-hyun commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

dongjoon-hyun commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733141118 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #30429: [SPARK-33492][SQL] DSv2: Append/Overwrite/ReplaceTable should invalidate cache

dongjoon-hyun commented on pull request #30429: URL: https://github.com/apache/spark/pull/30429#issuecomment-733140355 Thank you, @rdblue , @cloud-fan , @sunchao . This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

viirya commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r529769785 ## File path: python/pyspark/mllib/regression.py ## @@ -224,11 +234,13 @@ def _regression_train_wrapper(train_func, modelClass, data, initial_weights):

[GitHub] [spark] dongjoon-hyun commented on pull request #30487: [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in run-tests-jenkins script

dongjoon-hyun commented on pull request #30487: URL: https://github.com/apache/spark/pull/30487#issuecomment-733139251 Merged to master/branch-3.0/branch-2.4. This is an automated message from the Apache Git Service. To

<    1   2   3   4   5   6   7   8   9   10   >