[GitHub] [spark] maropu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

maropu commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r530021740 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -503,13 +503,32 @@ class AstBuilder extends

[GitHub] [spark] zero323 commented on a change in pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

zero323 commented on a change in pull request #30413: URL: https://github.com/apache/spark/pull/30413#discussion_r530021426 ## File path: python/pyspark/mllib/util.py ## @@ -273,24 +317,30 @@ def convertVectorColumnsFromML(dataset, *cols): return

[GitHub] [spark] HyukjinKwon commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

HyukjinKwon commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733312646 I think it's fine to avoid removing `spark.yarn.dist.archives` out yet - maybe we could think about removing out once this feature becomes stable (?). Yarn also has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

HyukjinKwon commented on a change in pull request #30486: URL: https://github.com/apache/spark/pull/30486#discussion_r530016725 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1803,6 +1803,16 @@ package object config { .toSequence

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

HyukjinKwon commented on a change in pull request #30486: URL: https://github.com/apache/spark/pull/30486#discussion_r530016260 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -1520,6 +1534,30 @@ class SparkContext(config: SparkConf) extends Logging

[GitHub] [spark] ulysses-you commented on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

ulysses-you commented on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-733293754 cc @maropu @AngersZh @wangyum @HyukjinKwon This is an automated message from the Apache Git Service.

[GitHub] [spark] imback82 commented on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

imback82 commented on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733293200 cc @cloud-fan thanks! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

SparkQA commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733283254 **[Test build #131704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131704/testReport)** for PR 30427 at commit

[GitHub] [spark] SparkQA commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

SparkQA commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733283106 **[Test build #131703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131703/testReport)** for PR 30470 at commit

[GitHub] [spark] SparkQA commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733283090 **[Test build #131702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131702/testReport)** for PR 30478 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733282467 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733236746 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

AmplabJenkins removed a comment on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733119823 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] wangyum commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

wangyum commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-733282626 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-733282467 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733237855 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

AmplabJenkins commented on pull request #30486: URL: https://github.com/apache/spark/pull/30486#issuecomment-733282465 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733282468 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] wangyum commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

wangyum commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733282158 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] viirya commented on a change in pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

viirya commented on a change in pull request #30492: URL: https://github.com/apache/spark/pull/30492#discussion_r529968023 ## File path: core/src/main/scala/org/apache/spark/storage/FallbackStorage.scala ## @@ -0,0 +1,170 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [spark] HeartSaVioR commented on pull request #30366: [SPARK-33440][CORE] Use current timestamp with warning log when the issue date for token is not set up properly

HeartSaVioR commented on pull request #30366: URL: https://github.com/apache/spark/pull/30366#issuecomment-733278446 cc. @tgravescs @mridulm Friendly reminder. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HeartSaVioR commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

HeartSaVioR commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733277464 Just rebased. I'll merge either Github Action or Jenkins is happy with the change. This is an automated

[GitHub] [spark] HeartSaVioR commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

HeartSaVioR commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733274719 Thanks all for reviewing and thanks @gaborgsomogyi for the contribution. Merged to master. This is an

[GitHub] [spark] HeartSaVioR closed pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

HeartSaVioR closed pull request #30336: URL: https://github.com/apache/spark/pull/30336 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HeartSaVioR commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

HeartSaVioR commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733274006 I'll merge this as Github Action passed for the last change (e2f1594). Jenkins seems to have been unstable and I don't like to drag it anymore due to this.

[GitHub] [spark] AmplabJenkins commented on pull request #30471: [WIP][SPARK-33520][ML] make CrossValidator/TrainValidateSplit support Python backend estimator/model

AmplabJenkins commented on pull request #30471: URL: https://github.com/apache/spark/pull/30471#issuecomment-733267314 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733265378 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30488: [SPARK-33536][SQL] Avoid changing dataset_id of LogicalPlan in join() to not break DetectAmbiguousSelfJoin

AmplabJenkins removed a comment on pull request #30488: URL: https://github.com/apache/spark/pull/30488#issuecomment-733265074 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-733265378 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

SparkQA commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733265228 **[Test build #131701 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131701/testReport)** for PR 29122 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30488: [SPARK-33536][SQL] Avoid changing dataset_id of LogicalPlan in join() to not break DetectAmbiguousSelfJoin

AmplabJenkins commented on pull request #30488: URL: https://github.com/apache/spark/pull/30488#issuecomment-733265074 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

AmplabJenkins removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733264415 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

AmplabJenkins commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733264415 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] shaneknapp commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

shaneknapp commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733263758 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

AmplabJenkins removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733260155 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

AmplabJenkins removed a comment on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733238511 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

AmplabJenkins commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733260155 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

AmplabJenkins commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733260141 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

AmplabJenkins removed a comment on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733260129 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

AmplabJenkins commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733260110 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

AmplabJenkins commented on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733260129 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

dongjoon-hyun commented on pull request #30492: URL: https://github.com/apache/spark/pull/30492#issuecomment-733260121 Could you review this, @holdenk , @viirya , @mridulm ? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

AmplabJenkins removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733258144 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733258142 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

AmplabJenkins removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733258147 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30485: [SPARK-33533][SQL] BasicConnectionProvider should consider case-sensitivity for properties.

AmplabJenkins removed a comment on pull request #30485: URL: https://github.com/apache/spark/pull/30485#issuecomment-733258145 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins removed a comment on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733258139 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

AmplabJenkins removed a comment on pull request #30491: URL: https://github.com/apache/spark/pull/30491#issuecomment-733258141 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733258148 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

AmplabJenkins removed a comment on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733258140 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30212: [SPARK-33308][SQL] Refract current grouping analytics

AmplabJenkins removed a comment on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-733258146 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

AmplabJenkins commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733258147 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30485: [SPARK-33533][SQL] BasicConnectionProvider should consider case-sensitivity for properties.

AmplabJenkins commented on pull request #30485: URL: https://github.com/apache/spark/pull/30485#issuecomment-733258157 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30212: [SPARK-33308][SQL] Refract current grouping analytics

AmplabJenkins commented on pull request #30212: URL: https://github.com/apache/spark/pull/30212#issuecomment-733258146 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733258154 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

AmplabJenkins commented on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733258155 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733258148 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733258142 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

AmplabJenkins commented on pull request #30491: URL: https://github.com/apache/spark/pull/30491#issuecomment-733258141 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

AmplabJenkins commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733258153 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

SparkQA removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733173573 **[Test build #131692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131692/testReport)** for PR 30427 at commit

[GitHub] [spark] SparkQA commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

SparkQA commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-733255004 **[Test build #131692 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131692/testReport)** for PR 30427 at commit

[GitHub] [spark] dongjoon-hyun opened a new pull request #30492: [SPARK-33545][CORE] Support Fallback Storage during Worker decommission

dongjoon-hyun opened a new pull request #30492: URL: https://github.com/apache/spark/pull/30492 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ###

[GitHub] [spark] imback82 commented on a change in pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

imback82 commented on a change in pull request #30490: URL: https://github.com/apache/spark/pull/30490#discussion_r529895862 ## File path: sql/core/src/test/resources/sql-tests/results/show_columns.sql.out ## @@ -129,26 +129,26 @@ SHOW COLUMNS IN showdb.showcolumn3 -- !query

[GitHub] [spark] SparkQA removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

SparkQA removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733113991 **[Test build #131683 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131683/testReport)** for PR 28026 at commit

[GitHub] [spark] SparkQA commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

SparkQA commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-733242771 **[Test build #131683 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131683/testReport)** for PR 28026 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733146309 **[Test build #131688 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131688/testReport)** for PR 30478 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

AmplabJenkins commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-733238511 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733237855 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30487: [SPARK-33535][INFRA][TESTS] Export LANG to en_US.UTF-8 in run-tests-jenkins script

AmplabJenkins commented on pull request #30487: URL: https://github.com/apache/spark/pull/30487#issuecomment-733236949 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

SparkQA commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733236803 **[Test build #131688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131688/testReport)** for PR 30478 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

AmplabJenkins commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-733236746 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30472: [WIP][SPARK-32221] Avoid possible errors due to incorrect file size or type supplied in spark conf.

AmplabJenkins removed a comment on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-733232808 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30472: [WIP][SPARK-32221] Avoid possible errors due to incorrect file size or type supplied in spark conf.

AmplabJenkins commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-733232808 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

SparkQA commented on pull request #30491: URL: https://github.com/apache/spark/pull/30491#issuecomment-733231561 **[Test build #131696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131696/testReport)** for PR 30491 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

AmplabJenkins removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733230963 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

AmplabJenkins removed a comment on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-733230959 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

AmplabJenkins removed a comment on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733230958 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins removed a comment on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733230957 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

AmplabJenkins removed a comment on pull request #30484: URL: https://github.com/apache/spark/pull/30484#issuecomment-733230956 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

AmplabJenkins commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-733230957 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

AmplabJenkins commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-733230963 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

AmplabJenkins commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733230958 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

AmplabJenkins commented on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-733230959 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

AmplabJenkins commented on pull request #30484: URL: https://github.com/apache/spark/pull/30484#issuecomment-733230956 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

SparkQA removed a comment on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733148701 **[Test build #131689 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131689/testReport)** for PR 30408 at commit

[GitHub] [spark] SparkQA commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

SparkQA commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-733216545 **[Test build #131689 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131689/testReport)** for PR 30408 at commit

[GitHub] [spark] sunchao opened a new pull request #30491: [SPARK-33492][SQL][FOLLOWUP] Use callback instead of passing Spark session and v2 relation

sunchao opened a new pull request #30491: URL: https://github.com/apache/spark/pull/30491 ### What changes were proposed in this pull request? This replaces Spark session and `DataSourceV2Relation` in V2 write plans by replacing them with a callback `afterWrite`.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

AmplabJenkins removed a comment on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-733206259 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

AmplabJenkins commented on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-733206259 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] xkrogen commented on a change in pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

xkrogen commented on a change in pull request #29966: URL: https://github.com/apache/spark/pull/29966#discussion_r529847248 ## File path: sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala ## @@ -159,6 +161,13 @@ class SessionResourceLoader(session:

[GitHub] [spark] xkrogen commented on a change in pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

xkrogen commented on a change in pull request #29966: URL: https://github.com/apache/spark/pull/29966#discussion_r529840209 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2980,6 +2980,77 @@ private[spark] object Utils extends Logging {

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733202978 **[Test build #131695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131695/testReport)** for PR 30403 at commit

[GitHub] [spark] SparkQA commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

SparkQA commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-733202862 **[Test build #131694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131694/testReport)** for PR 30482 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

AmplabJenkins removed a comment on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-733202287 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

AmplabJenkins removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-733202279 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

AmplabJenkins removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-733202292 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30490: [SPARK-33543][SQL] Migrate SHOW COLUMNS command to use UnresolvedTableOrView to resolve the identifier

SparkQA commented on pull request #30490: URL: https://github.com/apache/spark/pull/30490#issuecomment-733202766 **[Test build #131693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131693/testReport)** for PR 30490 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

AmplabJenkins removed a comment on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-733202281 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-733202277 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    1   2   3   4   5   6   7   8   9   10   >