[GitHub] [spark] AmplabJenkins removed a comment on pull request #30467: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30467: URL: https://github.com/apache/spark/pull/30467#issuecomment-732841775 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30467: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30467: URL: https://github.com/apache/spark/pull/30467#issuecomment-732841775 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] beliefer commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
beliefer commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732840939 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732838910 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732756465 **[Test build #131637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131637/testReport)** for PR 30412 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732838910 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732838546 **[Test build #131637 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131637/testReport)** for PR 30412 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-732835381 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-732835381 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-732790797 **[Test build #131642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131642/testReport)** for PR 30481 at commit

[GitHub] [spark] SparkQA commented on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
SparkQA commented on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-732834680 **[Test build #131642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131642/testReport)** for PR 30481 at commit

[GitHub] [spark] cloud-fan closed pull request #30457: [SPARK-33514][SQL] Migrate TRUNCATE TABLE command to use UnresolvedTable to resolve the identifier

2020-11-24 Thread GitBox
cloud-fan closed pull request #30457: URL: https://github.com/apache/spark/pull/30457 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #30457: [SPARK-33514][SQL] Migrate TRUNCATE TABLE command to use UnresolvedTable to resolve the identifier

2020-11-24 Thread GitBox
cloud-fan commented on pull request #30457: URL: https://github.com/apache/spark/pull/30457#issuecomment-732833005 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] gengliangwang commented on a change in pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
gengliangwang commented on a change in pull request #30440: URL: https://github.com/apache/spark/pull/30440#discussion_r529459190 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -98,6 +98,19 @@ object Cast { case _ =>

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732827738 **[Test build #131650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131650/testReport)** for PR 30421 at commit

[GitHub] [spark] SparkQA commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
SparkQA commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732827618 **[Test build #131649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131649/testReport)** for PR 30427 at commit

[GitHub] [spark] SparkQA commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
SparkQA commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732827355 **[Test build #131647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131647/testReport)** for PR 30482 at commit

[GitHub] [spark] SparkQA commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

2020-11-24 Thread GitBox
SparkQA commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-732827379 **[Test build #131648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131648/testReport)** for PR 30470 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30382: [SPARK-33457][PYTHON] Adjust mypy configuration

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30382: URL: https://github.com/apache/spark/pull/30382#issuecomment-732823899 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732823896 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732823908 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30432: [SPARK-33494][SQL][AQE] Do not use local shuffle reader for repartition

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30432: URL: https://github.com/apache/spark/pull/30432#issuecomment-732823898 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732823924 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732823908 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732823896 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30382: [SPARK-33457][PYTHON] Adjust mypy configuration

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30382: URL: https://github.com/apache/spark/pull/30382#issuecomment-732823899 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30432: [SPARK-33494][SQL][AQE] Do not use local shuffle reader for repartition

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30432: URL: https://github.com/apache/spark/pull/30432#issuecomment-732823898 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732823901 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

2020-11-24 Thread GitBox
HyukjinKwon commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-732823644 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] gaborgsomogyi commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
gaborgsomogyi commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732819837 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732764182 **[Test build #131640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131640/testReport)** for PR 30465 at commit

[GitHub] [spark] SparkQA commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732818260 **[Test build #131640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131640/testReport)** for PR 30465 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30432: [SPARK-33494][SQL][AQE] Do not use local shuffle reader for repartition

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30432: URL: https://github.com/apache/spark/pull/30432#issuecomment-732756403 **[Test build #131636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131636/testReport)** for PR 30432 at commit

[GitHub] [spark] SparkQA commented on pull request #30432: [SPARK-33494][SQL][AQE] Do not use local shuffle reader for repartition

2020-11-24 Thread GitBox
SparkQA commented on pull request #30432: URL: https://github.com/apache/spark/pull/30432#issuecomment-732816771 **[Test build #131636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131636/testReport)** for PR 30432 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732725370 **[Test build #131630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131630/testReport)** for PR 30427 at commit

[GitHub] [spark] SparkQA commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
SparkQA commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732815872 **[Test build #131630 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131630/testReport)** for PR 30427 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r529403802 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -503,13 +503,32 @@ class AstBuilder extends

[GitHub] [spark] AmplabJenkins commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-732803500 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732803609 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732725669 **[Test build #131632 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131632/testReport)** for PR 29966 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-732730489 **[Test build #131634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131634/testReport)** for PR 29000 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AngersZh commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732802953 > > Yes, user can use TypeConstruct value as partition spec value such as > > `` > > Is the description above incomplete? Btw, could you put an example query that

[GitHub] [spark] SparkQA commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
SparkQA commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732802966 **[Test build #131632 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131632/testReport)** for PR 29966 at commit

[GitHub] [spark] SparkQA commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-11-24 Thread GitBox
SparkQA commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-732802576 **[Test build #131634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131634/testReport)** for PR 29000 at commit

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732802365 **[Test build #131646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131646/testReport)** for PR 30421 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-732799105 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
SparkQA commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732799386 **[Test build #131645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131645/testReport)** for PR 30479 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-732799105 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-732756404 **[Test build #131635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131635/testReport)** for PR 30442 at commit

[GitHub] [spark] SparkQA commented on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-24 Thread GitBox
SparkQA commented on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-732798784 **[Test build #131635 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131635/testReport)** for PR 30442 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30476: [SPARK-33523][SQL][TEST] Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30476: URL: https://github.com/apache/spark/pull/30476#issuecomment-732798130 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30450: [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30450: URL: https://github.com/apache/spark/pull/30450#issuecomment-732797906 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30476: [SPARK-33523][SQL][TEST] Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30476: URL: https://github.com/apache/spark/pull/30476#issuecomment-732798130 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732797564 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30450: [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30450: URL: https://github.com/apache/spark/pull/30450#issuecomment-732797906 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732797564 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732790773 **[Test build #131641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131641/testReport)** for PR 30482 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732794192 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
SparkQA commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732794164 **[Test build #131641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131641/testReport)** for PR 30482 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732794192 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-11-24 Thread GitBox
SparkQA commented on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-732791895 **[Test build #131644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131644/testReport)** for PR 28647 at commit

[GitHub] [spark] SparkQA commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732790908 **[Test build #131643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131643/testReport)** for PR 30465 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732725257 **[Test build #131628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131628/testReport)** for PR 30479 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732790562 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
SparkQA commented on pull request #30481: URL: https://github.com/apache/spark/pull/30481#issuecomment-732790797 **[Test build #131642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131642/testReport)** for PR 30481 at commit

[GitHub] [spark] SparkQA commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
SparkQA commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732790773 **[Test build #131641 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131641/testReport)** for PR 30482 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732790562 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
SparkQA commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732790339 **[Test build #131628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131628/testReport)** for PR 30479 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30476: [SPARK-33523][SQL][TEST] Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30476: URL: https://github.com/apache/spark/pull/30476#issuecomment-732789718 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30476: [SPARK-33523][SQL][TEST] Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30476: URL: https://github.com/apache/spark/pull/30476#issuecomment-732790036 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30476: [SPARK-33523][SQL][TEST] Add predicate related benchmark to SubExprEliminationBenchmark

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30476: URL: https://github.com/apache/spark/pull/30476#issuecomment-732789718 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-732789363 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732789364 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30475: [SPARK-33522][SQL] Improve exception messages while handling UnresolvedTableOrView

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30475: URL: https://github.com/apache/spark/pull/30475#issuecomment-732789363 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732789364 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

2020-11-24 Thread GitBox
maropu commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-732788459 @wangyum How about asking it in the spark-dev thread so that Shane could notice it

[GitHub] [spark] MaxGekk commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529377394 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] MaxGekk commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529377394 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] MaxGekk commented on a change in pull request #30474: [SPARK-33521][SQL] Universal type conversion in resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30474: URL: https://github.com/apache/spark/pull/30474#discussion_r529375116 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolvePartitionSpec.scala ## @@ -65,31 +65,8 @@ object

[GitHub] [spark] MaxGekk commented on a change in pull request #30474: [SPARK-33521][SQL] Universal type conversion in resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30474: URL: https://github.com/apache/spark/pull/30474#discussion_r529375116 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolvePartitionSpec.scala ## @@ -65,31 +65,8 @@ object

[GitHub] [spark] MaxGekk commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529373882 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/util/PartitioningUtils.scala ## @@ -18,9 +18,15 @@ package org.apache.spark.sql.util

[GitHub] [spark] MaxGekk opened a new pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk opened a new pull request #30482: URL: https://github.com/apache/spark/pull/30482 ### What changes were proposed in this pull request? 1. Extract the code for partition values casting from DSv1 to the common place `sql.util.PartitioningUtils` - the method

[GitHub] [spark] SparkQA removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732757294 **[Test build #131639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131639/testReport)** for PR 28026 at commit

[GitHub] [spark] SparkQA commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
SparkQA commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732781939 **[Test build #131639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131639/testReport)** for PR 28026 at commit

[GitHub] [spark] wangyum commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

2020-11-24 Thread GitBox
wangyum commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-732769319 @shaneknapp Did you set :`export LANG=en_US.UTF-8`? ``` org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException:

[GitHub] [spark] ulysses-you commented on a change in pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
ulysses-you commented on a change in pull request #30481: URL: https://github.com/apache/spark/pull/30481#discussion_r529336316 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/ThriftServerWithSparkContextSuite.scala ## @@ -79,6 +84,45

[GitHub] [spark] beliefer commented on a change in pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
beliefer commented on a change in pull request #30465: URL: https://github.com/apache/spark/pull/30465#discussion_r529334200 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -1404,11 +1404,24 @@ class AstBuilder extends

[GitHub] [spark] SparkQA removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-732727595 **[Test build #131633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131633/testReport)** for PR 30403 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-732766504 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-732766504 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ulysses-you opened a new pull request #30481: [SPARK-33526][SQL] Add config to control if cancel invoke interrupt task on thriftserver

2020-11-24 Thread GitBox
ulysses-you opened a new pull request #30481: URL: https://github.com/apache/spark/pull/30481 ### What changes were proposed in this pull request? This PR add a new config `spark.sql.thriftServer.forceCancel` to give user a way to interrupt task when cancel statement.

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Support CACHE/UNCACHE TABLE commands for v2 tables

2020-11-24 Thread GitBox
SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-732766111 **[Test build #131633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131633/testReport)** for PR 30403 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-732765233 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29000: [SPARK-27194][SPARK-29302][SQL] Fix commit collision in dynamic partition overwrite mode

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29000: URL: https://github.com/apache/spark/pull/29000#issuecomment-732765233 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732764182 **[Test build #131640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131640/testReport)** for PR 30465 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-732763225 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-732763225 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-732725287 **[Test build #131629 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131629/testReport)** for PR 30468 at commit

[GitHub] [spark] beliefer commented on a change in pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
beliefer commented on a change in pull request #30465: URL: https://github.com/apache/spark/pull/30465#discussion_r529323100 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -216,16 +216,16 @@ object SQLConf { "for using

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-732761870 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    5   6   7   8   9   10   11   >