[GitHub] [spark] SparkQA removed a comment on pull request #30472: [WIP][SPARK-32221] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-732960228 **[Test build #131660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131660/testReport)** for PR 30472 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30472: [WIP][SPARK-32221] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-732967004 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30472: [WIP][SPARK-32221] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-732966793 **[Test build #131660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131660/testReport)** for PR 30472 at commit

[GitHub] [spark] SparkQA commented on pull request #30413: [SPARK-33252][PYTHON][DOCS] Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

2020-11-24 Thread GitBox
SparkQA commented on pull request #30413: URL: https://github.com/apache/spark/pull/30413#issuecomment-732964747 **[Test build #131662 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131662/testReport)** for PR 30413 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732962743 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-732962743 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29893: [SPARK-32976][SQL]Support column list in INSERT statement

2020-11-24 Thread GitBox
SparkQA commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-732960610 **[Test build #131661 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131661/testReport)** for PR 29893 at commit

[GitHub] [spark] SparkQA commented on pull request #30472: [WIP][SPARK-32221] Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30472: URL: https://github.com/apache/spark/pull/30472#issuecomment-732960228 **[Test build #131660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131660/testReport)** for PR 30472 at commit

[GitHub] [spark] SparkQA commented on pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-11-24 Thread GitBox
SparkQA commented on pull request #30484: URL: https://github.com/apache/spark/pull/30484#issuecomment-732960198 **[Test build #131659 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131659/testReport)** for PR 30484 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732958619 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732958621 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732958620 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732958631 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732958619 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732958620 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732846706 **[Test build #131652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131652/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
SparkQA commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732955324 **[Test build #131652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131652/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732827618 **[Test build #131649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131649/testReport)** for PR 30427 at commit

[GitHub] [spark] SparkQA commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
SparkQA commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732950127 **[Test build #131649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131649/testReport)** for PR 30427 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #30243: [SPARK-33335][SQL] Support `array_contains_array` func

2020-11-24 Thread GitBox
AngersZh commented on pull request #30243: URL: https://github.com/apache/spark/pull/30243#issuecomment-732948270 Any update? This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732827355 **[Test build #131647 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131647/testReport)** for PR 30482 at commit

[GitHub] [spark] SparkQA commented on pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
SparkQA commented on pull request #30482: URL: https://github.com/apache/spark/pull/30482#issuecomment-732946867 **[Test build #131647 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131647/testReport)** for PR 30482 at commit

[GitHub] [spark] LuciferYang opened a new pull request #30484: [SPARK-33532][SQL] Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-11-24 Thread GitBox
LuciferYang opened a new pull request #30484: URL: https://github.com/apache/spark/pull/30484 ### What changes were proposed in this pull request? There are two places in Spark to call the `SpecificParquetRecordReaderBase.initialize(InputSplit, taskAttemptContext)` method, one is in

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r529504680 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -503,13 +503,32 @@ class AstBuilder extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732939815 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732853983 **[Test build #131654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131654/testReport)** for PR 30412 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732939815 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529503529 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -587,13 +587,24 @@ fromClause ;

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732939546 **[Test build #131654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131654/testReport)** for PR 30412 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529502777 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -587,13 +587,24 @@ fromClause ;

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529501391 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -587,13 +587,24 @@ fromClause ;

[GitHub] [spark] maropu commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
maropu commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732937865 Could you add some descriptions about this syntax and add examples in the `INSERT` document?: https://spark.apache.org/docs/3.0.1/sql-ref-syntax-dml-insert-into.html#parameters

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-732937178 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529500858 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/grouping.scala ## @@ -39,45 +39,22 @@ trait GroupingSet extends

[GitHub] [spark] AmplabJenkins commented on pull request #30470: [SPARK-33495][BUILD] Remove commons-logging.jar's dependency

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30470: URL: https://github.com/apache/spark/pull/30470#issuecomment-732937178 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-11-24 Thread GitBox
SparkQA commented on pull request #29122: URL: https://github.com/apache/spark/pull/29122#issuecomment-732936032 **[Test build #131658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131658/testReport)** for PR 29122 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30473: [SPARK-33430][SQL] Support namespaces in JDBC v2 Table Catalog

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30473: URL: https://github.com/apache/spark/pull/30473#issuecomment-732934562 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30473: [SPARK-33430][SQL] Support namespaces in JDBC v2 Table Catalog

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30473: URL: https://github.com/apache/spark/pull/30473#issuecomment-732934562 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
maropu commented on a change in pull request #30421: URL: https://github.com/apache/spark/pull/30421#discussion_r529498575 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -503,13 +503,32 @@ class AstBuilder extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732928938 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-732928683 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732928938 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30408: [SPARK-33477][SQL] Hive Metastore should support filter by date type

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30408: URL: https://github.com/apache/spark/pull/30408#issuecomment-732928683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732827738 **[Test build #131650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131650/testReport)** for PR 30421 at commit

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529497054 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1971,65 +2025,84 @@ class Analyzer( */

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732927594 **[Test build #131650 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131650/testReport)** for PR 30421 at commit

[GitHub] [spark] Fokko commented on a change in pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-11-24 Thread GitBox
Fokko commented on a change in pull request #29122: URL: https://github.com/apache/spark/pull/29122#discussion_r529496929 ## File path: python/pyspark/sql/functions.py ## @@ -3471,7 +3473,7 @@ def from_json(col, schema, options={}): return Column(jc) -def to_json(col,

[GitHub] [spark] Fokko commented on a change in pull request #29122: [SPARK-32320][PYSPARK] Remove mutable default arguments

2020-11-24 Thread GitBox
Fokko commented on a change in pull request #29122: URL: https://github.com/apache/spark/pull/29122#discussion_r529496774 ## File path: python/pyspark/sql/functions.py ## @@ -3471,7 +3473,7 @@ def from_json(col, schema, options={}): return Column(jc) -def to_json(col,

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529496711 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1971,65 +2025,84 @@ class Analyzer( */

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529496579 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -1971,65 +2025,84 @@ class Analyzer( */

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
AngersZh commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529496396 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -665,13 +676,15 @@ class Analyzer( //

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732923488 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-73291 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-732918797 **[Test build #131655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131655/testReport)** for PR 30483 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30427: [SPARK-33224][SS] Add watermark gap information into SS UI page

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30427: URL: https://github.com/apache/spark/pull/30427#issuecomment-732923488 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-73291 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
SparkQA commented on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-732922174 **[Test build #131655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131655/testReport)** for PR 30483 at commit

[GitHub] [spark] SparkQA commented on pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

2020-11-24 Thread GitBox
SparkQA commented on pull request #30336: URL: https://github.com/apache/spark/pull/30336#issuecomment-732919629 **[Test build #131657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131657/testReport)** for PR 30336 at commit

[GitHub] [spark] SparkQA commented on pull request #30442: [SPARK-33498][SQL] Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

2020-11-24 Thread GitBox
SparkQA commented on pull request #30442: URL: https://github.com/apache/spark/pull/30442#issuecomment-732919060 **[Test build #131656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131656/testReport)** for PR 30442 at commit

[GitHub] [spark] SparkQA commented on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
SparkQA commented on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-732918797 **[Test build #131655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131655/testReport)** for PR 30483 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-732916741 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30468: [SPARK-33518][ML][WIP] Improve performance of ML ALS recommendForAll by GEMV

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30468: URL: https://github.com/apache/spark/pull/30468#issuecomment-732916741 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732914432 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732914457 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732914434 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732914434 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732914432 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732914428 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #30212: [SPARK-33308][SQL] Support CUBE(...) and ROLLUP(...), GROUPING SETS(...) as group by expr in parser level

2020-11-24 Thread GitBox
maropu commented on a change in pull request #30212: URL: https://github.com/apache/spark/pull/30212#discussion_r529480121 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -587,13 +587,24 @@ fromClause ;

[GitHub] [spark] LuciferYang commented on pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
LuciferYang commented on pull request #30483: URL: https://github.com/apache/spark/pull/30483#issuecomment-732905089 @wangyum WIP now, missing some configuration entries, test suite and orc file support This is an

[GitHub] [spark] SparkQA removed a comment on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732790908 **[Test build #131643 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131643/testReport)** for PR 30465 at commit

[GitHub] [spark] SparkQA commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732899668 **[Test build #131643 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131643/testReport)** for PR 30465 at commit

[GitHub] [spark] LuciferYang opened a new pull request #30483: [WIP][SPARK-33449][SQL] Add File Metadata cache support for Parquet and Orc

2020-11-24 Thread GitBox
LuciferYang opened a new pull request #30483: URL: https://github.com/apache/spark/pull/30483 ### What changes were proposed in this pull request? Add File Metadata cache support for Parquet and Orc, this pr is WIP now ### Why are the changes needed? Support Parquet and Orc

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

2020-11-24 Thread GitBox
gaborgsomogyi commented on a change in pull request #30336: URL: https://github.com/apache/spark/pull/30336#discussion_r529477504 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatisticsPage.scala ## @@ -22,15 +22,25 @@ import

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #30336: [SPARK-33287][SS][UI]Expose state custom metrics information on SS UI

2020-11-24 Thread GitBox
gaborgsomogyi commented on a change in pull request #30336: URL: https://github.com/apache/spark/pull/30336#discussion_r529477301 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryStatisticsPage.scala ## @@ -199,49 +209,100 @@ private[ui]

[GitHub] [spark] malduarte commented on pull request #30236: [SPARK-33330][SQL] Add support for Enums on CatalystTypeConverters

2020-11-24 Thread GitBox
malduarte commented on pull request #30236: URL: https://github.com/apache/spark/pull/30236#issuecomment-732868502 @viirya any further comments? This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] MaxGekk commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529474127 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732802365 **[Test build #131646 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131646/testReport)** for PR 30421 at commit

[GitHub] [spark] SparkQA commented on pull request #30421: [SPARK-33474][SQL] Support TypeConstructed partition spec value

2020-11-24 Thread GitBox
SparkQA commented on pull request #30421: URL: https://github.com/apache/spark/pull/30421#issuecomment-732862083 **[Test build #131646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131646/testReport)** for PR 30421 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
cloud-fan commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529472863 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732799386 **[Test build #131645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131645/testReport)** for PR 30479 at commit

[GitHub] [spark] MaxGekk commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529470852 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] SparkQA commented on pull request #30479: [WIP][SPARK-33527][SQL] Extend the function of decode so as consistent with mainstream databases

2020-11-24 Thread GitBox
SparkQA commented on pull request #30479: URL: https://github.com/apache/spark/pull/30479#issuecomment-732856036 **[Test build #131645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131645/testReport)** for PR 30479 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
cloud-fan commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529470693 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732853983 **[Test build #131654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131654/testReport)** for PR 30412 at commit

[GitHub] [spark] MaxGekk commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
MaxGekk commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529469591 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-732849766 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30478: [SPARK-33525][SQL] Update hive-service-rpc to 3.1.2

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #30478: URL: https://github.com/apache/spark/pull/30478#issuecomment-732849766 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732846506 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732846853 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
SparkQA commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732846706 **[Test build #131652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131652/testReport)** for PR 30440 at commit

[GitHub] [spark] SparkQA commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
SparkQA commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732846865 **[Test build #131653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131653/testReport)** for PR 30412 at commit

[GitHub] [spark] SparkQA commented on pull request #30465: [SPARK-33045][SQL][FOLLOWUP] Support built-in function like_any and fix StackOverflowError issue.

2020-11-24 Thread GitBox
SparkQA commented on pull request #30465: URL: https://github.com/apache/spark/pull/30465#issuecomment-732846567 **[Test build #131651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131651/testReport)** for PR 30465 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
AmplabJenkins commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732846506 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
SparkQA removed a comment on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732756825 **[Test build #131638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131638/testReport)** for PR 29966 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
AmplabJenkins removed a comment on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732803609 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29966: [SPARK-33084][CORE][SQL] Add jar support ivy path

2020-11-24 Thread GitBox
SparkQA commented on pull request #29966: URL: https://github.com/apache/spark/pull/29966#issuecomment-732844619 **[Test build #131638 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131638/testReport)** for PR 29966 at commit

[GitHub] [spark] cloud-fan commented on pull request #30412: [SPARK-33480][SQL] Support char/varchar type

2020-11-24 Thread GitBox
cloud-fan commented on pull request #30412: URL: https://github.com/apache/spark/pull/30412#issuecomment-732844437 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] cloud-fan commented on a change in pull request #30482: [SPARK-33529][SQL] Handle '__HIVE_DEFAULT_PARTITION__' while resolving V2 partition specs

2020-11-24 Thread GitBox
cloud-fan commented on a change in pull request #30482: URL: https://github.com/apache/spark/pull/30482#discussion_r529465696 ## File path: sql/core/src/test/scala/org/apache/spark/sql/connector/AlterTablePartitionV2SQLSuite.scala ## @@ -243,4 +243,22 @@ class

[GitHub] [spark] gengliangwang commented on pull request #30440: [SPARK-33496][SQL]Improve error message of ANSI explicit cast

2020-11-24 Thread GitBox
gengliangwang commented on pull request #30440: URL: https://github.com/apache/spark/pull/30440#issuecomment-732842384 @cloud-fan @maropu Thanks for the suggestions. I have addressed them. This is an automated message from

<    4   5   6   7   8   9   10   11   >