[jira] [Created] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
Tim Hughes created SPARK-34315: -- Summary: docker-image-tool.sh debconf trying to configure kerberos Key: SPARK-34315 URL: https://issues.apache.org/jira/browse/SPARK-34315 Project: Spark Issue T

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276612#comment-17276612 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34314: Assignee: Apache Spark > Wrong discovered partition value > -

[jira] [Assigned] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34314: Assignee: (was: Apache Spark) > Wrong discovered partition value > --

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276610#comment-17276610 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34314: -- Summary: Wrong discovered partition value Key: SPARK-34314 URL: https://issues.apache.org/jira/browse/SPARK-34314 Project: Spark Issue Type: Bug Compon

[jira] [Assigned] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34313: Assignee: Apache Spark > Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new

[jira] [Assigned] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34313: Assignee: (was: Apache Spark) > Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands

[jira] [Commented] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276583#comment-17276583 ] Apache Spark commented on SPARK-34313: -- User 'imback82' has created a pull request

[jira] [Updated] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34313: -- Description: Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework (wa

[jira] [Updated] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34313: -- Summary: Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework (was: M

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276514#comment-17276514 ] Apache Spark commented on SPARK-33591: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-34313) Migrate ALTER TABLE SET/UNSET PROPERTIES commands to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
Terry Kim created SPARK-34313: - Summary: Migrate ALTER TABLE SET/UNSET PROPERTIES commands to the new resolution framework Key: SPARK-34313 URL: https://issues.apache.org/jira/browse/SPARK-34313 Project:

[jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query

2021-02-01 Thread Laurens Janssen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276395#comment-17276395 ] Laurens Janssen commented on SPARK-24497: - Any progress on this? The pull reques

[jira] [Resolved] (SPARK-34083) Using TPCDS original definitions for char/varchar columns

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34083. - Fix Version/s: 3.1.1 Assignee: Kent Yao Resolution: Fixed > Using TPCDS original

[jira] [Updated] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34310: - Priority: Trivial (was: Minor) > Replaces map and flatten with flatMap > --

[jira] [Assigned] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34310: Assignee: Yang Jie > Replaces map and flatten with flatMap >

[jira] [Resolved] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34310. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31416 [https://gi

[jira] [Updated] (SPARK-34233) NPE for char padding in binary comparison

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34233: Fix Version/s: (was: 3.2.0) 3.1.1 > NPE for char padding in binary comparis

[jira] [Assigned] (SPARK-34239) Unify output of SHOW COLUMNS pass output attributes properly

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34239: --- Assignee: angerszhu > Unify output of SHOW COLUMNS pass output attributes properly > --

[jira] [Resolved] (SPARK-34239) Unify output of SHOW COLUMNS pass output attributes properly

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34239. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31377 [https://gith

[jira] [Assigned] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34301: --- Assignee: Maxim Gekk > Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

[jira] [Resolved] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34301. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31403 [https://gith

[jira] [Commented] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276342#comment-17276342 ] Apache Spark commented on SPARK-34312: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34312: Assignee: Maxim Gekk (was: Apache Spark) > Support partition truncation by `SupportsPart

[jira] [Assigned] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34312: Assignee: Apache Spark (was: Maxim Gekk) > Support partition truncation by `SupportsPart

[jira] [Updated] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34312: --- Description: Add new method `truncatePartition` in `SupportsPartitionManagement` and `truncatePartit

[jira] [Created] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34312: -- Summary: Support partition truncation by `SupportsPartitionManagement` Key: SPARK-34312 URL: https://issues.apache.org/jira/browse/SPARK-34312 Project: Spark Is

[jira] [Assigned] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34311: Assignee: Kousuke Saruta (was: Apache Spark) > PostgresDialect can't treat arrays of som

[jira] [Commented] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276330#comment-17276330 ] Apache Spark commented on SPARK-34311: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34311: Assignee: Apache Spark (was: Kousuke Saruta) > PostgresDialect can't treat arrays of som

[jira] [Resolved] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34303. - Resolution: Fixed Issue resolved by pull request 31414 [https://github.com/apache/spark/pull/314

[jira] [Updated] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34311: --- Description: PostgresDialect implements the logic to treat array of some types but it's not

[jira] [Updated] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34311: --- Summary: PostgresDialect can't treat arrays of some types (was: PostgresDialect can't treat

[jira] [Created] (SPARK-34311) PostgresDialect can't treat array of some types

2021-02-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34311: -- Summary: PostgresDialect can't treat array of some types Key: SPARK-34311 URL: https://issues.apache.org/jira/browse/SPARK-34311 Project: Spark Issue Typ

[jira] [Comment Edited] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276309#comment-17276309 ] Yang Jie edited comment on SPARK-34309 at 2/1/21, 1:14 PM: --- So

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276309#comment-17276309 ] Yang Jie commented on SPARK-34309: -- Some different behaviors about `removalListener`, r

[jira] [Resolved] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34266. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31364 [https://gith

[jira] [Assigned] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34266: --- Assignee: Maxim Gekk > Update comments for `SessionCatalog.refreshTable()` and > `CatalogI

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276259#comment-17276259 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276252#comment-17276252 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276250#comment-17276250 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34310: Assignee: (was: Apache Spark) > Replaces map and flatten with flatMap > -

[jira] [Assigned] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34310: Assignee: Apache Spark > Replaces map and flatten with flatMap >

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276249#comment-17276249 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-34310: Summary: Replaces map and flatten with flatMap Key: SPARK-34310 URL: https://issues.apache.org/jira/browse/SPARK-34310 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql

2021-02-01 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276221#comment-17276221 ] Jungtaek Lim commented on SPARK-12497: -- That is odd, see what is printed for Spark

[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql

2021-02-01 Thread xinzhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276207#comment-17276207 ] xinzhang commented on SPARK-12497: -- It's still a bug with spark 3.0.0 .  Start spark th

[jira] [Comment Edited] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-02-01 Thread Yahui Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275492#comment-17275492 ] Yahui Liu edited comment on SPARK-34212 at 2/1/21, 9:33 AM:

[jira] [Updated] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33990: Fix Version/s: (was: 3.2.0) 3.1.1 > v2 ALTER TABLE .. DROP PARTITION does n

[jira] [Commented] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276154#comment-17276154 ] Apache Spark commented on SPARK-34303: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34303: Assignee: Maxim Gekk (was: Apache Spark) > Migrate ALTER TABLE ... SET LOCATION to new r

[jira] [Assigned] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34303: Assignee: Apache Spark (was: Maxim Gekk) > Migrate ALTER TABLE ... SET LOCATION to new r

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276137#comment-17276137 ] Yang Jie commented on SPARK-34309: -- Testing this now, but I'm not sure it's worth it, c

[jira] [Commented] (SPARK-34098) HadoopVersionInfoSuite faild when maven test in Scala 2.13

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276133#comment-17276133 ] Yang Jie commented on SPARK-34098: -- cc [~hyukjin.kwon] Can you help close this jira? se

[jira] [Created] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-34309: Summary: Use Caffeine instead of Guava Cache Key: SPARK-34309 URL: https://issues.apache.org/jira/browse/SPARK-34309 Project: Spark Issue Type: Improvement

<    1   2