[jira] [Created] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-34309: Summary: Use Caffeine instead of Guava Cache Key: SPARK-34309 URL: https://issues.apache.org/jira/browse/SPARK-34309 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34098) HadoopVersionInfoSuite faild when maven test in Scala 2.13

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276133#comment-17276133 ] Yang Jie commented on SPARK-34098: -- cc [~hyukjin.kwon] Can you help close this jira? se

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276137#comment-17276137 ] Yang Jie commented on SPARK-34309: -- Testing this now, but I'm not sure it's worth it, c

[jira] [Commented] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276154#comment-17276154 ] Apache Spark commented on SPARK-34303: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34303: Assignee: Maxim Gekk (was: Apache Spark) > Migrate ALTER TABLE ... SET LOCATION to new r

[jira] [Assigned] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34303: Assignee: Apache Spark (was: Maxim Gekk) > Migrate ALTER TABLE ... SET LOCATION to new r

[jira] [Updated] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33990: Fix Version/s: (was: 3.2.0) 3.1.1 > v2 ALTER TABLE .. DROP PARTITION does n

[jira] [Comment Edited] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-02-01 Thread Yahui Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275492#comment-17275492 ] Yahui Liu edited comment on SPARK-34212 at 2/1/21, 9:33 AM:

[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql

2021-02-01 Thread xinzhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276207#comment-17276207 ] xinzhang commented on SPARK-12497: -- It's still a bug with spark 3.0.0 .  Start spark th

[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql

2021-02-01 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276221#comment-17276221 ] Jungtaek Lim commented on SPARK-12497: -- That is odd, see what is printed for Spark

[jira] [Created] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-34310: Summary: Replaces map and flatten with flatMap Key: SPARK-34310 URL: https://issues.apache.org/jira/browse/SPARK-34310 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276249#comment-17276249 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34310: Assignee: (was: Apache Spark) > Replaces map and flatten with flatMap > -

[jira] [Assigned] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34310: Assignee: Apache Spark > Replaces map and flatten with flatMap >

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276250#comment-17276250 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276252#comment-17276252 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276259#comment-17276259 ] Apache Spark commented on SPARK-34310: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34266: --- Assignee: Maxim Gekk > Update comments for `SessionCatalog.refreshTable()` and > `CatalogI

[jira] [Resolved] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34266. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31364 [https://gith

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276309#comment-17276309 ] Yang Jie commented on SPARK-34309: -- Some different behaviors about `removalListener`, r

[jira] [Comment Edited] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276309#comment-17276309 ] Yang Jie edited comment on SPARK-34309 at 2/1/21, 1:14 PM: --- So

[jira] [Created] (SPARK-34311) PostgresDialect can't treat array of some types

2021-02-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34311: -- Summary: PostgresDialect can't treat array of some types Key: SPARK-34311 URL: https://issues.apache.org/jira/browse/SPARK-34311 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34311: --- Summary: PostgresDialect can't treat arrays of some types (was: PostgresDialect can't treat

[jira] [Updated] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34311: --- Description: PostgresDialect implements the logic to treat array of some types but it's not

[jira] [Resolved] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34303. - Resolution: Fixed Issue resolved by pull request 31414 [https://github.com/apache/spark/pull/314

[jira] [Assigned] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34311: Assignee: Apache Spark (was: Kousuke Saruta) > PostgresDialect can't treat arrays of som

[jira] [Assigned] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34311: Assignee: Kousuke Saruta (was: Apache Spark) > PostgresDialect can't treat arrays of som

[jira] [Commented] (SPARK-34311) PostgresDialect can't treat arrays of some types

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276330#comment-17276330 ] Apache Spark commented on SPARK-34311: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34312: -- Summary: Support partition truncation by `SupportsPartitionManagement` Key: SPARK-34312 URL: https://issues.apache.org/jira/browse/SPARK-34312 Project: Spark Is

[jira] [Updated] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34312: --- Description: Add new method `truncatePartition` in `SupportsPartitionManagement` and `truncatePartit

[jira] [Assigned] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34312: Assignee: Maxim Gekk (was: Apache Spark) > Support partition truncation by `SupportsPart

[jira] [Assigned] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34312: Assignee: Apache Spark (was: Maxim Gekk) > Support partition truncation by `SupportsPart

[jira] [Commented] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276342#comment-17276342 ] Apache Spark commented on SPARK-34312: -- User 'MaxGekk' has created a pull request f

[jira] [Resolved] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34301. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31403 [https://gith

[jira] [Assigned] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34301: --- Assignee: Maxim Gekk > Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

[jira] [Resolved] (SPARK-34239) Unify output of SHOW COLUMNS pass output attributes properly

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34239. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31377 [https://gith

[jira] [Assigned] (SPARK-34239) Unify output of SHOW COLUMNS pass output attributes properly

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34239: --- Assignee: angerszhu > Unify output of SHOW COLUMNS pass output attributes properly > --

[jira] [Updated] (SPARK-34233) NPE for char padding in binary comparison

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34233: Fix Version/s: (was: 3.2.0) 3.1.1 > NPE for char padding in binary comparis

[jira] [Resolved] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34310. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31416 [https://gi

[jira] [Assigned] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34310: Assignee: Yang Jie > Replaces map and flatten with flatMap >

[jira] [Updated] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34310: - Priority: Trivial (was: Minor) > Replaces map and flatten with flatMap > --

[jira] [Resolved] (SPARK-34083) Using TPCDS original definitions for char/varchar columns

2021-02-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34083. - Fix Version/s: 3.1.1 Assignee: Kent Yao Resolution: Fixed > Using TPCDS original

[jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query

2021-02-01 Thread Laurens Janssen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276395#comment-17276395 ] Laurens Janssen commented on SPARK-24497: - Any progress on this? The pull reques

[jira] [Created] (SPARK-34313) Migrate ALTER TABLE SET/UNSET PROPERTIES commands to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
Terry Kim created SPARK-34313: - Summary: Migrate ALTER TABLE SET/UNSET PROPERTIES commands to the new resolution framework Key: SPARK-34313 URL: https://issues.apache.org/jira/browse/SPARK-34313 Project:

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276514#comment-17276514 ] Apache Spark commented on SPARK-33591: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34313: -- Summary: Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework (was: M

[jira] [Updated] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34313: -- Description: Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework (wa

[jira] [Commented] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276583#comment-17276583 ] Apache Spark commented on SPARK-34313: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34313: Assignee: Apache Spark > Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new

[jira] [Assigned] (SPARK-34313) Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands to the new resolution framework

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34313: Assignee: (was: Apache Spark) > Migrate ALTER TABLE SET/UNSET TBLPROPERTIES commands

[jira] [Created] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34314: -- Summary: Wrong discovered partition value Key: SPARK-34314 URL: https://issues.apache.org/jira/browse/SPARK-34314 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276610#comment-17276610 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34314: Assignee: (was: Apache Spark) > Wrong discovered partition value > --

[jira] [Assigned] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34314: Assignee: Apache Spark > Wrong discovered partition value > -

[jira] [Commented] (SPARK-34314) Wrong discovered partition value

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276612#comment-17276612 ] Apache Spark commented on SPARK-34314: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
Tim Hughes created SPARK-34315: -- Summary: docker-image-tool.sh debconf trying to configure kerberos Key: SPARK-34315 URL: https://issues.apache.org/jira/browse/SPARK-34315 Project: Spark Issue T

[jira] [Updated] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Hughes updated SPARK-34315: --- Attachment: full-logs.txt > docker-image-tool.sh debconf trying to configure kerberos >

[jira] [Updated] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Hughes updated SPARK-34315: --- Environment: # ## Full logs   {{}}{{}} was: ## Full logs   {{}}{{$ bin/docker-image-tool.sh

[jira] [Created] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

2021-02-01 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-34316: -- Summary: Optional Propagation of SPARK_CONF_DIR in K8s Key: SPARK-34316 URL: https://issues.apache.org/jira/browse/SPARK-34316 Project: Spark Issue Type: New Fea

[jira] [Created] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

2021-02-01 Thread Terry Kim (Jira)
Terry Kim created SPARK-34317: - Summary: Introduce relationTypeMismatchHint to UnresolvedTable for a better error message Key: SPARK-34317 URL: https://issues.apache.org/jira/browse/SPARK-34317 Project: S

[jira] [Updated] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Hughes updated SPARK-34315: --- Environment: (was: # ## Full logs   {{}}{{}}) > docker-image-tool.sh debconf trying to confi

[jira] [Commented] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276654#comment-17276654 ] Apache Spark commented on SPARK-34317: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34317: Assignee: Apache Spark > Introduce relationTypeMismatchHint to UnresolvedTable for a bett

[jira] [Assigned] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34317: Assignee: (was: Apache Spark) > Introduce relationTypeMismatchHint to UnresolvedTable

[jira] [Commented] (SPARK-34317) Introduce relationTypeMismatchHint to UnresolvedTable for a better error message

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276655#comment-17276655 ] Apache Spark commented on SPARK-34317: -- User 'imback82' has created a pull request

[jira] [Commented] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276680#comment-17276680 ] Tim Hughes commented on SPARK-34315: [https://github.com/apache/spark/blob/master/re

[jira] [Commented] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Tim Hughes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276681#comment-17276681 ] Tim Hughes commented on SPARK-34315: Created a pull request https://github.com/apach

[jira] [Assigned] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34315: Assignee: Apache Spark > docker-image-tool.sh debconf trying to configure kerberos >

[jira] [Assigned] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34315: Assignee: (was: Apache Spark) > docker-image-tool.sh debconf trying to configure kerb

[jira] [Commented] (SPARK-34315) docker-image-tool.sh debconf trying to configure kerberos

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276682#comment-17276682 ] Apache Spark commented on SPARK-34315: -- User 'timhughes' has created a pull request

[jira] [Created] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

2021-02-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34318: -- Summary: Dataset.colRegex should work with column names and qualifiers which contain newlines Key: SPARK-34318 URL: https://issues.apache.org/jira/browse/SPARK-34318

[jira] [Assigned] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34318: Assignee: Apache Spark (was: Kousuke Saruta) > Dataset.colRegex should work with column

[jira] [Assigned] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34318: Assignee: Kousuke Saruta (was: Apache Spark) > Dataset.colRegex should work with column

[jira] [Commented] (SPARK-34318) Dataset.colRegex should work with column names and qualifiers which contain newlines

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276708#comment-17276708 ] Apache Spark commented on SPARK-34318: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-26325) Interpret timestamp fields in Spark while reading json (timestampFormat)

2021-02-01 Thread Daniel Himmelstein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276711#comment-17276711 ] Daniel Himmelstein commented on SPARK-26325: Here's the code from the origin

[jira] [Comment Edited] (SPARK-26325) Interpret timestamp fields in Spark while reading json (timestampFormat)

2021-02-01 Thread Daniel Himmelstein (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276711#comment-17276711 ] Daniel Himmelstein edited comment on SPARK-26325 at 2/1/21, 10:53 PM:

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276727#comment-17276727 ] Apache Spark commented on SPARK-34209: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-34209) Allow multiple namespaces with session catalog

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34209: Assignee: Apache Spark > Allow multiple namespaces with session catalog > ---

[jira] [Assigned] (SPARK-34209) Allow multiple namespaces with session catalog

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34209: Assignee: (was: Apache Spark) > Allow multiple namespaces with session catalog >

[jira] [Commented] (SPARK-34209) Allow multiple namespaces with session catalog

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276728#comment-17276728 ] Apache Spark commented on SPARK-34209: -- User 'holdenk' has created a pull request f

[jira] [Updated] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34310: - Fix Version/s: 2.4.8 > Replaces map and flatten with flatMap > -

[jira] [Updated] (SPARK-34310) Replaces map and flatten with flatMap

2021-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34310: - Fix Version/s: 3.1.2 3.0.2 > Replaces map and flatten with flatMap >

[jira] [Resolved] (SPARK-34306) Use Snake naming rule across the function APIs

2021-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34306. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31408 [https://gi

[jira] [Assigned] (SPARK-34306) Use Snake naming rule across the function APIs

2021-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34306: Assignee: Hyukjin Kwon > Use Snake naming rule across the function APIs > ---

[jira] [Assigned] (SPARK-34300) Fix of typos in documentation of pyspark.sql.functions and output of lint-python

2021-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34300: Assignee: David Toneian > Fix of typos in documentation of pyspark.sql.functions and outp

[jira] [Resolved] (SPARK-34300) Fix of typos in documentation of pyspark.sql.functions and output of lint-python

2021-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34300. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31401 [https://gi

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276766#comment-17276766 ] Dongjoon Hyun commented on SPARK-34309: --- Thank you for pinging me, [~LuciferYang].

[jira] [Commented] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

2021-02-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276782#comment-17276782 ] Dongjoon Hyun commented on SPARK-34316: --- Thank you for filing a Jira issue, [~zhou

[jira] [Updated] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

2021-02-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34316: -- Affects Version/s: (was: 3.0.1) 3.2.0 > Optional Propagation of SPA

[jira] [Commented] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276802#comment-17276802 ] Apache Spark commented on SPARK-34316: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34316: Assignee: Apache Spark > Optional Propagation of SPARK_CONF_DIR in K8s >

[jira] [Assigned] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34316: Assignee: (was: Apache Spark) > Optional Propagation of SPARK_CONF_DIR in K8s > -

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

2021-02-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276806#comment-17276806 ] Yang Jie commented on SPARK-34309: -- There has been a patch to replace all the places.

[jira] [Created] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

2021-02-01 Thread wuyi (Jira)
wuyi created SPARK-34319: Summary: Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes Key: SPARK-34319 URL: https://issues.apache.org/jira/browse/SPARK-34319 Project: Spark

[jira] [Commented] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276818#comment-17276818 ] Apache Spark commented on SPARK-34319: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34319: Assignee: Apache Spark > Self-join after cogroup applyInPandas fails due to unresolved co

[jira] [Assigned] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34319: Assignee: (was: Apache Spark) > Self-join after cogroup applyInPandas fails due to un

[jira] [Commented] (SPARK-34319) Self-join after cogroup applyInPandas fails due to unresolved conflicting attributes

2021-02-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276820#comment-17276820 ] Apache Spark commented on SPARK-34319: -- User 'Ngone51' has created a pull request f

[jira] [Created] (SPARK-34320) Migrate ALTER TABLE drop columns command to the new resolution framework

2021-02-01 Thread Terry Kim (Jira)
Terry Kim created SPARK-34320: - Summary: Migrate ALTER TABLE drop columns command to the new resolution framework Key: SPARK-34320 URL: https://issues.apache.org/jira/browse/SPARK-34320 Project: Spark

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore as external module

2021-02-01 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276857#comment-17276857 ] Cheng Su commented on SPARK-34198: -- [~viirya] - could you help elaborate what's the ben

  1   2   >