[jira] [Commented] (SPARK-42804) when target table format is textfile using `insert into select` will got error

[ https://issues.apache.org/jira/browse/SPARK-42804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701010#comment-17701010 ] kevinshin commented on SPARK-42804: --- @[~yumwang]  below is my step by step reproduce  this issue :   

[jira] [Comment Edited] (SPARK-42804) when target table format is textfile using `insert into select` will got error

[ https://issues.apache.org/jira/browse/SPARK-42804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17700926#comment-17700926 ] kevinshin edited comment on SPARK-42804 at 3/16/23 6:47 AM: orc and parquet

[jira] [Commented] (SPARK-42804) when target table format is textfile using `insert into select` will got error

[ https://issues.apache.org/jira/browse/SPARK-42804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17700926#comment-17700926 ] kevinshin commented on SPARK-42804: --- orc and parquet table won't have this problem. > when target

[jira] [Created] (SPARK-42804) when target table format is textfile using `insert into select` will got error

kevinshin created SPARK-42804: - Summary: when target table format is textfile using `insert into select` will got error Key: SPARK-42804 URL: https://issues.apache.org/jira/browse/SPARK-42804 Project:

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Description: *spark config :*  spark.sql.adaptive.enabled true

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Description: spark config :  spark.sql.adaptive.enabled true

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Attachment: image-2023-03-09-17-34-26-428.png > when enable AQE update or drop a small iceberg table

[jira] [Created] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

kevinshin created SPARK-42728: - Summary: when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config Key: SPARK-42728

[jira] [Updated] (SPARK-42650) insert overwrite table will casue table location lost if java.lang.ArithmeticException is thrown

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Summary: insert overwrite table will casue table location lost if java.lang.ArithmeticException is

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696810#comment-17696810 ] kevinshin commented on SPARK-42650: --- Thank you @[~yumwang]  > link issue SPARK-42550 >

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696645#comment-17696645 ] kevinshin commented on SPARK-42650: --- Thanks [~ulysses] , I can reproduced it without any spark's

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696037#comment-17696037 ] kevinshin commented on SPARK-42650: --- Spark and Kyuubi are both belong to apache. May Apache community

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use

[jira] [Created] (SPARK-42650) link issue SPARK-42550

kevinshin created SPARK-42650: - Summary: link issue SPARK-42550 Key: SPARK-42650 URL: https://issues.apache.org/jira/browse/SPARK-42650 Project: Spark Issue Type: Bug Components: SQL

[jira] [Closed] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin closed SPARK-42550. - > table directory will lost on hdfs when `INSERT OVERWRITE` faild >

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694270#comment-17694270 ] kevinshin commented on SPARK-42550: --- this is not spark's issue > table directory will lost on hdfs

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693467#comment-17693467 ] kevinshin commented on SPARK-42550: --- https://github.com/apache/kyuubi/issues/4416 > table directory

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693457#comment-17693457 ] kevinshin commented on SPARK-42550: --- It seems like my environment problem, I can't reproduce this

[jira] [Comment Edited] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693044#comment-17693044 ] kevinshin edited comment on SPARK-42550 at 2/24/23 7:44 AM: when try to 

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: (was: image-2023-02-24-15-26-01-846.png) > table directory will lost on hdfs when

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: (was: image-2023-02-24-15-22-45-876.png) > table directory will lost on hdfs when

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693053#comment-17693053 ] kevinshin commented on SPARK-42550: --- the diffrent is :  1、spark3.2.1 will delete table's data files

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693044#comment-17693044 ] kevinshin commented on SPARK-42550: --- when try to  refresh table test.spark32_overwrite

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-26-01-846.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-25-57-770.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-23-32-977.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-22-45-876.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-21-55-273.png > table directory will lost on hdfs when `INSERT

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during

[jira] [Created] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

kevinshin created SPARK-42550: - Summary: table directory will lost on hdfs when `INSERT OVERWRITE` faild Key: SPARK-42550 URL: https://issues.apache.org/jira/browse/SPARK-42550 Project: Spark

[jira] [Comment Edited] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690965#comment-17690965 ] kevinshin edited comment on SPARK-42473 at 2/20/23 1:47 AM: [~yumwang] 

[jira] [Commented] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690965#comment-17690965 ] kevinshin commented on SPARK-42473: --- [~yumwang]  'What is your test.spark33_decimal_orc column type?'

[jira] [Updated] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42473: -- Description: *when 'union all' and one select statement use* *Literal as column value , the other* 

[jira] [Created] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

kevinshin created SPARK-42473: - Summary: An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL Key: SPARK-42473 URL: https://issues.apache.org/jira/browse/SPARK-42473 Project: Spark

[jira] [Commented] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688377#comment-17688377 ] kevinshin commented on SPARK-41727: ---

[jira] [Resolved] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin resolved SPARK-41727. --- Resolution: Not A Bug it is not a issue about spark, but for hive > ClassCastException when config

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-41727: -- Attachment: hms-init-error.txt > ClassCastException when config spark.sql.hive.metastore* properties

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-41727: -- Description: Apache spark3.3.1 \ HDP3.1.5 with hive 3.1.0 when config properties about

[jira] [Created] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

kevinshin created SPARK-41727: - Summary: ClassCastException when config spark.sql.hive.metastore* properties under jdk17 Key: SPARK-41727 URL: https://issues.apache.org/jira/browse/SPARK-41727 Project:

[jira] [Commented] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

[ https://issues.apache.org/jira/browse/SPARK-32166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651989#comment-17651989 ] kevinshin commented on SPARK-32166: --- try set  spark.sql.legacy.createHiveTableByDefault to false >