[jira] [Updated] (SPARK-50668) Got UNSUPPORTED_INSERT.RDD_BASED error when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-50668: -- Summary: Got UNSUPPORTED_INSERT.RDD_BASED error when insert into a jdbc datasource (was: UNSUPPORTED_

[jira] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668 ] kevinshin deleted comment on SPARK-50668: --- was (Author: JIRAUSER281772): Is it because of the use of back quotes on dbtable？ > UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource >

[jira] [Commented] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17909001#comment-17909001 ] kevinshin commented on SPARK-50668: --- Is it because of the use of back quotes on dbtabl

[jira] [Updated] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-50668: -- Description: I have some SQL scripts for pushing the calculation results of the data warehouse to the

[jira] [Updated] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-50668: -- Description: I have some SQL scripts for pushing the calculation results of the data warehouse to the

[jira] [Updated] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-50668: -- Description: I have some SQL scripts for pushing the calculation results of the data warehouse to the

[jira] [Updated] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-50668: -- Description: I have some SQL scripts for pushing the calculation results of the data warehouse to the

[jira] [Updated] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-50668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-50668: -- Description: I have some SQL scripts for pushing the calculation results of the data warehouse to the

[jira] [Created] (SPARK-50668) UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource

kevinshin created SPARK-50668: - Summary: UNSUPPORTED_INSERT.RDD_BASED when insert into a jdbc datasource Key: SPARK-50668 URL: https://issues.apache.org/jira/browse/SPARK-50668 Project: Spark Is

[jira] [Commented] (SPARK-42804) when target table format is textfile using `insert into select` will got error

[ https://issues.apache.org/jira/browse/SPARK-42804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17701010#comment-17701010 ] kevinshin commented on SPARK-42804: --- @[~yumwang]  below is my step by step reproduce 

[jira] [Comment Edited] (SPARK-42804) when target table format is textfile using `insert into select` will got error

[ https://issues.apache.org/jira/browse/SPARK-42804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700926#comment-17700926 ] kevinshin edited comment on SPARK-42804 at 3/16/23 6:47 AM:

[jira] [Commented] (SPARK-42804) when target table format is textfile using `insert into select` will got error

[ https://issues.apache.org/jira/browse/SPARK-42804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700926#comment-17700926 ] kevinshin commented on SPARK-42804: --- orc and parquet table won't have this problem. >

[jira] [Created] (SPARK-42804) when target table format is textfile using `insert into select` will got error

kevinshin created SPARK-42804: - Summary: when target table format is textfile using `insert into select` will got error Key: SPARK-42804 URL: https://issues.apache.org/jira/browse/SPARK-42804 Project: Spa

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Description: *spark config :*  spark.sql.adaptive.enabled true spark.sql.adaptive.advisoryPartitionSiz

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Description: spark config :  spark.sql.adaptive.enabled true spark.sql.adaptive.advisoryPartitionSizeI

[jira] [Updated] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

[ https://issues.apache.org/jira/browse/SPARK-42728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42728: -- Attachment: image-2023-03-09-17-34-26-428.png > when enable AQE update or drop a small iceberg table s

[jira] [Created] (SPARK-42728) when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config

kevinshin created SPARK-42728: - Summary: when enable AQE update or drop a small iceberg table should not generate as much task as `spark.sql.adaptive.coalescePartitions.initialPartitionNum` config Key: SPARK-42728 UR

[jira] [Updated] (SPARK-42650) insert overwrite table will casue table location lost if java.lang.ArithmeticException is thrown

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Summary: insert overwrite table will casue table location lost if java.lang.ArithmeticException is thr

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696810#comment-17696810 ] kevinshin commented on SPARK-42650: --- Thank you @[~yumwang]  > link issue SPARK-42550

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696645#comment-17696645 ] kevinshin commented on SPARK-42650: --- Thanks [~ulysses] , I can reproduced it without a

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696037#comment-17696037 ] kevinshin commented on SPARK-42650: --- Spark and Kyuubi are both belong to apache. May

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use [KyuubiSparkSQLExtension|https://kyuubi.readthedocs.io/en/v1.6.1-incubating/ext

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use [KyuubiSparkSQLExtension|https://kyuubi.readthedocs.io/en/v1.6.1-incubating/ext

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use [KyuubiSparkSQLExtension|https://kyuubi.readthedocs.io/en/v1.6.1-incubating/ext

[jira] [Created] (SPARK-42650) link issue SPARK-42550

kevinshin created SPARK-42650: - Summary: link issue SPARK-42550 Key: SPARK-42650 URL: https://issues.apache.org/jira/browse/SPARK-42650 Project: Spark Issue Type: Bug Components: SQL

[jira] [Closed] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin closed SPARK-42550. - > table directory will lost on hdfs when `INSERT OVERWRITE` faild >

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17694270#comment-17694270 ] kevinshin commented on SPARK-42550: --- this is not spark's issue > table directory will

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693467#comment-17693467 ] kevinshin commented on SPARK-42550: --- https://github.com/apache/kyuubi/issues/4416 > t

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693457#comment-17693457 ] kevinshin commented on SPARK-42550: --- It seems like my environment problem, I can't rep

[jira] [Comment Edited] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693044#comment-17693044 ] kevinshin edited comment on SPARK-42550 at 2/24/23 7:44 AM:

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: (was: image-2023-02-24-15-26-01-846.png) > table directory will lost on hdfs when `INS

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: (was: image-2023-02-24-15-22-45-876.png) > table directory will lost on hdfs when `INS

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693053#comment-17693053 ] kevinshin commented on SPARK-42550: --- the diffrent is :  1、spark3.2.1 will delete tabl

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693044#comment-17693044 ] kevinshin commented on SPARK-42550: --- when try to  refresh table test.spark32_overwrite

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-26-01-846.png > table directory will lost on hdfs when `INSERT OVERWRI

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-25-57-770.png > table directory will lost on hdfs when `INSERT OVERWRI

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during execution,

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-23-32-977.png > table directory will lost on hdfs when `INSERT OVERWRI

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during execution,

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-22-45-876.png > table directory will lost on hdfs when `INSERT OVERWRI

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Attachment: image-2023-02-24-15-21-55-273.png > table directory will lost on hdfs when `INSERT OVERWRI

[jira] [Updated] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42550: -- Description: {color:#4c9aff}when a  `{*}INSERT{*} OVERWRITE *TABLE`* statment faild during execution,

[jira] [Created] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

kevinshin created SPARK-42550: - Summary: table directory will lost on hdfs when `INSERT OVERWRITE` faild Key: SPARK-42550 URL: https://issues.apache.org/jira/browse/SPARK-42550 Project: Spark Is

[jira] [Comment Edited] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690965#comment-17690965 ] kevinshin edited comment on SPARK-42473 at 2/20/23 1:47 AM:

[jira] [Commented] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17690965#comment-17690965 ] kevinshin commented on SPARK-42473: --- [~yumwang]  'What is your test.spark33_decimal_or

[jira] [Updated] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42473: -- Description: *when 'union all' and one select statement use* *Literal as column value , the other* *s

[jira] [Created] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

kevinshin created SPARK-42473: - Summary: An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL Key: SPARK-42473 URL: https://issues.apache.org/jira/browse/SPARK-42473 Project: Spark

[jira] [Commented] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17688377#comment-17688377 ] kevinshin commented on SPARK-41727: --- https://github.com/apache/hive/commit/93f2274b5dd

[jira] [Resolved] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin resolved SPARK-41727. --- Resolution: Not A Bug it is not a issue about spark, but for hive > ClassCastException when config

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-41727: -- Attachment: hms-init-error.txt > ClassCastException when config spark.sql.hive.metastore* properties u

[jira] [Updated] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-41727: -- Description: Apache spark3.3.1 \ HDP3.1.5 with hive 3.1.0 when config properties about spark.sql.hive

[jira] [Created] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

kevinshin created SPARK-41727: - Summary: ClassCastException when config spark.sql.hive.metastore* properties under jdk17 Key: SPARK-41727 URL: https://issues.apache.org/jira/browse/SPARK-41727 Project: Sp

[jira] [Commented] (SPARK-32166) Metastore problem on Spark3.0 with Hive3.0

[ https://issues.apache.org/jira/browse/SPARK-32166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651989#comment-17651989 ] kevinshin commented on SPARK-32166: --- try set  spark.sql.legacy.createHiveTableByDefaul