[jira] [Updated] (SPARK-47488) Driver stuck when thread pool is not shut down

2024-03-22 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-47488: -- Description: The app example:   {code:java} object SparkTest { def main(args: Array[String]): Unit

[jira] [Updated] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

2024-03-20 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-47488: -- Description: The app example:   {code:java} object SparkTest { def main(args: Array[String]): Unit

[jira] [Created] (SPARK-47488) [k8s]Driver stuck when thread pool is not shut down

2024-03-20 Thread Zhou Tong (Jira)
Zhou Tong created SPARK-47488: - Summary: [k8s]Driver stuck when thread pool is not shut down Key: SPARK-47488 URL: https://issues.apache.org/jira/browse/SPARK-47488 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46460) The filter of partition including cast function may lead the partition pruning to disable

2023-12-26 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Attachment: SPARK-46460.patch > The filter of partition including cast function may lead the

[jira] [Updated] (SPARK-46460) The filter of partition including cast function may lead the partition pruning to disable

2023-12-21 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Attachment: (was: SPARK-46460.patch) > The filter of partition including cast function may lead

[jira] [Updated] (SPARK-46460) The filter of partition including cast function may lead the partition pruning to disable

2023-12-20 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Summary: The filter of partition including cast function may lead the partition pruning to disable

[jira] [Updated] (SPARK-46460) The filter of partition includes cast function may lead the partition pruning to disable

2023-12-19 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Attachment: SPARK-46460.patch > The filter of partition includes cast function may lead the partition

[jira] [Updated] (SPARK-46460) The filter of partition includes cast function may lead the partition pruning to disable

2023-12-19 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Description: SQL:select * from test_db.test_table where day between date_sub('2023-12-01',1) and 

[jira] [Updated] (SPARK-46460) The filter of partition includes cast function may lead the partition pruning to disable

2023-12-19 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Description: SQL:select * from test_db.test_table where day between date_sub('2023-12-01',1) and 

[jira] [Updated] (SPARK-46460) The filter of partition includes cast function may lead the partition pruning to disable

2023-12-19 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Description: SQL:select * from test_db.test_table where day between date_sub('2023-12-01',1) and 

[jira] [Updated] (SPARK-46460) The filter of partition includes cast function may lead the partition pruning to disable

2023-12-19 Thread Zhou Tong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Tong updated SPARK-46460: -- Summary: The filter of partition includes cast function may lead the partition pruning to disable

[jira] [Created] (SPARK-46460) When spark access HiveMetastore to abtain the meta data about hive table, if the filter of partition includes cast function, the partition pruning may disable. In this s

2023-12-19 Thread Zhou Tong (Jira)
Zhou Tong created SPARK-46460: - Summary: When spark access HiveMetastore to abtain the meta data about hive table, if the filter of partition includes cast function, the partition pruning may disable. In this situation, the performance of HMS will