[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Affects Version/s: 3.5.1 > Optimize hive patition filter when the comparision dataType not match >

[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Affects Version/s: 3.5.0 > Optimize hive patition filter when the comparision dataType not match >

[jira] [Updated] (SPARK-45387) Optimize hive patition filter when the comparision dataType not match

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Summary: Optimize hive patition filter when the comparision dataType not match (was: Partition key

[jira] [Updated] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2024-04-16 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Description: Suppose we have a partitioned table `table_pt` with partition colum `dt` which is

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-05 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Description: we encounter that spark driver hangs for about 11 hours,  and finall killed by user. In

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-05 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Attachment: oom-killer.png > spark driver process hangs due to "unable to create new native thread" >

[jira] [Commented] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2024-03-05 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823524#comment-17823524 ] TianyiMa commented on SPARK-45387: -- [~doki] the output execution plan is the final result, but the

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Description: we encounter that spark driver hangs for about 11 hours,  and finall killed by user. In

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Description: we encounter that spark driver hangs for about 11 hours,  and finall killed by user. In

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Attachment: executor_4.png > spark driver process hangs due to "unable to create new native thread" >

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Description: we encounter that spark driver hangs for about 11 hours,  and finall killed by user. In

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Description: we encounter that spark driver hangs for about 11 hours,  and finall killed by user. In

[jira] [Updated] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-47279: - Attachment: driver_submit_task.png > spark driver process hangs due to "unable to create new native

[jira] [Created] (SPARK-47279) spark driver process hangs due to "unable to create new native thread"

2024-03-04 Thread TianyiMa (Jira)
TianyiMa created SPARK-47279: Summary: spark driver process hangs due to "unable to create new native thread" Key: SPARK-47279 URL: https://issues.apache.org/jira/browse/SPARK-47279 Project: Spark

[jira] [Updated] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2023-10-13 Thread TianyiMa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TianyiMa updated SPARK-45387: - Attachment: PruneFileSourcePartitions.diff > Partition key filter cannot be pushed down when using cast

[jira] [Created] (SPARK-45387) Partition key filter cannot be pushed down when using cast

2023-09-30 Thread TianyiMa (Jira)
TianyiMa created SPARK-45387: Summary: Partition key filter cannot be pushed down when using cast Key: SPARK-45387 URL: https://issues.apache.org/jira/browse/SPARK-45387 Project: Spark Issue