[jira] [Created] (SPARK-50656) JDBC Reader Fails to Handle Complex Types (Array, Map) from Trino

2024-12-23 Thread Narayan Bhawar (Jira)
Narayan Bhawar created SPARK-50656: -- Summary: JDBC Reader Fails to Handle Complex Types (Array, Map) from Trino Key: SPARK-50656 URL: https://issues.apache.org/jira/browse/SPARK-50656 Project: Spark

[jira] [Resolved] (SPARK-50644) Read variant struct in Parquet reader.

2024-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50644. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49263 [https://gith

[jira] [Assigned] (SPARK-50644) Read variant struct in Parquet reader.

2024-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50644: --- Assignee: Chenhao Li > Read variant struct in Parquet reader. > ---

[jira] [Resolved] (SPARK-50649) Fix inconsistencies with casting between different collations

2024-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50649. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49269 [https://gith

[jira] [Assigned] (SPARK-50649) Fix inconsistencies with casting between different collations

2024-12-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50649: --- Assignee: Stefan Kandic > Fix inconsistencies with casting between different collations > -

[jira] [Resolved] (SPARK-50651) Add note about octal representation for characters

2024-12-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50651. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49273 [https://gi

[jira] [Created] (SPARK-50655) Fix metric for tracking total state rows as logical entities in transformWithState

2024-12-23 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-50655: -- Summary: Fix metric for tracking total state rows as logical entities in transformWithState Key: SPARK-50655 URL: https://issues.apache.org/jira/browse/SPARK-50655

[jira] [Created] (SPARK-50654) CommitMetadata should set stateUniqueIds to None in V1

2024-12-23 Thread Wei Liu (Jira)
Wei Liu created SPARK-50654: --- Summary: CommitMetadata should set stateUniqueIds to None in V1 Key: SPARK-50654 URL: https://issues.apache.org/jira/browse/SPARK-50654 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-50639) Improve warning logging in CacheManager

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50639: --- Labels: pull-request-available (was: ) > Improve warning logging in CacheManager >

[jira] [Updated] (SPARK-50652) RocksDB V2 backward compatibility currently not suuported

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50652: --- Labels: pull-request-available (was: ) > RocksDB V2 backward compatibility currently not su

[jira] [Updated] (SPARK-50652) RocksDB V2 backward compatibility currently not suuported

2024-12-23 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-50652: Epic Link: SPARK-49374 > RocksDB V2 backward compatibility currently not suuported > -

[jira] [Created] (SPARK-50653) Support RocksDB V2 -> V1 backward compatibility

2024-12-23 Thread Wei Liu (Jira)
Wei Liu created SPARK-50653: --- Summary: Support RocksDB V2 -> V1 backward compatibility Key: SPARK-50653 URL: https://issues.apache.org/jira/browse/SPARK-50653 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-50652) RocksDB V2 backward compatibility currently not suuported

2024-12-23 Thread Wei Liu (Jira)
Wei Liu created SPARK-50652: --- Summary: RocksDB V2 backward compatibility currently not suuported Key: SPARK-50652 URL: https://issues.apache.org/jira/browse/SPARK-50652 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-50649) Fix inconsistencies with casting between different collations

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50649: --- Labels: pull-request-available (was: ) > Fix inconsistencies with casting between different

[jira] [Updated] (SPARK-49087) Move all Connect invocations of system.internal function to the proper namespace

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49087: --- Labels: pull-request-available (was: ) > Move all Connect invocations of system.internal fu

[jira] [Updated] (SPARK-50651) Add note about octal representation for characters

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50651: --- Labels: pull-request-available (was: ) > Add note about octal representation for characters

[jira] [Created] (SPARK-50651) Add note about octal representation for characters

2024-12-23 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-50651: -- Summary: Add note about octal representation for characters Key: SPARK-50651 URL: https://issues.apache.org/jira/browse/SPARK-50651 Project: Spark Issue

[jira] [Updated] (SPARK-50650) Improve PlanLogger in the single-pass Analyzer

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50650: --- Labels: pull-request-available (was: ) > Improve PlanLogger in the single-pass Analyzer > -

[jira] [Created] (SPARK-50650) Improve PlanLogger in the single-pass Analyzer

2024-12-23 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50650: Summary: Improve PlanLogger in the single-pass Analyzer Key: SPARK-50650 URL: https://issues.apache.org/jira/browse/SPARK-50650 Project: Spark Issue

[jira] [Created] (SPARK-50649) Fix inconsistencies with casting between different collations

2024-12-23 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-50649: - Summary: Fix inconsistencies with casting between different collations Key: SPARK-50649 URL: https://issues.apache.org/jira/browse/SPARK-50649 Project: Spark

[jira] [Updated] (SPARK-50648) when the job is cancelled during shuffle retry in parent stage, might leave behind zombie tasks

2024-12-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50648: --- Labels: pull-request-available (was: ) > when the job is cancelled during shuffle retry in

[jira] [Updated] (SPARK-50648) when the job is cancelled during shuffle retry in parent stage, might leave behind zombie tasks

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Description: Assume a job is stage1-> stage2, when FetchFailed occurs during the stage 2, the stage1 and stage2

[jira] [Updated] (SPARK-50648) when the job is cancelled during shuffle retry in parent stage, we should kill all the zombie tasks

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Summary: when the job is cancelled during shuffle retry in parent stage, we should kill all the zombie tasks (w

[jira] [Updated] (SPARK-50648) when the job is cancelled during shuffle retry in parent stage, might leave behind zombie tasks

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Summary: when the job is cancelled during shuffle retry in parent stage, might leave behind zombie tasks (was:

[jira] [Updated] (SPARK-50648) When the job is cancelled during shuffle retry, some tasks may be

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Summary: When the job is cancelled during shuffle retry, some tasks may be (was: When the job is cancelled dur

[jira] [Updated] (SPARK-50648) When the job is cancelled during shuffle retry, all the tasks should be killed

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Summary: When the job is cancelled during shuffle retry, all the tasks should be killed (was: When the job is c

[jira] [Updated] (SPARK-50648) When the job is cancelled during shuffle retry, there are still zombie tasks that continue to run

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Affects Version/s: 2.1.0 (was: 4.0.0) > When the job is cancelled during shuffle retr

[jira] [Updated] (SPARK-50648) When the job is cancelled during shuffle retry, there are still zombie tasks that continue to run

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Description: Assume a job is stage1-> stage2, when FetchFailed occurs during the stage 2, the stage1 and stage2

[jira] [Updated] (SPARK-50648) When the job is cancelled during shuffle retry, there are still zombie tasks that continue to run

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Description: Assume a job is stage1-> stage2, when FetchFailed occurs during the stage 2, the stage1 and stage2

[jira] [Created] (SPARK-50648) When the job is cancelled when shuffle retry, there are still zombie tasks that continue to run

2024-12-23 Thread Mars (Jira)
Mars created SPARK-50648: Summary: When the job is cancelled when shuffle retry, there are still zombie tasks that continue to run Key: SPARK-50648 URL: https://issues.apache.org/jira/browse/SPARK-50648 Proje

[jira] [Updated] (SPARK-50648) When the job is cancelled during shuffle retry, there are still zombie tasks that continue to run

2024-12-23 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-50648: - Summary: When the job is cancelled during shuffle retry, there are still zombie tasks that continue to run (was

[jira] [Resolved] (SPARK-50641) Move `GetJsonObjectEvaluator` to `JsonExpressionEvalUtils`

2024-12-23 Thread Pan Bingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pan Bingkun resolved SPARK-50641. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49259 [https://gith