[jira] [Updated] (SPARK-51757) `LEAD` causes NullPointerException in window function

2025-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51757: --- Labels: pull-request-available (was: ) > `LEAD` causes NullPointerException in window funct

[jira] [Assigned] (SPARK-51751) Fix case with multiple rCTEs that reference each other

2025-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51751: --- Assignee: Pavle Martinović > Fix case with multiple rCTEs that reference each other > -

[jira] [Resolved] (SPARK-51754) Make sampleBy doctest deterministic

2025-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51754. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50547 [https://

[jira] [Resolved] (SPARK-51755) Set up a scheduled builder for free-threaded Python 3.13

2025-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51755. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50534 [https://

[jira] [Resolved] (SPARK-51751) Fix case with multiple rCTEs that reference each other

2025-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51751. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50544 [https://gith

[jira] [Assigned] (SPARK-51747) Data source cached plan should respect options

2025-04-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-51747: -- Assignee: Amanda Liu > Data source cached plan should respect options > -

[jira] [Resolved] (SPARK-51673) Apply default collation for Alter view query

2025-04-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51673. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50468 [https://github.com

[jira] [Assigned] (SPARK-51673) Apply default collation for Alter view query

2025-04-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51673: Assignee: Marko Ilic > Apply default collation for Alter view query > ---

[jira] [Assigned] (SPARK-51738) IN subquery with struct of mismatching field names fails with PLAN_VALIDATION_FAILED_RULE_IN_BATCH

2025-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51738: --- Assignee: Wenchen Fan > IN subquery with struct of mismatching field names fails with > PL

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Attachment: example 1.png > Non-deterministic stage could lead to incorrect results with partial ret

[jira] [Updated] (SPARK-51759) Add `ErrorUtils` and `SQLHelper`

2025-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51759: --- Labels: pull-request-available (was: ) > Add `ErrorUtils` and `SQLHelper` > ---

[jira] [Created] (SPARK-51759) Add `ErrorUtils` and `SQLHelper`

2025-04-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-51759: - Summary: Add `ErrorUtils` and `SQLHelper` Key: SPARK-51759 URL: https://issues.apache.org/jira/browse/SPARK-51759 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51750) Upgrade `FlatBuffers` to v25.2.10

2025-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51750: --- Labels: pull-request-available (was: ) > Upgrade `FlatBuffers` to v25.2.10 > -

[jira] [Created] (SPARK-51757) `LEAD` causes NullPointerException in window function

2025-04-09 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-51757: --- Summary: `LEAD` causes NullPointerException in window function Key: SPARK-51757 URL: https://issues.apache.org/jira/browse/SPARK-51757 Project: Spark Issue Typ

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Attachment: (was: example 1.png) > Non-deterministic stage could lead to incorrect results with

[jira] [Assigned] (SPARK-51395) Refine handling of default values in procedures

2025-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51395: --- Assignee: Anton Okolnychyi > Refine handling of default values in procedures >

[jira] [Resolved] (SPARK-51738) IN subquery with struct of mismatching field names fails with PLAN_VALIDATION_FAILED_RULE_IN_BATCH

2025-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51738. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50537 [https://gith

[jira] [Resolved] (SPARK-51395) Refine handling of default values in procedures

2025-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51395. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50541 [https://gith

[jira] [Updated] (SPARK-51755) Set up a scheduled builder for free-threaded Python 3.13

2025-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51755: --- Labels: pull-request-available (was: ) > Set up a scheduled builder for free-threaded Pytho

[jira] [Assigned] (SPARK-51755) Set up a scheduled builder for free-threaded Python 3.13

2025-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51755: - Assignee: Ruifeng Zheng > Set up a scheduled builder for free-threaded Python 3.13 > --

[jira] [Assigned] (SPARK-51754) Make sampleBy doctest deterministic

2025-04-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51754: - Assignee: Ruifeng Zheng > Make sampleBy doctest deterministic > ---

[jira] [Updated] (SPARK-51630) The sequential testing of UISeleniumSuite and ProcfsMetricsGetterSuite will cause ProcfsMetricsGetterSuite test fail on macOs

2025-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51630: --- Labels: pull-request-available (was: ) > The sequential testing of UISeleniumSuite and Proc

[jira] [Resolved] (SPARK-51699) Upgrade to Apache parent pom 34

2025-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51699. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50500 [https://github.com

[jira] [Created] (SPARK-51754) Make sampleBy doctest deterministic

2025-04-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-51754: - Summary: Make sampleBy doctest deterministic Key: SPARK-51754 URL: https://issues.apache.org/jira/browse/SPARK-51754 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-51751) Fix case with multiple rCTEs that reference each other

2025-04-09 Thread Jira
Pavle Martinović created SPARK-51751: Summary: Fix case with multiple rCTEs that reference each other Key: SPARK-51751 URL: https://issues.apache.org/jira/browse/SPARK-51751 Project: Spark

[jira] [Created] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
Jiexing Li created SPARK-51756: -- Summary: Non-deterministic stage could lead to incorrect results with partial retry Key: SPARK-51756 URL: https://issues.apache.org/jira/browse/SPARK-51756 Project: Spark

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Attachment: example 3.png > Non-deterministic stage could lead to incorrect results with partial ret

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Attachment: example 4.png > Non-deterministic stage could lead to incorrect results with partial ret

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Description: Spark's resilience features can cause an RDD to be partially recomputed, e.g. when an

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Description: Spark's resilience features can cause an RDD to be partially recomputed, e.g. when an

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Attachment: example 2.png > Non-deterministic stage could lead to incorrect results with partial ret

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

2025-04-09 Thread Jiexing Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiexing Li updated SPARK-51756: --- Attachment: example 1.png > Non-deterministic stage could lead to incorrect results with partial ret

[jira] [Resolved] (SPARK-49507) Fix Expected only partition pruning predicates exception

2025-04-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-49507. - Resolution: Fixed > Fix Expected only partition pruning predicates exception > -

[jira] [Assigned] (SPARK-51512) Filter out null MapStatus when cleaning up shuffle data with ExternalShuffleService

2025-04-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51512: Assignee: Wan Kun > Filter out null MapStatus when cleaning up shuffle data with > ExternalShuff

[jira] [Created] (SPARK-51752) Enable rCTE referencing from within a CTE

2025-04-09 Thread Jira
Pavle Martinović created SPARK-51752: Summary: Enable rCTE referencing from within a CTE Key: SPARK-51752 URL: https://issues.apache.org/jira/browse/SPARK-51752 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51752) Enable rCTE referencing from within a CTE

2025-04-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavle Martinović updated SPARK-51752: - Description: We should add the possibility for a recursion CTE to be referenced inside a

[jira] [Updated] (SPARK-51752) Enable rCTE referencing from within a CTE

2025-04-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51752: --- Labels: pull-request-available (was: ) > Enable rCTE referencing from within a CTE > --

[jira] [Assigned] (SPARK-51421) Get seconds of time

2025-04-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51421: Assignee: Senthil Kumar > Get seconds of time > --- > > Key: SPAR

[jira] [Created] (SPARK-51753) Spark , Avro and Iceberg Timestamp , Timestamp NTZ definition need more clarifications

2025-04-09 Thread Shekhar Prasad Rajak (Jira)
Shekhar Prasad Rajak created SPARK-51753: Summary: Spark , Avro and Iceberg Timestamp , Timestamp NTZ definition need more clarifications Key: SPARK-51753 URL: https://issues.apache.org/jira/browse/SPARK-5

[jira] [Resolved] (SPARK-51421) Get seconds of time

2025-04-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51421. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50525 [https://github.com