[jira] [Commented] (SPARK-17398) Failed to query on external JSon Partitioned table

2025-02-28 Thread Dyno Fu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17931622#comment-17931622 ] Dyno Fu commented on SPARK-17398: - > Caused by: java.lang.ClassCastException: java.util.

[jira] [Created] (SPARK-51359) Set INT64 as the default timestamp type for Parquet files

2025-02-28 Thread Ganesha Shreedhara (Jira)
Ganesha Shreedhara created SPARK-51359: -- Summary: Set INT64 as the default timestamp type for Parquet files Key: SPARK-51359 URL: https://issues.apache.org/jira/browse/SPARK-51359 Project: Spark

[jira] [Assigned] (SPARK-49960) Support end DeveloperAPI provided AgnosticEncoders based on ExpressionEncoders to allow migration

2025-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-49960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-49960: - Assignee: Chris Twiner > Support end DeveloperAPI provided AgnosticEncoders bas

[jira] [Resolved] (SPARK-49960) Support end DeveloperAPI provided AgnosticEncoders based on ExpressionEncoders to allow migration

2025-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-49960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49960. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50023 [

[jira] [Updated] (SPARK-51358) Introduce snapshot upload lag detection through StateStoreCoordinator

2025-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51358: --- Labels: pull-request-available (was: ) > Introduce snapshot upload lag detection through St

[jira] [Resolved] (SPARK-51351) TWS PySpark implementation materializes the entire output iterator in python worker

2025-02-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51351. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50110 [https://gi

[jira] [Created] (SPARK-51357) Plan change logging level is not preserved for views

2025-02-28 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-51357: Summary: Plan change logging level is not preserved for views Key: SPARK-51357 URL: https://issues.apache.org/jira/browse/SPARK-51357 Project: Spark

[jira] [Updated] (SPARK-51357) Plan change logging level is not preserved for views

2025-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51357: --- Labels: pull-request-available (was: ) > Plan change logging level is not preserved for vie

[jira] [Updated] (SPARK-51356) FilterExec incorrectly reorders IsNotNull predicates for nested access

2025-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-51356: -- Description: In whole stage code generation FilterExec reorders IsNotNull to make sure

[jira] [Updated] (SPARK-51356) FilterExec incorrectly reorders IsNotNull predicates for nested access

2025-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-51356: -- Description: In whole stage code generation FilterExec reorders IsNotNull to make sure

[jira] [Created] (SPARK-51356) FilterExec incorrectly reorders IsNotNull predicates for nested access

2025-02-28 Thread Jira
Herman van Hövell created SPARK-51356: - Summary: FilterExec incorrectly reorders IsNotNull predicates for nested access Key: SPARK-51356 URL: https://issues.apache.org/jira/browse/SPARK-51356 Proj

[jira] [Assigned] (SPARK-51335) Publish Apache Spark 3.5.5 to docker registry

2025-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51335: - Assignee: Dongjoon Hyun > Publish Apache Spark 3.5.5 to docker registry > -

[jira] [Updated] (SPARK-51355) Add a brief explanation for Spark Connect at PySpark Overview page

2025-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51355: --- Labels: pull-request-available (was: ) > Add a brief explanation for Spark Connect at PySpa

[jira] [Updated] (SPARK-51355) Add a brief explanation for Spark Connect at PySpark Overview page

2025-02-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51355: - Summary: Add a brief explanation for Spark Connect at PySpark Overview page (was: Add a brief e

[jira] [Created] (SPARK-51355) Add a brief explanation at PySpark Overview page

2025-02-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-51355: Summary: Add a brief explanation at PySpark Overview page Key: SPARK-51355 URL: https://issues.apache.org/jira/browse/SPARK-51355 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51353) dyn/closer.lua might not be retried before falling back to archive

2025-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51353: --- Labels: pull-request-available (was: ) > dyn/closer.lua might not be retried before falling

[jira] [Updated] (SPARK-51354) Fix sbt K8s integration test arg javaImageTag

2025-02-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51354: --- Labels: pull-request-available (was: ) > Fix sbt K8s integration test arg javaImageTag > --

[jira] [Updated] (SPARK-50873) An optimization for SparkOptimizer to prune the column in subquery

2025-02-28 Thread KeKe Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KeKe Zhu updated SPARK-50873: - Affects Version/s: 3.3.3 (was: 3.5.3) > An optimization for SparkOptimizer to

[jira] [Updated] (SPARK-51354) Fix sbt K8s integration test arg javaImageTag

2025-02-28 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-51354: -- Summary: Fix sbt K8s integration test arg javaImageTag (was: Fix sbt K8s integration tests arg javaIm

[jira] [Updated] (SPARK-51354) Fix sbt K8s integration tests arg javaImageTag

2025-02-28 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-51354: -- Summary: Fix sbt K8s integration tests arg javaImageTag (was: Fix K8s integration tests arg javaImage

[jira] [Created] (SPARK-51354) Fix K8s integration tests arg javaImageTag

2025-02-28 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-51354: - Summary: Fix K8s integration tests arg javaImageTag Key: SPARK-51354 URL: https://issues.apache.org/jira/browse/SPARK-51354 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-51353) dyn/closer.lua might not be retried before falling back to archive

2025-02-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-51353: Summary: dyn/closer.lua might not be retried before falling back to archive Key: SPARK-51353 URL: https://issues.apache.org/jira/browse/SPARK-51353 Project: Spark I