[jira] [Updated] (SPARK-51760) Upgrade ASM to 9.8

[ https://issues.apache.org/jira/browse/SPARK-51760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51760: --- Labels: pull-request-available (was: ) > Upgrade ASM to 9.8 > --- > >

[jira] [Updated] (SPARK-51756) Non-deterministic stage could lead to incorrect results with partial retry

[ https://issues.apache.org/jira/browse/SPARK-51756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51756: --- Labels: pull-request-available (was: ) > Non-deterministic stage could lead to incorrect re

[jira] [Resolved] (SPARK-51630) The sequential testing of UISeleniumSuite and ProcfsMetricsGetterSuite will cause ProcfsMetricsGetterSuite test fail on macOs

[ https://issues.apache.org/jira/browse/SPARK-51630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51630. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50545 [https://github.com

[jira] [Resolved] (SPARK-51691) SerializationDebugger should swallow exception when try to find the reason of serialization problem

[ https://issues.apache.org/jira/browse/SPARK-51691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51691. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50489 [https://github.com

[jira] [Comment Edited] (SPARK-51562) Add the time() function

[ https://issues.apache.org/jira/browse/SPARK-51562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17940141#comment-17940141 ] Senthil Kumar edited comment on SPARK-51562 at 4/10/25 2:08 PM: --

[jira] [Created] (SPARK-51764) Add collation to AnalysisContext doc

Marko Ilic created SPARK-51764: -- Summary: Add collation to AnalysisContext doc Key: SPARK-51764 URL: https://issues.apache.org/jira/browse/SPARK-51764 Project: Spark Issue Type: Test C

[jira] [Updated] (SPARK-51764) Add collation to AnalysisContext doc

[ https://issues.apache.org/jira/browse/SPARK-51764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51764: --- Labels: pull-request-available (was: ) > Add collation to AnalysisContext doc > ---

[jira] [Created] (SPARK-51765) Document SQL Scripting

Serge Rielau created SPARK-51765: Summary: Document SQL Scripting Key: SPARK-51765 URL: https://issues.apache.org/jira/browse/SPARK-51765 Project: Spark Issue Type: Documentation Co

[jira] [Assigned] (SPARK-51691) SerializationDebugger should swallow exception when try to find the reason of serialization problem

[ https://issues.apache.org/jira/browse/SPARK-51691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51691: Assignee: zhoubin > SerializationDebugger should swallow exception when try to find the reason of

[jira] [Resolved] (SPARK-51712) Swallow non-fatal Throwables when resolving tables in spark.catalog.listTables()

[ https://issues.apache.org/jira/browse/SPARK-51712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51712. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50515 [https://gi

[jira] [Assigned] (SPARK-51711) Propagates the active remote spark session to new threads to fix parallelFitTasks

[ https://issues.apache.org/jira/browse/SPARK-51711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51711: - Assignee: Xi Lyu > Propagates the active remote spark session to new threads to fix >

[jira] [Assigned] (SPARK-51761) Add a daily test for Linux + Arm64

[ https://issues.apache.org/jira/browse/SPARK-51761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51761: Assignee: Yang Jie > Add a daily test for Linux + Arm64 > -- > >

[jira] [Updated] (SPARK-51761) Add a daily test for Linux + Arm64

[ https://issues.apache.org/jira/browse/SPARK-51761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51761: --- Labels: pull-request-available (was: ) > Add a daily test for Linux + Arm64 > -

[jira] [Resolved] (SPARK-51761) Add a daily test for Linux + Arm64

[ https://issues.apache.org/jira/browse/SPARK-51761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51761. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50553 [https://github.com

[jira] [Resolved] (SPARK-51759) Add `ErrorUtils` and `SQLHelper`

[ https://issues.apache.org/jira/browse/SPARK-51759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51759. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 4

[jira] [Resolved] (SPARK-51760) Upgrade ASM to 9.8

[ https://issues.apache.org/jira/browse/SPARK-51760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-51760. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50543 [https://github.com

[jira] [Updated] (SPARK-51763) Support `ArrowStruct` type

[ https://issues.apache.org/jira/browse/SPARK-51763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51763: --- Labels: pull-request-available (was: ) > Support `ArrowStruct` type > -

[jira] [Updated] (SPARK-51762) Fix Resolution of Views in Single-Pass Analyzer When Bridging is Enabled

[ https://issues.apache.org/jira/browse/SPARK-51762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51762: --- Labels: pull-request-available (was: ) > Fix Resolution of Views in Single-Pass Analyzer Wh

[jira] [Created] (SPARK-51762) Fix Resolution of Views in Single-Pass Analyzer When Bridging is Enabled

Mihailo Milosevic created SPARK-51762: - Summary: Fix Resolution of Views in Single-Pass Analyzer When Bridging is Enabled Key: SPARK-51762 URL: https://issues.apache.org/jira/browse/SPARK-51762 Pr

[jira] [Created] (SPARK-51761) Add a daily test for Linux + Arm64

Yang Jie created SPARK-51761: Summary: Add a daily test for Linux + Arm64 Key: SPARK-51761 URL: https://issues.apache.org/jira/browse/SPARK-51761 Project: Spark Issue Type: Task Compone

[jira] [Commented] (SPARK-51419) Get hour of time

[ https://issues.apache.org/jira/browse/SPARK-51419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17942413#comment-17942413 ] Senthil Kumar commented on SPARK-51419: --- Follow-up PR : https://github.com/apache/

[jira] [Updated] (SPARK-51763) Support `struct` type in `ArrowReader`

[ https://issues.apache.org/jira/browse/SPARK-51763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51763: -- Summary: Support `struct` type in `ArrowReader` (was: Support `ArrowStruct` type) > Support

[jira] [Commented] (SPARK-51554) Add the time_trunc() function

[ https://issues.apache.org/jira/browse/SPARK-51554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17941728#comment-17941728 ] Sakthi commented on SPARK-51554: Work in progress. > Add the time_trunc() function > --

[jira] [Resolved] (SPARK-51747) Data source cached plan should respect options

[ https://issues.apache.org/jira/browse/SPARK-51747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51747. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50538 [https:

[jira] [Updated] (SPARK-51743) Add `describe_(database|table)`, `show_(database|table)`, `explain` sql test and answer files

[ https://issues.apache.org/jira/browse/SPARK-51743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51743: --- Labels: pull-request-available (was: ) > Add `describe_(database|table)`, `show_(database|t

[jira] [Created] (SPARK-51760) Upgrade ASM to 9.8

Yang Jie created SPARK-51760: Summary: Upgrade ASM to 9.8 Key: SPARK-51760 URL: https://issues.apache.org/jira/browse/SPARK-51760 Project: Spark Issue Type: Improvement Components: Bui

[jira] [Updated] (SPARK-51751) Fix case with multiple rCTEs that reference each other

[ https://issues.apache.org/jira/browse/SPARK-51751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51751: --- Labels: pull-request-available (was: ) > Fix case with multiple rCTEs that reference each o

[jira] [Updated] (SPARK-51754) Make sampleBy doctest deterministic

[ https://issues.apache.org/jira/browse/SPARK-51754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51754: --- Labels: pull-request-available (was: ) > Make sampleBy doctest deterministic >

[jira] [Updated] (SPARK-51673) Apply default collation for Alter view query

[ https://issues.apache.org/jira/browse/SPARK-51673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marko Ilic updated SPARK-51673: --- Issue Type: Bug (was: Test) > Apply default collation for Alter view query > --

[jira] [Created] (SPARK-51742) Upgrade snowflake-jdbc to 3.23.2

Yang Jie created SPARK-51742: Summary: Upgrade snowflake-jdbc to 3.23.2 Key: SPARK-51742 URL: https://issues.apache.org/jira/browse/SPARK-51742 Project: Spark Issue Type: Improvement C

[jira] [Created] (SPARK-51766) Add default error class to prevent potential NPE

Michael Zhang created SPARK-51766: - Summary: Add default error class to prevent potential NPE Key: SPARK-51766 URL: https://issues.apache.org/jira/browse/SPARK-51766 Project: Spark Issue Type

[jira] [Created] (SPARK-51767) HashPartitioning does not check `checkInputDataTypes` on `partitionIdExpression`

Harsh Motwani created SPARK-51767: - Summary: HashPartitioning does not check `checkInputDataTypes` on `partitionIdExpression` Key: SPARK-51767 URL: https://issues.apache.org/jira/browse/SPARK-51767 Pr

[jira] [Assigned] (SPARK-51699) Upgrade to Apache parent pom 34

[ https://issues.apache.org/jira/browse/SPARK-51699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51699: Assignee: Vlad Rozov > Upgrade to Apache parent pom 34 > --- > >

[jira] [Assigned] (SPARK-51763) Support `struct` type in `ArrowReader`

[ https://issues.apache.org/jira/browse/SPARK-51763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51763: - Assignee: Dongjoon Hyun > Support `struct` type in `ArrowReader` >

[jira] [Resolved] (SPARK-51763) Support `struct` type in `ArrowReader`

[ https://issues.apache.org/jira/browse/SPARK-51763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51763. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 5

[jira] [Updated] (SPARK-51770) Set Content-Type headers for Prometheus v3 compatibility

[ https://issues.apache.org/jira/browse/SPARK-51770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51770: --- Labels: pull-request-available (was: ) > Set Content-Type headers for Prometheus v3 compati

[jira] [Resolved] (SPARK-51358) Introduce snapshot upload lag detection through StateStoreCoordinator

[ https://issues.apache.org/jira/browse/SPARK-51358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51358. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50123 [https://gi

[jira] [Assigned] (SPARK-51736) Make `SparkConnectError` and `StorageLevel` fields public

[ https://issues.apache.org/jira/browse/SPARK-51736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51736: - Assignee: Dongjoon Hyun > Make `SparkConnectError` and `StorageLevel` fields public > -

[jira] [Assigned] (SPARK-51358) Introduce snapshot upload lag detection through StateStoreCoordinator

[ https://issues.apache.org/jira/browse/SPARK-51358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51358: Assignee: Zeyu Chen > Introduce snapshot upload lag detection through StateStoreCoordinat

[jira] [Resolved] (SPARK-46995) Allow AQE coalesce final stage in SQL cached plan

[ https://issues.apache.org/jira/browse/SPARK-46995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46995. -- Fix Version/s: 4.0.0 Assignee: Ziqi Liu Resolution: Fixed Issue resolved by https://gi

[jira] [Resolved] (SPARK-51766) Add default error class to prevent potential NPE

[ https://issues.apache.org/jira/browse/SPARK-51766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51766. Resolution: Duplicate Duplicate with https://issues.apache.org/jira/browse/SPARK-46490 >

[jira] [Commented] (SPARK-31561) Add QUALIFY Clause

[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943188#comment-17943188 ] Kurt Stultz commented on SPARK-31561: - A lot of the code I'm attempting to migrate f

[jira] [Assigned] (SPARK-51760) Upgrade ASM to 9.8

[ https://issues.apache.org/jira/browse/SPARK-51760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51760: Assignee: Yang Jie > Upgrade ASM to 9.8 > --- > > Key: SPARK-517

[jira] [Created] (SPARK-51747) Data source cached plan should account for options

Amanda Liu created SPARK-51747: -- Summary: Data source cached plan should account for options Key: SPARK-51747 URL: https://issues.apache.org/jira/browse/SPARK-51747 Project: Spark Issue Type: Ta

[jira] [Resolved] (SPARK-51726) Migrate DSv2 StagingTableCatalog to use TableInfo

[ https://issues.apache.org/jira/browse/SPARK-51726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51726. Resolution: Fixed Issue resolved by pull request 50521 [https://github.com/apache/spark/pu

[jira] [Assigned] (SPARK-51630) The sequential testing of UISeleniumSuite and ProcfsMetricsGetterSuite will cause ProcfsMetricsGetterSuite test fail on macOs

[ https://issues.apache.org/jira/browse/SPARK-51630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51630: Assignee: Yang Jie > The sequential testing of UISeleniumSuite and ProcfsMetricsGetterSuite will

[jira] [Updated] (SPARK-51553) Modify EXTRACT to support TIME data type

[ https://issues.apache.org/jira/browse/SPARK-51553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51553: --- Labels: pull-request-available (was: ) > Modify EXTRACT to support TIME data type > ---

[jira] [Created] (SPARK-51755) Set up a scheduled builder for free-threaded Python 3.13

Ruifeng Zheng created SPARK-51755: - Summary: Set up a scheduled builder for free-threaded Python 3.13 Key: SPARK-51755 URL: https://issues.apache.org/jira/browse/SPARK-51755 Project: Spark Is

[jira] [Created] (SPARK-51771) Add DSv2 APIs for ALTER TABLE ADD/DROP CONSTRAINT

Gengliang Wang created SPARK-51771: -- Summary: Add DSv2 APIs for ALTER TABLE ADD/DROP CONSTRAINT Key: SPARK-51771 URL: https://issues.apache.org/jira/browse/SPARK-51771 Project: Spark Issue T

[jira] [Updated] (SPARK-51771) Add DSv2 APIs for ALTER TABLE ADD/DROP CONSTRAINT

[ https://issues.apache.org/jira/browse/SPARK-51771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51771: --- Labels: pull-request-available (was: ) > Add DSv2 APIs for ALTER TABLE ADD/DROP CONSTRAINT

[jira] [Created] (SPARK-51772) Use of `copy()` instead of `withNewChildren` to create a copy of `TreeNode` with new children

Jihoon Son created SPARK-51772: -- Summary: Use of `copy()` instead of `withNewChildren` to create a copy of `TreeNode` with new children Key: SPARK-51772 URL: https://issues.apache.org/jira/browse/SPARK-51772

[jira] [Created] (SPARK-51763) Support `ArrowStruct` type

Dongjoon Hyun created SPARK-51763: - Summary: Support `ArrowStruct` type Key: SPARK-51763 URL: https://issues.apache.org/jira/browse/SPARK-51763 Project: Spark Issue Type: Sub-task C

[jira] [Resolved] (SPARK-51750) Upgrade `FlatBuffers` to v25.2.10

[ https://issues.apache.org/jira/browse/SPARK-51750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51750. --- Fix Version/s: connect-swift-0.1.0 Resolution: Fixed Issue resolved by pull request 4

[jira] [Resolved] (SPARK-51723) Add DSv2 APIs for create/get table constraints

[ https://issues.apache.org/jira/browse/SPARK-51723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-51723. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50519 [https:

[jira] [Updated] (SPARK-51768) Create Failure Injection Test for Streaming offset and commit log write failures

[ https://issues.apache.org/jira/browse/SPARK-51768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51768: --- Labels: pull-request-available (was: ) > Create Failure Injection Test for Streaming offset

[jira] [Created] (SPARK-51768) Create Failure Injection Test for Streaming offset and commit log write failures

Siying Dong created SPARK-51768: --- Summary: Create Failure Injection Test for Streaming offset and commit log write failures Key: SPARK-51768 URL: https://issues.apache.org/jira/browse/SPARK-51768 Projec

[jira] [Assigned] (SPARK-51503) Support variant in XML scan

[ https://issues.apache.org/jira/browse/SPARK-51503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51503: Assignee: Xiaonan Yang > Support variant in XML scan > --- > >

[jira] [Created] (SPARK-51769) Add maxRecordsPerOutputBatch to limit the number of record of Arrow output batch

L. C. Hsieh created SPARK-51769: --- Summary: Add maxRecordsPerOutputBatch to limit the number of record of Arrow output batch Key: SPARK-51769 URL: https://issues.apache.org/jira/browse/SPARK-51769 Projec

[jira] [Resolved] (SPARK-51503) Support variant in XML scan

[ https://issues.apache.org/jira/browse/SPARK-51503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51503. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50300 [https://gi

[jira] [Created] (SPARK-51770) Set Content-Type headers for Prometheus v3 compatibility

Zhou JIANG created SPARK-51770: -- Summary: Set Content-Type headers for Prometheus v3 compatibility Key: SPARK-51770 URL: https://issues.apache.org/jira/browse/SPARK-51770 Project: Spark Issue Ty