[jira] [Updated] (SPARK-52694) Add a DeveloperApi - org.apache.spark.sql.Encoders#udt

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52694: --- Labels: pull-request-available (was: ) > Add a DeveloperApi - org.apache.spark.sql.Encoder

[jira] [Resolved] (SPARK-52744) Add `MacOS` integration test with Apache Spark 4.1.0-preview1 RC1

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52744. --- Fix Version/s: connect-swift-0.4.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Assigned] (SPARK-52744) Add `MacOS` integration test with Apache Spark 4.1.0-preview1 RC1

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52744: - Assignee: Dongjoon Hyun > Add `MacOS` integration test with Apache Spark 4.1.0-preview1

[jira] [Created] (SPARK-52747) Support timezone variations

2025-07-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52747: - Summary: Support timezone variations Key: SPARK-52747 URL: https://issues.apache.org/jira/browse/SPARK-52747 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52746) Fix `isLocal`

2025-07-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52746: - Summary: Fix `isLocal` Key: SPARK-52746 URL: https://issues.apache.org/jira/browse/SPARK-52746 Project: Spark Issue Type: Sub-task Components: Co

[jira] [Assigned] (SPARK-52723) Server side column name validation

2025-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-52723: - Assignee: Ruifeng Zheng > Server side column name validation >

[jira] [Resolved] (SPARK-52723) Server side column name validation

2025-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-52723. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51409 [https://

[jira] [Resolved] (SPARK-52743) Support `startRun`

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52743. --- Fix Version/s: connect-swift-0.4.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Updated] (SPARK-52745) Make Table.schema() be able to be deprecated

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52745: --- Labels: pull-request-available (was: ) > Make Table.schema() be able to be deprecated > ---

[jira] [Created] (SPARK-52745) Make Table.schema() be able to be deprecated

2025-07-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-52745: Summary: Make Table.schema() be able to be deprecated Key: SPARK-52745 URL: https://issues.apache.org/jira/browse/SPARK-52745 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-52744) Add `MacOS` integration test with Apache Spark 4.1.0-preview1 RC1

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52744: --- Labels: pull-request-available (was: ) > Add `MacOS` integration test with Apache Spark 4.1

[jira] [Created] (SPARK-52744) Add `MacOS` integration test with Apache Spark 4.1.0-preview1 RC1

2025-07-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52744: - Summary: Add `MacOS` integration test with Apache Spark 4.1.0-preview1 RC1 Key: SPARK-52744 URL: https://issues.apache.org/jira/browse/SPARK-52744 Project: Spark

[jira] [Assigned] (SPARK-52743) Support `startRun`

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52743: - Assignee: Dongjoon Hyun > Support `startRun` > -- > > K

[jira] [Updated] (SPARK-52743) Support `startRun`

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52743: --- Labels: pull-request-available (was: ) > Support `startRun` > -- > >

[jira] [Created] (SPARK-52743) Support `startRun`

2025-07-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52743: - Summary: Support `startRun` Key: SPARK-52743 URL: https://issues.apache.org/jira/browse/SPARK-52743 Project: Spark Issue Type: Sub-task Component

[jira] [Resolved] (SPARK-52742) Support `createDataflowGraph`

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52742. --- Fix Version/s: connect-swift-0.4.0 Resolution: Fixed Issue resolved by pull request 2

[jira] [Updated] (SPARK-52727) Refactor Window resolution in order to reuse it in single-pass analyzer

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52727: --- Labels: pull-request-available (was: ) > Refactor Window resolution in order to reuse it in

[jira] [Resolved] (SPARK-52739) Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52739. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51429 [https://gi

[jira] [Assigned] (SPARK-52739) Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52739: Assignee: Takuya Ueshin > Apply a patch to unittest to avoid unexpectedly passing when se

[jira] [Assigned] (SPARK-52742) Support `createDataflowGraph`

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52742: - Assignee: Dongjoon Hyun > Support `createDataflowGraph` > -

[jira] [Updated] (SPARK-52742) Support `createDataflowGraph`

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52742: --- Labels: pull-request-available (was: ) > Support `createDataflowGraph` > --

[jira] [Created] (SPARK-52742) Support `createDataflowGraph`

2025-07-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52742: - Summary: Support `createDataflowGraph` Key: SPARK-52742 URL: https://issues.apache.org/jira/browse/SPARK-52742 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-52718) Fix float32 type widening in `rmod`/`mod` under ANSI

2025-07-09 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-52718. -- Target Version/s: 4.1.0 Assignee: Xinrong Meng Resolution: Resolved Reso

[jira] [Updated] (SPARK-52652) Replace os-maven-plugin with nisse

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52652: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Replace os-maven-plugin

[jira] [Resolved] (SPARK-52735) Fix missing error class definition

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52735. -- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-52736) Typo Moveing in pyspark pandas generic.py

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52736. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51426 [https://gi

[jira] [Assigned] (SPARK-52736) Typo Moveing in pyspark pandas generic.py

2025-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52736: Assignee: Peter Nguyen > Typo Moveing in pyspark pandas generic.py >

[jira] [Updated] (SPARK-52741) RemoveFiles ShuffleCleanup mode doesnt work with non-adaptive execution

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52741: --- Labels: pull-request-available (was: ) > RemoveFiles ShuffleCleanup mode doesnt work with n

[jira] [Updated] (SPARK-52741) RemoveFiles ShuffleCleanup mode doesnt work with non-adaptive execution

2025-07-09 Thread Karuppayya (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karuppayya updated SPARK-52741: --- Summary: RemoveFiles ShuffleCleanup mode doesnt work with non-adaptive execution (was: RemoveFiles

[jira] [Created] (SPARK-52741) RemoveFiles ShuffleCleanup doesnt work with non-adaptive execution

2025-07-09 Thread Karuppayya (Jira)
Karuppayya created SPARK-52741: -- Summary: RemoveFiles ShuffleCleanup doesnt work with non-adaptive execution Key: SPARK-52741 URL: https://issues.apache.org/jira/browse/SPARK-52741 Project: Spark

[jira] [Updated] (SPARK-52740) Fix NPE in HDFSBackedStateStoreProvider accessing StateStoreConf.sqlConf when checkpoint format version is >=2

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52740: --- Labels: pull-request-available (was: ) > Fix NPE in HDFSBackedStateStoreProvider accessing

[jira] [Created] (SPARK-52740) Fix NPE in HDFSBackedStateStoreProvider accessing StateStoreConf.sqlConf when checkpoint format version is >=2

2025-07-09 Thread Livia Zhu (Jira)
Livia Zhu created SPARK-52740: - Summary: Fix NPE in HDFSBackedStateStoreProvider accessing StateStoreConf.sqlConf when checkpoint format version is >=2 Key: SPARK-52740 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-52738) Support aggregating TIME type with a UDAF when the underlying buffer is an UnsafeRow

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52738: --- Labels: pull-request-available (was: ) > Support aggregating TIME type with a UDAF when the

[jira] [Updated] (SPARK-52739) Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52739: --- Labels: pull-request-available (was: ) > Apply a patch to unittest to avoid unexpectedly pa

[jira] [Created] (SPARK-52739) Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails

2025-07-09 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-52739: - Summary: Apply a patch to unittest to avoid unexpectedly passing when setUpClass fails Key: SPARK-52739 URL: https://issues.apache.org/jira/browse/SPARK-52739 Proje

[jira] [Created] (SPARK-52738) Support aggregating TIME type with a UDAF when the underlying buffer is an UnsafeRow

2025-07-09 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-52738: - Summary: Support aggregating TIME type with a UDAF when the underlying buffer is an UnsafeRow Key: SPARK-52738 URL: https://issues.apache.org/jira/browse/SPARK-52738

[jira] [Updated] (SPARK-52737) SHS performance regression when visiting homepage

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52737: --- Labels: pull-request-available (was: ) > SHS performance regression when visiting homepage

[jira] [Created] (SPARK-52737) SHS performance regression when visiting homepage

2025-07-09 Thread Shardul Mahadik (Jira)
Shardul Mahadik created SPARK-52737: --- Summary: SHS performance regression when visiting homepage Key: SPARK-52737 URL: https://issues.apache.org/jira/browse/SPARK-52737 Project: Spark Issue

[jira] [Updated] (SPARK-52735) Fix missing error class definition

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52735: --- Labels: pull-request-available (was: ) > Fix missing error class definition > -

[jira] [Resolved] (SPARK-52733) Update the page about TIME literals

2025-07-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52733. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51420 [https://github.com

[jira] [Updated] (SPARK-52736) Typo Moveing in pyspark pandas generic.py

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52736: --- Labels: pull-request-available (was: ) > Typo Moveing in pyspark pandas generic.py > --

[jira] [Created] (SPARK-52736) Typo Moveing in pyspark pandas generic.py

2025-07-09 Thread Peter Nguyen (Jira)
Peter Nguyen created SPARK-52736: Summary: Typo Moveing in pyspark pandas generic.py Key: SPARK-52736 URL: https://issues.apache.org/jira/browse/SPARK-52736 Project: Spark Issue Type: Documen

[jira] [Resolved] (SPARK-52728) Remove the usage of non-existent profiles

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52728. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51418 [https://

[jira] [Assigned] (SPARK-52728) Remove the usage of non-existent profiles

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52728: - Assignee: Yang Jie > Remove the usage of non-existent profiles > --

[jira] [Updated] (SPARK-52728) Remove the usage of non-existent profiles

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52728: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Remove the usage of non

[jira] [Updated] (SPARK-52733) Update the page about TIME literals

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52733: --- Labels: pull-request-available (was: ) > Update the page about TIME literals >

[jira] [Created] (SPARK-52735) Fix missing error class definition

2025-07-09 Thread Allison Wang (Jira)
Allison Wang created SPARK-52735: Summary: Fix missing error class definition Key: SPARK-52735 URL: https://issues.apache.org/jira/browse/SPARK-52735 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52691) Upgrade ORC to 2.1.3

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52691: -- Fix Version/s: 4.0.1 > Upgrade ORC to 2.1.3 > > > Key: SP

[jira] [Resolved] (SPARK-52691) Upgrade ORC to 2.1.3

2025-07-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52691. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51382 [https://

[jira] [Assigned] (SPARK-52409) Deprecate PipelineRunEventBuffer to be a test-only event log container

2025-07-09 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-52409: -- Assignee: Sandy Ryza > Deprecate PipelineRunEventBuffer to be a test-only event log container

[jira] [Resolved] (SPARK-52409) Deprecate PipelineRunEventBuffer to be a test-only event log container

2025-07-09 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-52409. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51352 [https://github

[jira] [Created] (SPARK-52734) Support for Oracle-style Hierarchical Queries using CONNECT BY PRIOR in Spark SQL

2025-07-09 Thread anoop s nair (Jira)
anoop s nair created SPARK-52734: Summary: Support for Oracle-style Hierarchical Queries using CONNECT BY PRIOR in Spark SQL Key: SPARK-52734 URL: https://issues.apache.org/jira/browse/SPARK-52734 Pro

[jira] [Created] (SPARK-52733) Update the page about TIME literals

2025-07-09 Thread Max Gekk (Jira)
Max Gekk created SPARK-52733: Summary: Update the page about TIME literals Key: SPARK-52733 URL: https://issues.apache.org/jira/browse/SPARK-52733 Project: Spark Issue Type: Sub-task Co

[jira] [Updated] (SPARK-52725) Using configuration after DriverPlugin loaded to build defaultResourceProfile

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52725: --- Labels: pull-request-available (was: ) > Using configuration after DriverPlugin loaded to b

[jira] [Updated] (SPARK-52723) Server side column name validation

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52723: --- Labels: pull-request-available (was: ) > Server side column name validation > -

[jira] [Created] (SPARK-52732) to_timestamp returns null if format is just numbers with more than 1 fractional second

2025-07-09 Thread David Moss (Jira)
David Moss created SPARK-52732: -- Summary: to_timestamp returns null if format is just numbers with more than 1 fractional second Key: SPARK-52732 URL: https://issues.apache.org/jira/browse/SPARK-52732 Pr

[jira] [Updated] (SPARK-52731) Fix flaky test_listener_events in 'pyspark.sql.tests.streaming.test_streaming_listener'

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52731: --- Labels: pull-request-available (was: ) > Fix flaky test_listener_events in > 'pyspark.sql.

[jira] [Created] (SPARK-52731) Fix flaky test_listener_events in 'pyspark.sql.tests.streaming.test_streaming_listener'

2025-07-09 Thread Srinivas Rishindra Pothireddi (Jira)
Srinivas Rishindra Pothireddi created SPARK-52731: - Summary: Fix flaky test_listener_events in 'pyspark.sql.tests.streaming.test_streaming_listener' Key: SPARK-52731 URL: https://issues.apache.org/

[jira] [Updated] (SPARK-52730) Store JDBC database metadata in JDBCRDD

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52730: --- Labels: pull-request-available (was: ) > Store JDBC database metadata in JDBCRDD >

[jira] [Created] (SPARK-52730) Store JDBC database metadata in JDBCRDD

2025-07-09 Thread Alek Jarmov (Jira)
Alek Jarmov created SPARK-52730: --- Summary: Store JDBC database metadata in JDBCRDD Key: SPARK-52730 URL: https://issues.apache.org/jira/browse/SPARK-52730 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35677) Support dynamic executor range for dynamic allocation

2025-07-09 Thread Ming Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18004149#comment-18004149 ] Ming Li commented on SPARK-35677: - [~Qin Yao] hi, has there been any further progress on

[jira] [Updated] (SPARK-35677) Support dynamic executor range for dynamic allocation

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-35677: --- Labels: pull-request-available (was: ) > Support dynamic executor range for dynamic allocat

[jira] [Updated] (SPARK-52729) add GENERAL_TABLE v2 table capacity

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52729: --- Labels: pull-request-available (was: ) > add GENERAL_TABLE v2 table capacity >

[jira] [Created] (SPARK-52729) add GENERAL_TABLE v2 table capacity

2025-07-09 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-52729: --- Summary: add GENERAL_TABLE v2 table capacity Key: SPARK-52729 URL: https://issues.apache.org/jira/browse/SPARK-52729 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-52728) Remove the usage of non-existent profiles

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52728: --- Labels: pull-request-available (was: ) > Remove the usage of non-existent profiles > --

[jira] [Created] (SPARK-52728) Remove the usage of non-existent profiles

2025-07-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-52728: Summary: Remove the usage of non-existent profiles Key: SPARK-52728 URL: https://issues.apache.org/jira/browse/SPARK-52728 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-52726) Normalize project list under Window

2025-07-09 Thread Mihailo Timotic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Timotic updated SPARK-52726: Priority: Minor (was: Major) > Normalize project list under Window >

[jira] [Updated] (SPARK-52727) Refactor Window resolution in order to reuse it in single-pass analyzer

2025-07-09 Thread Mihailo Timotic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Timotic updated SPARK-52727: Priority: Minor (was: Major) > Refactor Window resolution in order to reuse it in single-

[jira] [Updated] (SPARK-52727) Refactor Window resolution in order to reuse it in single-pass analyzer

2025-07-09 Thread Mihailo Timotic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Timotic updated SPARK-52727: Issue Type: Improvement (was: Bug) > Refactor Window resolution in order to reuse it in s

[jira] [Created] (SPARK-52727) Refactor Window resolution in order to reuse it in single-pass analyzer

2025-07-09 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-52727: --- Summary: Refactor Window resolution in order to reuse it in single-pass analyzer Key: SPARK-52727 URL: https://issues.apache.org/jira/browse/SPARK-52727 Project

[jira] [Updated] (SPARK-52726) Normalize project list under Window

2025-07-09 Thread Mihailo Timotic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Timotic updated SPARK-52726: Issue Type: Improvement (was: Bug) > Normalize project list under Window > --

[jira] [Created] (SPARK-52726) Normalize project list under Window

2025-07-09 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-52726: --- Summary: Normalize project list under Window Key: SPARK-52726 URL: https://issues.apache.org/jira/browse/SPARK-52726 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-52725) Using configuration after DriverPlugin loaded to build defaultResourceProfile

2025-07-09 Thread Dejiu Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dejiu Lu updated SPARK-52725: - Description: When we modify the memory configuration in the plugin, the new configuration cannot be upd

[jira] [Created] (SPARK-52725) Using configuration after DriverPlugin loaded to build defaultResourceProfile

2025-07-09 Thread Dejiu Lu (Jira)
Dejiu Lu created SPARK-52725: Summary: Using configuration after DriverPlugin loaded to build defaultResourceProfile Key: SPARK-52725 URL: https://issues.apache.org/jira/browse/SPARK-52725 Project: Spark

[jira] [Resolved] (SPARK-52721) Wrong message parameter for CANNOT_PARSE_DATATYPE

2025-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-52721. -- Fix Version/s: 4.1.0 4.0.1 3.5.7 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-52721) Wrong message parameter for CANNOT_PARSE_DATATYPE

2025-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-52721: Assignee: Kent Yao > Wrong message parameter for CANNOT_PARSE_DATATYPE >

[jira] [Updated] (SPARK-52724) Enhance broadcast join OOM error handling with SHUFFLE_MERGE hint support

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52724: --- Labels: pull-request-available (was: ) > Enhance broadcast join OOM error handling with SHU

[jira] [Assigned] (SPARK-52724) Enhance broadcast join OOM error handling with SHUFFLE_MERGE hint support

2025-07-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-52724: --- Assignee: Run Zhang > Enhance broadcast join OOM error handling with SHUFFLE_MERGE hint sup

[jira] [Created] (SPARK-52724) Enhance broadcast join OOM error handling with SHUFFLE_MERGE hint support

2025-07-09 Thread Run Zhang (Jira)
Run Zhang created SPARK-52724: - Summary: Enhance broadcast join OOM error handling with SHUFFLE_MERGE hint support Key: SPARK-52724 URL: https://issues.apache.org/jira/browse/SPARK-52724 Project: Spark

[jira] [Created] (SPARK-52723) Server side column name validation

2025-07-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-52723: - Summary: Server side column name validation Key: SPARK-52723 URL: https://issues.apache.org/jira/browse/SPARK-52723 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-52723) Server side column name validation

2025-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-52723: -- Component/s: SQL > Server side column name validation > -- > >

[jira] [Updated] (SPARK-52722) Deprecate JDBC RDD

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52722: --- Labels: pull-request-available (was: ) > Deprecate JDBC RDD > -- > >

[jira] [Created] (SPARK-52722) Deprecate JDBC RDD

2025-07-09 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-52722: -- Summary: Deprecate JDBC RDD Key: SPARK-52722 URL: https://issues.apache.org/jira/browse/SPARK-52722 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-52721) Wrong message parameter for CANNOT_PARSE_DATATYPE

2025-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52721: --- Labels: pull-request-available (was: ) > Wrong message parameter for CANNOT_PARSE_DATATYPE

[jira] [Created] (SPARK-52721) Wrong message parameter for CANNOT_PARSE_DATATYPE

2025-07-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-52721: Summary: Wrong message parameter for CANNOT_PARSE_DATATYPE Key: SPARK-52721 URL: https://issues.apache.org/jira/browse/SPARK-52721 Project: Spark Issue Type: Sub-tas