[jira] [Resolved] (SPARK-49836) The outer query is broken when the subquery uses window function which receives time window as parameter

[ https://issues.apache.org/jira/browse/SPARK-49836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-49836. -- Fix Version/s: 4.0.0 3.4.4 3.5.4 Assignee: Jungt

[jira] [Assigned] (SPARK-49683) Block trim collations in all code paths

[ https://issues.apache.org/jira/browse/SPARK-49683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-49683: Assignee: Uroš Bojanić > Block trim collations in all code paths > --

[jira] [Resolved] (SPARK-49683) Block trim collations in all code paths

[ https://issues.apache.org/jira/browse/SPARK-49683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-49683. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48336 [https://gi

[jira] [Updated] (SPARK-49651) Add MacOS 15 to the build_and_test pipeline

[ https://issues.apache.org/jira/browse/SPARK-49651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49651: -- Parent: (was: SPARK-45923) Issue Type: Test (was: Sub-task) > Add MacOS 15 to the

[jira] [Updated] (SPARK-49528) Document SparkCluster spec fields that would be overwritten by Spark

[ https://issues.apache.org/jira/browse/SPARK-49528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49528: -- Parent: (was: SPARK-45923) Issue Type: Documentation (was: Sub-task) > Document S

[jira] [Updated] (SPARK-49726) Enable SentinelManager in E2E Test

[ https://issues.apache.org/jira/browse/SPARK-49726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49726: -- Parent: (was: SPARK-45923) Issue Type: Test (was: Sub-task) > Enable SentinelMana

[jira] [Resolved] (SPARK-49464) Add docs for operator

[ https://issues.apache.org/jira/browse/SPARK-49464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49464. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49888) Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

[ https://issues.apache.org/jira/browse/SPARK-49888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49888. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49888) Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

[ https://issues.apache.org/jira/browse/SPARK-49888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49888: - Assignee: Dongjoon Hyun > Use `registry.k8s.io/pause:3.9` to avoid failure deterministi

[jira] [Assigned] (SPARK-49887) Update `cluster-with-template.yaml` example with pod annotation

[ https://issues.apache.org/jira/browse/SPARK-49887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49887: - Assignee: Dongjoon Hyun > Update `cluster-with-template.yaml` example with pod annotati

[jira] [Resolved] (SPARK-49887) Update `cluster-with-template.yaml` example with pod annotation

[ https://issues.apache.org/jira/browse/SPARK-49887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49887. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49888) Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

Dongjoon Hyun created SPARK-49888: - Summary: Use `registry.k8s.io/pause:3.9` to avoid failure deterministically Key: SPARK-49888 URL: https://issues.apache.org/jira/browse/SPARK-49888 Project: Spark

[jira] [Created] (SPARK-49887) Update `cluster-with-template.yaml` example with pod annotation

Dongjoon Hyun created SPARK-49887: - Summary: Update `cluster-with-template.yaml` example with pod annotation Key: SPARK-49887 URL: https://issues.apache.org/jira/browse/SPARK-49887 Project: Spark

[jira] [Created] (SPARK-49886) Query Level Correctness verification

Wei Liu created SPARK-49886: --- Summary: Query Level Correctness verification Key: SPARK-49886 URL: https://issues.apache.org/jira/browse/SPARK-49886 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-49885) Avoid listing when V2 lineage is provided in RocksDB

Wei Liu created SPARK-49885: --- Summary: Avoid listing when V2 lineage is provided in RocksDB Key: SPARK-49885 URL: https://issues.apache.org/jira/browse/SPARK-49885 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-49885) Avoid listing when V2 lineage is provided in RocksDB

[ https://issues.apache.org/jira/browse/SPARK-49885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-49885: Epic Link: SPARK-49374 > Avoid listing when V2 lineage is provided in RocksDB > --

[jira] [Created] (SPARK-49884) Backward Compatibility and Test

Wei Liu created SPARK-49884: --- Summary: Backward Compatibility and Test Key: SPARK-49884 URL: https://issues.apache.org/jira/browse/SPARK-49884 Project: Spark Issue Type: Improvement Compo

[jira] [Created] (SPARK-49883) Integrate with RocksDB and RocksDBFileManager

Wei Liu created SPARK-49883: --- Summary: Integrate with RocksDB and RocksDBFileManager Key: SPARK-49883 URL: https://issues.apache.org/jira/browse/SPARK-49883 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-49879) Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file`

[ https://issues.apache.org/jira/browse/SPARK-49879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49879: - Assignee: Yang Jie > Fix compilation warnings related to `auxiliary class TransportCiph

[jira] [Resolved] (SPARK-49879) Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file`

[ https://issues.apache.org/jira/browse/SPARK-49879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49879. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48352 [https://

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.1` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Description: Although SPARK-48710 fixed to use NumPy 2.0 compatible types. Python 3.13 requir

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.1` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Summary: Handle or document `NumPy 2.1` difference in Python 3.13 (was: Handle or document `N

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.1` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Description: Although SPARK-48710 fixed to use NumPy 2.0 compatible types. Python 3.13 requir

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.x` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Description: Although SPARK-48710 fixed to use NumPy 2.0 compatible types. Python 3.13 with

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.x` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Summary: Handle or document `NumPy 2.x` difference in Python 3.13 (was: Handle or document `N

[jira] [Created] (SPARK-49882) Handle or document `NumPy 2.x` difference

Dongjoon Hyun created SPARK-49882: - Summary: Handle or document `NumPy 2.x` difference Key: SPARK-49882 URL: https://issues.apache.org/jira/browse/SPARK-49882 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-49881) SPIP : Improving analyzer performance by skipping DeduplicateRelations rule conditionally

[ https://issues.apache.org/jira/browse/SPARK-49881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-49881: - Description: In many cases, it has been observed that DeduplicateRelations rule, though essential, but by its n

[jira] [Updated] (SPARK-49881) SPIP : Improving analyzer performance by skipping DeduplicateRelations rule conditionally

[ https://issues.apache.org/jira/browse/SPARK-49881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-49881: - Description: In many cases, it has been observed that DeduplicateRelations rule, though essential, but by its n

[jira] [Updated] (SPARK-49881) SPIP : Improving analyzer performance by skipping DeduplicateRelations rule conditionally

[ https://issues.apache.org/jira/browse/SPARK-49881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-49881: - Summary: SPIP : Improving analyzer performance by skipping DeduplicateRelations rule conditionally (was: Improv

[jira] [Created] (SPARK-49881) Improving analyzer performance by skipping DeduplicateRelations rule conditionally

Asif created SPARK-49881: Summary: Improving analyzer performance by skipping DeduplicateRelations rule conditionally Key: SPARK-49881 URL: https://issues.apache.org/jira/browse/SPARK-49881 Project: Spark

[jira] [Created] (SPARK-49880) Utils.getCallSite() should also contain python stack traces

Никита Соколов created SPARK-49880: -- Summary: Utils.getCallSite() should also contain python stack traces Key: SPARK-49880 URL: https://issues.apache.org/jira/browse/SPARK-49880 Project: Spark

[jira] [Updated] (SPARK-47702) Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node.

[ https://issues.apache.org/jira/browse/SPARK-47702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47702: -- Fix Version/s: (was: 3.5.4) > Shuffle service endpoint is not removed from the locations l

[jira] [Resolved] (SPARK-49864) Improve message of BINARY_ARITHMETIC_OVERFLOW

[ https://issues.apache.org/jira/browse/SPARK-49864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49864. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48335 [https://github.com

[jira] [Assigned] (SPARK-49864) Improve message of BINARY_ARITHMETIC_OVERFLOW

[ https://issues.apache.org/jira/browse/SPARK-49864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49864: Assignee: Mihailo Milosevic > Improve message of BINARY_ARITHMETIC_OVERFLOW > ---

[jira] [Resolved] (SPARK-49806) Remove redundant `blank space` after 'show' in `Scala` and `Connect` clients

[ https://issues.apache.org/jira/browse/SPARK-49806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49806. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48277 [https://

[jira] [Created] (SPARK-49879) Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file`

Yang Jie created SPARK-49879: Summary: Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file` Key: SPARK-49879 URL: h

[jira] [Updated] (SPARK-49879) Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file`

[ https://issues.apache.org/jira/browse/SPARK-49879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-49879: - Description: run  build/mvn clean install -pl common/network-common   we can see   {code:java} [WARN

[jira] [Assigned] (SPARK-49874) Remove TRIM and RTRIM support

[ https://issues.apache.org/jira/browse/SPARK-49874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49874: Assignee: Jovan Pavlovic > Remove TRIM and RTRIM support > - > >

[jira] [Resolved] (SPARK-49874) Remove TRIM and RTRIM support

[ https://issues.apache.org/jira/browse/SPARK-49874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49874. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48349 [https://github.com

[jira] [Resolved] (SPARK-49662) Add trim specifier to collations

[ https://issues.apache.org/jira/browse/SPARK-49662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jovan Pavlovic resolved SPARK-49662. Target Version/s: 4.0.0 Resolution: Implemented Implemented as part of: https://

[jira] [Assigned] (SPARK-47702) Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node.

[ https://issues.apache.org/jira/browse/SPARK-47702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47702: Assignee: Attila Zsolt Piros > Shuffle service endpoint is not removed from the locations list wh

[jira] [Resolved] (SPARK-47702) Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node.

[ https://issues.apache.org/jira/browse/SPARK-47702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47702. -- Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-49868) ExecutorFailureTracker sometimes miss failed executors on k8s

[ https://issues.apache.org/jira/browse/SPARK-49868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49868. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48344 [https://

[jira] [Updated] (SPARK-49868) ExecutorFailureTracker sometimes miss failed executors on k8s

[ https://issues.apache.org/jira/browse/SPARK-49868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49868: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > ExecutorFailureTracker sometime

[jira] [Commented] (SPARK-49669) Implement whitespace trimming for UTF8Strings

[ https://issues.apache.org/jira/browse/SPARK-49669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17886938#comment-17886938 ] Uroš Bojanić commented on SPARK-49669: -- Note: trim sensitivity is related only to A

[jira] [Closed] (SPARK-49669) Implement whitespace trimming for UTF8Strings

[ https://issues.apache.org/jira/browse/SPARK-49669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić closed SPARK-49669. > Implement whitespace trimming for UTF8Strings > - > >

[jira] [Created] (SPARK-49877) Change classifyException function signature: add isRuntime argument

Ivan Jevtic created SPARK-49877: --- Summary: Change classifyException function signature: add isRuntime argument Key: SPARK-49877 URL: https://issues.apache.org/jira/browse/SPARK-49877 Project: Spark

[jira] [Created] (SPARK-49876) Cleanup remaining global locks in Spark Connect Service

Changgyoo Park created SPARK-49876: -- Summary: Cleanup remaining global locks in Spark Connect Service Key: SPARK-49876 URL: https://issues.apache.org/jira/browse/SPARK-49876 Project: Spark I

[jira] [Updated] (SPARK-49875) error build spark 3.5.3

[ https://issues.apache.org/jira/browse/SPARK-49875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arsen Gumin updated SPARK-49875: Summary: error build spark 3.5.3 (was: error build spark 3.5.3 with) > error build spark 3.5.3 >

[jira] [Updated] (SPARK-49875) error build spark 3.5.3

[ https://issues.apache.org/jira/browse/SPARK-49875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arsen Gumin updated SPARK-49875: Issue Type: Bug (was: Improvement) > error build spark 3.5.3 > --- > >

[jira] [Created] (SPARK-49875) error build spark 3.5.3 with

Arsen Gumin created SPARK-49875: --- Summary: error build spark 3.5.3 with Key: SPARK-49875 URL: https://issues.apache.org/jira/browse/SPARK-49875 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-49874) Remove TRIM and RTRIM support

Jovan Pavlovic created SPARK-49874: -- Summary: Remove TRIM and RTRIM support Key: SPARK-49874 URL: https://issues.apache.org/jira/browse/SPARK-49874 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49669) Implement whitespace trimming for UTF8Strings

[ https://issues.apache.org/jira/browse/SPARK-49669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jovan Pavlovic resolved SPARK-49669. Resolution: Implemented Implementation for trimming ASCII spaces already exists. > Implem

[jira] [Resolved] (SPARK-49668) Implement collation key support

[ https://issues.apache.org/jira/browse/SPARK-49668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49668. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48313 [https://github.com

[jira] [Assigned] (SPARK-49668) Implement collation key support

[ https://issues.apache.org/jira/browse/SPARK-49668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49668: Assignee: Jovan Pavlovic > Implement collation key support > --- > >