[jira] [Updated] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-02-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-47172: - Shepherd: (was: Sean R. Owen) > Upgrade Transport block cipher mode to GCM >

[jira] [Created] (SPARK-47173) fix typo in new streaming query listener explanation

2024-02-26 Thread Wei Liu (Jira)
Wei Liu created SPARK-47173: --- Summary: fix typo in new streaming query listener explanation Key: SPARK-47173 URL: https://issues.apache.org/jira/browse/SPARK-47173 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47173) fix typo in new streaming query listener explanation

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47173: --- Labels: pull-request-available (was: ) > fix typo in new streaming query listener

[jira] [Assigned] (SPARK-47173) fix typo in new streaming query listener explanation

2024-02-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47173: Assignee: Wei Liu > fix typo in new streaming query listener explanation >

[jira] [Updated] (SPARK-47173) fix typo in new streaming query listener explanation

2024-02-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-47173: - Fix Version/s: 4.0.0 > fix typo in new streaming query listener explanation >

[jira] [Created] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-02-26 Thread Steve Weis (Jira)
Steve Weis created SPARK-47172: -- Summary: Upgrade Transport block cipher mode to GCM Key: SPARK-47172 URL: https://issues.apache.org/jira/browse/SPARK-47172 Project: Spark Issue Type:

[jira] [Created] (SPARK-47171) Improve handling of new `exists` attributes within an aggregation

2024-02-26 Thread Anton Lykov (Jira)
Anton Lykov created SPARK-47171: --- Summary: Improve handling of new `exists` attributes within an aggregation Key: SPARK-47171 URL: https://issues.apache.org/jira/browse/SPARK-47171 Project: Spark

[jira] [Assigned] (SPARK-47170) Remove redundant scope identifier for `jakarta.servlet-api` and `javax.servlet-api`

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47170: - Assignee: HiuFung Kwok > Remove redundant scope identifier for `jakarta.servlet-api`

[jira] [Resolved] (SPARK-47170) Remove redundant scope identifier for `jakarta.servlet-api` and `javax.servlet-api`

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47170. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45258

[jira] [Commented] (SPARK-47173) fix typo in new streaming query listener explanation

2024-02-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820817#comment-17820817 ] Max Gekk commented on SPARK-47173: -- Resolved by https://github.com/apache/spark/pull/45263 > fix typo

[jira] [Updated] (SPARK-46067) Upgrade commons-compress to 1.25.0

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46067: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade

[jira] [Commented] (SPARK-47174) Client Side Listener - Server side implementation

2024-02-26 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820828#comment-17820828 ] Wei Liu commented on SPARK-47174: - im working on this > Client Side Listener - Server side

[jira] [Created] (SPARK-47174) Client Side Listener - Server side implementation

2024-02-26 Thread Wei Liu (Jira)
Wei Liu created SPARK-47174: --- Summary: Client Side Listener - Server side implementation Key: SPARK-47174 URL: https://issues.apache.org/jira/browse/SPARK-47174 Project: Spark Issue Type:

[jira] [Commented] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-26 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820853#comment-17820853 ] Pablo Langa Blanco commented on SPARK-47063: [~revans2] are you working on the fix? > CAST

[jira] [Resolved] (SPARK-47156) SparkSession returns a null context during a dataset creation

2024-02-26 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marc Le Bihan resolved SPARK-47156. --- Resolution: Not A Bug I was lacking Spark knowledge, and learned that executor don't have

[jira] [Resolved] (SPARK-44400) Improve Scala StreamingQueryListener to provide users a way to access the Spark session for Spark Connect

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44400. -- Resolution: Duplicate > Improve Scala StreamingQueryListener to provide users a way to access

[jira] [Updated] (SPARK-33356) DAG Scheduler exhibits exponential runtime with PartitionerAwareUnion

2024-02-26 Thread Chris Wells (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Wells updated SPARK-33356: Reporter: Lucas Brutschy (was: Lucas Brutschy) > DAG Scheduler exhibits exponential runtime with

[jira] [Assigned] (SPARK-47079) Unable to create PySpark dataframe containing Variant columns

2024-02-26 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-47079: - Assignee: Desmond Cheong > Unable to create PySpark dataframe containing Variant

[jira] [Resolved] (SPARK-47079) Unable to create PySpark dataframe containing Variant columns

2024-02-26 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-47079. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45131

[jira] [Updated] (SPARK-39771) If spark.default.parallelism is unset, RDD defaultPartitioner may pick a value that is too large to successfully run

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39771: --- Labels: pull-request-available (was: ) > If spark.default.parallelism is unset, RDD

[jira] [Updated] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47175: --- Labels: pull-request-available (was: ) > Remove ZOOKEEPER-1844 comment from KafkaTestUtils

[jira] [Created] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47175: - Summary: Remove ZOOKEEPER-1844 comment from KafkaTestUtils Key: SPARK-47175 URL: https://issues.apache.org/jira/browse/SPARK-47175 Project: Spark Issue

[jira] [Resolved] (SPARK-44462) Fix the session passed to foreachBatch.

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44462. -- Resolution: Duplicate > Fix the session passed to foreachBatch. >

[jira] [Commented] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-26 Thread Robert Joseph Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820877#comment-17820877 ] Robert Joseph Evans commented on SPARK-47063: - [~planga82] I was not planning on putting up

[jira] [Updated] (SPARK-47094) SPJ : Dynamically rebalance number of buckets when they are not equal

2024-02-26 Thread Szehon Ho (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated SPARK-47094: -- Parent: SPARK-37375 Issue Type: Sub-task (was: New Feature) > SPJ : Dynamically rebalance

[jira] [Created] (SPARK-47179) Improve error message from SparkThrowableSuite for better debuggability

2024-02-26 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47179: --- Summary: Improve error message from SparkThrowableSuite for better debuggability Key: SPARK-47179 URL: https://issues.apache.org/jira/browse/SPARK-47179 Project: Spark

[jira] [Assigned] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47178: Assignee: Hyukjin Kwon > Add a test case for createDataFrame with dataclasses >

[jira] [Resolved] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47178. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45271

[jira] [Comment Edited] (SPARK-24815) Structured Streaming should support dynamic allocation

2024-02-26 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820915#comment-17820915 ] Mich Talebzadeh edited comment on SPARK-24815 at 2/26/24 11:58 PM: ---

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2024-02-26 Thread Mich Talebzadeh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820915#comment-17820915 ] Mich Talebzadeh commented on SPARK-24815: - Now that the ticket is reopened let us review the

[jira] [Updated] (SPARK-47094) SPJ : Dynamically rebalance number of buckets when they are not equal

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47094: --- Labels: pull-request-available (was: ) > SPJ : Dynamically rebalance number of buckets

[jira] [Updated] (SPARK-47177) Cached SQL plan do not display final AQE plan in explain string

2024-02-26 Thread Ziqi Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziqi Liu updated SPARK-47177: - Description: AQE plan is expected to display final plan after execution. This is not true for cached

[jira] [Updated] (SPARK-41811) Implement SparkSession.sql's string formatter

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41811: --- Labels: pull-request-available (was: ) > Implement SparkSession.sql's string formatter >

[jira] [Created] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

2024-02-26 Thread Rui Wang (Jira)
Rui Wang created SPARK-47176: Summary: Have a ResolveAllExpressionsUpWithPruning helper function Key: SPARK-47176 URL: https://issues.apache.org/jira/browse/SPARK-47176 Project: Spark Issue

[jira] [Updated] (SPARK-47179) Improve error message from SparkThrowableSuite for better debuggability

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47179: --- Labels: pull-request-available (was: ) > Improve error message from SparkThrowableSuite

[jira] [Resolved] (SPARK-47166) Improve merge_spark_pr.py by emphasising input and error

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47166. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45256

[jira] [Created] (SPARK-47180) Migrate CSV parsing off of Univocity

2024-02-26 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-47180: Summary: Migrate CSV parsing off of Univocity Key: SPARK-47180 URL: https://issues.apache.org/jira/browse/SPARK-47180 Project: Spark Issue Type:

[jira] [Created] (SPARK-47181) Fix `MasterSuite` to validate the number of registered workers

2024-02-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47181: - Summary: Fix `MasterSuite` to validate the number of registered workers Key: SPARK-47181 URL: https://issues.apache.org/jira/browse/SPARK-47181 Project: Spark

[jira] [Updated] (SPARK-47181) Fix `MasterSuite` to validate the number of registered workers

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47181: --- Labels: pull-request-available (was: ) > Fix `MasterSuite` to validate the number of

[jira] [Resolved] (SPARK-47164) Make Default Value From Wider Type Narrow Literal of v2 behave the same as v1

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47164. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45254

[jira] [Resolved] (SPARK-47181) Fix `MasterSuite` to validate the number of registered workers

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47181. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45274

[jira] [Assigned] (SPARK-47181) Fix `MasterSuite` to validate the number of registered workers

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47181: - Assignee: Dongjoon Hyun > Fix `MasterSuite` to validate the number of registered

[jira] [Created] (SPARK-47177) Cached SQL plan do not display final AQE plan in explain string

2024-02-26 Thread Ziqi Liu (Jira)
Ziqi Liu created SPARK-47177: Summary: Cached SQL plan do not display final AQE plan in explain string Key: SPARK-47177 URL: https://issues.apache.org/jira/browse/SPARK-47177 Project: Spark

[jira] [Updated] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47176: --- Labels: pull-request-available (was: ) > Have a ResolveAllExpressionsUpWithPruning helper

[jira] [Resolved] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47165. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45255

[jira] [Assigned] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47165: Assignee: Kent Yao > Pull docker image only when its' absent >

[jira] [Assigned] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47175: Assignee: Dongjoon Hyun > Remove ZOOKEEPER-1844 comment from KafkaTestUtils >

[jira] [Resolved] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47175. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45265

[jira] [Created] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47178: Summary: Add a test case for createDataFrame with dataclasses Key: SPARK-47178 URL: https://issues.apache.org/jira/browse/SPARK-47178 Project: Spark Issue

[jira] [Updated] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47178: --- Labels: pull-request-available (was: ) > Add a test case for createDataFrame with

[jira] [Created] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`

2024-02-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47182: - Summary: Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*` Key: SPARK-47182 URL: https://issues.apache.org/jira/browse/SPARK-47182

[jira] [Updated] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47182: --- Labels: pull-request-available (was: ) > Exclude `commons-(io|lang3)` transitive

[jira] [Assigned] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47182: - Assignee: Dongjoon Hyun > Exclude `commons-(io|lang3)` transitive dependencies from

[jira] [Updated] (SPARK-41873) Implement DataFrame `pandas_api`

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41873: --- Labels: pull-request-available (was: ) > Implement DataFrame `pandas_api` >

[jira] [Resolved] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`

2024-02-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47182. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45278

[jira] [Resolved] (SPARK-47176) Have a ResolveAllExpressionsUpWithPruning helper function

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47176. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45270

[jira] [Assigned] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45599: --- Assignee: Nicholas Chammas > Percentile can produce a wrong answer if -0.0 and 0.0 are

[jira] [Resolved] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45599. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47158: -- Assignee: Apache Spark > Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134

[jira] [Assigned] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47158: -- Assignee: (was: Apache Spark) > Assign proper name and sqlState to

[jira] [Created] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-47165: Summary: Pull docker image only when its' absent Key: SPARK-47165 URL: https://issues.apache.org/jira/browse/SPARK-47165 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47103) Make the default storage level of intermediate datasets for MLlib configurable

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47103: -- Assignee: (was: Apache Spark) > Make the default storage level of intermediate

[jira] [Assigned] (SPARK-47103) Make the default storage level of intermediate datasets for MLlib configurable

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47103: -- Assignee: Apache Spark > Make the default storage level of intermediate datasets for

[jira] [Updated] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

2024-02-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-45599: - Fix Version/s: 3.5.2 (was: 3.5.1) > Percentile can produce a wrong

[jira] [Updated] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47165: - Issue Type: Test (was: Improvement) > Pull docker image only when its' absent >

[jira] [Updated] (SPARK-47170) Remove redundant scope identifier for `jakarta.servlet-api` and `javax.servlet-api`

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47170: --- Labels: pull-request-available (was: ) > Remove redundant scope identifier for

[jira] [Commented] (SPARK-47033) EXECUTE IMMEDIATE USING does not recognize session variable names

2024-02-26 Thread A G (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820680#comment-17820680 ] A G commented on SPARK-47033: - I want to work on this! > EXECUTE IMMEDIATE USING does not recognize session

[jira] [Created] (SPARK-47168) Disable filter pushdown for non default collated strings

2024-02-26 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-47168: - Summary: Disable filter pushdown for non default collated strings Key: SPARK-47168 URL: https://issues.apache.org/jira/browse/SPARK-47168 Project: Spark

[jira] [Updated] (SPARK-47168) Disable parquet filter pushdown for non default collated strings

2024-02-26 Thread Stefan Kandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47168: -- Summary: Disable parquet filter pushdown for non default collated strings (was: Disable

[jira] [Updated] (SPARK-47147) Fix Pyspark collated string conversion error

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47147: --- Labels: pull-request-available (was: ) > Fix Pyspark collated string conversion error >

[jira] [Updated] (SPARK-47169) Disable bucketing on collated collumns

2024-02-26 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47169: -- Summary: Disable bucketing on collated collumns (was: Disable bucketint on collated

[jira] [Created] (SPARK-47169) Disable bucketint on collated collumns

2024-02-26 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-47169: - Summary: Disable bucketint on collated collumns Key: SPARK-47169 URL: https://issues.apache.org/jira/browse/SPARK-47169 Project: Spark Issue Type:

[jira] [Created] (SPARK-47170) Remove redundant scope identifier for `jakarta.servlet-api` and `javax.servlet-api`

2024-02-26 Thread HiuFung Kwok (Jira)
HiuFung Kwok created SPARK-47170: Summary: Remove redundant scope identifier for `jakarta.servlet-api` and `javax.servlet-api` Key: SPARK-47170 URL: https://issues.apache.org/jira/browse/SPARK-47170

[jira] [Commented] (SPARK-47145) Provide table identifier to scan node when DS v2 strategy is applied

2024-02-26 Thread Uros Stankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820690#comment-17820690 ] Uros Stankovic commented on SPARK-47145: PR for this change

[jira] [Commented] (SPARK-47170) Remove redundant scope identifier for `jakarta.servlet-api` and `javax.servlet-api`

2024-02-26 Thread Nikita Awasthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820691#comment-17820691 ] Nikita Awasthi commented on SPARK-47170: User 'HiuKwok' has created a pull request for this

[jira] [Updated] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47165: --- Labels: pull-request-available (was: ) > Pull docker image only when its' absent >

[jira] [Created] (SPARK-47167) Add descriptive relation class

2024-02-26 Thread Uros Stankovic (Jira)
Uros Stankovic created SPARK-47167: -- Summary: Add descriptive relation class Key: SPARK-47167 URL: https://issues.apache.org/jira/browse/SPARK-47167 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

2024-02-26 Thread Denis Tarima (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820705#comment-17820705 ] Denis Tarima commented on SPARK-46992: -- I think the root problem is that

[jira] [Assigned] (SPARK-47009) Create table with collation

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47009: --- Assignee: Stefan Kandic > Create table with collation > --- > >

[jira] [Resolved] (SPARK-47009) Create table with collation

2024-02-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47009. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45105

[jira] [Comment Edited] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

2024-02-26 Thread Denis Tarima (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820705#comment-17820705 ] Denis Tarima edited comment on SPARK-46992 at 2/26/24 1:44 PM: --- I think

[jira] [Updated] (SPARK-47169) Disable bucketing on collated collumns

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47169: --- Labels: pull-request-available (was: ) > Disable bucketing on collated collumns >

[jira] [Updated] (SPARK-46077) Error in postgresql when pushing down filter by timestamp_ntz field

2024-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46077: --- Labels: pull-request-available (was: ) > Error in postgresql when pushing down filter by