[jira] [Updated] (SPARK-49936) Upgrade datasketches-java to 6.1.1

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49936: --- Labels: pull-request-available (was: ) > Upgrade datasketches-java to 6.1.1 > -

[jira] [Updated] (SPARK-49937) Ban call the method `SparkThrowable#getErrorClass`

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49937: --- Labels: pull-request-available (was: ) > Ban call the method `SparkThrowable#getErrorClass`

[jira] [Created] (SPARK-49937) Ban call the method `SparkThrowable#getErrorClass`

2024-10-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-49937: --- Summary: Ban call the method `SparkThrowable#getErrorClass` Key: SPARK-49937 URL: https://issues.apache.org/jira/browse/SPARK-49937 Project: Spark Issue Type:

[jira] [Created] (SPARK-49936) Upgrade datasketches-java to 6.1.1

2024-10-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-49936: Summary: Upgrade datasketches-java to 6.1.1 Key: SPARK-49936 URL: https://issues.apache.org/jira/browse/SPARK-49936 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-49932) Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leaks

2024-10-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-49932. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48420 [https://github.com

[jira] [Assigned] (SPARK-49932) Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leaks

2024-10-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-49932: Assignee: BingKun Pan > Strictly close the resources used in `JsonUtils#toJsonString` to avoid me

[jira] [Assigned] (SPARK-49935) The packaging result of `dev/make-distribution.sh` should not contain `spark-connect-shims`

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-49935: Assignee: Yang Jie > The packaging result of `dev/make-distribution.sh` should not contai

[jira] [Resolved] (SPARK-49935) The packaging result of `dev/make-distribution.sh` should not contain `spark-connect-shims`

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-49935. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48421 [https://gi

[jira] [Updated] (SPARK-49935) The packaging result of `dev/make-distribution.sh` should not contain `spark-connect-shims`

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49935: --- Labels: pull-request-available (was: ) > The packaging result of `dev/make-distribution.sh`

[jira] [Created] (SPARK-49935) The packaging result of `dev/make-distribution.sh` should not contain `spark-connect-shims`

2024-10-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-49935: Summary: The packaging result of `dev/make-distribution.sh` should not contain `spark-connect-shims` Key: SPARK-49935 URL: https://issues.apache.org/jira/browse/SPARK-49935 P

[jira] [Assigned] (SPARK-49927) pyspark.sql.tests.streaming.test_streaming_listener failure

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-49927: Assignee: Siying Dong > pyspark.sql.tests.streaming.test_streaming_listener failure > ---

[jira] [Resolved] (SPARK-49927) pyspark.sql.tests.streaming.test_streaming_listener failure

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-49927. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48424 [https://gi

[jira] [Resolved] (SPARK-49930) Ensure that socket updates are flushed on exception from the python worker

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-49930. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48418 [https://gi

[jira] [Assigned] (SPARK-49930) Ensure that socket updates are flushed on exception from the python worker

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-49930: Assignee: Anish Shrigondekar > Ensure that socket updates are flushed on exception from t

[jira] [Commented] (SPARK-49931) Named parameter invocation does not obey case--in-sensitivity rules for identifiers

2024-10-11 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888734#comment-17888734 ] Daniel commented on SPARK-49931: Changing this in the code should not comprise a breakin

[jira] [Updated] (SPARK-49934) Add implicit cast for accessing collated map with literal

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49934: --- Labels: pull-request-available (was: ) > Add implicit cast for accessing collated map with

[jira] [Updated] (SPARK-49934) Add implicit cast for accessing collated map with literal

2024-10-11 Thread Stefan Kandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-49934: -- Summary: Add implicit cast for accessing collated map with literal (was: Fix implicit cast fo

[jira] [Created] (SPARK-49934) Fix implicit cast for accessing collated map

2024-10-11 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-49934: - Summary: Fix implicit cast for accessing collated map Key: SPARK-49934 URL: https://issues.apache.org/jira/browse/SPARK-49934 Project: Spark Issue Type: Im

[jira] [Resolved] (SPARK-49925) Add tests for order by with collated strings

2024-10-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49925. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48412 [https://gith

[jira] [Resolved] (SPARK-49615) Feature transformers are case sensitive when unintented

2024-10-11 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-49615. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48398 [https://github

[jira] [Assigned] (SPARK-49615) Feature transformers are case sensitive when unintented

2024-10-11 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-49615: -- Assignee: Weichen Xu > Feature transformers are case sensitive when unintented >

[jira] [Comment Edited] (SPARK-49923) Spark task execution with Java execution option has an injection problem

2024-10-11 Thread sunjiangwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888619#comment-17888619 ] sunjiangwen edited comment on SPARK-49923 at 10/11/24 12:02 PM: --

[jira] [Updated] (SPARK-49923) Spark task execution with Java execution option has an injection problem

2024-10-11 Thread sunjiangwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjiangwen updated SPARK-49923: Description: 1. We use spark to perform periodic calculation through Spark tasks preset in our sy

[jira] [Commented] (SPARK-49923) Spark task execution with Java execution option has an injection problem

2024-10-11 Thread sunjiangwen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888619#comment-17888619 ] sunjiangwen commented on SPARK-49923: - [~cloud_fan] [~prashanthmenon] [~joshrosen] f

[jira] [Updated] (SPARK-48912) Improve collation support testing for various collations

2024-10-11 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-48912: - Labels: starter (was: ) > Improve collation support testing for various collations > --

[jira] [Created] (SPARK-49933) MERGE INTO does not push down the predicate of the WHEN NOT MATCHED BY SOURCE THEN DELETE clause (Iceberg)

2024-10-11 Thread Viacheslav Inozemtsev (Jira)
Viacheslav Inozemtsev created SPARK-49933: - Summary: MERGE INTO does not push down the predicate of the WHEN NOT MATCHED BY SOURCE THEN DELETE clause (Iceberg) Key: SPARK-49933 URL: https://issues.apache.o

[jira] [Assigned] (SPARK-49915) Handle zeros and ones in ReorderAssociativeOperator

2024-10-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49915: Assignee: Kent Yao > Handle zeros and ones in ReorderAssociativeOperator > --

[jira] [Resolved] (SPARK-49915) Handle zeros and ones in ReorderAssociativeOperator

2024-10-11 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49915. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48395 [https://github.com

[jira] [Updated] (SPARK-49932) Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leaks

2024-10-11 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-49932: Summary: Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leaks (was

[jira] [Updated] (SPARK-49932) Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leak

2024-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49932: --- Labels: pull-request-available (was: ) > Strictly close the resources used in `JsonUtils#to

[jira] [Created] (SPARK-49932) Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leak

2024-10-11 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-49932: --- Summary: Strictly close the resources used in `JsonUtils#toJsonString` to avoid memory leak Key: SPARK-49932 URL: https://issues.apache.org/jira/browse/SPARK-49932 Proj

[jira] [Updated] (SPARK-49927) pyspark.sql.tests.streaming.test_streaming_listener failure

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-49927: - Fix Version/s: (was: 4.0.0) > pyspark.sql.tests.streaming.test_streaming_listener failure >

[jira] [Reopened] (SPARK-49927) pyspark.sql.tests.streaming.test_streaming_listener failure

2024-10-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-49927: -- Assignee: (was: Siying Dong) Reverted > pyspark.sql.tests.streaming.test_streaming_list