[jira] [Assigned] (SPARK-52386) Refactor the `HistoryServerSuite` to support regenerating the `expectation.json` files using `SPARK_GENERATE_GOLDEN_FILES=1`

2025-06-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-52386: Assignee: Junqing Li > Refactor the `HistoryServerSuite` to support regenerating the > `expectat

[jira] [Resolved] (SPARK-52386) Refactor the `HistoryServerSuite` to support regenerating the `expectation.json` files using `SPARK_GENERATE_GOLDEN_FILES=1`

2025-06-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-52386. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51072 [https://github.com

[jira] [Resolved] (SPARK-52383) Improve errors in SparkConnectPlanner

2025-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52383. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51062 [https://gi

[jira] [Assigned] (SPARK-52383) Improve errors in SparkConnectPlanner

2025-06-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52383: Assignee: Yihong He > Improve errors in SparkConnectPlanner > ---

[jira] [Updated] (SPARK-52403) Add numTargetRowsCopied metric to MergeRowExec

2025-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52403: --- Labels: pull-request-available (was: ) > Add numTargetRowsCopied metric to MergeRowExec > -

[jira] [Updated] (SPARK-52403) Add numTargetRowsCopied metric to MergeRowExec

2025-06-04 Thread Szehon Ho (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated SPARK-52403: -- Summary: Add numTargetRowsCopied metric to MergeRowExec (was: Add numRowsCopied metric to MergeRowExe

[jira] [Created] (SPARK-52403) Add numRowsCopied metric to MergeRowExec

2025-06-04 Thread Szehon Ho (Jira)
Szehon Ho created SPARK-52403: - Summary: Add numRowsCopied metric to MergeRowExec Key: SPARK-52403 URL: https://issues.apache.org/jira/browse/SPARK-52403 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-52402) Fix divide-by-zero error in groupby().corr('kendall') with ANSI mode enabled

2025-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52402: --- Labels: pull-request-available (was: ) > Fix divide-by-zero error in groupby().corr('kendal

[jira] [Created] (SPARK-52402) Fix divide-by-zero error in groupby().corr('kendall') with ANSI mode enabled

2025-06-04 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-52402: Summary: Fix divide-by-zero error in groupby().corr('kendall') with ANSI mode enabled Key: SPARK-52402 URL: https://issues.apache.org/jira/browse/SPARK-52402 Project:

[jira] [Assigned] (SPARK-52385) Remove TempResolvedColumns from InheritAnalysisRules name

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52385: --- Assignee: Mihailo Aleksic > Remove TempResolvedColumns from InheritAnalysisRules name > ---

[jira] [Resolved] (SPARK-52385) Remove TempResolvedColumns from InheritAnalysisRules name

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52385. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51071 [https://gith

[jira] [Assigned] (SPARK-52392) Implement additional single-pass Analyzer functionality

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52392: --- Assignee: Vladimir Golubev > Implement additional single-pass Analyzer functionality >

[jira] [Resolved] (SPARK-52392) Implement additional single-pass Analyzer functionality

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52392. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51078 [https://gith

[jira] [Resolved] (SPARK-52398) Change ALTER TABLE ALTER COLUMN TYPE STRING not to apply default collation if original data type was instance of StringType

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52398. - Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-52398) Change ALTER TABLE ALTER COLUMN TYPE STRING not to apply default collation if original data type was instance of StringType

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52398: --- Assignee: Marko Ilic > Change ALTER TABLE ALTER COLUMN TYPE STRING not to apply default col

[jira] [Resolved] (SPARK-52353) Fix bug with wrong constraints in LogicalRDDs referencing previous iterations

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52353. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51070 [https://gith

[jira] [Assigned] (SPARK-52353) Fix bug with wrong constraints in LogicalRDDs referencing previous iterations

2025-06-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52353: --- Assignee: Pavle Martinović > Fix bug with wrong constraints in LogicalRDDs referencing prev

[jira] [Updated] (SPARK-52401) Unexpected behavior when using .collect() after modifying an external Spark table

2025-06-04 Thread Rodrigo Cardoso (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Cardoso updated SPARK-52401: Description: I encountered an inconsistency when using {{.collect()}} on a DataFrame that

[jira] [Created] (SPARK-52401) Unexpected behavior when using .collect() after modifying an external Spark table

2025-06-04 Thread Rodrigo Cardoso (Jira)
Rodrigo Cardoso created SPARK-52401: --- Summary: Unexpected behavior when using .collect() after modifying an external Spark table Key: SPARK-52401 URL: https://issues.apache.org/jira/browse/SPARK-52401

[jira] [Updated] (SPARK-52400) Cover SQL test gaps in golden files

2025-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52400: --- Labels: pull-request-available (was: ) > Cover SQL test gaps in golden files >

[jira] [Commented] (SPARK-51475) ArrayDistinct Producing Inconsistent Behavior For -0.0 and +0.0

2025-06-04 Thread Robert Joseph Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17956143#comment-17956143 ] Robert Joseph Evans commented on SPARK-51475: - [~doki] you did reproduce the

[jira] [Created] (SPARK-52400) Cover SQL test gaps in golden files

2025-06-04 Thread Mihailo Aleksic (Jira)
Mihailo Aleksic created SPARK-52400: --- Summary: Cover SQL test gaps in golden files Key: SPARK-52400 URL: https://issues.apache.org/jira/browse/SPARK-52400 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-52399) Add support for ephemeral-storage resource on driver/kubernetes pods

2025-06-04 Thread Nicolas Fraison (Jira)
Nicolas Fraison created SPARK-52399: --- Summary: Add support for ephemeral-storage resource on driver/kubernetes pods Key: SPARK-52399 URL: https://issues.apache.org/jira/browse/SPARK-52399 Project: S

[jira] [Updated] (SPARK-52398) Change ALTER TABLE ALTER COLUMN TYPE STRING not to apply default collation if original data type was instance of StringType

2025-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52398: --- Labels: pull-request-available (was: ) > Change ALTER TABLE ALTER COLUMN TYPE STRING not to

[jira] [Created] (SPARK-52398) Change ALTER TABLE ALTER COLUMN TYPE STRING not to apply default collation if original data type was instance of StringType

2025-06-04 Thread Marko Ilic (Jira)
Marko Ilic created SPARK-52398: -- Summary: Change ALTER TABLE ALTER COLUMN TYPE STRING not to apply default collation if original data type was instance of StringType Key: SPARK-52398 URL: https://issues.apache.org/ji

[jira] [Resolved] (SPARK-47117) Format the whole code base

2025-06-04 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jie Han resolved SPARK-47117. - Resolution: Won't Fix > Format the whole code base > -- > > Key:

[jira] [Commented] (SPARK-51475) ArrayDistinct Producing Inconsistent Behavior For -0.0 and +0.0

2025-06-04 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-51475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17956087#comment-17956087 ] Jie Han commented on SPARK-51475: - I can't reproduce this. The following is my result: {

[jira] [Updated] (SPARK-52397) Idempotent ExecutePlan: second ExecutePlan with same operationId and plan should reattach

2025-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52397: --- Labels: pull-request-available (was: ) > Idempotent ExecutePlan: second ExecutePlan with sa

[jira] [Created] (SPARK-52397) Idempotent ExecutePlan: second ExecutePlan with same operationId and plan should reattach

2025-06-04 Thread Xi Lyu (Jira)
Xi Lyu created SPARK-52397: -- Summary: Idempotent ExecutePlan: second ExecutePlan with same operationId and plan should reattach Key: SPARK-52397 URL: https://issues.apache.org/jira/browse/SPARK-52397 Project

[jira] [Updated] (SPARK-52396) Artifact Root Directory should use tmpdir

2025-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52396: --- Labels: pull-request-available (was: ) > Artifact Root Directory should use tmpdir > --

[jira] [Created] (SPARK-52396) Artifact Root Directory should use tmpdir

2025-06-04 Thread dzcxzl (Jira)
dzcxzl created SPARK-52396: -- Summary: Artifact Root Directory should use tmpdir Key: SPARK-52396 URL: https://issues.apache.org/jira/browse/SPARK-52396 Project: Spark Issue Type: Bug Compo