[jira] [Updated] (SPARK-52406) Move the test case named "benchmark" from PercentileHeapSuite to PercentileHeapBenchmark

2025-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52406: --- Labels: pull-request-available (was: ) > Move the test case named "benchmark" from Percenti

[jira] [Resolved] (SPARK-52346) [SDP] Triggered graph execution

2025-06-05 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-52346. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51050 [https:

[jira] [Updated] (SPARK-52412) Redact sensitive information in log files at release workflow

2025-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52412: --- Labels: pull-request-available (was: ) > Redact sensitive information in log files at relea

[jira] [Created] (SPARK-52412) Redact sensitive information in log files at release workflow

2025-06-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-52412: Summary: Redact sensitive information in log files at release workflow Key: SPARK-52412 URL: https://issues.apache.org/jira/browse/SPARK-52412 Project: Spark

[jira] [Resolved] (SPARK-52325) Publish Apache Spark 3.5.6 to docker registry

2025-06-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52325. -- Resolution: Fixed > Publish Apache Spark 3.5.6 to docker registry > -

[jira] [Created] (SPARK-52411) Spark event log not able to write to s3

2025-06-05 Thread melin (Jira)
melin created SPARK-52411: - Summary: Spark event log not able to write to s3 Key: SPARK-52411 URL: https://issues.apache.org/jira/browse/SPARK-52411 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-52410) Deprecate PipelineConf but use SqlConf directly

2025-06-05 Thread Yuheng Chang (Jira)
Yuheng Chang created SPARK-52410: Summary: Deprecate PipelineConf but use SqlConf directly Key: SPARK-52410 URL: https://issues.apache.org/jira/browse/SPARK-52410 Project: Spark Issue Type: S

[jira] [Created] (SPARK-52409) Deprecate PipelineRunEventBuffer to be a test-only event log container

2025-06-05 Thread Yuheng Chang (Jira)
Yuheng Chang created SPARK-52409: Summary: Deprecate PipelineRunEventBuffer to be a test-only event log container Key: SPARK-52409 URL: https://issues.apache.org/jira/browse/SPARK-52409 Project: Spark

[jira] [Resolved] (SPARK-52400) Cover SQL test gaps in golden files

2025-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52400. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51088 [https://gith

[jira] [Assigned] (SPARK-52400) Cover SQL test gaps in golden files

2025-06-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52400: --- Assignee: Mihailo Aleksic > Cover SQL test gaps in golden files > -

[jira] [Updated] (SPARK-52402) Fix divide-by-zero errors in Kendall and Pearson correlation under ANSI mode

2025-06-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-52402: - Summary: Fix divide-by-zero errors in Kendall and Pearson correlation under ANSI mode (was: Fix

[jira] [Created] (SPARK-52408) SPIP: Upgrade Apache Hive to 4.x

2025-06-05 Thread Vlad Rozov (Jira)
Vlad Rozov created SPARK-52408: -- Summary: SPIP: Upgrade Apache Hive to 4.x Key: SPARK-52408 URL: https://issues.apache.org/jira/browse/SPARK-52408 Project: Spark Issue Type: Umbrella C

[jira] [Updated] (SPARK-52407) Add Native Support for Apache Theta Sketches

2025-06-05 Thread Christopher Boumalhab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Boumalhab updated SPARK-52407: -- Component/s: (was: Spark Core) > Add Native Support for Apache Theta Sketc

[jira] [Updated] (SPARK-52407) Add Native Support for Apache Theta Sketches

2025-06-05 Thread Christopher Boumalhab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Boumalhab updated SPARK-52407: -- Labels: datasketches (was: ) > Add Native Support for Apache Theta Sketches >

[jira] [Commented] (SPARK-52407) Add Native Support for Apache Theta Sketches

2025-06-05 Thread Christopher Boumalhab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17956433#comment-17956433 ] Christopher Boumalhab commented on SPARK-52407: --- https://datasketches.apac

[jira] [Created] (SPARK-52407) Add Native Support for Apache Theta Sketches

2025-06-05 Thread Christopher Boumalhab (Jira)
Christopher Boumalhab created SPARK-52407: - Summary: Add Native Support for Apache Theta Sketches Key: SPARK-52407 URL: https://issues.apache.org/jira/browse/SPARK-52407 Project: Spark

[jira] [Created] (SPARK-52406) Move the test case named "benchmark" from PercentileHeapSuite to PercentileHeapBenchmark

2025-06-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-52406: Summary: Move the test case named "benchmark" from PercentileHeapSuite to PercentileHeapBenchmark Key: SPARK-52406 URL: https://issues.apache.org/jira/browse/SPARK-52406 Proj

[jira] [Updated] (SPARK-52386) Refactor the `HistoryServerSuite` to support regenerating the `expectation.json` files using `SPARK_GENERATE_GOLDEN_FILES=1`

2025-06-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-52386: - Fix Version/s: 4.0.1 (was: 4.1.0) > Refactor the `HistoryServerSuite` to support

[jira] [Assigned] (SPARK-52386) Refactor the `HistoryServerSuite` to support regenerating the `expectation.json` files using `SPARK_GENERATE_GOLDEN_FILES=1`

2025-06-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-52386: Assignee: Yang Jie (was: Junqing Li) > Refactor the `HistoryServerSuite` to support regenerating

[jira] [Resolved] (SPARK-52396) Artifact Root Directory should use tmpdir

2025-06-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52396. --- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-52396) Artifact Root Directory should use tmpdir

2025-06-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52396: - Assignee: dzcxzl > Artifact Root Directory should use tmpdir >

[jira] [Updated] (SPARK-52405) Extend V2JDBCTest to test multiple partition reading

2025-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52405: --- Labels: pull-request-available (was: ) > Extend V2JDBCTest to test multiple partition readi

[jira] [Updated] (SPARK-52405) Extend V2JDBCTest to test multiple partition reading

2025-06-05 Thread Petar Vasiljevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Petar Vasiljevic updated SPARK-52405: - Summary: Extend V2JDBCTest to test multiple partition reading (was: Extend V2JDBCTest t

[jira] [Created] (SPARK-52405) Extend V2JDBCTest to test multiple partitioning reading

2025-06-05 Thread Petar Vasiljevic (Jira)
Petar Vasiljevic created SPARK-52405: Summary: Extend V2JDBCTest to test multiple partitioning reading Key: SPARK-52405 URL: https://issues.apache.org/jira/browse/SPARK-52405 Project: Spark

[jira] [Commented] (SPARK-52384) Fix bug Connect should insensitive for JDBC options.

2025-06-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17956389#comment-17956389 ] Dongjoon Hyun commented on SPARK-52384: --- This is backported to branch-4.0 via http

[jira] [Updated] (SPARK-52384) Fix bug Connect should insensitive for JDBC options.

2025-06-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52384: -- Affects Version/s: 4.0.0 > Fix bug Connect should insensitive for JDBC options. >

[jira] [Updated] (SPARK-52384) Fix bug Connect should insensitive for JDBC options.

2025-06-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52384: -- Fix Version/s: 4.0.1 > Fix bug Connect should insensitive for JDBC options. >

[jira] [Updated] (SPARK-34541) Fixed an issue where data could not be cleaned up when unregisterShuffle

2025-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-34541: --- Labels: pull-request-available (was: ) > Fixed an issue where data could not be cleaned up

[jira] [Assigned] (SPARK-52397) Idempotent ExecutePlan: second ExecutePlan with same operationId and plan should reattach

2025-06-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-52397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-52397: - Assignee: Xi Lyu > Idempotent ExecutePlan: second ExecutePlan with same operati

[jira] [Resolved] (SPARK-52397) Idempotent ExecutePlan: second ExecutePlan with same operationId and plan should reattach

2025-06-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-52397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-52397. --- Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed Issue resolve

[jira] [Updated] (SPARK-52404) Failures in `BindReferences` should not reuse INTERNAL_ERROR error class

2025-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52404: --- Labels: pull-request-available (was: ) > Failures in `BindReferences` should not reuse INTE

[jira] [Created] (SPARK-52404) Failures in `BindReferences` should not reuse INTERNAL_ERROR error class

2025-06-05 Thread Ala Luszczak (Jira)
Ala Luszczak created SPARK-52404: Summary: Failures in `BindReferences` should not reuse INTERNAL_ERROR error class Key: SPARK-52404 URL: https://issues.apache.org/jira/browse/SPARK-52404 Project: Spa

[jira] [Commented] (SPARK-52404) Failures in `BindReferences` should not reuse INTERNAL_ERROR error class

2025-06-05 Thread Ala Luszczak (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17956346#comment-17956346 ] Ala Luszczak commented on SPARK-52404: -- Pr: https://github.com/apache/spark/pull/51

[jira] [Resolved] (SPARK-51671) Add column pruning to Recursive CTEs

2025-06-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-51671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavle Martinović resolved SPARK-51671. -- Resolution: Won't Do Column pruning is determined to be impossible to efficiently do,

[jira] [Updated] (SPARK-52399) Add support for ephemeral-storage resource on driver/kubernetes pods

2025-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52399: --- Labels: pull-request-available (was: ) > Add support for ephemeral-storage resource on driv