[jira] [Created] (SPARK-52062) Update `CFBundleVersion` to `0.2.0`

Dongjoon Hyun created SPARK-52062: - Summary: Update `CFBundleVersion` to `0.2.0` Key: SPARK-52062 URL: https://issues.apache.org/jira/browse/SPARK-52062 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52063) Support `newSession` in `SparkSession`

Dongjoon Hyun created SPARK-52063: - Summary: Support `newSession` in `SparkSession` Key: SPARK-52063 URL: https://issues.apache.org/jira/browse/SPARK-52063 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-52064) Support `first/take/toJSON` in `DataFrame`

Dongjoon Hyun created SPARK-52064: - Summary: Support `first/take/toJSON` in `DataFrame` Key: SPARK-52064 URL: https://issues.apache.org/jira/browse/SPARK-52064 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-52064) Support `first/take/toJSON` in `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-52064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52064: --- Labels: pull-request-available (was: ) > Support `first/take/toJSON` in `DataFrame` > -

[jira] [Resolved] (SPARK-52063) Support `newSession` in `SparkSession`

[ https://issues.apache.org/jira/browse/SPARK-52063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52063. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Updated] (SPARK-52063) Support `newSession` in `SparkSession`

[ https://issues.apache.org/jira/browse/SPARK-52063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52063: --- Labels: pull-request-available (was: ) > Support `newSession` in `SparkSession` > -

[jira] [Closed] (SPARK-52062) Update `CFBundleVersion` to `0.2.0`

[ https://issues.apache.org/jira/browse/SPARK-52062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-52062. - > Update `CFBundleVersion` to `0.2.0` > --- > > Key:

[jira] [Resolved] (SPARK-52061) Add `getOption/isModifiable` and `set` variants to `RuntimeConf`

[ https://issues.apache.org/jira/browse/SPARK-52061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52061. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Resolved] (SPARK-52062) Update `CFBundleVersion` to `0.2.0`

[ https://issues.apache.org/jira/browse/SPARK-52062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52062. --- Resolution: Invalid It seems that we don't need to manager this documentation archive versio

[jira] [Assigned] (SPARK-52062) Update `CFBundleVersion` to `0.2.0`

[ https://issues.apache.org/jira/browse/SPARK-52062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52062: - Assignee: Dongjoon Hyun > Update `CFBundleVersion` to `0.2.0` > ---

[jira] [Updated] (SPARK-52062) Update `CFBundleVersion` to `0.2.0`

[ https://issues.apache.org/jira/browse/SPARK-52062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52062: --- Labels: pull-request-available (was: ) > Update `CFBundleVersion` to `0.2.0` >

[jira] [Created] (SPARK-52061) Add `getOption/isModifiable` and `set` variants to `RuntimeConf`

Dongjoon Hyun created SPARK-52061: - Summary: Add `getOption/isModifiable` and `set` variants to `RuntimeConf` Key: SPARK-52061 URL: https://issues.apache.org/jira/browse/SPARK-52061 Project: Spark

[jira] [Updated] (SPARK-52061) Add `getOption/isModifiable` and `set` variants to `RuntimeConf`

[ https://issues.apache.org/jira/browse/SPARK-52061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52061: --- Labels: pull-request-available (was: ) > Add `getOption/isModifiable` and `set` variants to

[jira] [Updated] (SPARK-46685) PySpark UDF Unified Profiling

[ https://issues.apache.org/jira/browse/SPARK-46685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46685: --- Labels: pull-request-available (was: ) > PySpark UDF Unified Profiling > --

[jira] [Created] (SPARK-52055) Suppress the exception in ExecutePlanResponseReattachableIterator.__del__

Hyukjin Kwon created SPARK-52055: Summary: Suppress the exception in ExecutePlanResponseReattachableIterator.__del__ Key: SPARK-52055 URL: https://issues.apache.org/jira/browse/SPARK-52055 Project: Sp

[jira] [Created] (SPARK-52060) Create dedicated OneRowRelationExec node

Richard Chen created SPARK-52060: Summary: Create dedicated OneRowRelationExec node Key: SPARK-52060 URL: https://issues.apache.org/jira/browse/SPARK-52060 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-52059) Fix `DataFrame` to use SparkSession's `transportSecurity`

[ https://issues.apache.org/jira/browse/SPARK-52059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52059. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Resolved] (SPARK-52046) Prettify OuterReference on AggregateExpression names when using toPrettySQL

[ https://issues.apache.org/jira/browse/SPARK-52046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52046. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50836 [https://gith

[jira] [Updated] (SPARK-52058) Update `README.md` and integration test with Apache Spark 4.0.0 RC5

[ https://issues.apache.org/jira/browse/SPARK-52058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52058: --- Labels: pull-request-available (was: ) > Update `README.md` and integration test with Apach

[jira] [Updated] (SPARK-52059) Fix `DataFrame` to use SparkSession's `transportSecurity`

[ https://issues.apache.org/jira/browse/SPARK-52059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52059: --- Labels: pull-request-available (was: ) > Fix `DataFrame` to use SparkSession's `transportSe

[jira] [Updated] (SPARK-52059) Fix `DataFrame` to use SparkSession's `transportSecurity`

[ https://issues.apache.org/jira/browse/SPARK-52059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52059: -- Reporter: Martin Grund (was: Dongjoon Hyun) > Fix `DataFrame` to use SparkSession's `transpor

[jira] [Updated] (SPARK-52059) Fix `DataFrame` to use SparkSession's `transportSecurity`

[ https://issues.apache.org/jira/browse/SPARK-52059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52059: -- Target Version/s: connect-swift-0.2.0 > Fix `DataFrame` to use SparkSession's `transportSecuri

[jira] [Assigned] (SPARK-52055) Suppress the exception in ExecutePlanResponseReattachableIterator.__del__

[ https://issues.apache.org/jira/browse/SPARK-52055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52055: - Assignee: Hyukjin Kwon > Suppress the exception in ExecutePlanResponseReattachableItera

[jira] [Created] (SPARK-52059) Fix `DataFrame` to use SparkSession's `transportSecurity`

Dongjoon Hyun created SPARK-52059: - Summary: Fix `DataFrame` to use SparkSession's `transportSecurity` Key: SPARK-52059 URL: https://issues.apache.org/jira/browse/SPARK-52059 Project: Spark I

[jira] [Resolved] (SPARK-52058) Update `README.md` and integration test with Apache Spark 4.0.0 RC5

[ https://issues.apache.org/jira/browse/SPARK-52058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52058. --- Fix Version/s: connect-swift-0.2.0 Resolution: Fixed Issue resolved by pull request 1

[jira] [Commented] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter (Parquet works as expected)

[ https://issues.apache.org/jira/browse/SPARK-52032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950565#comment-17950565 ] Dongjoon Hyun commented on SPARK-52032: --- Thank you for reporting, [~doki]. > ORC

[jira] [Created] (SPARK-52058) Update `README.md` and integration test with Apache Spark 4.0.0 RC5

Dongjoon Hyun created SPARK-52058: - Summary: Update `README.md` and integration test with Apache Spark 4.0.0 RC5 Key: SPARK-52058 URL: https://issues.apache.org/jira/browse/SPARK-52058 Project: Spark

[jira] [Resolved] (SPARK-52055) Suppress the exception in ExecutePlanResponseReattachableIterator.__del__

[ https://issues.apache.org/jira/browse/SPARK-52055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52055. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50847 [https://

[jira] [Assigned] (SPARK-52052) Add .broadcast in the companion object of SerializableConfiguration

[ https://issues.apache.org/jira/browse/SPARK-52052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52052: - Assignee: Kent Yao > Add .broadcast in the companion object of SerializableConfiguratio

[jira] [Resolved] (SPARK-52052) Add .broadcast in the companion object of SerializableConfiguration

[ https://issues.apache.org/jira/browse/SPARK-52052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52052. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50844 [https://

[jira] [Commented] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter (Parquet works as expected)

[ https://issues.apache.org/jira/browse/SPARK-52032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950549#comment-17950549 ] Jie Han commented on SPARK-52032: - I filed an [orc issue|[https://github.com/apache/orc

[jira] [Comment Edited] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter (Parquet works as expected)

[ https://issues.apache.org/jira/browse/SPARK-52032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950549#comment-17950549 ] Jie Han edited comment on SPARK-52032 at 5/9/25 3:22 PM: - I file

[jira] [Comment Edited] (SPARK-52032) ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter (Parquet works as expected)

[ https://issues.apache.org/jira/browse/SPARK-52032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950549#comment-17950549 ] Jie Han edited comment on SPARK-52032 at 5/9/25 3:20 PM: - I file

[jira] [Updated] (SPARK-52057) Collect Tree size limit warning messages to client

[ https://issues.apache.org/jira/browse/SPARK-52057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52057: --- Labels: pull-request-available (was: ) > Collect Tree size limit warning messages to client

[jira] [Assigned] (SPARK-52051) Enable model summary when memory control is enabled

[ https://issues.apache.org/jira/browse/SPARK-52051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-52051: -- Assignee: Weichen Xu > Enable model summary when memory control is enabled >

[jira] [Resolved] (SPARK-52051) Enable model summary when memory control is enabled

[ https://issues.apache.org/jira/browse/SPARK-52051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-52051. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50843 [https://github

[jira] [Created] (SPARK-52057) Collect Tree size limit warning messages to client

Weichen Xu created SPARK-52057: -- Summary: Collect Tree size limit warning messages to client Key: SPARK-52057 URL: https://issues.apache.org/jira/browse/SPARK-52057 Project: Spark Issue Type: Su

[jira] [Resolved] (SPARK-52056) Disable tuning algorithm sub-models in spark connect

[ https://issues.apache.org/jira/browse/SPARK-52056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-52056. Resolution: Not A Problem it is already disabled by default > Disable tuning algorithm sub-models

[jira] [Created] (SPARK-52056) Disable tuning algorithm sub-models in spark connect

Weichen Xu created SPARK-52056: -- Summary: Disable tuning algorithm sub-models in spark connect Key: SPARK-52056 URL: https://issues.apache.org/jira/browse/SPARK-52056 Project: Spark Issue Type:

[jira] [Updated] (SPARK-52055) Suppress the exception in ExecutePlanResponseReattachableIterator.__del__

[ https://issues.apache.org/jira/browse/SPARK-52055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52055: --- Labels: pull-request-available (was: ) > Suppress the exception in ExecutePlanResponseReatt

[jira] [Resolved] (SPARK-52053) Enable test_job_cancellation and its parity test

[ https://issues.apache.org/jira/browse/SPARK-52053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-52053. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50845 [https://

[jira] [Assigned] (SPARK-52053) Enable test_job_cancellation and its parity test

[ https://issues.apache.org/jira/browse/SPARK-52053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-52053: - Assignee: Ruifeng Zheng > Enable test_job_cancellation and its parity test > --

[jira] [Resolved] (SPARK-51884) Subquery Definition Changes For Adding Support For Nested Correlated Subqueries

[ https://issues.apache.org/jira/browse/SPARK-51884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51884. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50838 [https://gith

[jira] [Assigned] (SPARK-51884) Subquery Definition Changes For Adding Support For Nested Correlated Subqueries

[ https://issues.apache.org/jira/browse/SPARK-51884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-51884: --- Assignee: Avery Qi > Subquery Definition Changes For Adding Support For Nested Correlated

[jira] [Updated] (SPARK-52053) Enable test_job_cancellation and its parity test

[ https://issues.apache.org/jira/browse/SPARK-52053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52053: --- Labels: pull-request-available (was: ) > Enable test_job_cancellation and its parity test >

[jira] [Created] (SPARK-52054) Enable test_interrupt_tag in pyspark.sql.tests.test_job_cancellation

Ruifeng Zheng created SPARK-52054: - Summary: Enable test_interrupt_tag in pyspark.sql.tests.test_job_cancellation Key: SPARK-52054 URL: https://issues.apache.org/jira/browse/SPARK-52054 Project: Spark

[jira] [Created] (SPARK-52053) Enable test_job_cancellation and its parity test

Ruifeng Zheng created SPARK-52053: - Summary: Enable test_job_cancellation and its parity test Key: SPARK-52053 URL: https://issues.apache.org/jira/browse/SPARK-52053 Project: Spark Issue Type

[jira] [Resolved] (SPARK-52042) Missed TIME in the error of supported typed literals

[ https://issues.apache.org/jira/browse/SPARK-52042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52042. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50834 [https://github.com

[jira] [Commented] (SPARK-21056) InMemoryFileIndex.listLeafFiles should create at most one spark job when listing files in parallel

[ https://issues.apache.org/jira/browse/SPARK-21056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950467#comment-17950467 ] Ohad Raviv commented on SPARK-21056: Hi! I know it's been a while :D, but we've rece

[jira] [Updated] (SPARK-52042) Missed TIME in the error of supported typed literals

[ https://issues.apache.org/jira/browse/SPARK-52042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52042: --- Labels: pull-request-available (was: ) > Missed TIME in the error of supported typed litera

[jira] [Updated] (SPARK-52054) Enable test_interrupt_tag in pyspark.sql.tests.test_job_cancellation

[ https://issues.apache.org/jira/browse/SPARK-52054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-52054: -- Description: == [4127|htt

[jira] [Commented] (SPARK-50873) An optimization for SparkOptimizer to prune column after RewriteSubquery

[ https://issues.apache.org/jira/browse/SPARK-50873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17950455#comment-17950455 ] Aparna Garg commented on SPARK-50873: - User 'Akeron-Zhu' has created a pull request