[jira] [Resolved] (SPARK-45219) Refine docstring of `DataFrame.withColumnRenamed`

[ https://issues.apache.org/jira/browse/SPARK-45219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45219. -- Fix Version/s: 4.0.0 Assignee: Allison Wang Resolution: Fixed Fixed in https:/

[jira] [Updated] (SPARK-45248) Slow HTTP Denial of Service Attack【jetty server in spark】

[ https://issues.apache.org/jira/browse/SPARK-45248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyu updated SPARK-45248: --- Summary: Slow HTTP Denial of Service Attack【jetty server in spark】 (was: Slow HTTP Denial of Service Attack

[jira] [Created] (SPARK-45248) Slow HTTP Denial of Service Attack

chenyu created SPARK-45248: -- Summary: Slow HTTP Denial of Service Attack Key: SPARK-45248 URL: https://issues.apache.org/jira/browse/SPARK-45248 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-45247) Upgrade Pandas to 2.1.1

[ https://issues.apache.org/jira/browse/SPARK-45247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45247: --- Labels: pull-request-available (was: ) > Upgrade Pandas to 2.1.1 > ---

[jira] [Created] (SPARK-45247) Upgrade Pandas to 2.1.1

Haejoon Lee created SPARK-45247: --- Summary: Upgrade Pandas to 2.1.1 Key: SPARK-45247 URL: https://issues.apache.org/jira/browse/SPARK-45247 Project: Spark Issue Type: Sub-task Componen

[jira] [Resolved] (SPARK-45235) The `sql()` method doesn't support map and array parameters in Python connect client

[ https://issues.apache.org/jira/browse/SPARK-45235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45235. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43014 [https://github.com

[jira] [Updated] (SPARK-45246) Encourage using latest jinja2 other than documentation build

[ https://issues.apache.org/jira/browse/SPARK-45246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45246: --- Labels: pull-request-available (was: ) > Encourage using latest jinja2 other than documenta

[jira] [Created] (SPARK-45246) Encourage using latest jinja2 other than documentation build

Haejoon Lee created SPARK-45246: --- Summary: Encourage using latest jinja2 other than documentation build Key: SPARK-45246 URL: https://issues.apache.org/jira/browse/SPARK-45246 Project: Spark I

[jira] [Updated] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45245: --- Labels: pull-request-available (was: ) > PythonWorkerFactory create gets stuck in case of w

[jira] [Created] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

Raghu Angadi created SPARK-45245: Summary: PythonWorkerFactory create gets stuck in case of worker failures Key: SPARK-45245 URL: https://issues.apache.org/jira/browse/SPARK-45245 Project: Spark

[jira] [Updated] (SPARK-45244) Correct spelling in VolcanoTestsSuite

[ https://issues.apache.org/jira/browse/SPARK-45244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45244: --- Labels: pull-request-available (was: ) > Correct spelling in VolcanoTestsSuite > --

[jira] [Created] (SPARK-45244) Correct spelling in VolcanoTestsSuite

Binjie Yang created SPARK-45244: --- Summary: Correct spelling in VolcanoTestsSuite Key: SPARK-45244 URL: https://issues.apache.org/jira/browse/SPARK-45244 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45138: Assignee: Neil Ramaswamy > Define a new error class and apply for the case where checkpoi

[jira] [Updated] (SPARK-45230) Adjust sorter for Aggregate after SMJ

[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Summary: Adjust sorter for Aggregate after SMJ (was: Plan sorter for Aggregate after SMJ) > Adjust sorte

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If there is an aggregate operator after the SMJ and the grouping expressions of aggregate op

[jira] [Updated] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-45138: - Fix Version/s: 4.0.0 > Define a new error class and apply for the case where checkpointing state

[jira] [Resolved] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45138. -- Resolution: Fixed Issue resolved via [https://github.com/apache/spark/pull/42895] NOTE: tempo

[jira] [Assigned] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45138: Assignee: (was: Raghu Angadi) > Define a new error class and apply for the case where

[jira] [Assigned] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45138: Assignee: Raghu Angadi > Define a new error class and apply for the case where checkpoint

[jira] [Assigned] (SPARK-45216) Fix non-deterministic seeded Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-45216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45216: Assignee: Peter Toth > Fix non-deterministic seeded Dataset APIs > --

[jira] [Resolved] (SPARK-45216) Fix non-deterministic seeded Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-45216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45216. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42997 [https://gi

[jira] [Updated] (SPARK-43297) Make improvement to LocalKMeans

[ https://issues.apache.org/jira/browse/SPARK-43297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43297: --- Labels: pull-request-available (was: ) > Make improvement to LocalKMeans >

[jira] [Updated] (SPARK-42617) Support `isocalendar`

[ https://issues.apache.org/jira/browse/SPARK-42617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42617: --- Labels: pull-request-available (was: ) > Support `isocalendar` > - > >

[jira] [Updated] (SPARK-45239) Reduce default spark.connect.jvmStacktrace.maxSize

[ https://issues.apache.org/jira/browse/SPARK-45239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45239: --- Labels: pull-request-available (was: ) > Reduce default spark.connect.jvmStacktrace.maxSize

[jira] [Resolved] (SPARK-45107) Refine docstring of `explode`

[ https://issues.apache.org/jira/browse/SPARK-45107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45107. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42860 [https://

[jira] [Assigned] (SPARK-45107) Refine docstring of `explode`

[ https://issues.apache.org/jira/browse/SPARK-45107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45107: - Assignee: Allison Wang > Refine docstring of `explode` > -

[jira] [Updated] (SPARK-45218) Refine docstring of `Column.isin`

[ https://issues.apache.org/jira/browse/SPARK-45218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45218: --- Labels: pull-request-available (was: ) > Refine docstring of `Column.isin` > --

[jira] [Resolved] (SPARK-45218) Refine docstring of `Column.isin`

[ https://issues.apache.org/jira/browse/SPARK-45218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45218. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43001 [https://

[jira] [Assigned] (SPARK-45218) Refine docstring of `Column.isin`

[ https://issues.apache.org/jira/browse/SPARK-45218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45218: - Assignee: Allison Wang > Refine docstring of `Column.isin` > --

[jira] [Resolved] (SPARK-45234) Refine DocString of `regr_*` functions

[ https://issues.apache.org/jira/browse/SPARK-45234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45234. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43012 [https://

[jira] [Updated] (SPARK-45234) Refine DocString of `regr_*` functions

[ https://issues.apache.org/jira/browse/SPARK-45234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45234: --- Labels: pull-request-available (was: ) > Refine DocString of `regr_*` functions > -

[jira] [Assigned] (SPARK-45234) Refine DocString of `regr_*` functions

[ https://issues.apache.org/jira/browse/SPARK-45234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45234: - Assignee: Ruifeng Zheng > Refine DocString of `regr_*` functions >

[jira] [Updated] (SPARK-45227) Fix an issue where an executor process randomly gets stuck, by making CoarseGrainedExecutorBackend.taskResources thread-safe

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45227: --- Labels: hang infinite-loop pull-request-available race-condition stuck threadsafe (was: han

[jira] [Updated] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43498: --- Labels: pull-request-available (was: ) > Enable StatsTests.test_axis_on_dataframe for panda

[jira] [Updated] (SPARK-41086) Consolidate SecondArgumentXXX error to INVALID_PARAMETER_VALUE

[ https://issues.apache.org/jira/browse/SPARK-41086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41086: --- Labels: pull-request-available (was: ) > Consolidate SecondArgumentXXX error to INVALID_PAR

[jira] [Updated] (SPARK-45231) Remove unrecognized and meaningless command about amm from the GA testing workflow

[ https://issues.apache.org/jira/browse/SPARK-45231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45231: --- Labels: pull-request-available (was: ) > Remove unrecognized and meaningless command about

[jira] [Updated] (SPARK-44113) Make Scala 2.13+ as default Scala version

[ https://issues.apache.org/jira/browse/SPARK-44113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44113: --- Labels: pull-request-available (was: ) > Make Scala 2.13+ as default Scala version > --

[jira] [Commented] (SPARK-43831) Build and Run Spark on Java 21

[ https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17767261#comment-17767261 ] Dongjoon Hyun commented on SPARK-43831: --- Java 21 reaches GA and this issue is reso

[jira] [Resolved] (SPARK-43831) Build and Run Spark on Java 21

[ https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43831. --- Fix Version/s: 4.0.0 Assignee: Dongjoon Hyun Resolution: Fixed > Build and R

[jira] [Updated] (SPARK-43831) Build and Run Spark on Java 21

[ https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43831: -- Labels: releasenotes (was: ) > Build and Run Spark on Java 21 > -

[jira] [Assigned] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45241: - Assignee: Dongjoon Hyun > Use Zulu JDK in java-other-versions pipeline and Java 21 > --

[jira] [Resolved] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45241. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43018 [https://

[jira] [Updated] (SPARK-45241) Use Zulu JDK in build_and_test and build_java21 GitHub Action and Java 21

[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45241: -- Summary: Use Zulu JDK in build_and_test and build_java21 GitHub Action and Java 21 (was: Use

[jira] [Created] (SPARK-45243) RADIX sort is not stable and can produce different results for first/collect_list aggs

Robert Joseph Evans created SPARK-45243: --- Summary: RADIX sort is not stable and can produce different results for first/collect_list aggs Key: SPARK-45243 URL: https://issues.apache.org/jira/browse/SPARK-452

[jira] [Updated] (SPARK-45207) Implement Error Enrichment for Scala Client

[ https://issues.apache.org/jira/browse/SPARK-45207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45207: --- Labels: pull-request-available (was: ) > Implement Error Enrichment for Scala Client >

[jira] [Created] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics

Rui Wang created SPARK-45242: Summary: Use DataFrame ID to semantically validate CollectMetrics Key: SPARK-45242 URL: https://issues.apache.org/jira/browse/SPARK-45242 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45216) Fix non-deterministic seeded Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-45216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45216: --- Labels: pull-request-available (was: ) > Fix non-deterministic seeded Dataset APIs > --

[jira] [Updated] (SPARK-45219) Refine docstring of `DataFrame.withColumnRenamed`

[ https://issues.apache.org/jira/browse/SPARK-45219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45219: --- Labels: pull-request-available (was: ) > Refine docstring of `DataFrame.withColumnRenamed`

[jira] [Updated] (SPARK-45232) Add missing function groups to SQL references

[ https://issues.apache.org/jira/browse/SPARK-45232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45232: --- Labels: pull-request-available (was: ) > Add missing function groups to SQL references > --

[jira] [Updated] (SPARK-45235) The `sql()` method doesn't support map and array parameters in Python connect client

[ https://issues.apache.org/jira/browse/SPARK-45235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45235: --- Labels: pull-request-available (was: ) > The `sql()` method doesn't support map and array p

[jira] [Updated] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45241: --- Labels: pull-request-available (was: ) > Use Zulu JDK in java-other-versions pipeline and J

[jira] [Created] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

Dongjoon Hyun created SPARK-45241: - Summary: Use Zulu JDK in java-other-versions pipeline and Java 21 Key: SPARK-45241 URL: https://issues.apache.org/jira/browse/SPARK-45241 Project: Spark Is

[jira] [Updated] (SPARK-45207) Implement Error Enrichment for Scala Client

[ https://issues.apache.org/jira/browse/SPARK-45207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-45207: -- Summary: Implement Error Enrichment for Scala Client (was: Implement Complete Error Reconstruction fo

[jira] [Created] (SPARK-45240) Implement Error Enrichment for Python Client

Yihong He created SPARK-45240: - Summary: Implement Error Enrichment for Python Client Key: SPARK-45240 URL: https://issues.apache.org/jira/browse/SPARK-45240 Project: Spark Issue Type: New Featur

[jira] [Assigned] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45237: - Assignee: Yang Jie > Correct the default value of `spark.history.store.hybridStore.disk

[jira] [Assigned] (SPARK-45112) Use UnresolvedFunction based resolution in SQL Dataset functions

[ https://issues.apache.org/jira/browse/SPARK-45112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45112: --- Assignee: Peter Toth > Use UnresolvedFunction based resolution in SQL Dataset functions > -

[jira] [Updated] (SPARK-44579) Support Interrupt On Cancel in SQLExecution

[ https://issues.apache.org/jira/browse/SPARK-44579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44579: --- Labels: pull-request-available (was: ) > Support Interrupt On Cancel in SQLExecution >

[jira] [Resolved] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45237. --- Fix Version/s: 3.5.1 4.0.0 3.4.2 Resolution: Fix

[jira] [Updated] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45237: --- Labels: pull-request-available (was: ) > Correct the default value of `spark.history.store.

[jira] [Created] (SPARK-45230) Plan sorter for Aggregate after SMJ

Wan Kun created SPARK-45230: --- Summary: Plan sorter for Aggregate after SMJ Key: SPARK-45230 URL: https://issues.apache.org/jira/browse/SPARK-45230 Project: Spark Issue Type: Improvement C

[jira] [Created] (SPARK-45233) HistoryServer should set headers Content-Security-Policy (CSP)

Laurenceau Julien created SPARK-45233: - Summary: HistoryServer should set headers Content-Security-Policy (CSP) Key: SPARK-45233 URL: https://issues.apache.org/jira/browse/SPARK-45233 Project: Spa

[jira] [Created] (SPARK-45239) Reduce default spark.connect.jvmStacktrace.maxSize

Yihong He created SPARK-45239: - Summary: Reduce default spark.connect.jvmStacktrace.maxSize Key: SPARK-45239 URL: https://issues.apache.org/jira/browse/SPARK-45239 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-45229) Show the number of drivers waiting in SUBMITTED status

[ https://issues.apache.org/jira/browse/SPARK-45229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45229: - Assignee: Dongjoon Hyun > Show the number of drivers waiting in SUBMITTED status >

[jira] [Resolved] (SPARK-45112) Use UnresolvedFunction based resolution in SQL Dataset functions

[ https://issues.apache.org/jira/browse/SPARK-45112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45112. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42864 [https://gith

[jira] [Created] (SPARK-45232) Add missing function groups to SQL references

Ruifeng Zheng created SPARK-45232: - Summary: Add missing function groups to SQL references Key: SPARK-45232 URL: https://issues.apache.org/jira/browse/SPARK-45232 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-45224) Add examples w/ map and array as parameters of sql()

[ https://issues.apache.org/jira/browse/SPARK-45224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42996 [https://github.com

[jira] [Resolved] (SPARK-45229) Show the number of drivers waiting in SUBMITTED status

[ https://issues.apache.org/jira/browse/SPARK-45229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45229. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43007 [https://

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If the aggregate operator comes after SMJ and the grouping expressions of aggregate operator

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If there is an aggregate operator after the SMJ and the grouping expressions of aggregate op

[jira] [Created] (SPARK-45234) Refine DocString of `regr_*` functions

Ruifeng Zheng created SPARK-45234: - Summary: Refine DocString of `regr_*` functions Key: SPARK-45234 URL: https://issues.apache.org/jira/browse/SPARK-45234 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If the aggregate operator comes after SMJ and the grouping expressions of aggregate operator

[jira] [Updated] (SPARK-45207) Implement Complete Error Reconstruction for Scala Client

[ https://issues.apache.org/jira/browse/SPARK-45207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-45207: -- Summary: Implement Complete Error Reconstruction for Scala Client (was: Implement Error Enrichment fo

[jira] [Resolved] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43498. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43002 [https://gi

[jira] [Updated] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45237: - Issue Type: Bug (was: Improvement) > Correct the default value of `spark.history.store.hybridStore.disk

[jira] [Created] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

Yang Jie created SPARK-45237: Summary: Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md` Key: SPARK-45237 URL: https://issues.apache.org/jira/browse/SPARK-45237

[jira] [Updated] (SPARK-45238) Add Unicode[encode/decode]() function

[ https://issues.apache.org/jira/browse/SPARK-45238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiyuanxing updated SPARK-45238: Issue Type: New Feature (was: Improvement) > Add Unicode[encode/decode]() function >

[jira] [Assigned] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43498: Assignee: Haejoon Lee > Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0. >

[jira] [Commented] (SPARK-44112) Drop Java 8 and 11 support

[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17767091#comment-17767091 ] Yang Jie commented on SPARK-44112: -- Sorry, there might have been a delay in receiving e

[jira] [Created] (SPARK-45238) Add Unicode[encode/decode]() function

feiyuanxing created SPARK-45238: --- Summary: Add Unicode[encode/decode]() function Key: SPARK-45238 URL: https://issues.apache.org/jira/browse/SPARK-45238 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45235) The `sql()` method doesn't support map and array parameters in Python connect client

Max Gekk created SPARK-45235: Summary: The `sql()` method doesn't support map and array parameters in Python connect client Key: SPARK-45235 URL: https://issues.apache.org/jira/browse/SPARK-45235 Project:

[jira] [Created] (SPARK-45236) ToPrettyString will treat java encoder or kryo encoder as BinaryType

Deng Ziming created SPARK-45236: --- Summary: ToPrettyString will treat java encoder or kryo encoder as BinaryType Key: SPARK-45236 URL: https://issues.apache.org/jira/browse/SPARK-45236 Project: Spark

[jira] [Updated] (SPARK-45231) Remove unrecognized and meaningless command about amm from the GA testing workflow

[ https://issues.apache.org/jira/browse/SPARK-45231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45231: Summary: Remove unrecognized and meaningless command about amm from the GA testing workflow (was:

[jira] [Created] (SPARK-45231) Remove unrecognized and meaningless command about amm from the GA testing workflow.

BingKun Pan created SPARK-45231: --- Summary: Remove unrecognized and meaningless command about amm from the GA testing workflow. Key: SPARK-45231 URL: https://issues.apache.org/jira/browse/SPARK-45231 Pro

[jira] [Resolved] (SPARK-45226) Refine docstring of `rand/randn`

[ https://issues.apache.org/jira/browse/SPARK-45226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45226. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43003 [https://

[jira] [Assigned] (SPARK-45226) Refine docstring of `rand/randn`

[ https://issues.apache.org/jira/browse/SPARK-45226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45226: - Assignee: BingKun Pan > Refine docstring of `rand/randn` >