[jira] [Updated] (SPARK-45246) Encourage using latest jinja2 other than documentation build

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45246: --- Labels: pull-request-available (was: ) > Encourage using latest jinja2 other than

[jira] [Created] (SPARK-45246) Encourage using latest jinja2 other than documentation build

2023-09-20 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45246: --- Summary: Encourage using latest jinja2 other than documentation build Key: SPARK-45246 URL: https://issues.apache.org/jira/browse/SPARK-45246 Project: Spark

[jira] [Updated] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45245: --- Labels: pull-request-available (was: ) > PythonWorkerFactory create gets stuck in case of

[jira] [Created] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

2023-09-20 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-45245: Summary: PythonWorkerFactory create gets stuck in case of worker failures Key: SPARK-45245 URL: https://issues.apache.org/jira/browse/SPARK-45245 Project: Spark

[jira] [Updated] (SPARK-45244) Correct spelling in VolcanoTestsSuite

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45244: --- Labels: pull-request-available (was: ) > Correct spelling in VolcanoTestsSuite >

[jira] [Created] (SPARK-45244) Correct spelling in VolcanoTestsSuite

2023-09-20 Thread Binjie Yang (Jira)
Binjie Yang created SPARK-45244: --- Summary: Correct spelling in VolcanoTestsSuite Key: SPARK-45244 URL: https://issues.apache.org/jira/browse/SPARK-45244 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

2023-09-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45138: Assignee: Neil Ramaswamy > Define a new error class and apply for the case where

[jira] [Updated] (SPARK-45230) Adjust sorter for Aggregate after SMJ

2023-09-20 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Summary: Adjust sorter for Aggregate after SMJ (was: Plan sorter for Aggregate after SMJ) > Adjust

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

2023-09-20 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If there is an aggregate operator after the SMJ and the grouping expressions of aggregate

[jira] [Updated] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

2023-09-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-45138: - Fix Version/s: 4.0.0 > Define a new error class and apply for the case where checkpointing

[jira] [Resolved] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

2023-09-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45138. -- Resolution: Fixed Issue resolved via [https://github.com/apache/spark/pull/42895] NOTE:

[jira] [Assigned] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

2023-09-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45138: Assignee: (was: Raghu Angadi) > Define a new error class and apply for the case

[jira] [Assigned] (SPARK-45138) Define a new error class and apply for the case where checkpointing state to DFS fails

2023-09-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45138: Assignee: Raghu Angadi > Define a new error class and apply for the case where

[jira] [Assigned] (SPARK-45216) Fix non-deterministic seeded Dataset APIs

2023-09-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45216: Assignee: Peter Toth > Fix non-deterministic seeded Dataset APIs >

[jira] [Resolved] (SPARK-45216) Fix non-deterministic seeded Dataset APIs

2023-09-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45216. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42997

[jira] [Updated] (SPARK-43297) Make improvement to LocalKMeans

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43297: --- Labels: pull-request-available (was: ) > Make improvement to LocalKMeans >

[jira] [Updated] (SPARK-42617) Support `isocalendar`

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42617: --- Labels: pull-request-available (was: ) > Support `isocalendar` > - > >

[jira] [Updated] (SPARK-45239) Reduce default spark.connect.jvmStacktrace.maxSize

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45239: --- Labels: pull-request-available (was: ) > Reduce default

[jira] [Resolved] (SPARK-45107) Refine docstring of `explode`

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45107. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42860

[jira] [Assigned] (SPARK-45107) Refine docstring of `explode`

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45107: - Assignee: Allison Wang > Refine docstring of `explode` > -

[jira] [Updated] (SPARK-45218) Refine docstring of `Column.isin`

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45218: --- Labels: pull-request-available (was: ) > Refine docstring of `Column.isin` >

[jira] [Resolved] (SPARK-45218) Refine docstring of `Column.isin`

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45218. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43001

[jira] [Assigned] (SPARK-45218) Refine docstring of `Column.isin`

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45218: - Assignee: Allison Wang > Refine docstring of `Column.isin` >

[jira] [Resolved] (SPARK-45234) Refine DocString of `regr_*` functions

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45234. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43012

[jira] [Updated] (SPARK-45234) Refine DocString of `regr_*` functions

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45234: --- Labels: pull-request-available (was: ) > Refine DocString of `regr_*` functions >

[jira] [Assigned] (SPARK-45234) Refine DocString of `regr_*` functions

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45234: - Assignee: Ruifeng Zheng > Refine DocString of `regr_*` functions >

[jira] [Updated] (SPARK-45227) Fix an issue where an executor process randomly gets stuck, by making CoarseGrainedExecutorBackend.taskResources thread-safe

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45227: --- Labels: hang infinite-loop pull-request-available race-condition stuck threadsafe (was:

[jira] [Updated] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43498: --- Labels: pull-request-available (was: ) > Enable StatsTests.test_axis_on_dataframe for

[jira] [Updated] (SPARK-41086) Consolidate SecondArgumentXXX error to INVALID_PARAMETER_VALUE

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41086: --- Labels: pull-request-available (was: ) > Consolidate SecondArgumentXXX error to

[jira] [Updated] (SPARK-45231) Remove unrecognized and meaningless command about amm from the GA testing workflow

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45231: --- Labels: pull-request-available (was: ) > Remove unrecognized and meaningless command about

[jira] [Updated] (SPARK-44113) Make Scala 2.13+ as default Scala version

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44113: --- Labels: pull-request-available (was: ) > Make Scala 2.13+ as default Scala version >

[jira] [Commented] (SPARK-43831) Build and Run Spark on Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767261#comment-17767261 ] Dongjoon Hyun commented on SPARK-43831: --- Java 21 reaches GA and this issue is resolved via

[jira] [Resolved] (SPARK-43831) Build and Run Spark on Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43831. --- Fix Version/s: 4.0.0 Assignee: Dongjoon Hyun Resolution: Fixed > Build and

[jira] [Updated] (SPARK-43831) Build and Run Spark on Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43831: -- Labels: releasenotes (was: ) > Build and Run Spark on Java 21 >

[jira] [Assigned] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45241: - Assignee: Dongjoon Hyun > Use Zulu JDK in java-other-versions pipeline and Java 21 >

[jira] [Resolved] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45241. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43018

[jira] [Updated] (SPARK-45241) Use Zulu JDK in build_and_test and build_java21 GitHub Action and Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45241: -- Summary: Use Zulu JDK in build_and_test and build_java21 GitHub Action and Java 21 (was: Use

[jira] [Created] (SPARK-45243) RADIX sort is not stable and can produce different results for first/collect_list aggs

2023-09-20 Thread Robert Joseph Evans (Jira)
Robert Joseph Evans created SPARK-45243: --- Summary: RADIX sort is not stable and can produce different results for first/collect_list aggs Key: SPARK-45243 URL:

[jira] [Updated] (SPARK-45207) Implement Error Enrichment for Scala Client

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45207: --- Labels: pull-request-available (was: ) > Implement Error Enrichment for Scala Client >

[jira] [Created] (SPARK-45242) Use DataFrame ID to semantically validate CollectMetrics

2023-09-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-45242: Summary: Use DataFrame ID to semantically validate CollectMetrics Key: SPARK-45242 URL: https://issues.apache.org/jira/browse/SPARK-45242 Project: Spark Issue

[jira] [Updated] (SPARK-45216) Fix non-deterministic seeded Dataset APIs

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45216: --- Labels: pull-request-available (was: ) > Fix non-deterministic seeded Dataset APIs >

[jira] [Updated] (SPARK-45219) Refine docstring of `DataFrame.withColumnRenamed`

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45219: --- Labels: pull-request-available (was: ) > Refine docstring of `DataFrame.withColumnRenamed`

[jira] [Updated] (SPARK-45232) Add missing function groups to SQL references

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45232: --- Labels: pull-request-available (was: ) > Add missing function groups to SQL references >

[jira] [Updated] (SPARK-45235) The `sql()` method doesn't support map and array parameters in Python connect client

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45235: --- Labels: pull-request-available (was: ) > The `sql()` method doesn't support map and array

[jira] [Updated] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45241: --- Labels: pull-request-available (was: ) > Use Zulu JDK in java-other-versions pipeline and

[jira] [Created] (SPARK-45241) Use Zulu JDK in java-other-versions pipeline and Java 21

2023-09-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45241: - Summary: Use Zulu JDK in java-other-versions pipeline and Java 21 Key: SPARK-45241 URL: https://issues.apache.org/jira/browse/SPARK-45241 Project: Spark

[jira] [Updated] (SPARK-45207) Implement Error Enrichment for Scala Client

2023-09-20 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-45207: -- Summary: Implement Error Enrichment for Scala Client (was: Implement Complete Error Reconstruction

[jira] [Created] (SPARK-45240) Implement Error Enrichment for Python Client

2023-09-20 Thread Yihong He (Jira)
Yihong He created SPARK-45240: - Summary: Implement Error Enrichment for Python Client Key: SPARK-45240 URL: https://issues.apache.org/jira/browse/SPARK-45240 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45237: - Assignee: Yang Jie > Correct the default value of

[jira] [Assigned] (SPARK-45112) Use UnresolvedFunction based resolution in SQL Dataset functions

2023-09-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45112: --- Assignee: Peter Toth > Use UnresolvedFunction based resolution in SQL Dataset functions >

[jira] [Updated] (SPARK-44579) Support Interrupt On Cancel in SQLExecution

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44579: --- Labels: pull-request-available (was: ) > Support Interrupt On Cancel in SQLExecution >

[jira] [Resolved] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45237. --- Fix Version/s: 3.5.1 4.0.0 3.4.2 Resolution:

[jira] [Updated] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45237: --- Labels: pull-request-available (was: ) > Correct the default value of

[jira] [Created] (SPARK-45230) Plan sorter for Aggregate after SMJ

2023-09-20 Thread Wan Kun (Jira)
Wan Kun created SPARK-45230: --- Summary: Plan sorter for Aggregate after SMJ Key: SPARK-45230 URL: https://issues.apache.org/jira/browse/SPARK-45230 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45233) HistoryServer should set headers Content-Security-Policy (CSP)

2023-09-20 Thread Laurenceau Julien (Jira)
Laurenceau Julien created SPARK-45233: - Summary: HistoryServer should set headers Content-Security-Policy (CSP) Key: SPARK-45233 URL: https://issues.apache.org/jira/browse/SPARK-45233 Project:

[jira] [Created] (SPARK-45239) Reduce default spark.connect.jvmStacktrace.maxSize

2023-09-20 Thread Yihong He (Jira)
Yihong He created SPARK-45239: - Summary: Reduce default spark.connect.jvmStacktrace.maxSize Key: SPARK-45239 URL: https://issues.apache.org/jira/browse/SPARK-45239 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-45229) Show the number of drivers waiting in SUBMITTED status

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45229: - Assignee: Dongjoon Hyun > Show the number of drivers waiting in SUBMITTED status >

[jira] [Resolved] (SPARK-45112) Use UnresolvedFunction based resolution in SQL Dataset functions

2023-09-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45112. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42864

[jira] [Created] (SPARK-45232) Add missing function groups to SQL references

2023-09-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45232: - Summary: Add missing function groups to SQL references Key: SPARK-45232 URL: https://issues.apache.org/jira/browse/SPARK-45232 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45224) Add examples w/ map and array as parameters of sql()

2023-09-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42996

[jira] [Resolved] (SPARK-45229) Show the number of drivers waiting in SUBMITTED status

2023-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45229. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43007

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

2023-09-20 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If the aggregate operator comes after SMJ and the grouping expressions of aggregate

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

2023-09-20 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If there is an aggregate operator after the SMJ and the grouping expressions of aggregate

[jira] [Created] (SPARK-45234) Refine DocString of `regr_*` functions

2023-09-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45234: - Summary: Refine DocString of `regr_*` functions Key: SPARK-45234 URL: https://issues.apache.org/jira/browse/SPARK-45234 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45230) Plan sorter for Aggregate after SMJ

2023-09-20 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-45230: Description: If the aggregate operator comes after SMJ and the grouping expressions of aggregate

[jira] [Updated] (SPARK-45207) Implement Complete Error Reconstruction for Scala Client

2023-09-20 Thread Yihong He (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-45207: -- Summary: Implement Complete Error Reconstruction for Scala Client (was: Implement Error Enrichment

[jira] [Resolved] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

2023-09-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43498. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43002

[jira] [Updated] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45237: - Issue Type: Bug (was: Improvement) > Correct the default value of

[jira] [Created] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`

2023-09-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-45237: Summary: Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md` Key: SPARK-45237 URL: https://issues.apache.org/jira/browse/SPARK-45237

[jira] [Updated] (SPARK-45238) Add Unicode[encode/decode]() function

2023-09-20 Thread feiyuanxing (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiyuanxing updated SPARK-45238: Issue Type: New Feature (was: Improvement) > Add Unicode[encode/decode]() function >

[jira] [Assigned] (SPARK-43498) Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0.

2023-09-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43498: Assignee: Haejoon Lee > Enable StatsTests.test_axis_on_dataframe for pandas 2.0.0. >

[jira] [Commented] (SPARK-44112) Drop Java 8 and 11 support

2023-09-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767091#comment-17767091 ] Yang Jie commented on SPARK-44112: -- Sorry, there might have been a delay in receiving emails, I just

[jira] [Created] (SPARK-45238) Add Unicode[encode/decode]() function

2023-09-20 Thread feiyuanxing (Jira)
feiyuanxing created SPARK-45238: --- Summary: Add Unicode[encode/decode]() function Key: SPARK-45238 URL: https://issues.apache.org/jira/browse/SPARK-45238 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45235) The `sql()` method doesn't support map and array parameters in Python connect client

2023-09-20 Thread Max Gekk (Jira)
Max Gekk created SPARK-45235: Summary: The `sql()` method doesn't support map and array parameters in Python connect client Key: SPARK-45235 URL: https://issues.apache.org/jira/browse/SPARK-45235

[jira] [Created] (SPARK-45236) ToPrettyString will treat java encoder or kryo encoder as BinaryType

2023-09-20 Thread Deng Ziming (Jira)
Deng Ziming created SPARK-45236: --- Summary: ToPrettyString will treat java encoder or kryo encoder as BinaryType Key: SPARK-45236 URL: https://issues.apache.org/jira/browse/SPARK-45236 Project: Spark

[jira] [Updated] (SPARK-45231) Remove unrecognized and meaningless command about amm from the GA testing workflow

2023-09-20 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45231: Summary: Remove unrecognized and meaningless command about amm from the GA testing workflow

[jira] [Created] (SPARK-45231) Remove unrecognized and meaningless command about amm from the GA testing workflow.

2023-09-20 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-45231: --- Summary: Remove unrecognized and meaningless command about amm from the GA testing workflow. Key: SPARK-45231 URL: https://issues.apache.org/jira/browse/SPARK-45231

[jira] [Resolved] (SPARK-45226) Refine docstring of `rand/randn`

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45226. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43003

[jira] [Assigned] (SPARK-45226) Refine docstring of `rand/randn`

2023-09-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45226: - Assignee: BingKun Pan > Refine docstring of `rand/randn` >