[jira] [Updated] (SPARK-46673) Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt`

[ https://issues.apache.org/jira/browse/SPARK-46673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46673: --- Labels: pull-request-available (was: ) > Refine docstring

[jira] [Updated] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

[ https://issues.apache.org/jira/browse/SPARK-46730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46730: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Created] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

Yang Jie created SPARK-46730: Summary: Refine docstring of `str_to_map/map_filter/map_zip_with` Key: SPARK-46730 URL: https://issues.apache.org/jira/browse/SPARK-46730 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46729) Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector

[ https://issues.apache.org/jira/browse/SPARK-46729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46729: --- Labels: pull-request-available (was: ) > Withdraw the recommendation of using Concurrent

[jira] [Created] (SPARK-46729) Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector

Kent Yao created SPARK-46729: Summary: Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector Key: SPARK-46729 URL: https://issues.apache.org/jira/browse/SPARK-46729 Project:

[jira] [Resolved] (SPARK-46722) Add a test regarding to backward compatibility check for StreamingQueryListener in Spark Connect (Scala/PySpark)

[ https://issues.apache.org/jira/browse/SPARK-46722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46722. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44736

[jira] [Assigned] (SPARK-46722) Add a test regarding to backward compatibility check for StreamingQueryListener in Spark Connect (Scala/PySpark)

[ https://issues.apache.org/jira/browse/SPARK-46722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46722: Assignee: Jungtaek Lim > Add a test regarding to backward compatibility check for >

[jira] [Updated] (SPARK-46639) Add WindowExec SQLMetrics

[ https://issues.apache.org/jira/browse/SPARK-46639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-46639: --- Description: Currently, WindowExec Physical Operator has only spillSize SQLMetric.

[jira] [Updated] (SPARK-46653) Code-gen for full outer sort merge join output row by row

[ https://issues.apache.org/jira/browse/SPARK-46653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Zhu updated SPARK-46653: -- Summary: Code-gen for full outer sort merge join output row by row (was: Code-gen for full

[jira] [Updated] (SPARK-46728) Check pandas installation properly

[ https://issues.apache.org/jira/browse/SPARK-46728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46728: --- Labels: pull-request-available (was: ) > Check pandas installation properly >

[jira] [Created] (SPARK-46728) Check pandas installation properly

Haejoon Lee created SPARK-46728: --- Summary: Check pandas installation properly Key: SPARK-46728 URL: https://issues.apache.org/jira/browse/SPARK-46728 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46677) Fix `df.col("*")` resolution

[ https://issues.apache.org/jira/browse/SPARK-46677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46677. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44689

[jira] [Updated] (SPARK-44571) Eliminate the Join by combine multiple Aggregates

[ https://issues.apache.org/jira/browse/SPARK-44571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44571: --- Labels: pull-request-available (was: ) > Eliminate the Join by combine multiple Aggregates

[jira] [Updated] (SPARK-43221) Executor obtained error information

[ https://issues.apache.org/jira/browse/SPARK-43221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43221: --- Labels: pull-request-available (was: ) > Executor obtained error information >

[jira] [Assigned] (SPARK-46723) Make addArtifact retrying on errors

[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46723: Assignee: Alice Sayutina > Make addArtifact retrying on errors >

[jira] [Resolved] (SPARK-46723) Make addArtifact retrying on errors

[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44740

[jira] [Assigned] (SPARK-46717) Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread

[ https://issues.apache.org/jira/browse/SPARK-46717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46717: - Assignee: Jiaan Geng > Simplify the ReloadingX509TrustManager by the exit operation

[jira] [Resolved] (SPARK-46717) Simplify the ReloadingX509TrustManager by the exit operation only depend on interrupt thread

[ https://issues.apache.org/jira/browse/SPARK-46717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46717. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44720

[jira] [Assigned] (SPARK-46724) Update tuning.md to use java 17 docs

[ https://issues.apache.org/jira/browse/SPARK-46724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46724: - Assignee: Kent Yao > Update tuning.md to use java 17 docs >

[jira] [Resolved] (SPARK-46724) Update tuning.md to use java 17 docs

[ https://issues.apache.org/jira/browse/SPARK-46724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46724. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44737

[jira] [Resolved] (SPARK-46094) Support Executor JVM Profiling

[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46094. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44021

[jira] [Updated] (SPARK-46094) Support Executor JVM Profiling

[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46094: -- Summary: Support Executor JVM Profiling (was: Add support for code profiling executors) >

[jira] [Assigned] (SPARK-46094) Support Executor JVM Profiling

[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46094: - Assignee: Parth Chandra > Support Executor JVM Profiling >

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806954#comment-17806954 ] Nicholas Chammas commented on SPARK-45599: -- Using

[jira] [Commented] (SPARK-46702) Spark Cluster Crashing

[ https://issues.apache.org/jira/browse/SPARK-46702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806953#comment-17806953 ] Mohamad Haidar commented on SPARK-46702: [~dongjoon] [~dongjoon] , would you please help on

[jira] [Created] (SPARK-46727) Port classifyException() in JDBC dialects on error classes

Max Gekk created SPARK-46727: Summary: Port classifyException() in JDBC dialects on error classes Key: SPARK-46727 URL: https://issues.apache.org/jira/browse/SPARK-46727 Project: Spark Issue

[jira] [Assigned] (SPARK-46726) Rebalance `pyspark_pandas_connect_part?`

[ https://issues.apache.org/jira/browse/SPARK-46726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46726: - Assignee: Ruifeng Zheng > Rebalance `pyspark_pandas_connect_part?` >

[jira] [Resolved] (SPARK-46726) Rebalance `pyspark_pandas_connect_part?`

[ https://issues.apache.org/jira/browse/SPARK-46726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46726. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44741

[jira] [Resolved] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46720. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44734

[jira] [Assigned] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46720: Assignee: Hyukjin Kwon > Refactor Python Data Source to align with other built-in Data

[jira] [Updated] (SPARK-46726) Rebalance `pyspark_pandas_connect_part?`

[ https://issues.apache.org/jira/browse/SPARK-46726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46726: --- Labels: pull-request-available (was: ) > Rebalance `pyspark_pandas_connect_part?` >

[jira] [Created] (SPARK-46726) Rebalance `pyspark_pandas_connect_part?`

Ruifeng Zheng created SPARK-46726: - Summary: Rebalance `pyspark_pandas_connect_part?` Key: SPARK-46726 URL: https://issues.apache.org/jira/browse/SPARK-46726 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46725) Add DAYNAME function

[ https://issues.apache.org/jira/browse/SPARK-46725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-46725: -- Description: Add function DAYNAME which returns three-letter abbreviation of a given

[jira] [Updated] (SPARK-46723) Make addArtifact retrying on errors

[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46723: --- Labels: pull-request-available (was: ) > Make addArtifact retrying on errors >

[jira] [Commented] (SPARK-46715) Pin `sphinxcontrib-*`

[ https://issues.apache.org/jira/browse/SPARK-46715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806754#comment-17806754 ] Bobby Wang commented on SPARK-46715: Hi [~podongfeng], I run into the same issue for the PR

[jira] [Updated] (SPARK-46724) Update tuning.md to use java 17 docs

[ https://issues.apache.org/jira/browse/SPARK-46724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46724: --- Labels: pull-request-available (was: ) > Update tuning.md to use java 17 docs >

[jira] [Created] (SPARK-46724) Update tuning.md to use java 17 docs

Kent Yao created SPARK-46724: Summary: Update tuning.md to use java 17 docs Key: SPARK-46724 URL: https://issues.apache.org/jira/browse/SPARK-46724 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46723) Make addArtifact retrying on errors

Alice Sayutina created SPARK-46723: -- Summary: Make addArtifact retrying on errors Key: SPARK-46723 URL: https://issues.apache.org/jira/browse/SPARK-46723 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46722) Add a test regarding to backward compatibility check for StreamingQueryListener in Spark Connect (Scala/PySpark)

[ https://issues.apache.org/jira/browse/SPARK-46722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46722: --- Labels: pull-request-available (was: ) > Add a test regarding to backward compatibility

[jira] [Assigned] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46720: -- Assignee: (was: Apache Spark) > Refactor Python Data Source to align with other

[jira] [Assigned] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46720: -- Assignee: Apache Spark > Refactor Python Data Source to align with other built-in

[jira] [Created] (SPARK-46722) Add a test regarding to backward compatibility check for StreamingQueryListener in Spark Connect (Scala/PySpark)

Jungtaek Lim created SPARK-46722: Summary: Add a test regarding to backward compatibility check for StreamingQueryListener in Spark Connect (Scala/PySpark) Key: SPARK-46722 URL:

[jira] [Assigned] (SPARK-46721) Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5

[ https://issues.apache.org/jira/browse/SPARK-46721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46721: -- Assignee: (was: Apache Spark) > Some tests failed when cherry-picking >

[jira] [Assigned] (SPARK-46721) Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5

[ https://issues.apache.org/jira/browse/SPARK-46721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46721: -- Assignee: Apache Spark > Some tests failed when cherry-picking >

[jira] [Updated] (SPARK-46721) Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5

[ https://issues.apache.org/jira/browse/SPARK-46721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46721: --- Labels: pull-request-available (was: ) > Some tests failed when cherry-picking >

[jira] [Created] (SPARK-46721) Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5

Bobby Wang created SPARK-46721: -- Summary: Some tests failed when cherry-picking https://github.com/apache/spark/pull/43494 back to branch 3.5 Key: SPARK-46721 URL: https://issues.apache.org/jira/browse/SPARK-46721

[jira] [Assigned] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46660: Assignee: Venkata Sai Akhil Gudesa > ReattachExecute requests do not refresh aliveness

[jira] [Resolved] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46660. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44670

[jira] [Updated] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46720: - Summary: Refactor Python Data Source to align with other built-in Data Sources (was: Refactor

[jira] [Updated] (SPARK-46720) Refactor Python Data Source to aline with other built-in Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46720: --- Labels: pull-request-available (was: ) > Refactor Python Data Source to aline with other