[jira] [Assigned] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

2023-11-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45730: --- Assignee: Hasnain Lakhani > [CORE] Make ReloadingX509TrustManagerSuite

[jira] [Resolved] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

2023-11-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45730. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-45556) Inconsistent status code between web page and REST API when exception is thrown

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45556: --- Labels: pull-request-available (was: ) > Inconsistent status code between web page and

[jira] [Updated] (SPARK-45777) Support `spark.test.appId` in `LocalSchedulerBackend`

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45777: --- Labels: pull-request-available (was: ) > Support `spark.test.appId` in

[jira] [Created] (SPARK-45777) Support `spark.test.appId` in `LocalSchedulerBackend`

2023-11-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45777: - Summary: Support `spark.test.appId` in `LocalSchedulerBackend` Key: SPARK-45777 URL: https://issues.apache.org/jira/browse/SPARK-45777 Project: Spark

[jira] [Updated] (SPARK-45776) Remove the defensive null check added in SPARK-39553.

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45776: --- Labels: pull-request-available (was: ) > Remove the defensive null check added in

[jira] [Assigned] (SPARK-45774) Support `spark.ui.historyServerUrl` in ApplicationPage

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45774: - Assignee: Dongjoon Hyun > Support `spark.ui.historyServerUrl` in ApplicationPage >

[jira] [Updated] (SPARK-45774) Support `spark.ui.historyServerUrl` in `ApplicationPage`

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45774: -- Summary: Support `spark.ui.historyServerUrl` in `ApplicationPage` (was: Support

[jira] [Updated] (SPARK-45776) Remove the defensive null check added in SPARK-39553.

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45776: - Description: {code:java} def unregisterShuffle(shuffleId: Int): Unit = {    

[jira] [Updated] (SPARK-45776) Remove the defensive null check added in SPARK-39553.

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45776: - Environment: (was: {code:java} def unregisterShuffle(shuffleId: Int): Unit = {    

[jira] [Created] (SPARK-45776) Remove the defensive null check added in SPARK-39553.

2023-11-02 Thread Yang Jie (Jira)
Yang Jie created SPARK-45776: Summary: Remove the defensive null check added in SPARK-39553. Key: SPARK-45776 URL: https://issues.apache.org/jira/browse/SPARK-45776 Project: Spark Issue Type:

[jira] [Created] (SPARK-45775) Drop table skiped when CatalogV2Util loadTable meet unexpected Exception

2023-11-02 Thread konwu (Jira)
konwu created SPARK-45775: - Summary: Drop table skiped when CatalogV2Util loadTable meet unexpected Exception Key: SPARK-45775 URL: https://issues.apache.org/jira/browse/SPARK-45775 Project: Spark

[jira] [Updated] (SPARK-45774) Support `spark.ui.historyServerUrl` in ApplicationPage

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45774: --- Labels: pull-request-available (was: ) > Support `spark.ui.historyServerUrl` in

[jira] [Created] (SPARK-45774) Support `spark.ui.historyServerUrl` in ApplicationPage

2023-11-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45774: - Summary: Support `spark.ui.historyServerUrl` in ApplicationPage Key: SPARK-45774 URL: https://issues.apache.org/jira/browse/SPARK-45774 Project: Spark

[jira] [Resolved] (SPARK-45695) Fix `method force in trait View is deprecated`

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45695. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43637

[jira] [Assigned] (SPARK-45694) Fix `method signum in trait ScalaNumberProxy is deprecated`

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45694: Assignee: Tengfei Huang > Fix `method signum in trait ScalaNumberProxy is deprecated` >

[jira] [Resolved] (SPARK-45694) Fix `method signum in trait ScalaNumberProxy is deprecated`

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45694. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43637

[jira] [Updated] (SPARK-45687) Fix `Passing an explicit array value to a Scala varargs method is deprecated`

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45687: --- Labels: pull-request-available (was: ) > Fix `Passing an explicit array value to a Scala

[jira] [Resolved] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

2023-11-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45768. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43635

[jira] [Assigned] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

2023-11-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45768: Assignee: Hyukjin Kwon > Make faulthandler a runtime configuration for Python execution

[jira] [Updated] (SPARK-44065) Optimize BroadcastHashJoin skew when localShuffleReader is disabled

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44065: --- Labels: pull-request-available (was: ) > Optimize BroadcastHashJoin skew when

[jira] [Updated] (SPARK-44517) first operator should respect the nullability of child expression as well as ignoreNulls option

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44517: --- Labels: pull-request-available (was: ) > first operator should respect the nullability of

[jira] [Updated] (SPARK-4836) Web UI should display separate information for all stage attempts

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-4836: -- Labels: bulk-closed pull-request-available (was: bulk-closed) > Web UI should display

[jira] [Reopened] (SPARK-4836) Web UI should display separate information for all stage attempts

2023-11-02 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-4836: --- > Web UI should display separate information for all stage attempts >

[jira] [Updated] (SPARK-45773) Refine docstring of `SparkSession.builder.config`

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45773: --- Labels: pull-request-available (was: ) > Refine docstring of `SparkSession.builder.config`

[jira] [Created] (SPARK-45773) Refine docstring of `SparkSession.builder.config`

2023-11-02 Thread Allison Wang (Jira)
Allison Wang created SPARK-45773: Summary: Refine docstring of `SparkSession.builder.config` Key: SPARK-45773 URL: https://issues.apache.org/jira/browse/SPARK-45773 Project: Spark Issue

[jira] [Assigned] (SPARK-45757) Avoid re-computation of NNZ in Binarizer

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45757: - Assignee: Ruifeng Zheng > Avoid re-computation of NNZ in Binarizer >

[jira] [Resolved] (SPARK-45757) Avoid re-computation of NNZ in Binarizer

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45757. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43619

[jira] [Resolved] (SPARK-45718) Remove remaining deprecated Pandas APIs from Spark 3.4.0

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45718. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43581

[jira] [Assigned] (SPARK-45718) Remove remaining deprecated Pandas APIs from Spark 3.4.0

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45718: - Assignee: Haejoon Lee > Remove remaining deprecated Pandas APIs from Spark 3.4.0 >

[jira] [Assigned] (SPARK-45771) Enable spark.eventLog.rolling.enabled by default

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45771: - Assignee: Dongjoon Hyun > Enable spark.eventLog.rolling.enabled by default >

[jira] [Resolved] (SPARK-45771) Enable spark.eventLog.rolling.enabled by default

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45771. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43638

[jira] [Updated] (SPARK-45772) Add additional test coverage for input_file_name() expr + Python UDFs

2023-11-02 Thread Utkarsh Agarwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-45772: Summary: Add additional test coverage for input_file_name() expr + Python UDFs (was: Add

[jira] [Created] (SPARK-45772) Add additional test coverage for input_file_name_expr

2023-11-02 Thread Utkarsh Agarwal (Jira)
Utkarsh Agarwal created SPARK-45772: --- Summary: Add additional test coverage for input_file_name_expr Key: SPARK-45772 URL: https://issues.apache.org/jira/browse/SPARK-45772 Project: Spark

[jira] [Updated] (SPARK-45771) Enable spark.eventLog.rolling.enabled by default

2023-11-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45771: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Enable

[jira] [Updated] (SPARK-45771) Enable spark.eventLog.rolling.enabled by default

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45771: --- Labels: pull-request-available (was: ) > Enable spark.eventLog.rolling.enabled by default

[jira] [Created] (SPARK-45771) Enable spark.eventLog.rolling.enabled by default

2023-11-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45771: - Summary: Enable spark.eventLog.rolling.enabled by default Key: SPARK-45771 URL: https://issues.apache.org/jira/browse/SPARK-45771 Project: Spark Issue

[jira] [Resolved] (SPARK-45767) Delete `TimeStampedHashMap` and its UT

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45767. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43633

[jira] [Assigned] (SPARK-45767) Delete `TimeStampedHashMap` and its UT

2023-11-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45767: Assignee: BingKun Pan > Delete `TimeStampedHashMap` and its UT >

[jira] [Updated] (SPARK-45694) Fix `method signum in trait ScalaNumberProxy is deprecated`

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45694: --- Labels: pull-request-available (was: ) > Fix `method signum in trait ScalaNumberProxy is

[jira] [Updated] (SPARK-45770) Fix column resolution in DataFrame.drop

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45770: --- Labels: pull-request-available (was: ) > Fix column resolution in DataFrame.drop >

[jira] [Updated] (SPARK-41454) Support Python 3.11

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41454: --- Labels: pull-request-available (was: ) > Support Python 3.11 > --- > >

[jira] [Created] (SPARK-45769) data retrieval fails on executors with spark connect

2023-11-02 Thread Steven Ottens (Jira)
Steven Ottens created SPARK-45769: - Summary: data retrieval fails on executors with spark connect Key: SPARK-45769 URL: https://issues.apache.org/jira/browse/SPARK-45769 Project: Spark Issue

[jira] [Updated] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

2023-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45768: --- Labels: pull-request-available (was: ) > Make faulthandler a runtime configuration for

[jira] [Updated] (SPARK-45768) Make faulthandler a runtime configuration for Python execution in SQL

2023-11-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45768: - Summary: Make faulthandler a runtime configuration for Python execution in SQL (was: Make

[jira] [Created] (SPARK-45768) Make faulthanlder a runtime configuration for Python execution in SQL

2023-11-02 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45768: Summary: Make faulthanlder a runtime configuration for Python execution in SQL Key: SPARK-45768 URL: https://issues.apache.org/jira/browse/SPARK-45768 Project: Spark