[jira] [Resolved] (SPARK-49901) Upgrade dropwizard metrics to 4.2.28

[ https://issues.apache.org/jira/browse/SPARK-49901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49901. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48377 [https://

[jira] [Updated] (SPARK-49903) Upgrade `Parquet` to 1.14.3

[ https://issues.apache.org/jira/browse/SPARK-49903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49903: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade `Parquet` to 1.

[jira] [Resolved] (SPARK-49903) Upgrade `Parquet` to 1.14.3

[ https://issues.apache.org/jira/browse/SPARK-49903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49903. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48378 [https://

[jira] [Resolved] (SPARK-49896) Drop K8s v1.28 Support

[ https://issues.apache.org/jira/browse/SPARK-49896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49896. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48371 [https://

[jira] [Assigned] (SPARK-49896) Drop K8s v1.28 Support

[ https://issues.apache.org/jira/browse/SPARK-49896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49896: - Assignee: Dongjoon Hyun > Drop K8s v1.28 Support > -- > >

[jira] [Created] (SPARK-49896) Drop K8s v1.28 Support

Dongjoon Hyun created SPARK-49896: - Summary: Drop K8s v1.28 Support Key: SPARK-49896 URL: https://issues.apache.org/jira/browse/SPARK-49896 Project: Spark Issue Type: Sub-task Compo

[jira] [Updated] (SPARK-49651) Add MacOS 15 to the build_and_test pipeline

[ https://issues.apache.org/jira/browse/SPARK-49651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49651: -- Parent: (was: SPARK-45923) Issue Type: Test (was: Sub-task) > Add MacOS 15 to the

[jira] [Updated] (SPARK-49528) Document SparkCluster spec fields that would be overwritten by Spark

[ https://issues.apache.org/jira/browse/SPARK-49528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49528: -- Parent: (was: SPARK-45923) Issue Type: Documentation (was: Sub-task) > Document S

[jira] [Updated] (SPARK-49726) Enable SentinelManager in E2E Test

[ https://issues.apache.org/jira/browse/SPARK-49726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49726: -- Parent: (was: SPARK-45923) Issue Type: Test (was: Sub-task) > Enable SentinelMana

[jira] [Resolved] (SPARK-49464) Add docs for operator

[ https://issues.apache.org/jira/browse/SPARK-49464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49464. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49888) Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

[ https://issues.apache.org/jira/browse/SPARK-49888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49888. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49888) Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

[ https://issues.apache.org/jira/browse/SPARK-49888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49888: - Assignee: Dongjoon Hyun > Use `registry.k8s.io/pause:3.9` to avoid failure deterministi

[jira] [Assigned] (SPARK-49887) Update `cluster-with-template.yaml` example with pod annotation

[ https://issues.apache.org/jira/browse/SPARK-49887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49887: - Assignee: Dongjoon Hyun > Update `cluster-with-template.yaml` example with pod annotati

[jira] [Resolved] (SPARK-49887) Update `cluster-with-template.yaml` example with pod annotation

[ https://issues.apache.org/jira/browse/SPARK-49887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49887. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49888) Use `registry.k8s.io/pause:3.9` to avoid failure deterministically

Dongjoon Hyun created SPARK-49888: - Summary: Use `registry.k8s.io/pause:3.9` to avoid failure deterministically Key: SPARK-49888 URL: https://issues.apache.org/jira/browse/SPARK-49888 Project: Spark

[jira] [Created] (SPARK-49887) Update `cluster-with-template.yaml` example with pod annotation

Dongjoon Hyun created SPARK-49887: - Summary: Update `cluster-with-template.yaml` example with pod annotation Key: SPARK-49887 URL: https://issues.apache.org/jira/browse/SPARK-49887 Project: Spark

[jira] [Assigned] (SPARK-49879) Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file`

[ https://issues.apache.org/jira/browse/SPARK-49879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49879: - Assignee: Yang Jie > Fix compilation warnings related to `auxiliary class TransportCiph

[jira] [Resolved] (SPARK-49879) Fix compilation warnings related to `auxiliary class TransportCipherUtil in TransportCipher.java should not be accessed from outside its own source file`

[ https://issues.apache.org/jira/browse/SPARK-49879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49879. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48352 [https://

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.1` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Description: Although SPARK-48710 fixed to use NumPy 2.0 compatible types. Python 3.13 requir

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.1` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Summary: Handle or document `NumPy 2.1` difference in Python 3.13 (was: Handle or document `N

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.1` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Description: Although SPARK-48710 fixed to use NumPy 2.0 compatible types. Python 3.13 requir

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.x` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Description: Although SPARK-48710 fixed to use NumPy 2.0 compatible types. Python 3.13 with

[jira] [Updated] (SPARK-49882) Handle or document `NumPy 2.x` difference in Python 3.13

[ https://issues.apache.org/jira/browse/SPARK-49882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49882: -- Summary: Handle or document `NumPy 2.x` difference in Python 3.13 (was: Handle or document `N

[jira] [Created] (SPARK-49882) Handle or document `NumPy 2.x` difference

Dongjoon Hyun created SPARK-49882: - Summary: Handle or document `NumPy 2.x` difference Key: SPARK-49882 URL: https://issues.apache.org/jira/browse/SPARK-49882 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-47702) Shuffle service endpoint is not removed from the locations list when RDD block is removed form a node.

[ https://issues.apache.org/jira/browse/SPARK-47702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47702: -- Fix Version/s: (was: 3.5.4) > Shuffle service endpoint is not removed from the locations l

[jira] [Resolved] (SPARK-49806) Remove redundant `blank space` after 'show' in `Scala` and `Connect` clients

[ https://issues.apache.org/jira/browse/SPARK-49806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49806. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48277 [https://

[jira] [Resolved] (SPARK-49868) ExecutorFailureTracker sometimes miss failed executors on k8s

[ https://issues.apache.org/jira/browse/SPARK-49868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49868. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48344 [https://

[jira] [Updated] (SPARK-49868) ExecutorFailureTracker sometimes miss failed executors on k8s

[ https://issues.apache.org/jira/browse/SPARK-49868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49868: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > ExecutorFailureTracker sometime

[jira] [Created] (SPARK-49871) Deflaky `(Ssl)CoarseGrainedExecutorBackendSuite` to reduce test resource and increase timeout

Dongjoon Hyun created SPARK-49871: - Summary: Deflaky `(Ssl)CoarseGrainedExecutorBackendSuite` to reduce test resource and increase timeout Key: SPARK-49871 URL: https://issues.apache.org/jira/browse/SPARK-49871

[jira] [Updated] (SPARK-49870) Support Python 3.13 in Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-49870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49870: -- Summary: Support Python 3.13 in Spark Classic (was: Add Python 3.13 support in Spark Classic)

[jira] [Updated] (SPARK-49870) Add Python 3.13 support in Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-49870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49870: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Add Python 3.13 support

[jira] [Assigned] (SPARK-49870) Add Python 3.13 support in Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-49870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49870: - Assignee: Hyukjin Kwon > Add Python 3.13 support in Spark Classic > ---

[jira] [Resolved] (SPARK-49870) Add Python 3.13 support in Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-49870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49870. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48343 [https://

[jira] [Assigned] (SPARK-49869) Add NumPy in Python 3.13 image

[ https://issues.apache.org/jira/browse/SPARK-49869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49869: - Assignee: Hyukjin Kwon > Add NumPy in Python 3.13 image > -

[jira] [Resolved] (SPARK-49869) Add NumPy in Python 3.13 image

[ https://issues.apache.org/jira/browse/SPARK-49869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49869. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48342 [https://

[jira] [Resolved] (SPARK-49861) Add `Python 3.13` to Infra docker image

[ https://issues.apache.org/jira/browse/SPARK-49861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49861. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48330 [https://

[jira] [Updated] (SPARK-44111) Prepare Apache Spark 4.0.0

[ https://issues.apache.org/jira/browse/SPARK-44111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44111: -- Description: For now, this issue aims to collect ideas for planning Apache Spark 4.0.0. We wi

[jira] [Updated] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46645: -- Parent: SPARK-45981 Issue Type: Sub-task (was: Test) > Exclude unittest-xml-reporting

[jira] [Created] (SPARK-49862) Add BASIC_PIP_PKGS and CONNECT_PIP_PKGS to Python 3.13 image when it supports Python 3.13

Dongjoon Hyun created SPARK-49862: - Summary: Add BASIC_PIP_PKGS and CONNECT_PIP_PKGS to Python 3.13 image when it supports Python 3.13 Key: SPARK-49862 URL: https://issues.apache.org/jira/browse/SPARK-49862

[jira] [Updated] (SPARK-49861) Add `Python 3.13` to Infra docker image

[ https://issues.apache.org/jira/browse/SPARK-49861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49861: -- Component/s: Tests > Add `Python 3.13` to Infra docker image > ---

[jira] [Created] (SPARK-49861) Add `Python 3.13` to Infra docker image

Dongjoon Hyun created SPARK-49861: - Summary: Add `Python 3.13` to Infra docker image Key: SPARK-49861 URL: https://issues.apache.org/jira/browse/SPARK-49861 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-46647) Add unittest-xml-reporting into Python 3.12 image

[ https://issues.apache.org/jira/browse/SPARK-46647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46647: -- Parent: SPARK-45981 Issue Type: Sub-task (was: Test) > Add unittest-xml-reporting int

[jira] [Resolved] (SPARK-49853) Increase test timeout of PythonForeachWriterSuite to 60s

[ https://issues.apache.org/jira/browse/SPARK-49853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49853. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48319 [https://

[jira] [Assigned] (SPARK-49853) Increase test timeout of PythonForeachWriterSuite to 60s

[ https://issues.apache.org/jira/browse/SPARK-49853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49853: - Assignee: Dongjoon Hyun > Increase test timeout of PythonForeachWriterSuite to 60s > --

[jira] [Created] (SPARK-49860) Add `Python 3.13` Daily Python Github Action job

Dongjoon Hyun created SPARK-49860: - Summary: Add `Python 3.13` Daily Python Github Action job Key: SPARK-49860 URL: https://issues.apache.org/jira/browse/SPARK-49860 Project: Spark Issue Type

[jira] [Updated] (SPARK-45472) RocksDB State Store Doesn't Need to Recheck checkpoint path existence

[ https://issues.apache.org/jira/browse/SPARK-45472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45472: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > RocksDB State Store Doesn't Ne

[jira] [Updated] (SPARK-48931) Reduce Cloud Store List API cost for state store maintenance task

[ https://issues.apache.org/jira/browse/SPARK-48931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48931: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Reduce Cloud Store List

[jira] [Created] (SPARK-49853) Increase test timeout of PythonForeachWriterSuite

Dongjoon Hyun created SPARK-49853: - Summary: Increase test timeout of PythonForeachWriterSuite Key: SPARK-49853 URL: https://issues.apache.org/jira/browse/SPARK-49853 Project: Spark Issue Typ

[jira] [Updated] (SPARK-49853) Increase test timeout of PythonForeachWriterSuite to 60s

[ https://issues.apache.org/jira/browse/SPARK-49853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49853: -- Summary: Increase test timeout of PythonForeachWriterSuite to 60s (was: Increase test timeout

[jira] [Updated] (SPARK-47866) Deflaky PythonForeachWriterSuite

[ https://issues.apache.org/jira/browse/SPARK-47866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47866: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Deflaky PythonForeachWriterSuit

[jira] [Updated] (SPARK-44707) Use INFO log in ExecutorPodsWatcher.onClose if SparkContext is stopped

[ https://issues.apache.org/jira/browse/SPARK-44707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44707: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Improvement) > Use INFO log in Executo

[jira] [Updated] (SPARK-44115) Upgrade ORC to 2.0

[ https://issues.apache.org/jira/browse/SPARK-44115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44115: -- Summary: Upgrade ORC to 2.0 (was: Upgrade Apache ORC to 2.0) > Upgrade ORC to 2.0 > -

[jira] [Updated] (SPARK-46998) The SQL config spark.sql.legacy.allowZeroIndexInFormatString doesn't work

[ https://issues.apache.org/jira/browse/SPARK-46998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46998: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > The SQL config spark.sql.legacy

[jira] [Updated] (SPARK-46998) Deprecate `spark.sql.legacy.allowZeroIndexInFormatString`

[ https://issues.apache.org/jira/browse/SPARK-46998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46998: -- Summary: Deprecate `spark.sql.legacy.allowZeroIndexInFormatString` (was: The SQL config spark

[jira] [Updated] (SPARK-44996) VolcanoFeatureStep should not create `DefaultVolcanoClient` if not needed

[ https://issues.apache.org/jira/browse/SPARK-44996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44996: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Improvement) > VolcanoFeatureStep shou

[jira] [Updated] (SPARK-45407) Skip Unidoc in SparkR GitHub Action Job

[ https://issues.apache.org/jira/browse/SPARK-45407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45407: -- Parent: SPARK-48094 Issue Type: Sub-task (was: Test) > Skip Unidoc in SparkR GitHub A

[jira] [Updated] (SPARK-45010) Limit GHA job execution time to up to 5 hours in build_and_test.yml

[ https://issues.apache.org/jira/browse/SPARK-45010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45010: -- Parent: SPARK-48094 Issue Type: Sub-task (was: Task) > Limit GHA job execution time t

[jira] [Updated] (SPARK-44995) Promote SparkKubernetesClientFactory to DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-44995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44995: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Improvement) > Promote SparkKubernetes

[jira] [Updated] (SPARK-44993) Add ShuffleChecksumUtils.compareChecksums by reusing ShuffleChecksumTestHelp.compareChecksums

[ https://issues.apache.org/jira/browse/SPARK-44993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44993: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Improvement) > Add ShuffleChecksumUtil

[jira] [Updated] (SPARK-44936) Simplify the log when Spark HybridStore hits the memory limit

[ https://issues.apache.org/jira/browse/SPARK-44936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44936: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Improvement) > Simplify the log when S

[jira] [Updated] (SPARK-44925) K8s default service token file should not be materialized into token

[ https://issues.apache.org/jira/browse/SPARK-44925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44925: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > K8s default service token file

[jira] [Updated] (SPARK-44745) Document shuffle data recovery from the remounted K8s PVCs

[ https://issues.apache.org/jira/browse/SPARK-44745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44745: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Documentation) > Document shuffle data

[jira] [Updated] (SPARK-44821) Upgrade `kubernetes-client` to 6.8.1

[ https://issues.apache.org/jira/browse/SPARK-44821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44821: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Dependency upgrade) > Upgrade `kuberne

[jira] [Updated] (SPARK-44725) Document spark.network.timeoutInterval

[ https://issues.apache.org/jira/browse/SPARK-44725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44725: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Documentation) > Document spark.networ

[jira] [Updated] (SPARK-45145) Add JavaSparkSQLCli example

[ https://issues.apache.org/jira/browse/SPARK-45145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45145: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Improvement) > Add JavaSparkSQLCli exa

[jira] [Updated] (SPARK-47875) Remove `spark.deploy.recoverySerializer`

[ https://issues.apache.org/jira/browse/SPARK-47875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47875: -- Parent: (was: SPARK-45869) Issue Type: Task (was: Sub-task) > Remove `spark.deplo

[jira] [Updated] (SPARK-45462) Show `Duration` in `ApplicationPage`

[ https://issues.apache.org/jira/browse/SPARK-45462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45462: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Improvement) > Show `Duration` in `App

[jira] [Updated] (SPARK-45587) Skip UNIDOC and MIMA in build GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-45587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45587: -- Parent: SPARK-48094 Issue Type: Sub-task (was: Improvement) > Skip UNIDOC and MIMA in

[jira] [Updated] (SPARK-45741) Upgrade Netty to 4.1.100.Final

[ https://issues.apache.org/jira/browse/SPARK-45741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45741: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Bug) > Upgrade Netty to 4.1.100.Final

[jira] [Updated] (SPARK-46735) `pyspark.sql.tests.test_group` should skip Pandas/PyArrow tests if not available

[ https://issues.apache.org/jira/browse/SPARK-46735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46735: -- Parent: SPARK-45981 Issue Type: Sub-task (was: Test) > `pyspark.sql.tests.test_group`

[jira] [Updated] (SPARK-45978) Skip unidoc step in docker-integration-tests GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-45978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45978: -- Parent: SPARK-48094 Issue Type: Sub-task (was: Task) > Skip unidoc step in docker-int

[jira] [Updated] (SPARK-46435) Exclude `branch-3.3` from `publish_snapshot.yml`

[ https://issues.apache.org/jira/browse/SPARK-46435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46435: -- Parent: SPARK-48094 Issue Type: Sub-task (was: Task) > Exclude `branch-3.3` from `pub

[jira] [Updated] (SPARK-46570) Run Python 3.11 and 3.12 test independently

[ https://issues.apache.org/jira/browse/SPARK-46570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46570: -- Parent: SPARK-45981 Issue Type: Sub-task (was: Test) > Run Python 3.11 and 3.12 test

[jira] [Updated] (SPARK-46657) Install `lxml` in Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-46657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46657: -- Parent: SPARK-45981 Issue Type: Sub-task (was: Bug) > Install `lxml` in Python 3.12 >

[jira] [Updated] (SPARK-46316) Enable `buf-lint-action` on `core` module

[ https://issues.apache.org/jira/browse/SPARK-46316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46316: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Enable `buf-lint-action` on `c

[jira] [Updated] (SPARK-46786) Fix MountVolumesFeatureStep to use ReadWriteOncePod instead of ReadWriteOnce

[ https://issues.apache.org/jira/browse/SPARK-46786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46786: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > Fix MountVolumesFeatureStep to

[jira] [Updated] (SPARK-46628) Use SPDX short identifier in `licenses` name

[ https://issues.apache.org/jira/browse/SPARK-46628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46628: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Use SPDX short identifier in `

[jira] [Updated] (SPARK-46780) Improve SBT K8s IT to skip R image build step if not needed

[ https://issues.apache.org/jira/browse/SPARK-46780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46780: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Test) > Improve SBT K8s IT to skip R i

[jira] [Updated] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46945: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > Add `spark.kubernetes.legacy.us

[jira] [Updated] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day

[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47535: -- Parent: SPARK-48094 Issue Type: Sub-task (was: Task) > Update `publish_snapshot.yml`

[jira] [Updated] (SPARK-48046) Remove `clock` parameter from `DriverServiceFeatureStep`

[ https://issues.apache.org/jira/browse/SPARK-48046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48046: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Task) > Remove `clock` parameter from

[jira] [Updated] (SPARK-48855) Make ExecutorPodsAllocatorSuite independent from default allocation batch size

[ https://issues.apache.org/jira/browse/SPARK-48855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48855: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Test) > Make ExecutorPodsAllocatorSuit

[jira] [Updated] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

[ https://issues.apache.org/jira/browse/SPARK-49381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49381: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix `SPARK-41388` test case to

[jira] [Updated] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

[ https://issues.apache.org/jira/browse/SPARK-49385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49385: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > Fix `getReusablePVCs` to use `p

[jira] [Updated] (SPARK-49347) Deprecate SaprkR

[ https://issues.apache.org/jira/browse/SPARK-49347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49347: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Deprecate SaprkR > ---

[jira] [Updated] (SPARK-49732) Spark deamons should respect spark.log.structuredLogging.enabled conf

[ https://issues.apache.org/jira/browse/SPARK-49732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49732: -- Parent Issue: SPARK-45869 (was: SPARK-44111) > Spark deamons should respect spark.log.structu

[jira] [Resolved] (SPARK-49845) Make `appArgs` and `environmentVariables` optional in REST API

[ https://issues.apache.org/jira/browse/SPARK-49845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49845. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48316 [https://

[jira] [Created] (SPARK-49845) Make `appArgs` and `environmentVariables` optional in REST API

Dongjoon Hyun created SPARK-49845: - Summary: Make `appArgs` and `environmentVariables` optional in REST API Key: SPARK-49845 URL: https://issues.apache.org/jira/browse/SPARK-49845 Project: Spark

[jira] [Resolved] (SPARK-49795) Clean up deprecated Guava API usage

[ https://issues.apache.org/jira/browse/SPARK-49795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49795. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48248 [https://

[jira] [Updated] (SPARK-48826) Upgrade `fasterxml.jackson` to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-48826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48826: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `fasterxml.jack

[jira] [Updated] (SPARK-48826) Upgrade jackson to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-48826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48826: -- Summary: Upgrade jackson to 2.17.2 (was: Upgrade `fasterxml.jackson` to 2.17.2) > Upgrade ja

[jira] [Resolved] (SPARK-49826) Upgrade jackson to 2.18.0

[ https://issues.apache.org/jira/browse/SPARK-49826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49826. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48294 [https://

[jira] [Updated] (SPARK-49816) should only update out-going-ref-count for referenced outer CTE relation

[ https://issues.apache.org/jira/browse/SPARK-49816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49816: -- Fix Version/s: 3.5.4 > should only update out-going-ref-count for referenced outer CTE relatio

[jira] [Commented] (SPARK-49816) should only update out-going-ref-count for referenced outer CTE relation

[ https://issues.apache.org/jira/browse/SPARK-49816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17886073#comment-17886073 ] Dongjoon Hyun commented on SPARK-49816: --- This is backported to branch-3.5 via http

[jira] [Resolved] (SPARK-49840) Use `MacOS 15` in `build_maven_java21_macos14.yml`

[ https://issues.apache.org/jira/browse/SPARK-49840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49840. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48305 [https://

[jira] [Assigned] (SPARK-49732) Spark deamons should respect spark.log.structuredLogging.enabled conf

[ https://issues.apache.org/jira/browse/SPARK-49732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49732: - Assignee: Cheng Pan > Spark deamons should respect spark.log.structuredLogging.enabled

[jira] [Updated] (SPARK-49834) SPIP: Single-pass Analyzer for Catalyst

[ https://issues.apache.org/jira/browse/SPARK-49834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49834: -- Target Version/s: (was: 4.0.0) > SPIP: Single-pass Analyzer for Catalyst > -

[jira] [Commented] (SPARK-49834) SPIP: Single-pass Analyzer for Catalyst

[ https://issues.apache.org/jira/browse/SPARK-49834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17886037#comment-17886037 ] Dongjoon Hyun commented on SPARK-49834: --- I removed the Target Version of this SPIP

[jira] [Resolved] (SPARK-49732) Spark deamons should respect spark.log.structuredLogging.enabled conf

[ https://issues.apache.org/jira/browse/SPARK-49732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49732. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48198 [https://

[jira] [Updated] (SPARK-49732) Spark deamons should respect spark.log.structuredLogging.enabled conf

[ https://issues.apache.org/jira/browse/SPARK-49732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49732: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Spark deamons should respect sp

  1   2   3   4   5   6   7   8   9   10   >