[jira] [Created] (SPARK-49840) Use `MacOS 15` in `build_maven_java21_macos14.yml`

Dongjoon Hyun created SPARK-49840: - Summary: Use `MacOS 15` in `build_maven_java21_macos14.yml` Key: SPARK-49840 URL: https://issues.apache.org/jira/browse/SPARK-49840 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-49840) Use `MacOS 15` in `build_maven_java21_macos14.yml`

[ https://issues.apache.org/jira/browse/SPARK-49840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49840: - Assignee: Dongjoon Hyun > Use `MacOS 15` in `build_maven_java21_macos14.yml` >

[jira] [Resolved] (SPARK-49833) Support user-defined annotations for OnDemand PVCs

[ https://issues.apache.org/jira/browse/SPARK-49833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49833. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48299 [https://

[jira] [Updated] (SPARK-49829) Issues with optimization on adding input to state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-49829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49829: -- Affects Version/s: 3.4.3 3.4.1 3.4.0

[jira] [Resolved] (SPARK-49838) Add `spark-version` label to `Spark Cluster` resources

[ https://issues.apache.org/jira/browse/SPARK-49838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49838. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-49651) Add MacOS 14 to the build_and_test pipeline

[ https://issues.apache.org/jira/browse/SPARK-49651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885977#comment-17885977 ] Dongjoon Hyun commented on SPARK-49651: --- Sounds good to me. > Add MacOS 14 to the

[jira] [Assigned] (SPARK-49838) Add `spark-version` label to `Spark Cluster` resources

[ https://issues.apache.org/jira/browse/SPARK-49838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49838: - Assignee: Dongjoon Hyun > Add `spark-version` label to `Spark Cluster` resources >

[jira] [Updated] (SPARK-49838) Add `spark-version` label to `Spark Cluster` resources

[ https://issues.apache.org/jira/browse/SPARK-49838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49838: -- Summary: Add `spark-version` label to `Spark Cluster` resources (was: Add `spark-version` lab

[jira] [Created] (SPARK-49838) Add `spark-version` label to all `Spark Cluster` resources

Dongjoon Hyun created SPARK-49838: - Summary: Add `spark-version` label to all `Spark Cluster` resources Key: SPARK-49838 URL: https://issues.apache.org/jira/browse/SPARK-49838 Project: Spark

[jira] [Assigned] (SPARK-49832) Make `o.a.s.k8s.operator.utils.Utils` argument naming consistent

[ https://issues.apache.org/jira/browse/SPARK-49832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49832: - Assignee: Dongjoon Hyun > Make `o.a.s.k8s.operator.utils.Utils` argument naming consist

[jira] [Resolved] (SPARK-49832) Make `o.a.s.k8s.operator.utils.Utils` argument naming consistent

[ https://issues.apache.org/jira/browse/SPARK-49832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49832. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49831) Provide empty `RuntimeVersions` object to `ClusterSpec.runtimeVersions` by default

[ https://issues.apache.org/jira/browse/SPARK-49831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49831. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49832) Make `o.a.s.k8s.operator.utils.Utils` argument naming consistent

Dongjoon Hyun created SPARK-49832: - Summary: Make `o.a.s.k8s.operator.utils.Utils` argument naming consistent Key: SPARK-49832 URL: https://issues.apache.org/jira/browse/SPARK-49832 Project: Spark

[jira] [Assigned] (SPARK-49831) Provide empty `RuntimeVersions` object to `ClusterSpec.runtimeVersions` by default

[ https://issues.apache.org/jira/browse/SPARK-49831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49831: - Assignee: Dongjoon Hyun > Provide empty `RuntimeVersions` object to `ClusterSpec.runtim

[jira] [Created] (SPARK-49831) Provide empty `RuntimeVersions` object to `ClusterSpec.runtimeVersions` by default

Dongjoon Hyun created SPARK-49831: - Summary: Provide empty `RuntimeVersions` object to `ClusterSpec.runtimeVersions` by default Key: SPARK-49831 URL: https://issues.apache.org/jira/browse/SPARK-49831

[jira] [Assigned] (SPARK-49830) Fix the error when enable the sparkApplicationSentinel

[ https://issues.apache.org/jira/browse/SPARK-49830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49830: - Assignee: Qi Tan > Fix the error when enable the sparkApplicationSentinel > --

[jira] [Resolved] (SPARK-49830) Fix the error when enable the sparkApplicationSentinel

[ https://issues.apache.org/jira/browse/SPARK-49830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49830. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49749) Change log level to debug in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-49749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49749: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Change log level to de

[jira] [Resolved] (SPARK-49749) Change log level to debug in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-49749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49749. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48197 [https://

[jira] [Assigned] (SPARK-49749) Change log level to debug in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-49749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49749: - Assignee: Yuming Wang > Change log level to debug in BlockManagerMasterEndpoint >

[jira] [Resolved] (SPARK-49434) Move org.apache.spark.sql.expressions.javalang.typed/scalalang.type to sql/api

[ https://issues.apache.org/jira/browse/SPARK-49434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49434. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48267 [https://

[jira] [Resolved] (SPARK-49712) Replace org.apache.spark.sql.encoderFor with AgnosticEncoders.agnosticEncoderFor

[ https://issues.apache.org/jira/browse/SPARK-49712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49712. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48266 [https://

[jira] [Resolved] (SPARK-49822) Update postgres docker image to 17.0

[ https://issues.apache.org/jira/browse/SPARK-49822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49822. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48291 [https://

[jira] [Assigned] (SPARK-49822) Update postgres docker image to 17.0

[ https://issues.apache.org/jira/browse/SPARK-49822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49822: - Assignee: BingKun Pan > Update postgres docker image to 17.0 >

[jira] [Commented] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

[ https://issues.apache.org/jira/browse/SPARK-47949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885494#comment-17885494 ] Dongjoon Hyun commented on SPARK-47949: --- This is backported to branch-3.4 via cher

[jira] [Updated] (SPARK-46525) Fix docker-integration-tests on Apple Chips

[ https://issues.apache.org/jira/browse/SPARK-46525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46525: -- Fix Version/s: 3.4.4 > Fix docker-integration-tests on Apple Chips > -

[jira] [Updated] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

[ https://issues.apache.org/jira/browse/SPARK-47949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47949: -- Fix Version/s: 3.4.4 > MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

[jira] [Commented] (SPARK-46525) Fix docker-integration-tests on Apple Chips

[ https://issues.apache.org/jira/browse/SPARK-46525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885493#comment-17885493 ] Dongjoon Hyun commented on SPARK-46525: --- This is backported to branch-3.4 via cher

[jira] [Commented] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

[ https://issues.apache.org/jira/browse/SPARK-47949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885491#comment-17885491 ] Dongjoon Hyun commented on SPARK-47949: --- This is backported to branch-3.5 via htt

[jira] [Updated] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

[ https://issues.apache.org/jira/browse/SPARK-47949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47949: -- Fix Version/s: 3.5.4 > MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04

[jira] [Updated] (SPARK-46525) Fix docker-integration-tests on Apple Chips

[ https://issues.apache.org/jira/browse/SPARK-46525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46525: -- Parent Issue: SPARK-47361 (was: SPARK-44111) > Fix docker-integration-tests on Apple Chips >

[jira] [Commented] (SPARK-46525) Fix docker-integration-tests on Apple Chips

[ https://issues.apache.org/jira/browse/SPARK-46525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885488#comment-17885488 ] Dongjoon Hyun commented on SPARK-46525: --- This is backported to branch-3.5 via http

[jira] [Updated] (SPARK-46525) Fix docker-integration-tests on Apple Chips

[ https://issues.apache.org/jira/browse/SPARK-46525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46525: -- Fix Version/s: 3.5.4 > Fix docker-integration-tests on Apple Chips > -

[jira] [Resolved] (SPARK-49817) Upgrade `gcs-connector` to `2.2.25`

[ https://issues.apache.org/jira/browse/SPARK-49817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49817. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48285 [https://

[jira] [Resolved] (SPARK-49818) Update E2E tests to use Spark 3.5.3

[ https://issues.apache.org/jira/browse/SPARK-49818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49818. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49787) Cast between UDT and other types

[ https://issues.apache.org/jira/browse/SPARK-49787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49787: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Cast between UDT and ot

[jira] [Updated] (SPARK-49818) Update E2E tests to use Spark 3.5.3

[ https://issues.apache.org/jira/browse/SPARK-49818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49818: -- Summary: Update E2E tests to use Spark 3.5.3 (was: Update E2 tests to use Spark 3.5.3) > Upd

[jira] [Created] (SPARK-49818) Update E22 tests to use Spark 3.5.3

Dongjoon Hyun created SPARK-49818: - Summary: Update E22 tests to use Spark 3.5.3 Key: SPARK-49818 URL: https://issues.apache.org/jira/browse/SPARK-49818 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-49818) Update E2 tests to use Spark 3.5.3

[ https://issues.apache.org/jira/browse/SPARK-49818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49818: -- Summary: Update E2 tests to use Spark 3.5.3 (was: Update E22 tests to use Spark 3.5.3) > Upd

[jira] [Resolved] (SPARK-49809) Use `sbt.IO` in `SparkBuild.scala` to avoid naming conflicts with `java.io.IO` in Java 23

[ https://issues.apache.org/jira/browse/SPARK-49809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49809. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48280 [https://

[jira] [Assigned] (SPARK-49809) Use `sbt.IO` in `SparkBuild.scala` to avoid naming conflicts with `java.io.IO` in Java 23

[ https://issues.apache.org/jira/browse/SPARK-49809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49809: - Assignee: Yang Jie > Use `sbt.IO` in `SparkBuild.scala` to avoid naming conflicts with

[jira] [Resolved] (SPARK-49804) Fix to use the exit code of executor container always

[ https://issues.apache.org/jira/browse/SPARK-49804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49804. --- Fix Version/s: 3.5.4 3.4.4 4.0.0 Resolution: Fix

[jira] [Updated] (SPARK-49804) Fix to use the exit code of executor container always

[ https://issues.apache.org/jira/browse/SPARK-49804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49804: -- Summary: Fix to use the exit code of executor container always (was: Incorrect exit code on K

[jira] [Assigned] (SPARK-49804) Fix to use the exit code of executor container always

[ https://issues.apache.org/jira/browse/SPARK-49804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49804: - Assignee: Oleksiy Dyagilev > Fix to use the exit code of executor container always > --

[jira] [Updated] (SPARK-49804) Incorrect exit code on Kubernetes when deploying with sidecars

[ https://issues.apache.org/jira/browse/SPARK-49804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49804: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > Incorrect exit code on Kubernet

[jira] [Updated] (SPARK-49804) Incorrect exit code on Kubernetes when deploying with sidecars

[ https://issues.apache.org/jira/browse/SPARK-49804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49804: -- Affects Version/s: 4.0.0 > Incorrect exit code on Kubernetes when deploying with sidecars > --

[jira] [Resolved] (SPARK-49803) Increase `spark.test.docker.connectionTimeout` to 10min

[ https://issues.apache.org/jira/browse/SPARK-49803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49803. --- Fix Version/s: 4.0.0 3.4.4 3.5.4 Assignee: Don

[jira] [Updated] (SPARK-49803) Increase `spark.test.docker.connectionTimeout` to 10min

[ https://issues.apache.org/jira/browse/SPARK-49803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49803: -- Description: **MASTER** branch https://github.com/apache/spark/actions/runs/11045311764/job/30

[jira] [Created] (SPARK-49803) Increase `spark.test.docker.connectionTimeout` to 10min

Dongjoon Hyun created SPARK-49803: - Summary: Increase `spark.test.docker.connectionTimeout` to 10min Key: SPARK-49803 URL: https://issues.apache.org/jira/browse/SPARK-49803 Project: Spark Iss

[jira] [Updated] (SPARK-47151) Update pandas to 2.2.1

[ https://issues.apache.org/jira/browse/SPARK-47151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47151: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Update pandas to

[jira] [Updated] (SPARK-47817) Update pandas to 2.2.2

[ https://issues.apache.org/jira/browse/SPARK-47817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47817: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Update pandas to

[jira] [Updated] (SPARK-49801) Update pandas to 2.2.3

[ https://issues.apache.org/jira/browse/SPARK-49801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49801: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Update pandas to

[jira] [Updated] (SPARK-49791) Make DelegatingCatalogExtension more extendable

[ https://issues.apache.org/jira/browse/SPARK-49791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49791: -- Issue Type: Bug (was: Improvement) > Make DelegatingCatalogExtension more extendable > --

[jira] [Updated] (SPARK-49800) Update kubernet-client to 6.13.4

[ https://issues.apache.org/jira/browse/SPARK-49800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49800: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Dependency upgrade) > Update kubernet-

[jira] [Resolved] (SPARK-49791) Make DelegatingCatalogExtension more extendable

[ https://issues.apache.org/jira/browse/SPARK-49791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49791. --- Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-49791) Make DelegatingCatalogExtension more extendable

[ https://issues.apache.org/jira/browse/SPARK-49791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49791: - Assignee: Wenchen Fan > Make DelegatingCatalogExtension more extendable > -

[jira] [Assigned] (SPARK-49800) Update kubernet-client to 6.13.4

[ https://issues.apache.org/jira/browse/SPARK-49800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49800: - Assignee: Bjørn Jørgensen > Update kubernet-client to 6.13.4 >

[jira] [Resolved] (SPARK-49800) Update kubernet-client to 6.13.4

[ https://issues.apache.org/jira/browse/SPARK-49800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49800. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48268 [https://

[jira] [Resolved] (SPARK-49786) Lower `KubernetesClusterSchedulerBackend.onDisconnected` log level to debug

[ https://issues.apache.org/jira/browse/SPARK-49786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49786. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48249 [https://

[jira] [Resolved] (SPARK-49790) Support `HPA` template for `SparkCluster`

[ https://issues.apache.org/jira/browse/SPARK-49790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49790. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49790) Support `HPA` template for `SparkCluster`

[ https://issues.apache.org/jira/browse/SPARK-49790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49790: - Assignee: Dongjoon Hyun > Support `HPA` template for `SparkCluster` > -

[jira] [Created] (SPARK-49790) Support `HPA` template for `SparkCluster`

Dongjoon Hyun created SPARK-49790: - Summary: Support `HPA` template for `SparkCluster` Key: SPARK-49790 URL: https://issues.apache.org/jira/browse/SPARK-49790 Project: Spark Issue Type: Sub-t

[jira] [Assigned] (SPARK-49786) Lower `KubernetesClusterSchedulerBackend.onDisconnected` log level to debug

[ https://issues.apache.org/jira/browse/SPARK-49786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49786: - Assignee: Dongjoon Hyun > Lower `KubernetesClusterSchedulerBackend.onDisconnected` log

[jira] [Created] (SPARK-49786) Lower `KubernetesClusterSchedulerBackend.onDisconnected` log level to debug

Dongjoon Hyun created SPARK-49786: - Summary: Lower `KubernetesClusterSchedulerBackend.onDisconnected` log level to debug Key: SPARK-49786 URL: https://issues.apache.org/jira/browse/SPARK-49786 Project

[jira] [Updated] (SPARK-49731) Support K8s volume `mount.subPathExpr` and `hostPath` volume `type`

[ https://issues.apache.org/jira/browse/SPARK-49731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49731: -- Parent: SPARK-49524 Issue Type: Sub-task (was: New Feature) > Support K8s volume `mou

[jira] [Resolved] (SPARK-49731) Support Kubernetes subPathExpr and hostPath volume type options

[ https://issues.apache.org/jira/browse/SPARK-49731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49731. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48181 [https://

[jira] [Assigned] (SPARK-49731) Support Kubernetes subPathExpr and hostPath volume type options

[ https://issues.apache.org/jira/browse/SPARK-49731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49731: - Assignee: Enrico Minack > Support Kubernetes subPathExpr and hostPath volume type optio

[jira] [Updated] (SPARK-49731) Support K8s volume `mount.subPathExpr` and `hostPath` volume `type`

[ https://issues.apache.org/jira/browse/SPARK-49731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49731: -- Summary: Support K8s volume `mount.subPathExpr` and `hostPath` volume `type` (was: Support Ku

[jira] [Resolved] (SPARK-49746) Upgrade Scala to 2.13.15

[ https://issues.apache.org/jira/browse/SPARK-49746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49746. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48192 [https://

[jira] [Resolved] (SPARK-49778) Remove (master|worker) prefix from field names of `(Master|Worker)Spec`

[ https://issues.apache.org/jira/browse/SPARK-49778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49778. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49778) Remove (master|worker) prefix from field names of `(Master|Worker)Spec`

[ https://issues.apache.org/jira/browse/SPARK-49778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49778: - Assignee: Dongjoon Hyun > Remove (master|worker) prefix from field names of `(Master|Wo

[jira] [Created] (SPARK-49778) Remove (master|worker) prefix from field names of `(Master|Worker)Spec`

Dongjoon Hyun created SPARK-49778: - Summary: Remove (master|worker) prefix from field names of `(Master|Worker)Spec` Key: SPARK-49778 URL: https://issues.apache.org/jira/browse/SPARK-49778 Project: Sp

[jira] [Updated] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

[ https://issues.apache.org/jira/browse/SPARK-49740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49740: -- Parent Issue: SPARK-49524 (was: SPARK-44111) > Update `publish-java17.yaml` and `publish-java

[jira] [Updated] (SPARK-49750) Update docs to mention delegation token support on K8s mode

[ https://issues.apache.org/jira/browse/SPARK-49750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49750: -- Parent Issue: SPARK-49524 (was: SPARK-44111) > Update docs to mention delegation token suppor

[jira] [Updated] (SPARK-49750) Update docs to mention delegation token support on K8s mode

[ https://issues.apache.org/jira/browse/SPARK-49750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49750: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Documentation) > Update docs to mentio

[jira] [Updated] (SPARK-49750) Update docs to mention delegation token support on K8s mode

[ https://issues.apache.org/jira/browse/SPARK-49750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49750: -- Fix Version/s: 3.4.4 > Update docs to mention delegation token support on K8s mode > -

[jira] [Resolved] (SPARK-49750) Update docs to mention delegation token support on K8s mode

[ https://issues.apache.org/jira/browse/SPARK-49750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49750. --- Fix Version/s: 4.0.0 3.5.3 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-49750) Update docs to mention delegation token support on K8s mode

[ https://issues.apache.org/jira/browse/SPARK-49750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49750: - Assignee: Cheng Pan > Update docs to mention delegation token support on K8s mode > ---

[jira] [Resolved] (SPARK-49753) Upgrade ZSTD-JNI to 1.5.6-6

[ https://issues.apache.org/jira/browse/SPARK-49753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49753. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48204 [https://

[jira] [Assigned] (SPARK-49753) Upgrade ZSTD-JNI to 1.5.6-6

[ https://issues.apache.org/jira/browse/SPARK-49753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49753: - Assignee: Yang Jie > Upgrade ZSTD-JNI to 1.5.6-6 > --- > >

[jira] [Resolved] (SPARK-49760) Correct handling of SPARK_USER env variable override in app master

[ https://issues.apache.org/jira/browse/SPARK-49760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49760. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48214 [https://

[jira] [Commented] (SPARK-44478) Executor decommission causes stage failure

[ https://issues.apache.org/jira/browse/SPARK-44478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884046#comment-17884046 ] Dongjoon Hyun commented on SPARK-44478: --- To [~boltonidze] ,  * SPARK-48292 might

[jira] [Resolved] (SPARK-49754) Support HPA for `SparkCluster`

[ https://issues.apache.org/jira/browse/SPARK-49754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49754. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49754) Support HPA for `SparkCluster`

[ https://issues.apache.org/jira/browse/SPARK-49754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49754: - Assignee: Dongjoon Hyun > Support HPA for `SparkCluster` >

[jira] [Updated] (SPARK-49754) Support HPA for `SparkCluster`

[ https://issues.apache.org/jira/browse/SPARK-49754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49754: -- Summary: Support HPA for `SparkCluster` (was: Support HPA for SparkCluster) > Support HPA for

[jira] [Created] (SPARK-49754) Support HPA for SparkCluster

Dongjoon Hyun created SPARK-49754: - Summary: Support HPA for SparkCluster Key: SPARK-49754 URL: https://issues.apache.org/jira/browse/SPARK-49754 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-49752) Remove workaround for YARN-3350

[ https://issues.apache.org/jira/browse/SPARK-49752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49752: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove workaround for Y

[jira] [Assigned] (SPARK-49752) Remove workaround for YARN-3350

[ https://issues.apache.org/jira/browse/SPARK-49752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49752: - Assignee: Cheng Pan > Remove workaround for YARN-3350 > ---

[jira] [Resolved] (SPARK-49752) Remove workaround for YARN-3350

[ https://issues.apache.org/jira/browse/SPARK-49752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49752. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48201 [https://

[jira] [Assigned] (SPARK-49746) Upgrade Scala to 2.13.15

[ https://issues.apache.org/jira/browse/SPARK-49746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49746: - Assignee: BingKun Pan > Upgrade Scala to 2.13.15 > > >

[jira] [Updated] (SPARK-49746) Upgrade Scala to 2.13.15

[ https://issues.apache.org/jira/browse/SPARK-49746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49746: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Scala to 2.13.1

[jira] [Resolved] (SPARK-49742) Upgrade `README`, examples, tests to use `preview2`

[ https://issues.apache.org/jira/browse/SPARK-49742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49742. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

[ https://issues.apache.org/jira/browse/SPARK-49740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49740. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 71 [https://git

[jira] [Assigned] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

[ https://issues.apache.org/jira/browse/SPARK-49740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49740: - Assignee: Dongjoon Hyun > Update `publish-java17.yaml` and `publish-java21.yaml` to use

[jira] [Created] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

Dongjoon Hyun created SPARK-49740: - Summary: Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default Key: SPARK-49740 URL: https://issues.apache.org/jira/browse/SPARK-49740

[jira] [Resolved] (SPARK-49736) Add Apache Spark `4.0.0-preview2` Dockerfiles

[ https://issues.apache.org/jira/browse/SPARK-49736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49736. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 70 [https://git

[jira] [Resolved] (SPARK-49735) Upgrade Spark to `4.0.0-preview2`

[ https://issues.apache.org/jira/browse/SPARK-49735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49735. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-49531) Support line plot with plotly backend

[ https://issues.apache.org/jira/browse/SPARK-49531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883318#comment-17883318 ] Dongjoon Hyun commented on SPARK-49531: --- This is resolved via [https://github.com/

[jira] [Resolved] (SPARK-49704) Upgrade `commons-io` to 2.17.0

[ https://issues.apache.org/jira/browse/SPARK-49704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49704. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48154 [https://

[jira] [Updated] (SPARK-49704) Upgrade `commons-io` to 2.17.0

[ https://issues.apache.org/jira/browse/SPARK-49704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49704: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `commons-io` to

<    1   2   3   4   5   6   7   8   9   10   >