[jira] [Assigned] (SPARK-49486) Upgrade tink to 1.15.0

[ https://issues.apache.org/jira/browse/SPARK-49486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49486: - Assignee: BingKun Pan > Upgrade tink to 1.15.0 > -- > >

[jira] [Commented] (SPARK-47193) Converting dataframe to rdd results in data loss

[ https://issues.apache.org/jira/browse/SPARK-47193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879042#comment-17879042 ] Dongjoon Hyun commented on SPARK-47193: --- Just a question because Spark 3.5.3 relea

[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans

[ https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879041#comment-17879041 ] Dongjoon Hyun commented on SPARK-48950: --- cc [~itholic] > Corrupt data from parque

[jira] [Assigned] (SPARK-49504) Add `jjwt` profile

[ https://issues.apache.org/jira/browse/SPARK-49504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49504: - Assignee: Dongjoon Hyun > Add `jjwt` profile > -- > > K

[jira] [Created] (SPARK-49504) Add `jjwt` profile

Dongjoon Hyun created SPARK-49504: - Summary: Add `jjwt` profile Key: SPARK-49504 URL: https://issues.apache.org/jira/browse/SPARK-49504 Project: Spark Issue Type: Sub-task Component

[jira] [Updated] (SPARK-47995) Refresh testing image for pyarrow 17

[ https://issues.apache.org/jira/browse/SPARK-47995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47995: -- Summary: Refresh testing image for pyarrow 17 (was: Upgrade `pyarrow` to 17.0.0 in GitHub Act

[jira] [Assigned] (SPARK-49494) Using spark logos from spark-website in docs

[ https://issues.apache.org/jira/browse/SPARK-49494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49494: - Assignee: Kent Yao > Using spark logos from spark-website in docs > ---

[jira] [Resolved] (SPARK-49494) Using spark logos from spark-website in docs

[ https://issues.apache.org/jira/browse/SPARK-49494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49494. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47966 [https://

[jira] [Resolved] (SPARK-47995) Upgrade `pyarrow` to 17.0.0 in GitHub Action CI

[ https://issues.apache.org/jira/browse/SPARK-47995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47995. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47965 [https://

[jira] [Updated] (SPARK-49465) Fix example props override in helm chart operatorConfiguration.dynamicConfig.data

[ https://issues.apache.org/jira/browse/SPARK-49465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49465: -- Parent: (was: SPARK-45923) Issue Type: Bug (was: Sub-task) > Fix example props ov

[jira] [Closed] (SPARK-49465) Fix example props override in helm chart operatorConfiguration.dynamicConfig.data

[ https://issues.apache.org/jira/browse/SPARK-49465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-49465. - > Fix example props override in helm chart > operatorConfiguration.dynamicConfig.data > ---

[jira] [Updated] (SPARK-49465) Fix example props override in helm chart operatorConfiguration.dynamicConfig.data

[ https://issues.apache.org/jira/browse/SPARK-49465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49465: -- Component/s: Kubernetes (was: k8s) > Fix example props override in helm c

[jira] [Resolved] (SPARK-49465) Fix example props override in helm chart operatorConfiguration.dynamicConfig.data

[ https://issues.apache.org/jira/browse/SPARK-49465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49465. --- Resolution: Duplicate > Fix example props override in helm chart > operatorConfiguration.dy

[jira] [Updated] (SPARK-49468) Hot Properties Reload E2E Test

[ https://issues.apache.org/jira/browse/SPARK-49468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49468: -- Parent: (was: SPARK-45923) Issue Type: Bug (was: Sub-task) > Hot Properties Reloa

[jira] [Updated] (SPARK-49468) Hot Properties Reload E2E Test

[ https://issues.apache.org/jira/browse/SPARK-49468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49468: -- Parent: SPARK-45923 Issue Type: Sub-task (was: Bug) > Hot Properties Reload E2E Test

[jira] [Closed] (SPARK-49453) spark-kubernetes-operator-dynamic-configuration ConfigMap Data Overriding Failure

[ https://issues.apache.org/jira/browse/SPARK-49453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-49453. - > spark-kubernetes-operator-dynamic-configuration ConfigMap Data Overriding > Failure > ---

[jira] [Resolved] (SPARK-49453) spark-kubernetes-operator-dynamic-configuration ConfigMap Data Overriding Failure

[ https://issues.apache.org/jira/browse/SPARK-49453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49453. --- Resolution: Duplicate > spark-kubernetes-operator-dynamic-configuration ConfigMap Data Overr

[jira] [Updated] (SPARK-49453) spark-kubernetes-operator-dynamic-configuration ConfigMap Data Overriding Failure

[ https://issues.apache.org/jira/browse/SPARK-49453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49453: -- Parent: (was: SPARK-45923) Issue Type: Bug (was: Sub-task) > spark-kubernetes-ope

[jira] [Resolved] (SPARK-49468) Hot Properties Reload E2E Test

[ https://issues.apache.org/jira/browse/SPARK-49468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49468. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49468) Hot Properties Reload E2E Test

[ https://issues.apache.org/jira/browse/SPARK-49468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49468: - Assignee: Qi Tan > Hot Properties Reload E2E Test > -- > >

[jira] [Resolved] (SPARK-49466) Upgrade `zstd-jni` to 1.5.6-5

[ https://issues.apache.org/jira/browse/SPARK-49466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49466. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47934 [https://

[jira] [Resolved] (SPARK-49459) Support CRC32C for Shuffle Checksum

[ https://issues.apache.org/jira/browse/SPARK-49459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49459. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47929 [https://

[jira] [Updated] (SPARK-49459) Support CRC32C for Shuffle Checksum

[ https://issues.apache.org/jira/browse/SPARK-49459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49459: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support CRC32C for Shuf

[jira] [Assigned] (SPARK-49459) Support CRC32C for Shuffle Checksum

[ https://issues.apache.org/jira/browse/SPARK-49459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49459: - Assignee: Kent Yao > Support CRC32C for Shuffle Checksum >

[jira] [Resolved] (SPARK-49446) Upgrade jetty to 11.0.23

[ https://issues.apache.org/jira/browse/SPARK-49446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49446. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47912 [https://

[jira] [Resolved] (SPARK-49447) Fix `spark.kubernetes.allocation.batch.delay` to prevent small values less than 100

[ https://issues.apache.org/jira/browse/SPARK-49447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49447. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47913 [https://

[jira] [Updated] (SPARK-45923) Spark Kubernetes Operator

[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45923: -- Labels: SPIP releasenotes (was: SPIP pull-request-available) > Spark Kubernetes Operator > --

[jira] [Resolved] (SPARK-45923) Spark Kubernetes Operator

[ https://issues.apache.org/jira/browse/SPARK-45923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45923. --- Fix Version/s: 4.0.0 Resolution: Fixed > Spark Kubernetes Operator >

[jira] [Resolved] (SPARK-48400) Promote `PrometheusServlet` to `DeveloperApi`

[ https://issues.apache.org/jira/browse/SPARK-48400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48400. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46716 [https://

[jira] [Resolved] (SPARK-48781) Add Catalog APIs for loading stored procedures

[ https://issues.apache.org/jira/browse/SPARK-48781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48781. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47190 [https://

[jira] [Assigned] (SPARK-48781) Add Catalog APIs for loading stored procedures

[ https://issues.apache.org/jira/browse/SPARK-48781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48781: - Assignee: Anton Okolnychyi > Add Catalog APIs for loading stored procedures > -

[jira] [Assigned] (SPARK-49447) Fix `spark.kubernetes.allocation.batch.delay` to prevent small values less than 100

[ https://issues.apache.org/jira/browse/SPARK-49447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49447: - Assignee: Dongjoon Hyun > Fix `spark.kubernetes.allocation.batch.delay` to prevent smal

[jira] [Updated] (SPARK-49447) Fix `spark.kubernetes.allocation.batch.delay` to prevent small values less than 100

[ https://issues.apache.org/jira/browse/SPARK-49447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49447: -- Description: The default value is `1s` (=1000). Usually, a small value like `1` happens when u

[jira] [Updated] (SPARK-49399) Add `pi-scala.yaml` and `pyspark-pi.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49399: -- Summary: Add `pi-scala.yaml` and `pyspark-pi.yaml` (was: Add examples for different Spark ima

[jira] [Assigned] (SPARK-49399) Add examples for different Spark image types

[ https://issues.apache.org/jira/browse/SPARK-49399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49399: - Assignee: Zhou JIANG > Add examples for different Spark image types > -

[jira] [Resolved] (SPARK-49399) Add examples for different Spark image types

[ https://issues.apache.org/jira/browse/SPARK-49399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49399. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49313) Upgrade `DB2` & `MySQL` & `Postgres` & `Mariadb` docker image version

[ https://issues.apache.org/jira/browse/SPARK-49313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49313. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47809 [https://

[jira] [Assigned] (SPARK-49313) Upgrade `DB2` & `MySQL` & `Postgres` & `Mariadb` docker image version

[ https://issues.apache.org/jira/browse/SPARK-49313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49313: - Assignee: BingKun Pan > Upgrade `DB2` & `MySQL` & `Postgres` & `Mariadb` docker image v

[jira] [Updated] (SPARK-49241) Add OpenTelemetryPush Sink

[ https://issues.apache.org/jira/browse/SPARK-49241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49241: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Add OpenTelemetryPush S

[jira] [Assigned] (SPARK-49241) Add OpenTelemetryPush Sink

[ https://issues.apache.org/jira/browse/SPARK-49241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49241: - Assignee: Qi Tan > Add OpenTelemetryPush Sink > -- > >

[jira] [Resolved] (SPARK-49241) Add OpenTelemetryPush Sink

[ https://issues.apache.org/jira/browse/SPARK-49241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49241. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47763 [https://

[jira] [Resolved] (SPARK-49393) fail by default in deprecated catalog plugin APIs

[ https://issues.apache.org/jira/browse/SPARK-49393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49393. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47874 [https://

[jira] [Resolved] (SPARK-49404) Adjust `ERROR`-level log messages

[ https://issues.apache.org/jira/browse/SPARK-49404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49404. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49404) Adjust `ERROR`-level log messages

[ https://issues.apache.org/jira/browse/SPARK-49404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49404: - Assignee: Dongjoon Hyun > Adjust `ERROR`-level log messages > -

[jira] [Created] (SPARK-49404) Adjust `ERROR`-level log messages

Dongjoon Hyun created SPARK-49404: - Summary: Adjust `ERROR`-level log messages Key: SPARK-49404 URL: https://issues.apache.org/jira/browse/SPARK-49404 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49403) Add `log4j2` default setting to `values.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49403. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49403) Add `log4j2` default setting to `values.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49403: - Assignee: Dongjoon Hyun > Add `log4j2` default setting to `values.yaml` > -

[jira] [Created] (SPARK-49403) Add `log4j2` default setting to `values.yaml`

Dongjoon Hyun created SPARK-49403: - Summary: Add `log4j2` default setting to `values.yaml` Key: SPARK-49403 URL: https://issues.apache.org/jira/browse/SPARK-49403 Project: Spark Issue Type: S

[jira] [Resolved] (SPARK-44256) Upgrade rocksdbjni to 8.3.2

[ https://issues.apache.org/jira/browse/SPARK-44256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44256. --- Fix Version/s: 3.5.0 Assignee: BingKun Pan Resolution: Fixed This was resolv

[jira] [Updated] (SPARK-49384) Upgrade rocksdbjni to 9.5.2

[ https://issues.apache.org/jira/browse/SPARK-49384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49384: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade rocksdbjni to 9

[jira] [Resolved] (SPARK-49384) Upgrade rocksdbjni to 9.5.2

[ https://issues.apache.org/jira/browse/SPARK-49384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49384. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47207 [https://

[jira] [Assigned] (SPARK-49384) Upgrade rocksdbjni to 9.5.2

[ https://issues.apache.org/jira/browse/SPARK-49384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49384: - Assignee: BingKun Pan > Upgrade rocksdbjni to 9.5.2 > --- > >

[jira] [Resolved] (SPARK-49400) Use Gradle Version Catalog

[ https://issues.apache.org/jira/browse/SPARK-49400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49400. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49400) Use Gradle Version Catalog

[ https://issues.apache.org/jira/browse/SPARK-49400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49400: - Assignee: Dongjoon Hyun > Use Gradle Version Catalog > -- > >

[jira] [Created] (SPARK-49400) Use Gradle Version Catalog

Dongjoon Hyun created SPARK-49400: - Summary: Use Gradle Version Catalog Key: SPARK-49400 URL: https://issues.apache.org/jira/browse/SPARK-49400 Project: Spark Issue Type: Sub-task C

[jira] [Resolved] (SPARK-49397) Add `Clean Up` section to `README.md`

[ https://issues.apache.org/jira/browse/SPARK-49397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49397. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49395) Add `8081` port to Worker resource spec

[ https://issues.apache.org/jira/browse/SPARK-49395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49395. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Commented] (SPARK-49180) Optimize spark-website and doc release size

[ https://issues.apache.org/jira/browse/SPARK-49180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876821#comment-17876821 ] Dongjoon Hyun commented on SPARK-49180: --- Thank you. It's great! > Optimize spark-

[jira] [Assigned] (SPARK-49397) Add `Clean Up` section to `README.md`

[ https://issues.apache.org/jira/browse/SPARK-49397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49397: - Assignee: Dongjoon Hyun > Add `Clean Up` section to `README.md` > -

[jira] [Created] (SPARK-49397) Add `Clean Up` section to `README.md`

Dongjoon Hyun created SPARK-49397: - Summary: Add `Clean Up` section to `README.md` Key: SPARK-49397 URL: https://issues.apache.org/jira/browse/SPARK-49397 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-49395) Add `8081` port to Worker resource spec

[ https://issues.apache.org/jira/browse/SPARK-49395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49395: - Assignee: Dongjoon Hyun > Add `8081` port to Worker resource spec > ---

[jira] [Created] (SPARK-49395) Add `8081` port to Worker resource spec

Dongjoon Hyun created SPARK-49395: - Summary: Add `8081` port to Worker resource spec Key: SPARK-49395 URL: https://issues.apache.org/jira/browse/SPARK-49395 Project: Spark Issue Type: Sub-tas

[jira] [Resolved] (SPARK-49389) Support `master|worker` container templates

[ https://issues.apache.org/jira/browse/SPARK-49389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49389. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49393) fail by default in deprecated catalog plugin APIs

[ https://issues.apache.org/jira/browse/SPARK-49393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49393: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > fail by default in depr

[jira] [Assigned] (SPARK-49389) Support `master|worker` container templates

[ https://issues.apache.org/jira/browse/SPARK-49389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49389: - Assignee: Dongjoon Hyun > Support `master|worker` container templates > ---

[jira] [Created] (SPARK-49389) Support `master|worker` container templates

Dongjoon Hyun created SPARK-49389: - Summary: Support `master|worker` container templates Key: SPARK-49389 URL: https://issues.apache.org/jira/browse/SPARK-49389 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-49388) Remove `SPARK_NO_DAEMONIZE` in favor of live log UIs

[ https://issues.apache.org/jira/browse/SPARK-49388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49388. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

[ https://issues.apache.org/jira/browse/SPARK-49385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49385: - Assignee: Dongjoon Hyun > Fix `getReusablePVCs` to use `podCreationTimeout` instead of

[jira] [Resolved] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

[ https://issues.apache.org/jira/browse/SPARK-49385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49385. --- Fix Version/s: 3.4.4 4.0.0 3.5.3 Resolution: Fix

[jira] [Assigned] (SPARK-49324) E2E Test Components: State Transition

[ https://issues.apache.org/jira/browse/SPARK-49324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49324: - Assignee: Qi Tan > E2E Test Components: State Transition > ---

[jira] [Resolved] (SPARK-49380) Add `cluster-with-template.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49380. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49324) E2E Test Components: State Transition

[ https://issues.apache.org/jira/browse/SPARK-49324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49324. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

Dongjoon Hyun created SPARK-49385: - Summary: Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay` Key: SPARK-49385 URL: https://issues.apache.org/jira/browse/SPARK-49385 P

[jira] [Assigned] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

[ https://issues.apache.org/jira/browse/SPARK-49381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49381: - Assignee: Dongjoon Hyun > Fix `SPARK-41388` test case to assert the result > --

[jira] [Resolved] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

[ https://issues.apache.org/jira/browse/SPARK-49381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49381. --- Fix Version/s: 3.4.4 4.0.0 3.5.3 Resolution: Fix

[jira] [Created] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

Dongjoon Hyun created SPARK-49381: - Summary: Fix `SPARK-41388` test case to assert the result Key: SPARK-49381 URL: https://issues.apache.org/jira/browse/SPARK-49381 Project: Spark Issue Type

[jira] [Updated] (SPARK-49359) allow StagedTableCatalog implementations to fall back to non-atomic write

[ https://issues.apache.org/jira/browse/SPARK-49359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49359: -- Issue Type: Bug (was: Improvement) > allow StagedTableCatalog implementations to fall back to

[jira] [Assigned] (SPARK-49380) Add `cluster-with-template.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49380: - Assignee: Dongjoon Hyun > Add `cluster-with-template.yaml` > --

[jira] [Created] (SPARK-49380) Add `cluster-with-template.yaml`

Dongjoon Hyun created SPARK-49380: - Summary: Add `cluster-with-template.yaml` Key: SPARK-49380 URL: https://issues.apache.org/jira/browse/SPARK-49380 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49329) Support user provided spec for SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49329. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49379) Enable Pull Request Labeler

[ https://issues.apache.org/jira/browse/SPARK-49379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49379. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49379) Enable Pull Request Labeler

[ https://issues.apache.org/jira/browse/SPARK-49379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49379: - Assignee: Dongjoon Hyun > Enable Pull Request Labeler > --- > >

[jira] [Created] (SPARK-49379) Enable Pull Request Labeler

Dongjoon Hyun created SPARK-49379: - Summary: Enable Pull Request Labeler Key: SPARK-49379 URL: https://issues.apache.org/jira/browse/SPARK-49379 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-49376) Introduce ClusterToleration and WorkerInstanceConfig

[ https://issues.apache.org/jira/browse/SPARK-49376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49376: - Assignee: Zhou JIANG > Introduce ClusterToleration and WorkerInstanceConfig > -

[jira] [Resolved] (SPARK-49376) Introduce ClusterToleration and WorkerInstanceConfig

[ https://issues.apache.org/jira/browse/SPARK-49376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49376. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49377) E2E Tests Catch Step SparkApplication Kind Not found

[ https://issues.apache.org/jira/browse/SPARK-49377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49377. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49377) E2E Tests Catch Step SparkApplication Kind Not found

[ https://issues.apache.org/jira/browse/SPARK-49377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49377: - Assignee: Qi Tan > E2E Tests Catch Step SparkApplication Kind Not found > -

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Fix Version/s: 3.4.4 > Avoid redundant array transform for identical expression >

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Affects Version/s: 3.4.3 3.5.2 3.3.4 > Avoid red

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Issue Type: Bug (was: Improvement) > Avoid redundant array transform for identical expression

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Fix Version/s: 3.5.3 > Avoid redundant array transform for identical expression >

[jira] [Resolved] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49352. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47843 [https://

[jira] [Resolved] (SPARK-49373) ProtobufFunctionsSuite test case should not be environment-dependent

[ https://issues.apache.org/jira/browse/SPARK-49373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49373. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47859 [https://

[jira] [Assigned] (SPARK-49362) Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default

[ https://issues.apache.org/jira/browse/SPARK-49362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49362: - Assignee: Dongjoon Hyun > Simplify snapshot HelmChart to use > `apache/spark-kubernete

[jira] [Resolved] (SPARK-49362) Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default

[ https://issues.apache.org/jira/browse/SPARK-49362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49362. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49362) Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default

Dongjoon Hyun created SPARK-49362: - Summary: Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default Key: SPARK-49362 URL: https://issues.apache.org/jira/browse/SPARK-49362

[jira] [Assigned] (SPARK-49361) Fix `Dockerfile` by removing unused `ARG` from builder and moving default value

[ https://issues.apache.org/jira/browse/SPARK-49361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49361: - Assignee: Dongjoon Hyun > Fix `Dockerfile` by removing unused `ARG` from builder and mo

[jira] [Resolved] (SPARK-49361) Fix `Dockerfile` by removing unused `ARG` from builder and moving default value

[ https://issues.apache.org/jira/browse/SPARK-49361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49361. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49361) Fix `Dockerfile` by removing unused `ARG` from builder and moving default value

Dongjoon Hyun created SPARK-49361: - Summary: Fix `Dockerfile` by removing unused `ARG` from builder and moving default value Key: SPARK-49361 URL: https://issues.apache.org/jira/browse/SPARK-49361 Pro

[jira] [Assigned] (SPARK-49360) Use `rsync` to upload to `nightlies`

[ https://issues.apache.org/jira/browse/SPARK-49360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49360: - Assignee: Dongjoon Hyun > Use `rsync` to upload to `nightlies` > --

<    1   2   3   4   5   6   7   8   9   10   >