[jira] [Resolved] (SPARK-49315) Generalize `relocateGeneratedCRD` Gradle Task to handle `*.spark.apache.org-v1.yml`

[ https://issues.apache.org/jira/browse/SPARK-49315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49315. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49316) Generalize `printer-columns.sh` to handle `*.spark.apache.org-v1.yml` files

[ https://issues.apache.org/jira/browse/SPARK-49316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49316. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

Dongjoon Hyun created SPARK-49317: - Summary: Add `pi-on-yunikorn.yaml` example Key: SPARK-49317 URL: https://issues.apache.org/jira/browse/SPARK-49317 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49317: - Assignee: Dongjoon Hyun > Add `pi-on-yunikorn.yaml` example > -

[jira] [Resolved] (SPARK-49317) Add `pi-on-yunikorn.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49317. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module

Dongjoon Hyun created SPARK-49319: - Summary: Add `SparkCluster` to `spark-operator-api` module Key: SPARK-49319 URL: https://issues.apache.org/jira/browse/SPARK-49319 Project: Spark Issue Typ

[jira] [Updated] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module and examples

[ https://issues.apache.org/jira/browse/SPARK-49319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49319: -- Summary: Add `SparkCluster` to `spark-operator-api` module and examples (was: Add `SparkClust

[jira] [Assigned] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module and examples

[ https://issues.apache.org/jira/browse/SPARK-49319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49319: - Assignee: Dongjoon Hyun > Add `SparkCluster` to `spark-operator-api` module and example

[jira] [Updated] (SPARK-49292) Upgrade dropwizard metrics to 4.2.27

[ https://issues.apache.org/jira/browse/SPARK-49292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49292: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade dropwizard metr

[jira] [Resolved] (SPARK-49292) Upgrade dropwizard metrics to 4.2.27

[ https://issues.apache.org/jira/browse/SPARK-49292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49292. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47799 [https://

[jira] [Updated] (SPARK-46892) Upgrade dropwizard metrics 4.2.25

[ https://issues.apache.org/jira/browse/SPARK-46892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46892: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade dropwizard metr

[jira] [Updated] (SPARK-45502) Upgrade Kafka to 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-45502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45502: -- Parent Issue: SPARK-44111 (was: SPARK-47046) > Upgrade Kafka to 3.6.1 > -

[jira] [Resolved] (SPARK-49319) Add `SparkCluster` to `spark-operator-api` module and examples

[ https://issues.apache.org/jira/browse/SPARK-49319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49319. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49322) Add `SparkCluster` to `spark-submission-worker` module

Dongjoon Hyun created SPARK-49322: - Summary: Add `SparkCluster` to `spark-submission-worker` module Key: SPARK-49322 URL: https://issues.apache.org/jira/browse/SPARK-49322 Project: Spark Issu

[jira] [Assigned] (SPARK-49322) Add `SparkCluster` to `spark-submission-worker` module

[ https://issues.apache.org/jira/browse/SPARK-49322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49322: - Assignee: Dongjoon Hyun > Add `SparkCluster` to `spark-submission-worker` module >

[jira] [Resolved] (SPARK-49322) Add `SparkCluster` to `spark-submission-worker` module

[ https://issues.apache.org/jira/browse/SPARK-49322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49322. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49325) Add `SparkCluster` to `spark-operator` module

Dongjoon Hyun created SPARK-49325: - Summary: Add `SparkCluster` to `spark-operator` module Key: SPARK-49325 URL: https://issues.apache.org/jira/browse/SPARK-49325 Project: Spark Issue Type: S

[jira] [Assigned] (SPARK-49325) Add `SparkCluster` to `spark-operator` module

[ https://issues.apache.org/jira/browse/SPARK-49325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49325: - Assignee: Dongjoon Hyun > Add `SparkCluster` to `spark-operator` module > -

[jira] [Resolved] (SPARK-49325) Add `SparkCluster` to `spark-operator` module

[ https://issues.apache.org/jira/browse/SPARK-49325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49325. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49328) Propagate Spark configurations to SparkCluster

Dongjoon Hyun created SPARK-49328: - Summary: Propagate Spark configurations to SparkCluster Key: SPARK-49328 URL: https://issues.apache.org/jira/browse/SPARK-49328 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-49328) Propagate Spark configurations to SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49328. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49328) Propagate Spark configurations to SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49328: - Assignee: Dongjoon Hyun > Propagate Spark configurations to SparkCluster >

[jira] [Assigned] (SPARK-49329) Support user provided spec for SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49329: - Assignee: Zhou JIANG > Support user provided spec for SparkCluster > --

[jira] [Assigned] (SPARK-49214) Add e2e test in operator workflow

[ https://issues.apache.org/jira/browse/SPARK-49214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49214: - Assignee: Qi Tan > Add e2e test in operator workflow >

[jira] [Created] (SPARK-49330) Revise `InstanceConfig` to `ExecutorInstanceConfig` class

Dongjoon Hyun created SPARK-49330: - Summary: Revise `InstanceConfig` to `ExecutorInstanceConfig` class Key: SPARK-49330 URL: https://issues.apache.org/jira/browse/SPARK-49330 Project: Spark I

[jira] [Assigned] (SPARK-49330) Revise `InstanceConfig` to `ExecutorInstanceConfig` class

[ https://issues.apache.org/jira/browse/SPARK-49330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49330: - Assignee: Dongjoon Hyun > Revise `InstanceConfig` to `ExecutorInstanceConfig` class > -

[jira] [Resolved] (SPARK-49331) Use Minikube Github Action

[ https://issues.apache.org/jira/browse/SPARK-49331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49331. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49331) Use `setup-minikube` GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-49331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49331: -- Summary: Use `setup-minikube` GitHub Action (was: Use Minikube Github Action) > Use `setup-m

[jira] [Created] (SPARK-49332) Add K8s service for Workers

Dongjoon Hyun created SPARK-49332: - Summary: Add K8s service for Workers Key: SPARK-49332 URL: https://issues.apache.org/jira/browse/SPARK-49332 Project: Spark Issue Type: Bug Compo

[jira] [Updated] (SPARK-49332) Add K8s service for Workers to SparkClusterResourceSpec

[ https://issues.apache.org/jira/browse/SPARK-49332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49332: -- Summary: Add K8s service for Workers to SparkClusterResourceSpec (was: Add K8s service for Wo

[jira] [Assigned] (SPARK-49332) Add K8s service for Workers to SparkClusterResourceSpec

[ https://issues.apache.org/jira/browse/SPARK-49332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49332: - Assignee: Dongjoon Hyun > Add K8s service for Workers to SparkClusterResourceSpec > ---

[jira] [Resolved] (SPARK-49332) Add K8s service for Workers to SparkClusterResourceSpec

[ https://issues.apache.org/jira/browse/SPARK-49332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49332. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Updated] (SPARK-49332) Add K8s service for Workers to SparkClusterResourceSpec

[ https://issues.apache.org/jira/browse/SPARK-49332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49332: -- Parent: SPARK-45923 Issue Type: Sub-task (was: Bug) > Add K8s service for Workers to

[jira] [Resolved] (SPARK-49214) Add e2e test in operator workflow

[ https://issues.apache.org/jira/browse/SPARK-49214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49214. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49335) Upgrade maven to 3.9.9

[ https://issues.apache.org/jira/browse/SPARK-49335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49335. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47827 [https://

[jira] [Assigned] (SPARK-49335) Upgrade maven to 3.9.9

[ https://issues.apache.org/jira/browse/SPARK-49335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49335: - Assignee: Yang Jie > Upgrade maven to 3.9.9 > -- > >

[jira] [Created] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

Dongjoon Hyun created SPARK-49338: - Summary: Make Spark Deamons support `spark.log.structuredLogging.enabled` Key: SPARK-49338 URL: https://issues.apache.org/jira/browse/SPARK-49338 Project: Spark

[jira] [Updated] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

[ https://issues.apache.org/jira/browse/SPARK-49338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49338: -- Priority: Blocker (was: Major) > Make Spark Deamons support `spark.log.structuredLogging.enab

[jira] [Updated] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

[ https://issues.apache.org/jira/browse/SPARK-49338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49338: -- Priority: Major (was: Blocker) > Make Spark Deamons support `spark.log.structuredLogging.enab

[jira] [Updated] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

[ https://issues.apache.org/jira/browse/SPARK-49338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49338: -- Component/s: (was: SQL) > Make Spark Deamons support `spark.log.structuredLogging.enabled`

[jira] [Updated] (SPARK-49339) Use Minikube Github Workflow Action

[ https://issues.apache.org/jira/browse/SPARK-49339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49339: -- Priority: Minor (was: Trivial) > Use Minikube Github Workflow Action > --

[jira] [Updated] (SPARK-49339) Use Minikube Github Workflow Action

[ https://issues.apache.org/jira/browse/SPARK-49339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49339: -- Component/s: Project Infra (was: Kubernetes) > Use Minikube Github Workfl

[jira] [Assigned] (SPARK-49339) Use Minikube Github Workflow Action

[ https://issues.apache.org/jira/browse/SPARK-49339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49339: - Assignee: Qi Tan > Use Minikube Github Workflow Action > --

[jira] [Updated] (SPARK-49339) Use `setup-minikube` GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-49339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49339: -- Summary: Use `setup-minikube` GitHub Action (was: Use Minikube Github Workflow Action) > Use

[jira] [Resolved] (SPARK-49330) Revise `InstanceConfig` to `ExecutorInstanceConfig` class

[ https://issues.apache.org/jira/browse/SPARK-49330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49330. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49340) Document `SparkCluster` and add `submit-pi-to-prod.sh` example

Dongjoon Hyun created SPARK-49340: - Summary: Document `SparkCluster` and add `submit-pi-to-prod.sh` example Key: SPARK-49340 URL: https://issues.apache.org/jira/browse/SPARK-49340 Project: Spark

[jira] [Created] (SPARK-49341) Remove `connector/docker` in favor of `Apache Spark Operator`

Dongjoon Hyun created SPARK-49341: - Summary: Remove `connector/docker` in favor of `Apache Spark Operator` Key: SPARK-49341 URL: https://issues.apache.org/jira/browse/SPARK-49341 Project: Spark

[jira] [Resolved] (SPARK-49340) Document `SparkCluster` and add `submit-pi-to-prod.sh` example

[ https://issues.apache.org/jira/browse/SPARK-49340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49340. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49340) Document `SparkCluster` and add `submit-pi-to-prod.sh` example

[ https://issues.apache.org/jira/browse/SPARK-49340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49340: - Assignee: Dongjoon Hyun > Document `SparkCluster` and add `submit-pi-to-prod.sh` exampl

[jira] [Updated] (SPARK-49338) Make Spark Deamons support `spark.log.structuredLogging.enabled`

[ https://issues.apache.org/jira/browse/SPARK-49338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49338: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Make Spark Deamons support `spa

[jira] [Updated] (SPARK-49340) Document `SparkCluster` and add `submit-pi-to-prod.sh` example

[ https://issues.apache.org/jira/browse/SPARK-49340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49340: -- Parent: SPARK-45923 Issue Type: Sub-task (was: Improvement) > Document `SparkCluster`

[jira] [Created] (SPARK-49343) Document nightly versions of operator image and Helm Chart

Dongjoon Hyun created SPARK-49343: - Summary: Document nightly versions of operator image and Helm Chart Key: SPARK-49343 URL: https://issues.apache.org/jira/browse/SPARK-49343 Project: Spark

[jira] [Assigned] (SPARK-49343) Document nightly versions of operator image and Helm Chart

[ https://issues.apache.org/jira/browse/SPARK-49343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49343: - Assignee: Dongjoon Hyun > Document nightly versions of operator image and Helm Chart >

[jira] [Resolved] (SPARK-49343) Document nightly versions of operator image and Helm Chart

[ https://issues.apache.org/jira/browse/SPARK-49343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49343. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49341) Remove `connector/docker` in favor of `Apache Spark Operator`

[ https://issues.apache.org/jira/browse/SPARK-49341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49341. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47833 [https://

[jira] [Created] (SPARK-49346) Add `publish_snapshot_dockerhub.yml` Daily GitHub Action job

Dongjoon Hyun created SPARK-49346: - Summary: Add `publish_snapshot_dockerhub.yml` Daily GitHub Action job Key: SPARK-49346 URL: https://issues.apache.org/jira/browse/SPARK-49346 Project: Spark

[jira] [Created] (SPARK-49348) Support `schedulerName` for SparkCluster

Dongjoon Hyun created SPARK-49348: - Summary: Support `schedulerName` for SparkCluster Key: SPARK-49348 URL: https://issues.apache.org/jira/browse/SPARK-49348 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-49348) Support `schedulerName` for SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49348: - Assignee: Dongjoon Hyun > Support `schedulerName` for SparkCluster > --

[jira] [Created] (SPARK-49351) Add `publish_snapshot_chart.yml` GitHub Action job

Dongjoon Hyun created SPARK-49351: - Summary: Add `publish_snapshot_chart.yml` GitHub Action job Key: SPARK-49351 URL: https://issues.apache.org/jira/browse/SPARK-49351 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-49346) Add `publish_snapshot_dockerhub.yml` Daily GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-49346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49346. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49348) Support `schedulerName` for SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49348. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49351) Add `publish_snapshot_chart.yml` GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-49351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49351. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49351) Add `publish_snapshot_chart.yml` GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-49351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49351: - Assignee: Dongjoon Hyun > Add `publish_snapshot_chart.yml` GitHub Action job >

[jira] [Resolved] (SPARK-49339) Use `setup-minikube` GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-49339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49339. --- Fix Version/s: 4.0.0 Resolution: Fixed This is resolved via https://github.com/apache

[jira] [Created] (SPARK-49360) Switch from `curl` to `rsync` to upload to `nightlies`

Dongjoon Hyun created SPARK-49360: - Summary: Switch from `curl` to `rsync` to upload to `nightlies` Key: SPARK-49360 URL: https://issues.apache.org/jira/browse/SPARK-49360 Project: Spark Iss

[jira] [Updated] (SPARK-49360) Use `rsync` to upload to `nightlies`

[ https://issues.apache.org/jira/browse/SPARK-49360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49360: -- Summary: Use `rsync` to upload to `nightlies` (was: Switch from `curl` to `rsync` to upload t

[jira] [Resolved] (SPARK-49360) Use `rsync` to upload to `nightlies`

[ https://issues.apache.org/jira/browse/SPARK-49360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49360. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49360) Use `rsync` to upload to `nightlies`

[ https://issues.apache.org/jira/browse/SPARK-49360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49360: - Assignee: Dongjoon Hyun > Use `rsync` to upload to `nightlies` > --

[jira] [Created] (SPARK-49361) Fix `Dockerfile` by removing unused `ARG` from builder and moving default value

Dongjoon Hyun created SPARK-49361: - Summary: Fix `Dockerfile` by removing unused `ARG` from builder and moving default value Key: SPARK-49361 URL: https://issues.apache.org/jira/browse/SPARK-49361 Pro

[jira] [Assigned] (SPARK-49361) Fix `Dockerfile` by removing unused `ARG` from builder and moving default value

[ https://issues.apache.org/jira/browse/SPARK-49361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49361: - Assignee: Dongjoon Hyun > Fix `Dockerfile` by removing unused `ARG` from builder and mo

[jira] [Resolved] (SPARK-49361) Fix `Dockerfile` by removing unused `ARG` from builder and moving default value

[ https://issues.apache.org/jira/browse/SPARK-49361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49361. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49362) Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default

Dongjoon Hyun created SPARK-49362: - Summary: Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default Key: SPARK-49362 URL: https://issues.apache.org/jira/browse/SPARK-49362

[jira] [Resolved] (SPARK-49362) Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default

[ https://issues.apache.org/jira/browse/SPARK-49362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49362. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49362) Simplify snapshot HelmChart to use `apache/spark-kubernetes-operator:main-snapshot` by default

[ https://issues.apache.org/jira/browse/SPARK-49362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49362: - Assignee: Dongjoon Hyun > Simplify snapshot HelmChart to use > `apache/spark-kubernete

[jira] [Resolved] (SPARK-49373) ProtobufFunctionsSuite test case should not be environment-dependent

[ https://issues.apache.org/jira/browse/SPARK-49373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49373. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47859 [https://

[jira] [Resolved] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49352. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47843 [https://

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Fix Version/s: 3.5.3 > Avoid redundant array transform for identical expression >

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Issue Type: Bug (was: Improvement) > Avoid redundant array transform for identical expression

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Affects Version/s: 3.4.3 3.5.2 3.3.4 > Avoid red

[jira] [Updated] (SPARK-49352) Avoid redundant array transform for identical expression

[ https://issues.apache.org/jira/browse/SPARK-49352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49352: -- Fix Version/s: 3.4.4 > Avoid redundant array transform for identical expression >

[jira] [Assigned] (SPARK-49377) E2E Tests Catch Step SparkApplication Kind Not found

[ https://issues.apache.org/jira/browse/SPARK-49377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49377: - Assignee: Qi Tan > E2E Tests Catch Step SparkApplication Kind Not found > -

[jira] [Resolved] (SPARK-49377) E2E Tests Catch Step SparkApplication Kind Not found

[ https://issues.apache.org/jira/browse/SPARK-49377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49377. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49376) Introduce ClusterToleration and WorkerInstanceConfig

[ https://issues.apache.org/jira/browse/SPARK-49376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49376. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49376) Introduce ClusterToleration and WorkerInstanceConfig

[ https://issues.apache.org/jira/browse/SPARK-49376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49376: - Assignee: Zhou JIANG > Introduce ClusterToleration and WorkerInstanceConfig > -

[jira] [Created] (SPARK-49379) Enable Pull Request Labeler

Dongjoon Hyun created SPARK-49379: - Summary: Enable Pull Request Labeler Key: SPARK-49379 URL: https://issues.apache.org/jira/browse/SPARK-49379 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-49379) Enable Pull Request Labeler

[ https://issues.apache.org/jira/browse/SPARK-49379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49379: - Assignee: Dongjoon Hyun > Enable Pull Request Labeler > --- > >

[jira] [Resolved] (SPARK-49379) Enable Pull Request Labeler

[ https://issues.apache.org/jira/browse/SPARK-49379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49379. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49329) Support user provided spec for SparkCluster

[ https://issues.apache.org/jira/browse/SPARK-49329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49329. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Created] (SPARK-49380) Add `cluster-with-template.yaml`

Dongjoon Hyun created SPARK-49380: - Summary: Add `cluster-with-template.yaml` Key: SPARK-49380 URL: https://issues.apache.org/jira/browse/SPARK-49380 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-49380) Add `cluster-with-template.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49380: - Assignee: Dongjoon Hyun > Add `cluster-with-template.yaml` > --

[jira] [Updated] (SPARK-49359) allow StagedTableCatalog implementations to fall back to non-atomic write

[ https://issues.apache.org/jira/browse/SPARK-49359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49359: -- Issue Type: Bug (was: Improvement) > allow StagedTableCatalog implementations to fall back to

[jira] [Created] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

Dongjoon Hyun created SPARK-49381: - Summary: Fix `SPARK-41388` test case to assert the result Key: SPARK-49381 URL: https://issues.apache.org/jira/browse/SPARK-49381 Project: Spark Issue Type

[jira] [Resolved] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

[ https://issues.apache.org/jira/browse/SPARK-49381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49381. --- Fix Version/s: 3.4.4 4.0.0 3.5.3 Resolution: Fix

[jira] [Assigned] (SPARK-49381) Fix `SPARK-41388` test case to assert the result

[ https://issues.apache.org/jira/browse/SPARK-49381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49381: - Assignee: Dongjoon Hyun > Fix `SPARK-41388` test case to assert the result > --

[jira] [Created] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

Dongjoon Hyun created SPARK-49385: - Summary: Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay` Key: SPARK-49385 URL: https://issues.apache.org/jira/browse/SPARK-49385 P

[jira] [Resolved] (SPARK-49324) E2E Test Components: State Transition

[ https://issues.apache.org/jira/browse/SPARK-49324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49324. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-49380) Add `cluster-with-template.yaml`

[ https://issues.apache.org/jira/browse/SPARK-49380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49380. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-49324) E2E Test Components: State Transition

[ https://issues.apache.org/jira/browse/SPARK-49324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49324: - Assignee: Qi Tan > E2E Test Components: State Transition > ---

[jira] [Resolved] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

[ https://issues.apache.org/jira/browse/SPARK-49385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49385. --- Fix Version/s: 3.4.4 4.0.0 3.5.3 Resolution: Fix

[jira] [Assigned] (SPARK-49385) Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`

[ https://issues.apache.org/jira/browse/SPARK-49385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49385: - Assignee: Dongjoon Hyun > Fix `getReusablePVCs` to use `podCreationTimeout` instead of

<    1   2   3   4   5   6   7   8   9   10   >