[jira] [Created] (SPARK-49623) Rename prefix `appResources` in helm chart

Zhou JIANG created SPARK-49623: -- Summary: Rename prefix `appResources` in helm chart Key: SPARK-49623 URL: https://issues.apache.org/jira/browse/SPARK-49623 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49528) Document SparkCluster spec fields that would be overwritten by Spark

Zhou JIANG created SPARK-49528: -- Summary: Document SparkCluster spec fields that would be overwritten by Spark Key: SPARK-49528 URL: https://issues.apache.org/jira/browse/SPARK-49528 Project: Spark

[jira] [Created] (SPARK-49527) Generate Spark Operator Config Property Doc

Zhou JIANG created SPARK-49527: -- Summary: Generate Spark Operator Config Property Doc Key: SPARK-49527 URL: https://issues.apache.org/jira/browse/SPARK-49527 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49465) Fix example props override in helm chart operatorConfiguration.dynamicConfig.data

Zhou JIANG created SPARK-49465: -- Summary: Fix example props override in helm chart operatorConfiguration.dynamicConfig.data Key: SPARK-49465 URL: https://issues.apache.org/jira/browse/SPARK-49465 Project

[jira] [Commented] (SPARK-49453) spark-kubernetes-operator-dynamic-configuration ConfigMap Data Overriding Failure

[ https://issues.apache.org/jira/browse/SPARK-49453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877909#comment-17877909 ] Zhou JIANG commented on SPARK-49453: Can you share the steps to reproduce this issue

[jira] [Created] (SPARK-49464) Add docs for operator

Zhou JIANG created SPARK-49464: -- Summary: Add docs for operator Key: SPARK-49464 URL: https://issues.apache.org/jira/browse/SPARK-49464 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-49399) Add examples for different Spark image types

Zhou JIANG created SPARK-49399: -- Summary: Add examples for different Spark image types Key: SPARK-49399 URL: https://issues.apache.org/jira/browse/SPARK-49399 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49376) Introduce ClusterToleration and WorkerInstanceConfig

Zhou JIANG created SPARK-49376: -- Summary: Introduce ClusterToleration and WorkerInstanceConfig Key: SPARK-49376 URL: https://issues.apache.org/jira/browse/SPARK-49376 Project: Spark Issue Type:

[jira] [Created] (SPARK-49329) Support user provided spec for SparkCluster

Zhou JIANG created SPARK-49329: -- Summary: Support user provided spec for SparkCluster Key: SPARK-49329 URL: https://issues.apache.org/jira/browse/SPARK-49329 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49214) Add e2e test in operator workflow

Zhou JIANG created SPARK-49214: -- Summary: Add e2e test in operator workflow Key: SPARK-49214 URL: https://issues.apache.org/jira/browse/SPARK-49214 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49052) Add SparkOperator main entry point class

Zhou JIANG created SPARK-49052: -- Summary: Add SparkOperator main entry point class Key: SPARK-49052 URL: https://issues.apache.org/jira/browse/SPARK-49052 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49045) Add docker image build for operator

Zhou JIANG created SPARK-49045: -- Summary: Add docker image build for operator Key: SPARK-49045 URL: https://issues.apache.org/jira/browse/SPARK-49045 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48984) Add Controller Metrics System and Utils

Zhou JIANG created SPARK-48984: -- Summary: Add Controller Metrics System and Utils Key: SPARK-48984 URL: https://issues.apache.org/jira/browse/SPARK-48984 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48786) Define Config Loading Framework for Spark Operator Controller

[ https://issues.apache.org/jira/browse/SPARK-48786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou JIANG updated SPARK-48786: --- Summary: Define Config Loading Framework for Spark Operator Controller (was: Define Conf Properties

[jira] [Created] (SPARK-48786) Define Conf Properties for Spark Operator Controller

Zhou JIANG created SPARK-48786: -- Summary: Define Conf Properties for Spark Operator Controller Key: SPARK-48786 URL: https://issues.apache.org/jira/browse/SPARK-48786 Project: Spark Issue Type:

[jira] [Created] (SPARK-48679) Upgrade checkstyle and spotbugs version

Zhou JIANG created SPARK-48679: -- Summary: Upgrade checkstyle and spotbugs version Key: SPARK-48679 URL: https://issues.apache.org/jira/browse/SPARK-48679 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48400) Promote `PrometheusServlet` to `DeveloperApi`

Zhou JIANG created SPARK-48400: -- Summary: Promote `PrometheusServlet` to `DeveloperApi` Key: SPARK-48400 URL: https://issues.apache.org/jira/browse/SPARK-48400 Project: Spark Issue Type: Sub-tas

[jira] [Created] (SPARK-48398) Add Helm chart for Operator Deployment

Zhou JIANG created SPARK-48398: -- Summary: Add Helm chart for Operator Deployment Key: SPARK-48398 URL: https://issues.apache.org/jira/browse/SPARK-48398 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48382) Add controller / reconciler module to operator

Zhou JIANG created SPARK-48382: -- Summary: Add controller / reconciler module to operator Key: SPARK-48382 URL: https://issues.apache.org/jira/browse/SPARK-48382 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-48326) Upgrade submission worker base Spark version to 4.0.0-preview2

Zhou JIANG created SPARK-48326: -- Summary: Upgrade submission worker base Spark version to 4.0.0-preview2 Key: SPARK-48326 URL: https://issues.apache.org/jira/browse/SPARK-48326 Project: Spark I

[jira] [Created] (SPARK-48121) Promote ` KubernetesDriverConf` to `DeveloperApi`

Zhou JIANG created SPARK-48121: -- Summary: Promote ` KubernetesDriverConf` to `DeveloperApi` Key: SPARK-48121 URL: https://issues.apache.org/jira/browse/SPARK-48121 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-48119) Promote ` KubernetesDriverSpec` to `DeveloperApi`

Zhou JIANG created SPARK-48119: -- Summary: Promote ` KubernetesDriverSpec` to `DeveloperApi` Key: SPARK-48119 URL: https://issues.apache.org/jira/browse/SPARK-48119 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-48103) Promote ` KubernetesDriverBuilder` to `DeveloperApi`

Zhou JIANG created SPARK-48103: -- Summary: Promote ` KubernetesDriverBuilder` to `DeveloperApi` Key: SPARK-48103 URL: https://issues.apache.org/jira/browse/SPARK-48103 Project: Spark Issue Type:

[jira] [Created] (SPARK-48017) Add Spark application submission worker for operator

Zhou JIANG created SPARK-48017: -- Summary: Add Spark application submission worker for operator Key: SPARK-48017 URL: https://issues.apache.org/jira/browse/SPARK-48017 Project: Spark Issue Type:

[jira] [Created] (SPARK-47950) Add Java API Module for Spark Operator

Zhou JIANG created SPARK-47950: -- Summary: Add Java API Module for Spark Operator Key: SPARK-47950 URL: https://issues.apache.org/jira/browse/SPARK-47950 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47943) Add Operator CI Task for Java Build and Test

Zhou JIANG created SPARK-47943: -- Summary: Add Operator CI Task for Java Build and Test Key: SPARK-47943 URL: https://issues.apache.org/jira/browse/SPARK-47943 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47889) Setup gradle as build tool for operator repository

Zhou JIANG created SPARK-47889: -- Summary: Setup gradle as build tool for operator repository Key: SPARK-47889 URL: https://issues.apache.org/jira/browse/SPARK-47889 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-47745) Add License to Spark Operator

Zhou JIANG created SPARK-47745: -- Summary: Add License to Spark Operator Key: SPARK-47745 URL: https://issues.apache.org/jira/browse/SPARK-47745 Project: Spark Issue Type: Sub-task Comp

[jira] [Created] (SPARK-45923) SPIP: Spark Kubernetes Operator

Zhou Jiang created SPARK-45923: -- Summary: SPIP: Spark Kubernetes Operator Key: SPARK-45923 URL: https://issues.apache.org/jira/browse/SPARK-45923 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-39100) RDD DeterministicLevel Needs Backward Compatibility

Zhou JIANG created SPARK-39100: -- Summary: RDD DeterministicLevel Needs Backward Compatibility Key: SPARK-39100 URL: https://issues.apache.org/jira/browse/SPARK-39100 Project: Spark Issue Type: B

[jira] [Created] (SPARK-34316) Optional Propagation of SPARK_CONF_DIR in K8s

Zhou JIANG created SPARK-34316: -- Summary: Optional Propagation of SPARK_CONF_DIR in K8s Key: SPARK-34316 URL: https://issues.apache.org/jira/browse/SPARK-34316 Project: Spark Issue Type: New Fea