(kyuubi) branch master updated: [KYUUBI #6653] Persist spark pod name conf into batch metadata

[feiwang]

This is an automated email from the ASF dual-hosted git repository.

feiwang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kyuubi.git


The following commit(s) were added to refs/heads/master by this push:
     new dff40e8685 [KYUUBI #6653] Persist spark pod name conf into batch 
metadata
dff40e8685 is described below

commit dff40e86853fa54789e778fce304132d0a9fe6b5
Author: Wang, Fei <fwan...@ebay.com>
AuthorDate: Mon Sep 2 12:34:18 2024 -0700

    [KYUUBI #6653] Persist spark pod name conf into batch metadata
    
    # :mag: Description
    ## Issue References 🔗
    
    As title, save the pod name conf into batch metadata, it is very meaningful.
    ## Describe Your Solution 🔧
    For spark on k8s batch app, persist the spark pod name configs into batch 
metadata.
    
    ## Types of changes :bookmark:
    
    - [ ] Bugfix (non-breaking change which fixes an issue)
    - [x] New feature (non-breaking change which adds functionality)
    - [ ] Breaking change (fix or feature that would cause existing 
functionality to change)
    
    ## Test Plan 🧪
    
    #### Behavior Without This Pull Request :coffin:
    
    #### Behavior With This Pull Request :tada:
    
    #### Related Unit Tests
    
    ---
    
    # Checklist 📝
    
    - [x] This patch was not authored or co-authored using [Generative 
Tooling](https://www.apache.org/legal/generative-tooling.html)
    
    **Be nice. Be informative.**
    
    Closes #6653 from turboFei/pod_name_conf.
    
    Closes #6653
    
    2bfa0aa9e [Wang, Fei] save spark pod name conf into metadata
    
    Authored-by: Wang, Fei <fwan...@ebay.com>
    Signed-off-by: Wang, Fei <fwan...@ebay.com>
---
 .../main/scala/org/apache/kyuubi/session/KyuubiBatchSession.scala    | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git 
a/kyuubi-server/src/main/scala/org/apache/kyuubi/session/KyuubiBatchSession.scala
 
b/kyuubi-server/src/main/scala/org/apache/kyuubi/session/KyuubiBatchSession.scala
index c8cce59e1f..ce8e4d0013 100644
--- 
a/kyuubi-server/src/main/scala/org/apache/kyuubi/session/KyuubiBatchSession.scala
+++ 
b/kyuubi-server/src/main/scala/org/apache/kyuubi/session/KyuubiBatchSession.scala
@@ -163,7 +163,10 @@ class KyuubiBatchSession(
         Map(KyuubiConf.KUBERNETES_CONTEXT.key -> context)
       }.getOrElse(Map.empty) ++ appMgrInfo.kubernetesInfo.namespace.map { 
namespace =>
         Map(KyuubiConf.KUBERNETES_NAMESPACE.key -> namespace)
-      }.getOrElse(Map.empty)
+      }.getOrElse(Map.empty) ++ (batchJobSubmissionOp.builder match {
+        case builder: SparkProcessBuilder => 
builder.appendPodNameConf(optimizedConf)
+        case _ => Map.empty[String, String]
+      })
     }
 
     (metadata, fromRecovery) match {