dongjoon-hyun commented on a change in pull request #32564:
URL: https://github.com/apache/spark/pull/32564#discussion_r633265397



##########
File path: 
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
##########
@@ -70,6 +70,15 @@ private[spark] object Config extends Logging {
       .booleanConf
       .createWithDefault(false)
 
+  val KUBERNETES_DRIVER_REUSE_PVC =
+    ConfigBuilder("spark.kubernetes.driver.reusePersistentVolumeClaim")
+      .doc("If true, driver pod tries to reuse driver-owned on-demand 
persistent volume claims " +
+        "of the deleted executor pods. This can be useful to reduce executor 
pod creation delay. " +
+        s"This requires ${KUBERNETES_DRIVER_OWN_PVC.key}=true.")

Review comment:
       I got what is your concerns.
   
   When you are saying `the PVC of removed executors`, you are referring the 
Spark executor JVM inside pod. Here, in the description, I chose `xxx of the 
deleted executor pods` to avoid that confusions.
   
   For example, the pod in `Terminating` status is not deleted yet. So, it's 
not included at `the deleted executor pods`. So, there is no reusable PVC in 
this case. I'll make it more clear in the conf description.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to