hai-tao-1 commented on code in PR #36606:
URL: https://github.com/apache/spark/pull/36606#discussion_r878786767
##########
core/src/main/scala/org/apache/spark/internal/config/package.scala:
##########
@@ -2363,4 +2363,12 @@ package object config {
.version("3.3.0")
.intConf
.createWithDefault(5)
+
+ val SPARK_PROPERTIES_KEY_QUEUE = ConfigBuilder("spark.properties.key.queue")
+ .doc("Specifies the spark property key name for queue information." +
+ " When it is specified, the eventLog parser could use it as the key" +
+ " to extract the queue value from the Spark Properties in the eventLog
files.")
+ .version("3.3.0")
+ .stringConf
+ .createWithDefault("spark.yarn.queue")
Review Comment:
Same as above, the configuration is only default to `spark.yarn.queue` which
is the spark properties key name for queue in Yarn, but can be overridden as a
spark conf if spark is running on other platforms. For example, when spark runs
on K8s, the queue info may be specified as a pod annotation which is used by a
scheduler to schedule jobs to the corresponding queues in the cluster. A
example of such queue property key name in k8s could be
`spark.kubernetes.driver.label.queue`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
