Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1538#discussion_r15430975
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/SparkDeploySchedulerBackend.scala
---
@@ -45,7 +45,7 @@ private[spark] class SparkDeploySchedulerBackend(
conf.get("spark.driver.host"), conf.get("spark.driver.port"),
CoarseGrainedSchedulerBackend.ACTOR_NAME)
val args = Seq(driverUrl, "{{EXECUTOR_ID}}", "{{HOSTNAME}}",
"{{CORES}}", "{{WORKER_URL}}")
- val extraJavaOpts =
sc.conf.getOption("spark.executor.extraJavaOptions")
+ val extraJavaOpts =
sc.conf.getOption("spark.executor.extraJavaOptions").toSeq
--- End diff --
This actually handles quoted strings, spaces, backslashes, and a
combination of all the above (I have tested this). This is because we pass
around these options as a sequence of strings before using them in commands.
I still need to verify the same for YARN.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
