[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-2914:
-
Fix Version/s: (was: 1.2.0)
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Assignee: Andrew Or
Priority: Critical
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2914:
---
Fix Version/s: (was: 1.3.0)
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Assignee: Andrew Or
Priority: Critical
Fix For: 1.2.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2914:
---
Assignee: Andrew Or
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Assignee: Andrew Or
Priority: Critical
Fix For: 1.2.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2914:
---
Fix Version/s: 1.2.0
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Assignee: Andrew Or
Priority: Critical
Fix For: 1.2.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2914:
---
Fix Version/s: (was: 1.1.0)
1.2.0
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Priority: Critical
Fix For: 1.2.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2914:
---
Priority: Blocker (was: Major)
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Priority: Blocker
Fix For: 1.1.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2914:
---
Priority: Critical (was: Blocker)
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Priority: Critical
Fix For: 1.1.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times
[
https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-2914:
-
Description:
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \ \\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
was:
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \ \\
{code}
This will be split incorrectly by Utils.splitCommandString.
spark.*.extraJavaOptions are evaluated too many times
-
Key: SPARK-2914
URL: https://issues.apache.org/jira/browse/SPARK-2914
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.0.2
Reporter: Andrew Or
Fix For: 1.1.0
If we pass the following to spark.executor.extraJavaOptions,
{code}
-Dthem.quotes=the \best\ joke ever -Dthem.backslashes= \\ \\
{code}
These will first be escaped once when the SparkSubmit JVM is launched. This
becomes the following string.
{code}
scala sc.getConf.get(spark.driver.extraJavaOptions)
res0: String = -Dthem.quotes=the best joke ever -Dthem.backslashes= \ \
\\
{code}
This will be split incorrectly by Utils.splitCommandString.
Of course, this also affects spark.driver.extraJavaOptions.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
