[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111024#comment-15111024
]
Marcelo Vanzin commented on SPARK-12650:
If it works it's a workaround; that's a
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110964#comment-15110964
]
Sean Owen commented on SPARK-12650:
---
[~vanzin] is that the intended way to set this? if
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107061#comment-15107061
]
John Vines commented on SPARK-12650:
SPARK_SUBMIT_OPTS seems to work. -Xmx256m change
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106786#comment-15106786
]
Sean Owen commented on SPARK-12650:
---
[~jvi...@gmail.com] are you able to follow up on t
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15095354#comment-15095354
]
Marcelo Vanzin commented on SPARK-12650:
Can you try the other one ({{SPARK_SUBMI
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094189#comment-15094189
]
John Vines commented on SPARK-12650:
So I ran it and got this message
{code}SPARK_JAV
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089684#comment-15089684
]
Marcelo Vanzin commented on SPARK-12650:
{{SparkLauncher}} has a constructor that
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089673#comment-15089673
]
John Vines commented on SPARK-12650:
How would I set those through the java SparkLaun
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086173#comment-15086173
]
Marcelo Vanzin commented on SPARK-12650:
Can you try the env variables I mention
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086167#comment-15086167
]
John Vines commented on SPARK-12650:
I do care about knowing when the spark job is fi
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086148#comment-15086148
]
Marcelo Vanzin commented on SPARK-12650:
Do you need the launcher process around
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086138#comment-15086138
]
John Vines commented on SPARK-12650:
I'm launching the spark job from inside an App M
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086135#comment-15086135
]
John Vines commented on SPARK-12650:
{code}[root@datanode1-systemtest-john-1 /]# java
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086133#comment-15086133
]
John Vines commented on SPARK-12650:
In the test example I was using, I set driver an
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086029#comment-15086029
]
Marcelo Vanzin commented on SPARK-12650:
And one last comment: you can set either
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086023#comment-15086023
]
Marcelo Vanzin commented on SPARK-12650:
Also, can you clarify this statement:
{
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085928#comment-15085928
]
Marcelo Vanzin commented on SPARK-12650:
You can find the default Xmx like this:
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085773#comment-15085773
]
Sean Owen commented on SPARK-12650:
---
This may be an aside but I'm curious -- what is yo
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085747#comment-15085747
]
John Vines commented on SPARK-12650:
No, neither Xmx nor Xms are set. This has to do
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085734#comment-15085734
]
Sean Owen commented on SPARK-12650:
---
Hm, the default heap size in the JVM isn't 8GB is
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085722#comment-15085722
]
John Vines commented on SPARK-12650:
I'm referring to the client which is launching t
[
https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084497#comment-15084497
]
Saisai Shao commented on SPARK-12650:
-
[~vines], what is your meaning of "SparkSubmit
22 matches
Mail list logo
