[jira] [Created] (SPARK-12943) spark should distribute truststore if used in yarn-cluster mode

2016-01-20 Thread John Vines (JIRA)
John Vines created SPARK-12943: -- Summary: spark should distribute truststore if used in yarn-cluster mode Key: SPARK-12943 URL: https://issues.apache.org/jira/browse/SPARK-12943 Project: Spark

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-19 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107061#comment-15107061 ] John Vines commented on SPARK-12650: SPARK_SUBMIT_OPTS seems to work. -Xmx256m changed the heap

[jira] [Comment Edited] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-12 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094189#comment-15094189 ] John Vines edited comment on SPARK-12650 at 1/12/16 10:52 PM: -- So I ran it

[jira] [Commented] (SPARK-10910) spark.{executor,driver}.userClassPathFirst don't work for kryo (probably others)

2016-01-12 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095177#comment-15095177 ] John Vines commented on SPARK-10910: snappy-java is another one >

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-12 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094189#comment-15094189 ] John Vines commented on SPARK-12650: So I ran it and got this message {code}SPARK_JAVA_OPTS was

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-08 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089673#comment-15089673 ] John Vines commented on SPARK-12650: How would I set those through the java SparkLauncher? > No

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-06 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086133#comment-15086133 ] John Vines commented on SPARK-12650: In the test example I was using, I set driver and executor to

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-06 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086135#comment-15086135 ] John Vines commented on SPARK-12650: {code}[root@datanode1-systemtest-john-1 /]# java

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-06 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086138#comment-15086138 ] John Vines commented on SPARK-12650: I'm launching the spark job from inside an App Master, as I said

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-06 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085747#comment-15085747 ] John Vines commented on SPARK-12650: No, neither Xmx nor Xms are set. This has to do with java 7 and

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-06 Thread John Vines (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086167#comment-15086167 ] John Vines commented on SPARK-12650: I do care about knowing when the spark job is finished. Unless

[jira] [Created] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-05 Thread John Vines (JIRA)
John Vines created SPARK-12650: -- Summary: No means to specify Xmx settings for SparkSubmit in yarn-cluster mode Key: SPARK-12650 URL: https://issues.apache.org/jira/browse/SPARK-12650 Project: Spark