[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736957#comment-15736957 ] Saisai Shao commented on SPARK-13955: - Yes, forgot to mention this zip file doesn't support nested

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736236#comment-15736236 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao]: After testing, i can use

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734207#comment-15734207 ] Saisai Shao commented on SPARK-13955: - Can you please check the runtime environment of launching

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734195#comment-15734195 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao]: yes , the archive contains

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734184#comment-15734184 ] Saisai Shao commented on SPARK-13955: - Do you have spark-yarn_2.11 jar in your archive? > Spark in

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734082#comment-15734082 ] liyunzhang_intel commented on SPARK-13955: -- test pi in yarn-client mode by using

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734071#comment-15734071 ] Saisai Shao commented on SPARK-13955: - IIRC {{spark.yarn.archive}} should be worked, I tried

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731574#comment-15731574 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao] &[~tzachz]: when i try to use

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593453#comment-15593453 ] Tzach Zohar commented on SPARK-13955: - [~saisai_shao] can you clarify regarding option #1: when you

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301342#comment-15301342 ] Yi Zhou commented on SPARK-13955: - Thanks a lot [~jerryshao]! > Spark in yarn mode fails >

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300071#comment-15300071 ] Saisai Shao commented on SPARK-13955: - You will have 3 options to upload jars to distributed cache:

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300014#comment-15300014 ] Yi Zhou commented on SPARK-13955: - Hi [~jerryshao] I build a Spark 2.0 snapshot package which included a

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212609#comment-15212609 ] Apache Spark commented on SPARK-13955: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203774#comment-15203774 ] Saisai Shao commented on SPARK-13955: - [~zjffdu], I think way to fix this is to specify assembly jar

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199198#comment-15199198 ] Sean Owen commented on SPARK-13955: --- Is this likely? the YARN tests succeed. There isn't detail here

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199201#comment-15199201 ] Jeff Zhang commented on SPARK-13955: I just run spark-shell in yarn-client mode. > Spark in yarn

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201840#comment-15201840 ] Marcelo Vanzin commented on SPARK-13955: Actually, this was an oversight. I need to change the

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199927#comment-15199927 ] Marcelo Vanzin commented on SPARK-13955: How did you build Spark? Did you do "mvn package" or

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202411#comment-15202411 ] Jeff Zhang commented on SPARK-13955: I can reproduce it with both sbt and mvn. The scenario is same