[ https://issues.apache.org/jira/browse/SPARK-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347209#comment-14347209 ]
Marcelo Vanzin commented on SPARK-6144: --------------------------------------- Separately, we should check the unit tests to make sure this is properly covered. It probably missed tests because the broken path is the one that handles "hdfs:" urls... > When in cluster mode using ADD JAR with a hdfs:// sourced jar will fail > ----------------------------------------------------------------------- > > Key: SPARK-6144 > URL: https://issues.apache.org/jira/browse/SPARK-6144 > Project: Spark > Issue Type: Bug > Affects Versions: 1.3.0 > Reporter: Trystan Leftwich > Assignee: Trystan Leftwich > Priority: Blocker > > While in cluster mode if you use ADD JAR with a HDFS sourced jar it will fail > trying to source that jar on the worker nodes with the following error: > {code} > 15/03/03 04:56:50 ERROR executor.Executor: Exception in task 0.0 in stage 0.0 > (TID 0) > java.io.FileNotFoundException: > /yarn/nm/usercache/vagrant/appcache/application_1425166832391_0027/-19222735701425358546704_cache > (No such file or directory) > at java.io.FileInputStream.open(Native Method) > at java.io.FileInputStream.<init>(FileInputStream.java:146) > {code} > PR https://github.com/apache/spark/pull/4880 -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org