Shay Rojansky created SPARK-7725: ------------------------------------ Summary: --py-files doesn't seem to work in YARN cluster mode Key: SPARK-7725 URL: https://issues.apache.org/jira/browse/SPARK-7725 Project: Spark Issue Type: Bug Components: Deploy, YARN Affects Versions: 1.3.1 Environment: Ubuntu 14.04, YARN 2.7.0 on local filesystem Reporter: Shay Rojansky
I'm having issues with submitting a Spark Yarn job in cluster mode when the cluster filesystem is file:///. It seems that additional resources (--py-files) are simply being skipped and not being added into the PYTHONPATH. The same issue may also exist for --jars, --files, etc. (I haven't checked) (I sent a mail to the Spark users list and Marcelo Vanzin confirms it's a bug, unrelated to the local filesystem) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org