Thanks for the quick response and confirmation, Marcelo, I just opened
https://issues.apache.org/jira/browse/SPARK-7725.
On Mon, May 18, 2015 at 9:02 PM, Marcelo Vanzin van...@cloudera.com wrote:
Hi Shay,
Yeah, that seems to be a bug; it doesn't seem to be related to the default
FS nor
I'm having issues with submitting a Spark Yarn job in cluster mode when the
cluster filesystem is file:///. It seems that additional resources
(--py-files) are simply being skipped and not being added into the
PYTHONPATH. The same issue may also exist for --jars, --files, etc.
We use a simple NFS
Hi Shay,
Yeah, that seems to be a bug; it doesn't seem to be related to the default
FS nor compareFs either - I can reproduce this with HDFS when copying files
from the local fs too. In yarn-client mode things seem to work.
Could you file a bug to track this? If you don't have a jira account I
