Hi Koert, Could you provide more details? Job arguments, log messages, errors, etc.
On Fri, Jun 20, 2014 at 9:40 AM, Koert Kuipers <ko...@tresata.com> wrote: > i noticed that when i submit a job to yarn it mistakenly tries to upload > files to local filesystem instead of hdfs. what could cause this? > > in spark-env.sh i have HADOOP_CONF_DIR set correctly (and spark-submit does > find yarn), and my core-site.xml has a fs.defaultFS that is hdfs, not local > filesystem. > > thanks! koert -- Marcelo
