subject:"Using YARN w\/o HDFS"

Re: Using YARN w/o HDFS

2017-06-23 Thread Steve Loughran

you'll need a filesystem with * consistency * accessibility everywhere * supports a binding through one of the hadoop fs connectors NFS-style distributed filesystems work with file:// ; things like glusterfs need their own connectors. you can use azure's wasb:// as a drop in replacement for

Re: Using YARN w/o HDFS

2017-06-21 Thread Chen He

chang your fs.defaultFS to point to local file system and have a try On Wed, Jun 21, 2017 at 4:50 PM, Alaa Zubaidi (PDF) wrote: > Hi, > > Can we run Spark on YARN with out installing HDFS? > If yes, where would HADOOP_CONF_DIR point to? > > Regards, > > *This message may

Using YARN w/o HDFS

2017-06-21 Thread Alaa Zubaidi (PDF)

Hi, Can we run Spark on YARN with out installing HDFS? If yes, where would HADOOP_CONF_DIR point to? Regards, -- *This message may contain confidential and privileged information. If it has been sent to you in error, please reply to advise the sender of the error and then immediately