Re: Spark with data on NFS v HDFS

2015-03-05 Thread Tobias Pfeiffer
Hi, On Thu, Mar 5, 2015 at 10:58 PM, Ashish Mukherjee ashish.mukher...@gmail.com wrote: I understand Spark can be used with Hadoop or standalone. I have certain questions related to use of the correct FS for Spark data. What is the efficiency trade-off in feeding data to Spark from NFS v

Spark with data on NFS v HDFS

2015-03-05 Thread Ashish Mukherjee
Hello, I understand Spark can be used with Hadoop or standalone. I have certain questions related to use of the correct FS for Spark data. What is the efficiency trade-off in feeding data to Spark from NFS v HDFS? If one is not using Hadoop, is it still usual to house data in HDFS for Spark