I rsync the spark-1.0.1 directory to all the nodes. Yep, one needs Spark in all the nodes irrespective of Hadoop/YARN. Cheers <k/>
On Tue, Jul 8, 2014 at 6:24 PM, Robert James <srobertja...@gmail.com> wrote: > I have a Spark app which runs well on local master. I'm now ready to > put it on a cluster. What needs to be installed on the master? What > needs to be installed on the workers? > > If the cluster already has Hadoop or YARN or Cloudera, does it still > need an install of Spark? >