They way we're deploying spark is in the standalone mode - I never seen any value in using YARN for that, but I guess it's just me.
HDFS use comes with no hassle, AFAIR, the way we setup it up. But my knowledge might be a bit outdated... Cos On Thu, Feb 19, 2015 at 08:45PM, jay vyas wrote: > hi folks. > > is anyone planning to use spark on yarn or spark w/ hdfs in bigtop? I > havent tried either... > > - anyone using spark <-> HDFS in bigtop ? Do we need to update any spark > configs to do so ? > - we want spark to run on yarn ? standalone ? > > im spinning some VMs up now, ill let folks know if it works. > -- > jay vyas
