Re: Do we really need mesos or yarn? or is standalone sufficent?

Hi Kant, Hope following information will help . 1)Cluster https://jaceklaskowski.gitbooks.io/mastering-apache-spark/content/spark-standalone.html http://spark.apache.org/docs/latest/hardware-provisioning.html 2) Yarn vs Mesos https://www.linkedin.com/pulse/mesos-compare-yarn-vaquar-

Re: Do we really need mesos or yarn? or is standalone sufficent?

Hi Saif, What do you mean by small cluster? Any specific size? Also can you shine some light on how YARN takes a win over mesos? Thanks, kant On Fri, Dec 16, 2016 at 10:45 AM, wrote: > In my experience, Standalone works very well in small cluster where there >

Re: Do we really need mesos or yarn? or is standalone sufficent?

+1 Sent from my iPhone > On Dec 16, 2016, at 10:45 AM, > wrote: > > In my experience, Standalone works very well in small cluster where there > isn’t anything else running. > > Bigger cluster or shared resources,

RE: Do we really need mesos or yarn? or is standalone sufficent?

In my experience, Standalone works very well in small cluster where there isn’t anything else running. Bigger cluster or shared resources, YARN takes a win, surpassing the overhead of spawning containers as opposed to a background running worker. Best is if you try both, if standalone is good