That confirms the three technologies are competing
for the same space as I suspected but wasn't sure.
I can focus on the APIs and not waste any unnecessary time on even
looking at mesos and yarn.
Backbutton.co.uk
¯\_(ツ)_/¯
♡۶Java♡۶RMI ♡۶
Make Use Method {MUM}
makeuse.org
<http://www.backbutton.co.uk>
On Sat, 28 Mar 2020 at 02:07, Sean Owen <sro...@gmail.com> wrote:
> Spark standalone is a resource manager like YARN and Mesos. It is
> specific to Spark, and is therefore simpler, as it assumes it can take
> over whole machines.
> YARN and Mesos are for mediating resource usage across applications on
> a cluster, which may be running more than Spark apps.
>
> On Fri, Mar 27, 2020 at 7:30 PM Zahid Rahman <zahidr1...@gmail.com> wrote:
> >
> > OK, Thanks.
> >
> > issue of load balancing /Clustering:
> >
> > I believe if I setup clustering like so :
> > sbin/start-master.sh
> > sbin/start-slave spark://master:port
> >
> > another machine
> > sbin/start-slave spark://master:port
> >
> > Does yarn and mesos do anything different than that ?
> >
> > The spark clustering setup and yarn and mesos, are they competing
> technologies for the same space / functionality ?
> >
>
