Re: Spark horizontal scaling is not supported in which cluster mode? Ask

2018-05-21 Thread Mark Hamstra
Horizontal scaling is scaling across multiple, distributed computers (or at least OS instances). Local mode is, therefore, by definition not horizontally scalable since it just uses a configurable number of local threads. If the question actually asked "which cluster manager...?", then I have a

Spark horizontal scaling is not supported in which cluster mode? Ask

2018-05-21 Thread unk1102
Hi I came by one Spark question which was about which spark cluster manager does not support horizontal scalability? Answer options were Mesos, Yarn, Standalone and local mode. I believe all cluster managers are horizontal scalable please correct if I am wrong. And I think answer is local mode. Is