I don't think I'd enable swap on a cluster. You'd rather processes fail than grind everything to a halt. You'd buy more memory or optimize memory before trading it for I/O.
On Thu, Sep 22, 2016 at 6:29 PM, Michael Segel <msegel_had...@hotmail.com> wrote: > Ok… gotcha… wasn’t sure that YARN just looked at the heap size allocation and > ignored the off heap. > > WRT over all OS memory… this would be one reason why I’d keep a decent amount > of swap around. (Maybe even putting it on a fast device like an .m2 or PCIe > flash drive…. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
