MEMORY_ONLY will fail if there is not enough memory but MEMORY_AND_DISK will spill to disk
Regards Sab On Tue, Aug 18, 2015 at 12:45 PM, Harsha HN <99harsha.h....@gmail.com> wrote: > Hello Sparkers, > > I would like to understand difference btw these Storage levels for a RDD > portion that doesn't fit in memory. > As it seems like in both storage levels, whatever portion doesnt fit in > memory will be spilled to disk. Any difference as such? > > Thanks, > Harsha > -- Architect - Big Data Ph: +91 99805 99458 Manthan Systems | *Company of the year - Analytics (2014 Frost and Sullivan India ICT)* +++