RAM or Virtual memory is finite, so data size needs to be considered before persist. Please see below documentation when to choose the persistency level.
http://spark.apache.org/docs/latest/programming-guide.html#which-storage-level-to-choose Thanks, Sreekanth Jella From: kant kodali
