Hi neprasad, You should give a try to Tachyon system. or any other in memory db. here you have the link <http://www.slideshare.net/haoyuanli/tachyon20141121ampcamp5-41881671?related=1> of a slideshow explaining all this. what you want is not 10th slide but the whole slide is worth reading.
Thank you. Himanshu -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-stop-making-Multiple-copies-in-memory-when-running-multiple-Spark-jobs-tp23534p23562.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org