persist and unpersist. unpersist:Mark the RDD as non-persistent, and remove all blocks for it from memory and disk
2014-03-19 16:40 GMT+08:00 林武康 <vboylin1...@gmail.com>: > Hi, can any one tell me about the lifecycle of an rdd? I search through > the official website and still can't figure it out. Can I use an rdd in > some stages and destroy it in order to release memory because that no > stages ahead will use this rdd any more. Is it possible? > > Thanks! > > Sincerely > Lin wukang >
