Yes, persist/cache will cache an RDD only when an action is applied to it.

On Sun, May 4, 2014 at 6:32 AM, Earthson <[email protected]> wrote:

> thx for the help, unpersist is excatly what I want:)
>
> I see that spark will remove some cache automatically when memory is full,
> it is much more helpful if the rule satisfy something like LRU
>
> ~~~~
>
> It seems that persist and cache is some kind of lazy?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/cache-not-work-as-expected-for-iteration-tp5292p5308.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Reply via email to