??????Cleaning spark memory
wml iPhone -- -- ??: Takeshi Yamamuro <linguin@gmail.com> : 2016611 12:15 ??: Cesar Flores <ces...@gmail.com> : user <user@spark.apache.org> ????: Re: Cleaning spark memory
Re: Cleaning spark memory
Hi, If you remove all cached data, please use `SQLContext#clearCache`. // maropu On Sat, Jun 11, 2016 at 3:18 AM, Cesar Floreswrote: > > Hello: > > Sometimes I cache data frames to memory that I forget to unpersist, losing > the variable reference in the process. > > Is there a way of: (i) is there a way of recovering references to data > frames that are still persisted in memory OR (ii) a way of just unpersist > all spark cached variables? > > > Thanks > -- > Cesar Flores > -- --- Takeshi Yamamuro
Cleaning spark memory
Hello: Sometimes I cache data frames to memory that I forget to unpersist, losing the variable reference in the process. Is there a way of: (i) is there a way of recovering references to data frames that are still persisted in memory OR (ii) a way of just unpersist all spark cached variables? Thanks -- Cesar Flores