??????Cleaning spark memory

2016-06-10 Thread Ricky
wml iPhone -- -- ??: Takeshi Yamamuro : 2016年6月11日 12:15 ??: Cesar Flores : user : Re: Cleaning spark memory

Re: Cleaning spark memory

2016-06-10 Thread Takeshi Yamamuro
Hi, If you remove all cached data, please use `SQLContext#clearCache`. // maropu On Sat, Jun 11, 2016 at 3:18 AM, Cesar Flores wrote: > > Hello: > > Sometimes I cache data frames to memory that I forget to unpersist, losing > the variable reference in the process. > > Is there a way of: (i) is

Cleaning spark memory

2016-06-10 Thread Cesar Flores
Hello: Sometimes I cache data frames to memory that I forget to unpersist, losing the variable reference in the process. Is there a way of: (i) is there a way of recovering references to data frames that are still persisted in memory OR (ii) a way of just unpersist all spark cached variables? T