??????Cleaning spark memory

2016-06-10 Thread Ricky
wml 

iPhone

--  --
??: Takeshi Yamamuro <linguin@gmail.com>
: 2016611 12:15
??: Cesar Flores <ces...@gmail.com>
: user <user@spark.apache.org>
????: Re: Cleaning spark memory

Re: Cleaning spark memory

2016-06-10 Thread Takeshi Yamamuro
Hi,

If you remove all cached data, please use `SQLContext#clearCache`.

// maropu

On Sat, Jun 11, 2016 at 3:18 AM, Cesar Flores  wrote:

>
> Hello:
>
> Sometimes I cache data frames to memory that I forget to unpersist, losing
> the variable reference in the process.
>
> Is there a way of: (i) is there a way of recovering references to data
> frames that are still persisted in memory OR (ii) a way of just unpersist
> all spark cached variables?
>
>
> Thanks
> --
> Cesar Flores
>



-- 
---
Takeshi Yamamuro


Cleaning spark memory

2016-06-10 Thread Cesar Flores
Hello:

Sometimes I cache data frames to memory that I forget to unpersist, losing
the variable reference in the process.

Is there a way of: (i) is there a way of recovering references to data
frames that are still persisted in memory OR (ii) a way of just unpersist
all spark cached variables?


Thanks
-- 
Cesar Flores