Re: Cache not getting cleaned.

2020-11-21 Thread Amit Sharma
please find attached the screenshot of no active task but memory i still
used .

[image: image.png]

On Sat, Nov 21, 2020 at 4:25 PM Amit Sharma  wrote:

> I am using df.cache and also unpersisting it. But when I check spark Ui
> storage I still see cache memory usage. Do I need to do any thing else.
>
> Also in executor tab on spark Ui for each executor memory used/total
> memory always display some used memory not sure if no request on streaming
> job then usages should be 0.
>
> Thanks
> Amit
>


Cache not getting cleaned.

2020-11-21 Thread Amit Sharma
I am using df.cache and also unpersisting it. But when I check spark Ui
storage I still see cache memory usage. Do I need to do any thing else.

Also in executor tab on spark Ui for each executor memory used/total memory
always display some used memory not sure if no request on streaming job
then usages should be 0.

Thanks
Amit