Re: newbie does python del, gc.collect() release all resources?

[Dana Powers]

Are you asking about a Kafka python driver? Or are referring to pyspark?
On Aug 1, 2016 10:03, "Andy Davidson"  wrote:

> I am new to python.
>
> I find my self working with several data frames at the same time. I have
> run
> into some driver memory problems and want to make sure I release all
> resource as soon as possible.
>
> 1. should I be calling del and gc.collect() ?
> 2. If a dataframe was cached do I need to explicitly call unpersist() or
> will del,gc.collect() do this for me?
>
> Thanks
>
> Andy
>
>
>
>
>

newbie does python del, gc.collect() release all resources?

[Andy Davidson]

I am new to python.

I find my self working with several data frames at the same time. I have run
into some driver memory problems and want to make sure I release all
resource as soon as possible.

1. should I be calling del and gc.collect() ?
2. If a dataframe was cached do I need to explicitly call unpersist() or
will del,gc.collect() do this for me?

Thanks

Andy