I am new to python. I find my self working with several data frames at the same time. I have run into some driver memory problems and want to make sure I release all resource as soon as possible.
1. should I be calling del and gc.collect() ? 2. If a dataframe was cached do I need to explicitly call unpersist() or will del,gc.collect() do this for me? Thanks Andy