GitHub user tgravescs added a comment to the discussion: Spark Driver memory Leak?
I've looked at a lot at this the last couple days. The python objects that don't seem to be cleaned up at the ones run in the user code. where execute_python.py does the compile and then exec(). The ones initialized and used in the execute_python.py script tiself seem to be cleaned up ok. i'm not quite sure why though. I also tried to manually call gc.collect() in the user code without any luck so far. it would be really nice to understand what is going on. GitHub link: https://github.com/apache/kyuubi/discussions/7060#discussioncomment-13160938 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
