Re: Unsubscribe

to unsubscribe: user-unsubscr...@spark.apache.org Shrikar archak wrote: unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

unsubscribe

Memory leak while caching in foreachBatch block

Hi, We have a structured streaming application, and we face a memory leak while caching in the foreachBatch block. We do unpersist every iteration, and we also verify via "spark.sparkContext.getPersistentRDDs" that we don't have unnecessary cached data. We also noted in the profiler that many