Re: Spark2 DynamicAllocation doesn't release executors that used cache

2018-09-21 Thread Sergejs Andrejevs
Has anybody tried dynamic allocation with executors, which use cache? -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Spark2 DynamicAllocation doesn't release executors that used cache

2018-09-14 Thread Sergejs Andrejevs
nd might live for a long time, as well as containers that free the cache (unpersist) and are expected to be killed (along with idling executors). Is it a bug or some configuration is missing? Best regards, Sergejs Andrejevs