Re: Re: about LIVY-424

2018-11-13 Thread lk_hadoop
I think it's really a mortal blow to livy about the repl scene . What I can do , I think is to monitoring spark metrics, when the driver's memory was used to a high leve I will isolate the session. 2018-11-14 lk_hadoop 发件人:"Harsch, Tim" 发送时间:2018-11-14 05:52 主题:Re: about LIVY-424 收件人:"u

Re: about LIVY-424

2018-11-13 Thread Harsch, Tim
While it's true LIVY-424 creates a session leak due to REPL leak in Scala it's not the only thing that can. I've run hundreds of simple scala commands and the leak is only mild/moderate. However, some scala commands can be really problematic. For instance import org.apache.spark.sql._ ru