Re: Re: about LIVY-424

2018-11-13 Thread lk_hadoop
I think it's really a mortal blow to livy about the repl scene . What I can do , I think is to monitoring spark metrics, when the driver's memory was used to a high leve I will isolate the session. 2018-11-14 lk_hadoop 发件人:"Harsch, Tim" 发送时间:2018-11-14 05:52 主题:Re: about LI

Re: about LIVY-424

2018-11-13 Thread Harsch, Tim
While it's true LIVY-424 creates a session leak due to REPL leak in Scala it's not the only thing that can. I've run hundreds of simple scala commands and the leak is only mild/moderate. However, some scala commands can be really problematic. For instance import org.apache.spark.sql._

Re: RE: about LIVY-424

2018-11-11 Thread lk_hadoop
tainer killed on request. Exit code is 143 Container exited with a non-zero exit code 143 Failing this attempt. Failing the application. 2018-11-12 lk_hadoop 发件人:"Rabe, Jens" 发送时间:2018-11-12 14:55 主题:RE: about LIVY-424 收件人:"user@livy.incubator.apache.org" 抄送: Do y

Re: about LIVY-424

2018-11-11 Thread Saisai Shao
If you're hitting the problem of LIVY-424, this is exactly a Scala REPL issue, not a Livy issue, it is hard to fix in the Livy side. lk_hadoop 于2018年11月12日周一 上午9:37写道: > hi,all: > I meet this issue https://issues.apache.org/jira/browse/LIVY-424 > , anybody know how to resolve it? >