Moon,

> ZeppelinServer try to terminate interpreter process when shutting down
[1].

Unfortunatally, this does not happen all the time.
I have seen zombie spark interpreter processes many times.
As a double conirmation - I see spark yarn application was still running.

> Also bin/zeppelin-deamon.sh script clean up if some processes are left
[2].

We were not using that script. We were just running like zeppelin.sh
--config ..
Will try to switch to zeppelin-deamon.sh and see if it makes a difference.

Thanks!




-- 
Ruslan Dautkhanov

On Thu, Dec 15, 2016 at 12:46 PM, moon <m...@zepl.com> wrote:

> Hi,
>
> ZeppelinServer try to terminate interpreter process when shutting down [1].
> Also bin/zeppelin-deamon.sh script clean up if some processes are left [2].
>
> If some processes are remained after shutting down Zeppelin, that's not an
> expected result.
>
> Thanks,
> moon
>
> [1]
> https://github.com/apache/zeppelin/blob/master/zeppelin-
> server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java#L159
> [2]
> https://github.com/apache/zeppelin/blob/master/bin/zeppelin-daemon.sh#L218
>
> On Thu, Dec 15, 2016 at 11:25 AM Ruslan Dautkhanov <dautkha...@gmail.com>
> wrote:
>
> > How to make Interpreter processes terminate if Zeppelin server exits?
> >
> > When we restart Zeppelin server (main process), in many cases,
> Interpreter
> > process keeps running, essential becoming a zombie processes.
> >
> > In case of Spark interpreter, it also holds SparkContext - consuming
> > server-side
> > resources too.
> >
> > How do we configure Zeppelin to kill all interpreters before its main
> > process terminates?
> > Or is this a bug?
> >
> > We're running ~2 weeks old snapshot of 0.7.0 Zeppelin.
> >
> >
> > Thank you,
> > Ruslan Dautkhanov
> >
>

Reply via email to