Re: Python interpreter getting hung

2018-10-08 Thread Bicky Ealias
We were facing the same issue.Currently scheduler size is set to 100.I
followed Jeff's suggestion  on his excellent blog to clean inactive
interpreter jvms -refer the link
https://medium.com/@zjffdu/zeppelin-0-8-0-new-features-ea53e8810235 every
30 minutes.
0.8.1 version would have a fix to make this value configurable.


On Tue., 9 Oct. 2018, 3:03 am Ben Vogan,  wrote:

> Hi there,
>
> We are using Zeppelin in a shared environment and are having persistent
> problems with the Python interpreter getting into a state where paragraphs
> are PENDING forever.  I have looked at the zeppelin-interpreter-python*.log
> files and there is virtually nothing in there - just starting/finished
> events.  Is there any way to see a log of any errors from python scripts?
> Any suggestions on how to debug this?
>
> Help is greatly appreciated!
>
> Thanks,
> --
> *BENJAMIN VOGAN | *Director of Architecture
>
>  
> 
>  
> 
> 
> 
>  
> 
> 
> 
>


Re: Python interpreter getting hung

2018-10-08 Thread Jeff Zhang
Which version do you use ? Could you enable the debug info via the
following log4j ?

log4j.rootLogger = INFO, dailyfile

log4j.appender.stdout = org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout = org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=%5p [%d] ({%t} %F[%M]:%L) -
%m%n

log4j.appender.dailyfile.DatePattern=.-MM-dd
log4j.appender.dailyfile.DEBUG = INFO
log4j.appender.dailyfile = org.apache.log4j.DailyRollingFileAppender
log4j.appender.dailyfile.File = ${zeppelin.log.file}
log4j.appender.dailyfile.layout = org.apache.log4j.PatternLayout
log4j.appender.dailyfile.layout.ConversionPattern=%5p [%d] ({%t} %F[%M]:%L)
- %m%n


log4j.logger.org.apache.zeppelin.python=DEBUG
log4j.logger.org.apache.zeppelin.spark=DEBUG

Ben Vogan 于2018年10月9日周二 上午12:03写道:

> Hi there,
>
> We are using Zeppelin in a shared environment and are having persistent
> problems with the Python interpreter getting into a state where paragraphs
> are PENDING forever.  I have looked at the zeppelin-interpreter-python*.log
> files and there is virtually nothing in there - just starting/finished
> events.  Is there any way to see a log of any errors from python scripts?
> Any suggestions on how to debug this?
>
> Help is greatly appreciated!
>
> Thanks,
> --
> *BENJAMIN VOGAN | *Director of Architecture
>
>  
> 
>  
> 
> 
> 
>  
> 
> 
> 
>


Python interpreter getting hung

2018-10-08 Thread Ben Vogan
Hi there,

We are using Zeppelin in a shared environment and are having persistent
problems with the Python interpreter getting into a state where paragraphs
are PENDING forever.  I have looked at the zeppelin-interpreter-python*.log
files and there is virtually nothing in there - just starting/finished
events.  Is there any way to see a log of any errors from python scripts?
Any suggestions on how to debug this?

Help is greatly appreciated!

Thanks,
-- 
*BENJAMIN VOGAN | *Director of Architecture