[jira] [Created] (ZEPPELIN-1272) Zeppelin spark innterpreters throws java.lang.StackOverflowError after running a while

[lichenglin (JIRA)]

lichenglin created ZEPPELIN-1272:
------------------------------------

             Summary: Zeppelin spark innterpreters throws 
java.lang.StackOverflowError after running a while
                 Key: ZEPPELIN-1272
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1272
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters
    Affects Versions: 0.6.0
            Reporter: lichenglin


I'm using Zeppelin  to run some spark job with crontab.

But In the last days,I found Zeppelin's spark interpreter shut down almost 
every day once or more.

And here is the log 
{code}
java.lang.StackOverflowError
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
        at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
        at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
        at 
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
        at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
        at 
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
        at 
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
        at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
        at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
        at 
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
        at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
        at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
        at 
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
        at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
        at 
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
        at 
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
        at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
        at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
        at 
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
        at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
        at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
        at 
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
        at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
        at 
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
        at 
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
        at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
        at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
        at 
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
        at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
        at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
........
{code}

It was a very very long log, seems to be a loop

I have adjust the env like this
{code}
export JAVA_HOME=/home/hadoop/jdk
export MASTER=spark://namenode:7077 
export ZEPPELIN_PORT=10001
export SPARK_HOME=/home/hadoop/spark-1.6.2-bin-hadoop2.6
export SPARK_SUBMIT_OPTIONS="--driver-memory 2g --executor-memory 5g 
--driver-class-path 
/home/hadoop/spark-1.6.2-bin-hadoop2.6/extlib/oracle-driver.jar:/home/hadoop/spark-1.6.2-bin-hadoop2.6/extlib/phoenix-4.7.0-HBase-1.1-client-spark.jar:/home/hadoop/spark-1.6.2-bin-hadoop2.6/extlib/spark-csv_2.10-1.3.0.jar:/home/hadoop/zeppelin-0.6.0-bin-all/lib/*:/home/hadoop/zeppelin-0.6.0-bin-all/*::/home/hadoop/zeppelin-0.6.0-bin-all/conf:/home/hadoop/zeppelin-0.6.0-bin-all/interpreter/spark/*::/home/hadoop/zeppelin-0.6.0-bin-all/conf:/home/hadoop/zeppelin-0.6.0-bin-all/conf:/home/hadoop/zeppelin-0.6.0-bin-all/lib/zeppelin-interpreter-0.6.0.jar/home/hadoop/zeppelin-0.6.0-bin-all/interpreter/spark/zeppelin-spark-0.6.0.jar"
 
export ZEPPELIN_MEM=-Xmx4096m
export ZEPPELIN_JAVA_OPTS="-Xmx4096m"

{code}
but not work at all.

I really don't know how to fix it



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)