It helped, thank you very much!
2015-11-25 0:19 GMT-08:00 Mina Lee :
> Thank you for sharing your env.
> I tried same configurations as yours and could reproduce the error.
> I found out this is because of the duplicate java memory option for spark
> driver which are ZEPPELIN_MEM and spark.driver
E setting if I export ZEPPELIN_INT_MEM="-Xmx10g",
>driver storage memory is 4.8G.
>
> The difference here is that first one starts spark interpreter process by
> running spark_submit and second one runs with java.
>
> Hope this helps!
>
>
>
&
I'm trying to configure driver memory size. So far I tied next parameters:
-
export JAVA_INTP_OPTS="-Xmx10g"
-
export SPARK_SUBMIT_OPTIONS="--driver-memory 10g --executor-memory 10g"
-
" -Xmx3m \
-
Change SparkInterpreter.java: conf.set("spark.executor.memory", "
I'm trying to configure driver memory size. So far I tied next parameters:
-
export JAVA_INTP_OPTS="-Xmx10g"
-
export SPARK_SUBMIT_OPTIONS="--driver-memory 10g --executor-memory 10g"
-
export ZEPPELIN_JAVA_OPTS=" -Xmx3m \
-Dspark.serializer=org.apache.spark.serialize
