Using Zeppelin continuously with the same UI open

2016-10-03 Thread Mich Talebzadeh
Hi, I have been testing Zeppelin in conjunction with Spark sql and Spark functional programming. I notice that as time gets by and many calls are made with the same session open with different codes and plots, Zeppelin becomes very slow and eventually one gets a message "pipe broken" in the run.

Livy with 0.6.0

2016-10-03 Thread Herman Yu
Hi everyone, Is there a way to enable the REPL output for Livy interpreter with zeppelin 0.6 and spark 1.6? set zeppelin.livy.spark.printREPLOutput to true doesn’t work with Livy interpreter. Thanks Herman.

Restart zeppelin spark interpreter

2016-10-03 Thread Jung, Soonoh
Hi everyone, I am using Zeppelin in AWS EMR (Zeppelin 0.6.1, spark 2.0 on Yarn RM) Basically Zeppelin spark interpreter's spark job is not finishing after executing a notebook. It looks like the spark job still occupying memory a lot in my Yarn cluster. Is there a way restart spark interpreter aut

Re: Restart zeppelin spark interpreter

2016-10-03 Thread Jonathan Kelly
On the most recent several releases of EMR, Spark dynamicAllocation is automatically enabled, as it allows longer running apps like Zeppelin's Spark interpreter to continue running in the background without taking up resources for any executors unless Spark jobs are actively running. However, if y

Re: Restart zeppelin spark interpreter

2016-10-03 Thread Jung, Soonoh
Hi Jonathan, Thank you for the information! Yes, I am using maximizeResourceAllocation. I will try turn off this and just use dynamicAllocation alone. Regards, Soonoh On 4 October 2016 at 11:07, Jonathan Kelly wrote: > On the most recent several releases of EMR, Spark dynamicAllocation is > au