Moon, That worked! There were quite a few more configuration properties added, so I added those too in both zeppelin-site.xml and zeppelin-env.sh. But, now, I’m getting errors starting a spark context.
Thanks, Ben > On Jun 30, 2016, at 8:10 AM, moon soo Lee <leemoon...@gmail.com> wrote: > > Hi Ben, > > Livy interpreter is included in 0.6.0. If it is not listed when you create > interpreter setting, could you check if your 'zeppelin.interpreters' property > list Livy interpreter classes? (conf/zeppelin-site.xml) > > Thanks, > moon > > On Wed, Jun 29, 2016 at 11:52 AM Benjamin Kim <bbuil...@gmail.com > <mailto:bbuil...@gmail.com>> wrote: > On a side note… > > Has anyone got the Livy interpreter to be added as an interpreter in the > latest build of Zeppelin 0.6.0? By the way, I have Shiro authentication on. > Could this interfere? > > Thanks, > Ben > > >> On Jun 29, 2016, at 11:18 AM, moon soo Lee <m...@apache.org >> <mailto:m...@apache.org>> wrote: >> >> Livy interpreter internally creates multiple sessions for each user, >> independently from 3 binding modes supported in Zeppelin. >> Therefore, 'shared' mode, Livy interpreter will create sessions per each >> user, 'scoped' or 'isolated' mode will result create sessions per notebook, >> per user. >> >> Notebook is shared among users, they always use the same interpreter >> instance/process, for now. I think supporting per user interpreter >> instance/process would be future work. >> >> Thanks, >> moon >> >> On Wed, Jun 29, 2016 at 7:57 AM Chen Song <chen.song...@gmail.com >> <mailto:chen.song...@gmail.com>> wrote: >> Thanks for your explanation, Moon. >> >> Following up on this, I can see the difference in terms of single or >> multiple interpreter processes. >> >> With respect to spark drivers, since each interpreter spawns a separate >> Spark driver in regular Spark interpreter setting, it is clear to me the >> different implications of the 3 binding modes. >> >> However, when it comes to Livy server with impersonation turned on, I am a >> bit confused. Will Livy interpreter always create a new Spark driver (along >> with a Spark Context instance) for each user session, regardless of the >> binding mode of Livy interpreter? I am not very familiar with Livy, but from >> what I could tell, I see no difference between different binding modes for >> Livy on as far as how Spark drivers are concerned. >> >> Last question, when a notebook is shared among users, will they always use >> the same interpreter instance/process already created? >> >> Thanks >> Chen >> >> >> >> On Fri, Jun 24, 2016 at 11:51 AM moon soo Lee <m...@apache.org >> <mailto:m...@apache.org>> wrote: >> Hi, >> >> Thanks for asking question. It's not dumb question at all, Zeppelin docs >> does not explain very well. >> >> Spark Interpreter, >> >> 'shared' mode, a spark interpreter setting spawn a interpreter process to >> serve all notebooks which binded to this interpreter setting. >> 'scoped' mode, a spark interpreter setting spawn multiple interpreter >> processes per notebook which binded to this interpreter setting. >> >> Using Livy interpreter, >> >> Zeppelin propagate current user information to Livy interpreter. And Livy >> interpreter creates different session per user via Livy Server. >> >> >> Hope this helps. >> >> Thanks, >> moon >> >> >> On Tue, Jun 21, 2016 at 6:41 PM Chen Song <chen.song...@gmail.com >> <mailto:chen.song...@gmail.com>> wrote: >> Zeppelin provides 3 binding modes for each interpreter. With `scoped` or >> `shared` Spark interpreter, every user share the same SparkContext. Sorry >> for the dumb question, how does it differ from Spark via Ivy Server? >> >> >> -- >> Chen Song >> >
