Re: Zeppelin in multi user environment

2015-06-30 Thread John Omernik
Alex - How are you addressing the Yarn's need to have dynamic ports available on the yarn-client so the app master can connect to it? I've run into an issue where if I try to run Docker on Mesos in this setup, the containers fail due to the application master trying to connect to the container, bu

Re: Zeppelin in multi user environment

2015-06-29 Thread Alexander Bezzubov
Hi, thank you for asking, indeed, as Moon mentioned, we are working on making a standalone tool available that is a reverse proxy, capable of launching separate docker container per-user for the chosen spark\hadoop version, implementing the A. architecture from above. -- Alex On Mon, Jun 29, 2

Re: Zeppelin in multi user environment

2015-06-28 Thread IT CTO
Thanks! That's clarify the issue... Can you share what NFLabs doing in open source? Eran On Sun, Jun 28, 2015 at 10:10 PM moon soo Lee wrote: > Hi, > > Here's something i know about multi-tenancy for Zeppelin. > > A. Reverse Proxy + Zeppelin on docker. > > Setup a reverse proxy, who is doing aut

Re: Zeppelin in multi user environment

2015-06-28 Thread moon soo Lee
Hi, Here's something i know about multi-tenancy for Zeppelin. A. Reverse Proxy + Zeppelin on docker. Setup a reverse proxy, who is doing authentication and redirect user to proper Zeppelin instance running on docker container. I saw many companies are already using Zeppelin in this way. My comp

Re: Zeppelin in multi user environment

2015-06-28 Thread Eric Charles
There is also https://github.com/apache/incubator-zeppelin/pull/53 which proposes to add shiro security (user authentication on the web part). This does not address what Ophir mentions (separated environment for e.g. spark interpreters to avoid variables shared across simultaneous authenticated

Re: Zeppelin in multi user environment

2015-06-28 Thread Ophir Cohen
I'll do so. Actually I didn't mean for every user but for every customer (that can have many end-users in my business), I can see advantage of sharing the same environment for the same group/department but then again, it depends on your business and your needs... I'll keep everybody updated. On Su

Re: Zeppelin in multi user environment

2015-06-28 Thread IT CTO
Thanks Ophir! That means that I have to wrap zeppelin with my own site which launch a zeppelin server on behalf of every requesting user. this is an option but I want avoiding it. pls, share wherever you come across during this journey Eran On Sun, Jun 28, 2015 at 12:09 PM Ophir Cohen wrote: > A

Re: Zeppelin in multi user environment

2015-06-28 Thread Ophir Cohen
Actually it a bit more than that: Even the variables shared across notebooks! I think that NFLabs has a commercial version that supports groups and users. In my organisation we are looking on few solutions for that. One of them is using different instances - maybe even on the same machine. I'm goi

Zeppelin in multi user environment

2015-06-28 Thread IT CTO
Hi, we are in the process of testing Zeppelin as our investigation platform inside the organization. One of the first question raised was with regard to multi user environment - currently, as I see it, all users run against the same zeppelin server and have access and availability to all notebooks.