Re: Multiple spark interpreters in the same Zeppelin instance

2016-05-02 Thread John Omernik
I see two components. 1. To ability to have multiple interpreters of the same time, but use different configuration options. a jdbc1, jdbc2, spark1, spark2, spark3, etc. What ever you want to name them is great, but spark1 would use the SPARK_HOME that is configured, and spark2 would use a

Re: Multiple spark interpreters in the same Zeppelin instance

2016-05-02 Thread John Omernik
y static > interpreter name in note.json would be more simple and practical. > > What do you think? > > Thanks, > moon > > > On Fri, Apr 29, 2016 at 11:15 AM DuyHai Doan <doanduy...@gmail.com> wrote: > >> I would agree with John Omernik point about portability of

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread John Omernik
Moon - I would be curious on your thoughts on my email from April 12th. John On Tue, Apr 12, 2016 at 7:11 AM, John Omernik <j...@omernik.com> wrote: > I would actually argue that if the user doesn't have access to the same or > a similar interpreter.json file, than notebook file

Re: HA for Zeppelin

2016-04-13 Thread John Omernik
rk brings 50% decrease In > perf. It may change with calico because it abstract network with routing > not virtualizing like flannel > Le 12 avr. 2016 2:22 PM, "John Omernik" <j...@omernik.com> a écrit : > >> On 2. I had some thoughts there. How "expensive&q

Re: Interpreter Alias

2016-04-12 Thread John Omernik
. >> >> Regards, >> Jongyoul >> >> On Tue, Apr 12, 2016 at 3:26 AM, John Omernik <j...@omernik.com> wrote: >> >>> So I copied the %jdbc interpreter. I am looking to create a specific >>> connection to Apache Drill, and would like to use th

Re: HA for Zeppelin

2016-04-11 Thread John Omernik
Context? > 3. for auto failover through marathon, how do you deal with the DNS > resolve for clients? > > Thanks! > J. > > On Fri, Apr 8, 2016 at 10:09 AM, John Omernik <j...@omernik.com > <javascript:_e(%7B%7D,'cvml','j...@omernik.com');>> wrote: > >> So for u

Interpreter Alias

2016-04-11 Thread John Omernik
So I copied the %jdbc interpreter. I am looking to create a specific connection to Apache Drill, and would like to use the jdbc interpreter, but invoke it by calling %drill rather than %jdbc, is this possible? I tried create interpreter and did a new name "drill" with interpreter type jdbc, but I

Re: Zeppelin UX Design Roadmap Proposal

2016-04-08 Thread John Omernik
This is great work, quick question. Will the "shared" capability of Zeppelin still apply to the new UI? I.e. if I have two people connected to the same notebook, they see updates in real time, can that be maintained with the new UI? John On Fri, Apr 8, 2016 at 7:34 AM, Jeremy Anderson

Re: Storing Interpreter Passwords

2016-04-07 Thread John Omernik
> single user can have access to the interpreters. Do you have any thoughts > how encryption of interpreter.json can work with multiple users? > > Thanks, > moon > > > > On Fri, Apr 8, 2016 at 9:21 AM John Omernik <j...@omernik.com > <javascript:_e(%7B%7D,'cvml','j

Re: Storing Interpreter Passwords

2016-04-07 Thread John Omernik
unning one of the interpreters we could force an unlock, this seems to provide somewhat better security than just storing them in plain test. I am interested in discussions here, perhaps some philosophy on what should fall on Zeppelin to secure and what should not. On Wednesday, April 6, 2016, John

Re: Display in JDBC Interpreter

2016-04-07 Thread John Omernik
Yea this has always bothered me. Do commas even need to be displayed it >> the field is an int? Are they adding anything? >> >> >> On Wednesday, April 6, 2016, John Omernik <j...@omernik.com> wrote: >> >>> Note this is also the case in the spark sql int

Zeppelin Performance

2016-04-06 Thread John Omernik
As I am getting back into the swing of things with Zeppelin, I am liking it more and more! Great work community! One thing I have noticed is with as few as 4 notes, I can start getting some laggy response from my browser (Firefox). Since I am new, I am going to assume it's something in my

Re: Display in JDBC Interpreter

2016-04-06 Thread John Omernik
Note this is also the case in the spark sql interpreter. Thanks! On Wed, Apr 6, 2016 at 4:10 PM, John Omernik <j...@omernik.com> wrote: > Are there display settings in the jdbc interpreter. Something in how data > is being returned from Apache Drill is making some assumptions about

Display in JDBC Interpreter

2016-04-06 Thread John Omernik
Are there display settings in the jdbc interpreter. Something in how data is being returned from Apache Drill is making some assumptions about formatting that is bothering me, for example, a zip code field is being read (I assume) as an int, and commas are being added in the display. The commas

Re: Zeppelin in Docker

2016-04-06 Thread John Omernik
the hostname specified in spark.driver.host, not on all interfaces, thus it doesn't work inside the container. Anyone else have luck with running Zeppelin in a Docker container, and using Yarn? On Wed, Jun 17, 2015 at 12:20 PM, John Omernik <j...@omernik.com> wrote: > My challenge is I a

Storing Interpreter Passwords

2016-04-06 Thread John Omernik
Is there any good guidance for storing interpreter passwords? While I know it likely has to be in the interpreter.json files as plain text, is there something more we could do? Perhaps store encrypted to a master password that the user, once they are in Zeppelin can. (I.e, I open Zeppelin, then

Spark Job Server

2016-04-03 Thread John Omernik
Hello all, Has there been any discussion on using the Spark Job Server with Zeppelin? https://github.com/spark-jobserver/spark-jobserver My thought is this: Trying to get get Zeppelin Running in Docker and then able to interact with Spark on Mesos is a challenge. It requires us to include a lot

Re: Writing New Interpreter

2016-04-02 Thread John Omernik
; > > On Sat, Apr 2, 2016 at 1:28 PM -0700, "John Omernik" <j...@omernik.com> > wrote: > > Hey all, > > I am a very novice java programmer, and I was hoping to try to write a > basic "example" interpreter to demonstrate a concept to the community. &g

Writing New Interpreter

2016-04-02 Thread John Omernik
Hey all, I am a very novice java programmer, and I was hoping to try to write a basic "example" interpreter to demonstrate a concept to the community. *Ideas from Strata! That said, I copied the Markdown interpreter, into a new directory, changed all the code to reflect my "interpreter hello

Drill Interpreter

2015-09-21 Thread John Omernik
Hey all, has the Drill Interpreter been moved into the mainline yet? I am itching to use it, but am concerned if the PR is old, that it will be some sort of weird mismatch of old and new... John

Re: Apache Drill Interpreter

2015-07-16 Thread John Omernik
to open/close status of pullrequests, but usually green CI status is one requirement to be merged. Hope this helps. Thanks, moon On Thu, Jul 16, 2015 at 5:47 AM John Omernik j...@omernik.com wrote: Thank you so much Moon! I have a few questions on how Github works. So these pull requests. I

Re: Hive on Spark

2015-07-10 Thread John Omernik
Zeppelin is connecting to a Hive Thrift Server (Hiveserver2) in your org. Can you run another instance where you start it with the execution engine being spark or perhaps set it in the hive-site.xml? On Fri, Jul 10, 2015 at 10:51 AM, Abhi Basu 9000r...@gmail.com wrote: SET

Re: Hive on Spark

2015-07-10 Thread John Omernik
HS2). On Fri, Jul 10, 2015 at 9:45 AM, John Omernik j...@omernik.com wrote: Zeppelin is connecting to a Hive Thrift Server (Hiveserver2) in your org. Can you run another instance where you start it with the execution engine being spark or perhaps set it in the hive-site.xml? On Fri, Jul 10

Re: Zeppelin in multi user environment

2015-06-30 Thread John Omernik
Alex - How are you addressing the Yarn's need to have dynamic ports available on the yarn-client so the app master can connect to it? I've run into an issue where if I try to run Docker on Mesos in this setup, the containers fail due to the application master trying to connect to the container,

Re: Inconsistent Starting of Interpreters

2015-06-20 Thread John Omernik
at 7:37 AM John Omernik j...@omernik.com wrote: Thanks for the email Moon, I have gone through some pretty logical troubleshooting steps, but I can't seem to get this bug to occur consistently. Like I said, this is an interesting setup in that sometimes things work normally sometimes they don't

Re: configuring Zeppelin with yarn-client

2015-06-19 Thread John Omernik
Ensure you have a yarn-site.xml available on the system you are running Zeppelin (that points to your resource manager) and then use the env variable HADDOP_CONF_DIR and set that to the location that has all the config for Yarn.. John On Fri, Jun 19, 2015 at 10:55 AM, Radu Brumariu

Re: Inconsistent Starting of Interpreters

2015-06-19 Thread John Omernik
interfaces and a docker0 interface on this node) John On Fri, Jun 19, 2015 at 8:02 AM, John Omernik j...@omernik.com wrote: I am not an expert in Java, but could there be an issue using the markdown and the hive interpreters together because they share a variable name (md = markdown object

Re: Zeppelin In Docker on Mesos

2015-06-16 Thread John Omernik
not found On Tue, Jun 16, 2015 at 9:19 AM, John Omernik j...@omernik.com wrote: As a follow-up with the zeppelin installation read/write. I get the same error messages, I don't think that is what's causing my issue. On Tue, Jun 16, 2015 at 9:10 AM, John Omernik j...@omernik.com wrote

Re: Notebook Storage Options

2015-06-13 Thread John Omernik
problem with the acl restriction you would like to do though is the 'user'. Zeppelin web interface is just the zeppelin instance and doesnt have knowledge of which user is using it On Jun 12, 2015 11:32 PM, John Omernik j...@omernik.com wrote: Hey all, are there any notebook storage options

Notebook Storage Options

2015-06-12 Thread John Omernik
Hey all, are there any notebook storage options that are configurable? Let me explain what I have observed and go from there with my specific questions I set a NFS share location to be my notebook location export ZEPPELIN_NOTEBOOK_DIR=/mnt/zeppelin_notebooks My ideas was I could have a