Re: Multiple queries to single Spark interpreter

2016-02-12 Thread Zhong Wang
I don't think it should work on non-SQL jobs. Because all of the paragraphs share the same interpreter process, what do you expect the interpreter to do if you run multiple paragraphs with shared variables? If you really want to run jobs concurrently, I think you may try these solutions: -- 1. do

Re: HBase Interpreter

2016-02-12 Thread Felix Cheung
Cool, I think I have figured out how to set properties too. I might open a PR tomorrow or later. On Thu, Feb 11, 2016 at 9:24 PM -0800, "Rajat Venkatesh" wrote: Hi, I'll take a look over the weekend. Sorry for the delay in replying. On Wed, Feb 10, 2016 at 6:44 AM Felix Cheung wrote

Queries regarding the table views and exception

2016-02-12 Thread Shabeel Syed
Hello All, I was trying some usage using the zeppelin rest apis. Steps, I'm trying to achieve 1) Requirement is to provide a data viewer for a given mysql table 2) Firstly, I will create the note book dynamically if it does not exists. 3) Then create a paragraph with scala code to r

Re: Help.. (zContext and 'JavaArray' object is not callable)

2016-02-12 Thread 진상형
Thanks Ahyoung! Problem solved. Here are my codes // para #1 val temp = norm_featured_2f.select("norm_2f_features").rdd.map(r=>r(0).asInstanceOf[DenseVector].toArray).collect() z.put("norm_featured_2f",temp) // para #2 %pyspark import matplotlib as matplt matplt.use('Agg') import matplotlib.p

Can't get Pyspark(1.4.1) interpreter to work on Zeppelin(0.6)

2016-02-12 Thread Ian Maloney
Hi, I've been trying unsuccessfully to configure the pyspark interpreter on Zeppelin. I can use pyspark from the CLI and can use the Spark interpreter from Zeppelin without issue. Here are the lines which aren't commented out in my zeppelin-env.sh file: export MASTER=yarn-client export ZEPPELIN_

Re: Queries regarding the table views and exception

2016-02-12 Thread Zhong Wang
For your second question, the answer is yes. See this example: http://s.apache.org/57E Zhong On Fri, Feb 12, 2016 at 1:31 AM, Shabeel Syed wrote: > Hello All, > >I was trying some usage using the zeppelin rest apis. >Steps, I'm trying to achieve >1) Requirement is to provide a data

Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread Zhong Wang
Hi, I am wondering whether I could build some rich UI with AngularView & TableView in the same paragraph. Currently, it seems I can use only one of them? I want to create a "selection box", which is not supported by dynamic forms currently. I think I can do that using Angular, but I really want t

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread Zhong Wang
Sorry, by "selection box", I actually mean checkbox Zhong On Fri, Feb 12, 2016 at 11:20 AM, Zhong Wang wrote: > Hi, > > I am wondering whether I could build some rich UI with AngularView & > TableView in the same paragraph. Currently, it seems I can use only one of > them? > > I want to create

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread DuyHai Doan
I'm thinking about a major refactoring of the current display system so that we can have, in 1 paragraph, multiple display (table with graph options, simple text, raw HTML ...) But I'll need to finish first the AngularJS utilities functions PR On Fri, Feb 12, 2016 at 8:28 PM, Zhong Wang wrote:

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread Zhong Wang
On Fri, Feb 12, 2016 at 11:35 AM, DuyHai Doan wrote: > I'm thinking about a major refactoring of the current display system so > that we can have, in 1 paragraph, multiple display (table with graph > options, simple text, raw HTML ...) > > That's really cool! Any planned timeline? Seems not a tri

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread DuyHai Doan
Yes it'll be a very long work. I think it will be split it small iterations, IF the idea of having multiple displays by paragraph reaches consensus among the community On Fri, Feb 12, 2016 at 8:54 PM, Zhong Wang wrote: > On Fri, Feb 12, 2016 at 11:35 AM, DuyHai Doan > wrote: > >> I'm thinking a

Re: %spark is significantly slower than %sql

2016-02-12 Thread moon soo Lee
Hi Zhong, Thanks for sharing the problem. I think that's related to the behavior (not releasing any resource) of scala compiler embedded into SparkInterpreter. For now, restart seems only practical solution. Do you mind create an issue for it? Thanks, moon On Wed, Feb 10, 2016 at 8:48 PM Zhong