Re: Best practices of maintaining a long running SparkContext

2016-03-08 Thread Zhong Wang
pelin community. Thanks, Zhong On Tue, Mar 8, 2016 at 11:13 AM, Zhong Wang wrote: > Thanks for your insights, Deenar. I think this is really helpful to users > who want to run Zeppelin as a service. > > The caching issue we experienced seems to be a Spark bug, because I see > some

Re: Best practices of maintaining a long running SparkContext

2016-03-08 Thread Zhong Wang
e cached data from memory. > 3) If you are using Kerberos authentication, you need a process that > renews tickets. > > Deenar > > On 8 March 2016 at 01:35, Zhong Wang wrote: > >> Hi zeppelin-users, >> >> Because Zeppelin relies on a long running SparkConte

Best practices of maintaining a long running SparkContext

2016-03-07 Thread Zhong Wang
Hi zeppelin-users, Because Zeppelin relies on a long running SparkContext, it is quite important to make it stable to improve availability. From my experience, I run into a couple of issues if I run a SparkContext for several days, including: -- 1. EventLoggong doest work due to HDFS lease issue.

Re: Updating local dependency jars

2016-03-05 Thread Zhong Wang
owski < > vincent.gromakow...@gmail.com> wrote: > >> In my case I juste need to edit the settings in UI then save it. I agree >> the behavior is strange. >> Le 4 mars 2016 8:20 AM, "Zhong Wang" a écrit : >> >>> Seems I need to remove the dependency

Re: Updating local dependency jars

2016-03-03 Thread Zhong Wang
Seems I need to remove the dependency in UI, then save the configuration, then add it back again. Is there any more convenient way to do that? Thanks, Zhong On Thu, Mar 3, 2016 at 2:41 PM, Zhong Wang wrote: > Hi guys, > > It seems the local dependency jars set in the new UI don'

Updating local dependency jars

2016-03-03 Thread Zhong Wang
Hi guys, It seems the local dependency jars set in the new UI don't update along with the original jar files. How can I force update the dependencies in the new UI? Thanks, Zhong

Re: [DISCUSS] Update Roadmap

2016-03-01 Thread Zhong Wang
; However, in the future Hadoop might not necessarily be installed in >>>>>>>> Spark Cluster and Oozie (since its installs with Hadoop Distribution) >>>>>>>> might >>>>>>>> not be available. >>>>>>>> So perhaps we should give

Re: [DISCUSS] Update Roadmap

2016-02-27 Thread Zhong Wang
Sourav: I think this newly merged PR can help you https://github.com/apache/incubator-zeppelin/pull/703#issuecomment-185582537 On Sat, Feb 27, 2016 at 1:46 PM, Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Hi Moon, > > This looks great. > > My only suggestion would be to include a PR/fe

Re: [DISCUSS] Update Roadmap

2016-02-27 Thread Zhong Wang
This is awesome! Really glad to see that the roadmap is adjusted based on the community's needs. One feature I hope to see in 0.6.0 is folder support, which can benefit both "UX improvement" and "Multi-tenacy". Zhong On Sat, Feb 27, 2016 at 1:46 PM, Sourav Mazumder < sourav.mazumde...@gmail.com>

Re: zeppelin.notebook.dir doens't work?

2016-02-20 Thread Zhong Wang
; >> Thanks, >> moon >> >> On Fri, Feb 19, 2016 at 9:29 PM Zhong Wang >> wrote: >> >>> It seems zeppelin.notebook.dir doesn't work? I changed to another >>> directory, but Zeppelin still reads from the old directory... >>> >>> Zhong >>> >>

zeppelin.notebook.dir doens't work?

2016-02-19 Thread Zhong Wang
It seems zeppelin.notebook.dir doesn't work? I changed to another directory, but Zeppelin still reads from the old directory... Zhong

Re: %spark is significantly slower than %sql

2016-02-13 Thread Zhong Wang
any resource) of > scala compiler embedded into SparkInterpreter. > > For now, restart seems only practical solution. > Do you mind create an issue for it? > > Thanks, > moon > > On Wed, Feb 10, 2016 at 8:48 PM Zhong Wang > wrote: > >> Hi, >> >>

Re: Add paragraphs using dynamic forms

2016-02-13 Thread Zhong Wang
sider exposing these APIs through ZeppelinContext? This will be really helpful to build rich UI on top of Zeppelin. The current REST solution isn't bad at all, but I am wondering whether there is a better way. Thanks, Zhong On Mon, Feb 8, 2016 at 11:05 AM, Zhong Wang wrote: > Sure. I will ext

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread Zhong Wang
ned timeline? Seems not a trivial work... Zhong > But I'll need to finish first the AngularJS utilities functions PR > > On Fri, Feb 12, 2016 at 8:28 PM, Zhong Wang > wrote: > >> Sorry, by "selection box", I actually mean checkbox >> >> Zhon

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread Zhong Wang
Sorry, by "selection box", I actually mean checkbox Zhong On Fri, Feb 12, 2016 at 11:20 AM, Zhong Wang wrote: > Hi, > > I am wondering whether I could build some rich UI with AngularView & > TableView in the same paragraph. Currently, it seems I can use only one of &g

Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread Zhong Wang
Hi, I am wondering whether I could build some rich UI with AngularView & TableView in the same paragraph. Currently, it seems I can use only one of them? I want to create a "selection box", which is not supported by dynamic forms currently. I think I can do that using Angular, but I really want t

Re: Queries regarding the table views and exception

2016-02-12 Thread Zhong Wang
For your second question, the answer is yes. See this example: http://s.apache.org/57E Zhong On Fri, Feb 12, 2016 at 1:31 AM, Shabeel Syed wrote: > Hello All, > >I was trying some usage using the zeppelin rest apis. >Steps, I'm trying to achieve >1) Requirement is to provide a data

Re: Multiple queries to single Spark interpreter

2016-02-12 Thread Zhong Wang
etting built up. > > Is there any other parameter which can help me in tuning this ? > > Regards, > Sourav > > On Wed, Feb 10, 2016 at 5:54 PM, Zhong Wang > wrote: > >> I think this configuration of spark interpreter allows you to run queries >> concurrently: >>

Re: Multiple queries to single Spark interpreter

2016-02-10 Thread Zhong Wang
I think this configuration of spark interpreter allows you to run queries concurrently: zeppelin.spark.concurrentSQL=true Best, Zhong On Wed, Feb 10, 2016 at 4:25 PM, Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Hi, > > I'm sending multiple queries/tasks to a single Zeppelin instance

%spark is significantly slower than %sql

2016-02-10 Thread Zhong Wang
Hi, I am working on building some responsive UI to visualize reports on top of Zeppelin. I found that running the same query using %spark sometimes is significantly slower than using %sql. For the query I am running, I can get result within 1 sec using %sql, but sometimes using more than 2 secs t

Re: Add paragraphs using dynamic forms

2016-02-08 Thread Zhong Wang
you share your notebook on github/gist? I'd be interested in seeing > it, and I'm sure the rest of the community would as well. > > Chris Matta > cma...@mapr.com > 215-701-3146 > > On Mon, Feb 8, 2016 at 1:47 PM, Zhong Wang > wrote: > >> I just got the gra

Re: Add paragraphs using dynamic forms

2016-02-08 Thread Zhong Wang
for you? Zhong On Mon, Feb 8, 2016 at 10:28 AM, Zhong Wang wrote: > I got it worked using the REST API, and I am pretty help with it! > > There is just one issue: if I create and run the paragraph using the REST > API, I cannot get/set graph settings > using z.getInterpreterCo

Re: Add paragraphs using dynamic forms

2016-02-08 Thread Zhong Wang
REST API and click the run button? Is there anyway to set the graph settings using InterpreterContext when run using the REST API? Thanks! Zhong On Sun, Feb 7, 2016 at 9:50 PM, Zhong Wang wrote: > I'd like to create paragraphs programmatically using dynamic forms: select > an item

Add paragraphs using dynamic forms

2016-02-07 Thread Zhong Wang
I'd like to create paragraphs programmatically using dynamic forms: select an item in dynamic form, create a graph immediately inside of that notebook. I can probably do that using the REST API, but I am wondering whether there is a better way to create paragraphs programmatically inside a notebook

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-05 Thread Zhong Wang
ntifier at the moment. > > If you have any other thoughts, ideas, please feel free to share. > > Thanks, > moon > > On Fri, Feb 5, 2016 at 3:58 PM Zhong Wang wrote: > >> Thanks, Moon! I got it worked. The reason why it didn't work is that I >> tried to

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-04 Thread Zhong Wang
find error message on the log file? > > Thanks, > moon > > On Fri, Feb 5, 2016 at 11:54 AM Zhong Wang > wrote: > >> Hi zeppelin pilots, >> >> I am trying to run multiple spark interpreters in the same Zeppelin >> instance. This is very helpful if the

Multiple spark interpreters in the same Zeppelin instance

2016-02-04 Thread Zhong Wang
Hi zeppelin pilots, I am trying to run multiple spark interpreters in the same Zeppelin instance. This is very helpful if the data comes from multiple spark clusters. Another useful use case is that, run one instance in cluster mode, and another in local mode. This will significantly boost the pe

Re: md interpreter is slow

2016-02-02 Thread Zhong Wang
If it's a server response latency problem, it will also > take some time to browse Zeppelin home too. > > Thanks, > Ahyoung > > On Wed, Feb 3, 2016 at 11:55 AM, Zhong Wang > wrote: > >> Thanks Ahyoung & Corneau for both of your quick replies! >> >

Re: md interpreter is slow

2016-02-02 Thread Zhong Wang
om/apache/incubator-zeppelin/blob/master/docs/README.md> >> in Zeppelin github ? >> You can follow some instructions in this file, and then browse >> http://localhost:4000. Using this, you may see and test your >> documentation. >> Hopefully it could help you. >> >&

md interpreter is slow

2016-02-02 Thread Zhong Wang
Hi guys, I am writing some documentation in Zeppelin using the md interpreter, and found that it is pretty slow to render. The documentation is not very long: less than 1000 words with some code. I tried both Safari and Chrome, and it seems Chrome is slower: browser get stuck without response for

Re: Configure graph programmatically

2016-01-19 Thread Zhong Wang
I've figured it out. The "index" actually refers to the field index of the output table. I should use Group(2, "col2") in the last example. Zhong On Tue, Jan 19, 2016 at 2:40 PM, Zhong Wang wrote: > Moon: thanks very much for creating a concrete example for me. It i

Re: Configure graph programmatically

2016-01-19 Thread Zhong Wang
atch. i.e. form, column selection, drag n drop, pivot, > graph, etc. > > Thanks, > moon > > On Tue, Jan 19, 2016 at 1:30 AM Zhong Wang > wrote: > >> Hi all, >> >> I am building an application on Zeppelin using dynamic forms to generate >> graph

Configure graph programmatically

2016-01-19 Thread Zhong Wang
Hi all, I am building an application on Zeppelin using dynamic forms to generate graphs. The change of some of the forms may change the number of columns of the output table, which requires the visualization to be reconfigured. Every time when I change these forms, I need to specify graph configur

Re: Failed to build zeppelin-web on master

2016-01-12 Thread Zhong Wang
, Jan 12, 2016 at 12:02 AM, Corneau Damien wrote: > Hi, > > If you got problem with PhantomJS, you can remove this line: > > https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-web/Gruntfile.js#L437 > > On Tue, Jan 12, 2016 at 4:50 PM, Zhong Wang > wrote: >

Failed to build zeppelin-web on master

2016-01-11 Thread Zhong Wang
Hi guys, I got a failure when I try building Zeppelin on a Mac OSX machine. It seems it is related to grunt/bower configuration: -- Running "karma:unit" (karma) task INFO [karma]: Karma v0.12.37 server started at http://localhost:9002/ INFO [launcher]: Starting browser PhantomJS INFO [PhantomJS 1.