Re: method listing in Zeppellin

2016-05-17 Thread moon soo Lee
Or simply, "Ctrl + . (dot)" works On Tue, May 17, 2016 at 6:09 AM Hyung Sung Shim wrote: > If you are talking about completion you can put "Ctrl(or > Command)+Shift+Space". > > 2016-05-17 21:26 GMT+09:00 Snehotosh Banerjee < > snehotosh.baner...@gmail.com>: > >> Hi, >> >> How

Re: Is it possible or feasible to deploy zeppelin as war?

2016-05-16 Thread moon soo Lee
Hi Woosan, Currently, Zeppelin starts interpreter as a separate process using bin/interpreter.sh, and that process need to add one of subdirectory under './interpreter' directory into classpath. I guess packaging everything into war will not be simple unless change current interpreter starting

Re: Zeppelin 0.6 Build

2016-05-16 Thread moon soo Lee
Hi Ben, Thanks reporting the error. Could you try patch https://github.com/apache/incubator-zeppelin/pull/892 ? Patch is just changing slf package name in import statements. Thanks, moon On Sat, May 7, 2016 at 12:19 PM Benjamin Kim wrote: > When trying to build the latest

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread moon soo Lee
..@gmail.com> >>> wrote: >>> >>>> Thanks moon - it is good to know the ideas behind the design. It makes >>>> a lot more sense to use system-defined identifiers in order to make the >>>> notebook portable. >>>> >>>> Curr

Re: zeppelin performance debugging?

2016-04-26 Thread moon soo Lee
> Regards, > Ashish > > On Tue, Apr 26, 2016 at 10:22 PM, moon soo Lee <m...@apache.org> wrote: > >> Hi, >> >> Loading paragraphs Incrementally might be a possible way to reduce data >> handling in front-end side. But I haven't seen any issue related

Re: zeppelin packaging and distribution

2016-04-26 Thread moon soo Lee
No worries. Thanks for asking! On Tue, Apr 26, 2016 at 9:59 AM ashish rawat <dceash...@gmail.com> wrote: > Sorry, not sure how I managed to miss that. Thanks a lot moon. > > On Tue, Apr 26, 2016 at 10:10 PM, moon soo Lee <m...@apache.org> wrote: > >> Hi Ashis

Re: zeppelin performance debugging?

2016-04-26 Thread moon soo Lee
ta >> through web sockets. >> >> I am not able to attach a profiling tool, because of server side >> restrictions, would try to do offline analysis. >> >> Regards, >> Ashish >> >> On Tue, Apr 26, 2016 at 7:23 AM, moon soo Lee <m...@apache.org>

Re: Questions regarding cron jobs and notebook/note terminology

2016-04-25 Thread moon soo Lee
Hi Prasad, Good catch. While Notebook.CronJob.execute checks only last last paragraph, it'll misbehave when parallel scheduler is used or paragraphs uses different interpreters. I think this should be fixed. In the beginning, Note was the term for set of Paragraphs and Notebook was the term for

Re: zeppelin performance debugging?

2016-04-25 Thread moon soo Lee
Hi Ashish, While ZeppelinServer and Interpreter process are running on JVM, I think any JVM profiling tool can be attached to the process. When you're experiencing 10-15s time to retrieve a notebook, is the time includes notebook being displayed on your webbrowser or not? Thanks, moon On Mon,

Re: Disconnected

2016-04-23 Thread moon soo Lee
Hi, Zeppelin uses websocket connection. Do you have some firewall/proxy between your browser and zeppelin server daemon? If that does not pass websocket connection, start page may show 'Disconnected'. Thanks, moon On 2016년 4월 22일 (금) at 오후 5:17 cao...@donson.com.cn wrote:

Re: Seeing strange logging behaviour

2016-04-15 Thread moon soo Lee
Hi, Recently, Jongyoul submitted a related patch https://github.com/apache/incubator-zeppelin/pull/830 and now it's in master branch. Please take a look. Thanks, moon On Sat, Apr 2, 2016 at 1:29 AM Ravi Gurram wrote: > Hi, > I have enabled log4j.debug=true in the

Re: Zeppelin Performance

2016-04-15 Thread moon soo Lee
Hi John, Thanks for sharing your feedback. Could you share how big your 4 notes are? Laggy response might comes from two different reasons. First one is size of notebook. Zeppelin front-end built-on AngularJS 1.x. And performance of front-end depends on number of watcher. While more paragraph

Re: Line feed ( \r ) behind %pyspark command causes interpreter not found

2016-04-15 Thread moon soo Lee
Hi, Thanks for finding problem and solution. If you can make a pullrequest, that would be really great. Let me know if you have any question on making pullrequest! Best, moon On Tue, Apr 12, 2016 at 9:55 AM TITTMANN, Lucas (Allianz en France) < lucas.titt...@allianz.fr> wrote: > Thank you

Re: Create worker Instance in Apache Zeppelin running on Spark Standalone

2016-04-15 Thread moon soo Lee
Hi, To increase the number of worker instance, you'll need change your configuration of Spark standalone cluster. Please check http://spark.apache.org/docs/latest/spark-standalone.html#cluster-launch-scripts and SPARK_WORKER_INSTANCES might help. Thanks, moon On Wed, Apr 13, 2016 at 11:07 AM

Re: Interpreter Alias

2016-04-11 Thread moon soo Lee
Hi John, Here's a related thread you might also interested. http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Multiple-spark-interpreters-in-the-same-Zeppelin-instance-tp2171.html Thanks, moon On Tue, Apr 12, 2016 at 7:26 AM Jongyoul Lee wrote: > Hi

Re: Display in JDBC Interpreter

2016-04-07 Thread moon soo Lee
Hi, It is done by frontend side 'formatTableContext' function [1]. Quick workaround is printing cell value in a html format. e.g. instead of '12345', '%html 12345' will not do number formatting. Ideally, i think table component should have formatting option for each columns. Thanks, moon [1]

Re: Storing Interpreter Passwords

2016-04-07 Thread moon soo Lee
Hi, Thanks for starting this discussion and sharing your idea. I open Zeppelin, then I get a a little lock icon showing me that my > passwords (and thus passwords in JDBC or other storage plugins are not > available) I click on the lock, and then I can enter in a password for the > session.

Re: Zeppelin UX Design Roadmap Proposal

2016-04-07 Thread moon soo Lee
Hi Jeremy, Thanks for writing and sharing the proposal. The video really helps. I like this good looking theme, too. And Code dock is brilliant idea. That could be really useful. Like 'Show code' toggle button and corresponding toggle button for the result. Their location is much more intuitive

Re: Zeppelin Dashboards

2016-04-06 Thread moon soo Lee
y end goal is to enable the customers to make a dashboard quickly. But >>> I don't want to branch off from Zeppelin and create a custom offering. So, >>> can I assume that these changes can be pushed back to Zeppelin and used by >>> anyone to create a new dashboard. >

Re: How to make one side binding between zeppelin paragraph and published paragraph?

2016-04-06 Thread moon soo Lee
Hi, Removing sync is not supported at the moment. For iframe, i think we can introduce new feature that selectively enable sync with parameters such as '?sync=false' in the link. But for notebook level, i think it's bit more complicated because different users can update notebook at the same

Re: Spark Job Server

2016-04-04 Thread moon soo Lee
Hi John, A proposal [1] attached in ZEPPELIN-773 [2] shows spark interpreter based on livy [3]. I think this is similar to what you think. Please take a look. Thanks, moon [1] https://docs.google.com/document/d/1AVGcviyVqWmmbHJmkgUo76ZDSwWAMjwHxmKBhZdAav4/edit#heading=h.5uzzc48tw5d8 [2]

Re: [DISCUSS] Update Roadmap

2016-03-26 Thread moon soo Lee
t; >> >> >> On Tue, Mar 1, 2016 at 11:26 PM Benjamin Kim <bbuil...@gmail.com> wrote: >> >> I see in the Enterprise section that multi-tenancy will be included, will >> this have user impersonation too? In this way, the user executing will be >>

Re: How to get username of currently logged user

2016-03-26 Thread moon soo Lee
Hi, If you can use SparkInterpreter, you can get current user by %spark z.getInterpreterContext.getAuthenticationInfo.getUser() I think other interpreters does not provides way to access username inside the notebook. It would be nice if zeppelin has some way to access username inside the

Re: Spark + Zeppelin on EC2

2016-03-25 Thread moon soo Lee
Hi, Spark workers will open connections to access Spark driver (SparkContext), which is running on Zeppelin instance. So make sure your network configuration (firewall, routing table, etc) allows workers connect to Zeppelin instance. Could you verify spark shell command, not on the master node,

Re: Zeppelin Dashboards

2016-03-24 Thread moon soo Lee
Hi Ashish, Thanks for the question. I think you'll need to leverage Angular display system [1] to achieve the features you want. With Angular displays system, you can create date picker and update all paragraphs on change. Same to Autocomplete search box. For linked graph (drilling down), i

Re: Zeppelin with Spark 2.0

2016-03-22 Thread moon soo Lee
Hi Deenar, Currently, Zeppelin does not work with Spark 2.0. While Spark 2.0 will be built with scala 2.11 by default [1], Zeppelin need to support scala 2.11 [2] [1] https://issues.apache.org/jira/browse/SPARK-6363 [2] https://issues.apache.org/jira/browse/ZEPPELIN-605 I think there're no jira

Re: Shiro authentication dialog does not appear

2016-03-19 Thread moon soo Lee
Hi Peter, Thanks sharing the problem. That seems unusual. Have you tried clean browser cache? Thanks, moon On Tue, Mar 15, 2016 at 3:48 PM Peter Briggs wrote: > Hi, > > I am having trouble getting the Shiro user authentication to work for > Zeppelin - the issue is

Re: Empy Notebook file prevents Zeppelin from starting

2016-03-19 Thread moon soo Lee
Thanks, > Boris > > On Fri, 18 Mar 2016 at 02:09 moon soo Lee <m...@apache.org> wrote: > >> Hi, >> >> That seems problem Zeppelin can not start when there're invalid json file. >> Thanks for sharing the problem. Do you mind creating an issue for it? >>

Re: use of z.run

2016-03-19 Thread moon soo Lee
to refresh (run), > would there be a way to register paragraphs to be refreshed and then > trigger a refresh for all of them. > > May be I need to implement that? Or would that be a generic requirement > > Cheers > > > On Thursday, 17 March 2016, moon soo Lee <m...

Re: Shiro authentication dialog does not appear

2016-03-19 Thread moon soo Lee
> and zeppelin-site.xml config files. > > Thanks, > Peter > > On 17 Mar 2016, at 23:03, moon soo Lee <m...@apache.org> wrote: > > Hi Peter, > > Thanks sharing the problem. That seems unusual. Have you tried clean > browser cache? > > Thanks, > moon > &

Re: use of z.run

2016-03-18 Thread moon soo Lee
u wanted to do z.run() from spark. >> >> If you need to run from %angular, you can try this PR: >> https://github.com/apache/incubator-zeppelin/pull/742 >> >> On Fri, Mar 18, 2016 at 1:55 PM, Balachandar R.A. < >> balachandar...@gmail.com> wrote: >> &g

Re: use of z.run

2016-03-18 Thread moon soo Lee
> Bala > On 17-Mar-2016 11:39 pm, "moon soo Lee" <m...@apache.org> wrote: > >> Hi Bala, >> >> z.run() accept both integer index of paragraph (starts from 0) [1] or >> paragraph id [2]. >> >> So you can do something like

Re: Stop execution if a paragraph errors

2016-03-10 Thread moon soo Lee
hich can be > checked to see whether next paragraph should be triggered based on the > status of the current paragraph. Also the notebook run can be modified to > use this runAll method. Your thoughts pls. > > Regards > > > Skanda > On 09-Mar-2016 11:38 PM, "moon s

Re: Stop execution if a paragraph errors

2016-03-09 Thread moon soo Lee
Hi Girish, Currently, I think there're no simple way. Please feel free to file an issue on JIRA. Technically, RunNote function iterates runParagraph in front-end side [1]. To make execution stop on paragraph error, a) Need to iterate it on backend side by calling [2], otherwise closing browser

Re: Multi-User Zeppelin Deployment?

2016-03-09 Thread moon soo Lee
Hi Chris Miller, - If one user is running a job with an interpreter, can another user simultaneously run a job (such as, in another notebook) with the same interpreter? Short answer is yes, but it depends. Long answer is, first, it depends on which scheduler interpreter implementation

Re: Overriding guava dependency

2016-03-07 Thread moon soo Lee
Hi Jae, Have you tried export SPARK_SUBMIT_OPTIONS="--packages com.google.guava:guava:18.0" described in http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/interpreter/spark.html ? Or if you're using master,

Re: [DISCUSS] Update Roadmap

2016-03-02 Thread moon soo Lee
nject' external js visualizations also. >>>>> >>>>> >>>>> For scheduling Zeppelin notebooks we use >>>>> https://github.com/airbnb/airflow <https://github.com/airbnb/airflow> >>>>> through the job rest api. It's an

Re: Multiple JDBC interpreters

2016-03-02 Thread moon soo Lee
Hi Chris Matta, At the moment, Zeppelin allow one 'Interpreter setting' derived from an interpreter in a notebook. Therefore, Zeppelin will always use the first available interpreter (drilllocal) among your 3 interpreter settings derived from jdbc interpreter drilllocal(%jdbc), jdbc(%jdbc),

Re: error "Could not find creator property with name 'id' "

2016-03-01 Thread moon soo Lee
Hi Enzo, It happens when you have multiple version of jackson library in your classpath. Please check following email thread http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/com-fasterxml-jackson-databind-JsonMappingException-td1607.html Thanks, moon On Tue, Mar 1, 2016

Re: [DISCUSS] Update Roadmap

2016-02-29 Thread moon soo Lee
e scheduler can be used with Cron expression or a pre-set >>>>> time. But in an enterprise solution, a notebook might be one piece of the >>>>> workflow. Can we look towards the functionality of scheduling notebook's >>>>> based on other notebooks finishing th

Re: OOM error when run all paragraphs

2016-02-29 Thread moon soo Lee
et me > know if you need anything else. > > > > Regards, > > Dafeng > > > > *From:* moon soo Lee [mailto:m...@apache.org] > *Sent:* Saturday, February 27, 2016 2:25 AM > > > *To:* users@zeppelin.incubator.apache.org > *Subject:* Re: OOM error when

Re: %pyspark default??

2016-02-28 Thread moon soo Lee
Hi Enzo, Unfortunately, there're no way to change it in notebook level at the moment. Do you mind create an issue for it? Thanks, moon On Sun, Feb 28, 2016 at 1:41 PM enzo wrote: > Hi > > How can I set *at the notebook level* %pyspark (for example) as default?

Re: [DISCUSS] Update Roadmap

2016-02-28 Thread moon soo Lee
elin (and the related interpreter). A >> possible solution would be to spawn separate instance of the same >> interpreter at every notebook/user level. >> >> Regards, >> Sourav >> >> On Sat, Feb 27, 2016 at 12:48 PM, moon soo Lee <m...@apache.org&

Re: [DISCUSS] Update Roadmap

2016-02-28 Thread moon soo Lee
nal message > From: moon soo Lee <m...@apache.org> > Date: 02/27/2016 3:48 PM (GMT-05:00) > To: users@zeppelin.incubator.apache.org, d...@zeppelin.incubator.apache.org > Subject: [DISCUSS] Update Roadmap > > Hi Zeppelin users and developers, > > The roadmap we

[DISCUSS] Update Roadmap

2016-02-27 Thread moon soo Lee
Hi Zeppelin users and developers, The roadmap we have published at https://cwiki.apache.org/confluence/display/ZEPPELIN/Zeppelin+Roadmap is almost 9 month old, and it doesn't reflect where the community goes anymore. It's time to update. Based on mailing list, jira issues, pullrequests,

Re: OOM error when run all paragraphs

2016-02-26 Thread moon soo Lee
gt; > 24 > > *java.io.ByteArrayOutputStream > <http://localhost:7000/refsByType/0x6162c3f98>* > > 24 > > *java.util.jar.JarVerifier <http://localhost:7000/refsByType/0x615fc7838>* > > 22 > > *java.util.jar.JarVerifier <http://localhost:7000/refsB

Re: OOM error when run all paragraphs

2016-02-25 Thread moon soo Lee
Hi Dafeng, Zeppelin keeps notebooks in memory. That may cause OOM when notebooks has a lot of contents (code + result) inside. Unfortunately, unless modify Zeppelin to not keep notebooks in memory, there're no good way to reduce memory usage except for keep result small. Most of notebooks i've

Re: Error while querying Df temp Tweet table

2016-02-25 Thread moon soo Lee
Could you check `sc.version` matches 1.6.0 (your library version org.apache.spark:spark-streaming-twitter_2.10:jar:1.6.0) ? Thanks, moon On Wed, Feb 24, 2016 at 11:09 PM Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Do u get the same error even in case you use SPARK_SUBMIT_OPTIONS to

Re: Upgrade Tachyon interpreter to Alluxio interpreter

2016-02-24 Thread moon soo Lee
Hi Mauro, Sure, upgrading would be necessary. Thanks, moon On Tue, Feb 23, 2016 at 7:07 AM Mauro Cortellazzi < mauro.cortella...@radicalbit.io> wrote: > Hi All, I have saw today that the Tachyon project is become Alluxio > project (with a new and improved version of them software). > Do you

Re: how to automatically load jars

2016-02-23 Thread moon soo Lee
false, > "exclusions": [] > } > ] > 3. Start zeppelin > 4. Run a paragraph with > import com.datastax.spark.connector._ > => error: object datastax is not a member of package com > 5. Edit Spark interpreter settings,

Re: how to automatically load jars

2016-02-23 Thread moon soo Lee
interpreter.json supposed to be loaded on launch. Could double check that interpreter.json is not read at zeppelin launch? Or if it keep happening, could you let me know how to reproduce? Thanks, moon On Tue, Feb 23, 2016 at 8:22 AM vincent gromakowski < vincent.gromakow...@gmail.com> wrote: >

Re: Scala 2.11

2016-02-23 Thread moon soo Lee
..). So would we agree to have partial 2.11 support (only a > portion of the interpreters)? > > > On 23/02/16 17:03, moon soo Lee wrote: > > Hi, > > > > There're some related issues and some discussions in it. > > https://issues.apache.org/jira/browse/ZEPPELIN-605

Re: Scala 2.11

2016-02-23 Thread moon soo Lee
Hi, There're some related issues and some discussions in it. https://issues.apache.org/jira/browse/ZEPPELIN-605 https://issues.apache.org/jira/browse/ZEPPELIN-450 So far, no patch or pullrequest has been created. It'll be very nice if we could have patch for 2.11. Thanks, moon On Tue, Feb 23,

Re: Zeppelin Web UI Customizations

2016-02-22 Thread moon soo Lee
> > Moon, >Is there any examples available online where html and javascript > rendering under paragraphs are used ? It will give me some ideas. > > Regards > Shabeel > > On Mon, Feb 22, 2016 at 10:17 PM, moon soo Lee <m...@apache.org> wrote: > >> Hi Sha

Re: Zeppelin Web UI Customizations

2016-02-22 Thread moon soo Lee
Hi Shabeel, You can customize the home page of your Zeppelin instance by setting ZEPPELIN_NOTEBOOK_HOMESCREEN [1]. That'll replace home screen to one of your notebook, and as we know, notebook is customizable. While Zeppelin able to render HTML and Javascript inside of the notebook, you can use

Re: Protecting sensitive paragraph information

2016-02-21 Thread moon soo Lee
Hi, Do you mean sensitive information inside of paragraph code or output? Zeppelin itself does not have any special treatment of such contents. If your viewers does not run notebook, then those sensitive informations can packaged into jar and loaded, referenced, like

Re: h2o from zeppelin notebook

2016-02-20 Thread moon soo Lee
As Felix mentioned, Loading ai.h2o:sparkling-water-core_2.10 package [1] in SparkInterpreter [2] would let H2O work in Zeppelin. Let me know if it does not work for you. Thanks, moon [1] https://github.com/h2oai/sparkling-water#sparkling-water-as-spark-package [2]

Re: Unable to access AVRO method

2016-02-20 Thread moon soo Lee
ore anything to do with spark? > > > > > > On Sat, Feb 20, 2016 at 12:33 AM -0800, "Ankur Jain" <ankur.j...@yash.com> > wrote: > > LGTM… > > > > Thanks > > Ankur > > > > *From:* moon soo Lee [mailto:m...@apache.org] > *Sent

Re: Does zeppelin work on windows?

2016-02-20 Thread moon soo Lee
+1 for Windows support. Looking forward windows batch files. I can test on my Windows XP (though, I'm not sure other people still use it) Best, moon On Thu, Feb 11, 2016 at 5:23 AM Silvio Fiorito < silvio.fior...@granturing.com> wrote: > I actually have some Windows batch files that I plan on

Re: zeppelin.notebook.dir doens't work?

2016-02-19 Thread moon soo Lee
Realized that there were already related issue https://issues.apache.org/jira/browse/ZEPPELIN-408 and patch https://github.com/apache/incubator-zeppelin/pull/420 from Chiwan Park. Please keep track this issue and pr. Best, moon On Fri, Feb 19, 2016 at 10:13 PM moon soo Lee <m...@apache.

Re: Unable to access AVRO method

2016-02-19 Thread moon soo Lee
the semantics of z.load to be automatically add in >> the dependency? The only advantage I was really after with z.load was that >> self-documenting feature. >> >> >> >> >> On Fri, Feb 19, 2016 at 2:11 PM moon soo Lee <m...@apache.org> wrote: >> >>&

Re: Impala interpreter planned?

2016-02-19 Thread moon soo Lee
Thanks for sharing that it works for impala. Best, moon On Fri, Feb 19, 2016 at 6:58 PM Abhi Basu <9000r...@gmail.com> wrote: > Folks, this setting seems to work, I can see the impala queries being > generated. It would be nice to be able to rename this interpreter to Impala > and keep the hive

Re: Unable to access AVRO method

2016-02-19 Thread moon soo Lee
ebook? We quite > commonly share notebooks. > > > > On Fri, Feb 19, 2016 at 10:09 AM moon soo Lee <m...@apache.org> wrote: > >> Hi Ankur, >> >> It's bit depends on you Zeppelin version, but basically >> z.load() inside of Spark interpreter was buggy and

Re: interpreter

2016-02-19 Thread moon soo Lee
Hi, Could you try add some python code after %pyspark? e.g) %pyspark print("hello pyspark") You basically need two things to setup Zeppelin with your own spark cluster. First, export SPARK_HOME in conf/zeppelin-env.sh. Second configure 'master' property in 'Interpreter' menu on GUI. That's all.

Re: Can I change shortcuts

2016-02-18 Thread moon soo Lee
You can not unless you modify source code https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph.controller.js#L926 It current shortcuts conflicts with some language keyboard layout i think it should be fixed. Could you create an issue for it?

Re: Zeppelin 0.56 binaries

2016-02-18 Thread moon soo Lee
nt to verify Zeppelin is working on Spark and YARN. > > Thanks, > > Abhi > > On Thu, Feb 18, 2016 at 12:09 PM, moon soo Lee <m...@apache.org> wrote: > >> Right, after https://issues.apache.org/jira/browse/ZEPPELIN-160 resolved, >> Zeppelin supposed to work with any (s

Re: Zeppelin 0.56 binaries

2016-02-18 Thread moon soo Lee
ous switches. > > Just want to clarify before wasting time building from source :) > > BTW, awesome tool, love it :) > > Thanks, > > Abhi > > On Thu, Feb 18, 2016 at 11:03 AM, moon soo Lee <m...@apache.org> wrote: > >> Hi Abhi, >> >> Zeppelin 0.

Re: Zeppelin 0.56 binaries

2016-02-18 Thread moon soo Lee
Hi Abhi, Zeppelin 0.5.6-incubating binary package supposed to load installed Spark binaries when SPARK_HOME is exported in conf/zeppelin-env.sh. Please let us know if it does not work with CDH 5.5. Thanks, moon On Wed, Feb 17, 2016 at 10:19 AM Abhi Basu <9000r...@gmail.com> wrote: > Will the

Re: Plotting of K Means cluster

2016-02-18 Thread moon soo Lee
request you to provide some details for how to use Zeppelin's built > in scatter plot for KmeansModel. > > Thanks > Ashutosh > > On Thu, Feb 18, 2016 at 11:18 AM, moon soo Lee <m...@apache.org> wrote: > >> Hi Ashutosh, >> >> You might have some optio

Re: Cron job fails to run a paragraph that runs correctly manually

2016-02-18 Thread moon soo Lee
Hi Jose Rivera, If your script takes more than the timeout defined here https://github.com/apache/incubator-zeppelin/blob/master/shell/src/main/java/org/apache/zeppelin/shell/ShellInterpreter.java#L49, the process will be terminated. Otherwise, it looks like something send SIGTERM (kill) signal

Re: Cytoscape-qtip and zeppelin

2016-02-18 Thread moon soo Lee
t I have done, you may observe few more > information. Nevertheless, I will come back to you once I see the error in > my side. > > Thanks > Bala > > On 18 February 2016 at 14:29, moon soo Lee <m...@apache.org> wrote: > >> With proper cytoscape-qtip address,

Re: matplotlib import error

2016-02-18 Thread moon soo Lee
Could you try import it from regular python commandline shell? If it fails, it looks like need to install matplotlib. Thanks, moon On Thu, Feb 18, 2016 at 7:50 AM Ashutosh Kumar wrote: > I did not built from source. Using downloaded binaries 0.5.5 Do I need to > do

Re: Cytoscape-qtip and zeppelin

2016-02-18 Thread moon soo Lee
whole cytoscape-qtip project is hosted here and you can find the js > file in the below link > > > https://github.com/cytoscape/cytoscape.js-qtip/blob/master/cytoscape-qtip.js > > regards > Bala > > > Thanks > > On 18 February 2016 at 13:47, moon soo Lee &

Re: Cytoscape-qtip and zeppelin

2016-02-18 Thread moon soo Lee
Hi Bala, The file http://40.221.94.235/cytoscape-qtip.js looks like not accessible. Could you check if it is correct address? Thanks, moon On Wed, Feb 17, 2016 at 10:10 PM Balachandar R.A. wrote: > I am trying reciprocate the example seen in the link >

Re: Plotting of K Means cluster

2016-02-17 Thread moon soo Lee
:57 PM Ashutosh Kumar <kmr.ashutos...@gmail.com> wrote: > Hi Ankur and Moon > Thanks for response > @Moon , I don't see any link or attachment . Did you miss to provide link > for example you mentioned about? > > Thanks > Ashu > > On Thu, Feb 18, 2016 at 11:18

Re: Plotting of K Means cluster

2016-02-17 Thread moon soo Lee
Hi Ashutosh, You might have some options to visualize result of KmeansModel. If you are okay with scatter chart with different color per cluster, you can leverage Zeppelin's built-in scatter chart. Or you can implement your own visualization using Javascript inside of notebook, or you can

Re: Add paragraphs using dynamic forms

2016-02-17 Thread moon soo Lee
Thanks for sharing the example. ZeppelinContext has run(paragraphId or paragraphIndex) method. I think it's fine to expose add new paragraph method through ZeppelinContext. Thanks, moon On Sat, Feb 13, 2016 at 8:24 PM Zhong Wang wrote: > Chris, I've created a notebook

Re: Incoming conference for Zeppelin

2016-02-10 Thread moon soo Lee
Thanks DuyHai for sharing information. and they look awesome. Looks like you are participating talk continuously, do you mind add you (cwiki id : doanduyhai) edit permission and let you update? Thanks, moon On Wed, Feb 10, 2016 at 11:34 PM DuyHai Doan wrote: > Hello > >

Re: Incoming conference for Zeppelin

2016-02-10 Thread moon soo Lee
d me edit permission so I can add new incoming talks > without asking again every time ? > > Thank you > > Regards > > On Wed, Feb 10, 2016 at 10:52 PM, moon soo Lee <m...@apache.org> wrote: > >> Thanks DuyHai for sharing information. and they look awesome

Re: Plotting error

2016-02-09 Thread moon soo Lee
Hi Abhi, You'll need to define show(). Such as %pyspark import StringIO def show(p): img = StringIO.StringIO() p.savefig(img, format='svg') img.seek(0) print "%html " + img.buf Hope this helps. Best, moon On Wed, Feb 10, 2016 at 4:34 AM Abhi Basu <9000r...@gmail.com> wrote: > Using

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-05 Thread moon soo Lee
hey share the same log file. I am not sure whether there > are other cases they interfere with each other. > > Thanks, > Zhong > > On Thu, Feb 4, 2016 at 9:04 PM, moon soo Lee <m...@apache.org> wrote: > >> Hi, >> >> Once you create another spark interpre

Re: custom interpreter not found

2016-02-04 Thread moon soo Lee
Hi, Could you double check if you have created interpreter setting in 'Interpreter' menu and bind your notebook to the created interpreter setting? Thanks, moon On Fri, Feb 5, 2016 at 11:37 AM Jeff Zhang wrote: > I develop a very simple custom interpreter and following the

Re: Notebook Authorization Design

2016-01-30 Thread moon soo Lee
Thanks Prasad for sharing the design document. I think your document really nicely defined authorization in Zeppelin and I think your approach for Notebook Authorization really make sense. Like DuyHai mentioned, Zeppelin uses Shiro for authentication. If authorization can works smoothly with

ApacheCon 2016 North America

2016-01-28 Thread moon soo Lee
Hi, ApacheCon 2016 North America CFP closes in Feb 12. Some people in the community already interested in participate the event as well as submitting talks. How about we share the proposals in the wiki ? https://cwiki.apache.org/confluence/display/ZEPPELIN/ApacheCon+2016+North+America (like we

Re: Dynamic Form Option

2016-01-27 Thread moon soo Lee
Hi Afancy, How about use dynamic form in this way? SELECT * FROM user ${User= , (All)|WHERE userId=1(Jonh Smith)|WHERE userId=2(Harry)|WHERE userId=3(Rose)} Thanks, moon On Sat, Jan 23, 2016 at 6:13 PM afancy wrote: > Hi, > > I want to create PostgreSQL with the dynamic

Re: Pre-load Spark's scripts

2016-01-20 Thread moon soo Lee
Hi, You can go to Interpreter menu on Zeppelin GUI, and set 'args' property of one of your spark interpreter setting, like -i [path to your .scala] that will pre-load scala script when interpreter starts. Thanks, moon On Wed, Jan 20, 2016 at 12:10 AM MichaelYoung <452611...@qq.com> wrote:

Re: Starting Zeppelin server from Java client

2016-01-19 Thread moon soo Lee
It looks like notebook directory is not exist. Could you check if the directory ZEPPELIN_NOTEBOOK_DIR env variable or zeppelin.notebook.dir jvm property pointing is exists? Default directory is 'notebook' in current path. Thanks, moon On Tue, Jan 19, 2016 at 5:46 AM Fazlan Nazeem

Re: Configure graph programmatically

2016-01-19 Thread moon soo Lee
Hi Zhong, I've made simple example that programmatically configure graph with dynamic form. please check following link. http://s.apache.org/57E Theoretically, Angular Display System can do, but you'll need to build everything from scratch. i.e. form, column selection, drag n drop, pivot,

Re: autocompletion

2016-01-15 Thread moon soo Lee
Hi Marc, Could you be little bit more specific? Text box can be created either by dynamic form ( http://zeppelin.incubator.apache.org/docs/latest/manual/dynamicform.html) or angular display system ( http://zeppelin.incubator.apache.org/docs/latest/displaysystem/angular.html ) Which one are you

Re: Thrift Exception when executing a custom written Interpreter

2016-01-14 Thread moon soo Lee
Hi, The error can happen when ZeppelinServer can not connect to the interpreter process. You can check log file for your custom interpreter logs/zeppelin-interpreter-[your interpreter name]-* And the log file will have some clue. Thanks, moon On Wed, Jan 13, 2016 at 10:10 PM Fazlan Nazeem

Re: Change http root

2016-01-08 Thread moon soo Lee
Hi, I think ZEPPELIN_SERVER_CONTEXT_PATH environment variable or zeppelin.server.context.path jvm property is related option. Please take a look configure section on http://zeppelin.incubator.apache.org/docs/latest/install/install.html Thanks, moon On Thu, Jan 7, 2016 at 11:57 PM on

Re: cannot build Spark 1.6 with Pyspark

2016-01-08 Thread moon soo Lee
Hi Enzo, Could you make sure you're in latest master branch and specified -Pspark-1.6 flag, too? Thanks, moon On Fri, Jan 8, 2016 at 12:00 PM enzo wrote: > I’m trying to build Spark 1.6 with Pyspark but somewhere in Zeppelin the > old dependency

Re: Change http root

2016-01-08 Thread moon soo Lee
nothing more than renaming conf/zeppelin-env.sh.template to > conf/zeppelin-env.sh an added "export > ZEPPELIN_SERVER_CONTEXT_PATH=/zeppelin" > > The parameter seems to be ignored but others are not (I changed, e.g., the > notebook dir). > > > > On 08

Re: Change http root

2016-01-08 Thread moon soo Lee
: > > Problem accessing /zeppelin/. Reason: > > Not Found > > -- > > > *Powered by Jetty:// *I tried this in both 0.5.5 and 0.6. > > What am I doing wrong? > > Best regards, > on > > > On 08.01.2016 09:34, moon soo Lee wrote: > > Hi, &

Re: Copy and paste ASCII control character errors in Zeppelin

2016-01-06 Thread moon soo Lee
Hi Joel, Thanks for sharing the problem and detailed information. Please feel free to file an issue if you don't mind :) Best, moon On Wed, Jan 6, 2016 at 6:43 PM Joel Van Veluwen < joel.vanvelu...@quantium.com.au> wrote: > Hey Guys, > > > > (let me know if this should be on the dev mailing

Re: Zeppelin Connection Refused Error

2016-01-04 Thread moon soo Lee
If restart does not work, could you check any error or exceptions in any file in logs directory ? that might help see the reason for the exception you see. Thanks, moon On Mon, Jan 4, 2016 at 2:54 PM Jungtaek Lim wrote: > Hi Snehit, > > Seems like Zeppelin can't connect

Re: How to support multiple notebooks in Zeppelin

2015-12-30 Thread moon soo Lee
Hi Dafeng, Zeppelin at the moment keeps every notebook in memory once it's been loaded. So number of notebooks supported by instance will be limited by the memory on the system. Scale out Zeppelin-Server you mean scale out the server that serves REST API, Websocket connection? Thanks, moon On

Re: How to support multiple notebooks in Zeppelin

2015-12-30 Thread moon soo Lee
when I wanna support more users? > > > > Regards, > > Dafeng > > > > *From:* moon soo Lee [mailto:m...@apache.org] > *Sent:* Thursday, December 31, 2015 12:11 AM > *To:* users@zeppelin.incubator.apache.org > *Subject:* Re: How to support multiple notebooks in Zeppe

Re: Connection Exception using Spark 1.5.2 pre-built with Hadoop 2.6

2015-12-24 Thread moon soo Lee
Hi, It looks like interpreter process is somehow failed to launch or spark context is failed to create. Can you find any other log in ./logs directory? Thanks, moon On Thu, Dec 24, 2015 at 6:59 AM Hoc Phan wrote: > Hi > > I am downloading this prebuild binary from

Re: Can't run any new jobs because of OOME (spark interpreter)

2015-12-23 Thread moon soo Lee
Hi Jungtaek Lim, SparkInterpreter uses scala REPL inside. Please see related issue https://issues.scala-lang.org/browse/SI-4331. There's a workaround in the description. But I believe there will be no easy way to free up the memory completely, unless destroy and create scala REPL again. Thanks,

  1   2   3   4   >