Re: method listing in Zeppellin

2016-05-17 Thread moon soo Lee
Or simply, "Ctrl + . (dot)" works On Tue, May 17, 2016 at 6:09 AM Hyung Sung Shim wrote: > If you are talking about completion you can put "Ctrl(or > Command)+Shift+Space". > > 2016-05-17 21:26 GMT+09:00 Snehotosh Banerjee < > snehotosh.baner...@gmail.com>: > >> Hi, >> >> How to get the method l

Re: Is it possible or feasible to deploy zeppelin as war?

2016-05-16 Thread moon soo Lee
Hi Woosan, Currently, Zeppelin starts interpreter as a separate process using bin/interpreter.sh, and that process need to add one of subdirectory under './interpreter' directory into classpath. I guess packaging everything into war will not be simple unless change current interpreter starting me

Re: Zeppelin error

2016-05-16 Thread moon soo Lee
Hi, Really appreciate for sharing the problem. This is how Zeppelin extracting interpreter name https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Paragraph.java#L137 This is how Interpreter is selected from the extracted name htt

Re: Zeppelin 0.6 Build

2016-05-16 Thread moon soo Lee
Hi Ben, Thanks reporting the error. Could you try patch https://github.com/apache/incubator-zeppelin/pull/892 ? Patch is just changing slf package name in import statements. Thanks, moon On Sat, May 7, 2016 at 12:19 PM Benjamin Kim wrote: > When trying to build the latest from Git, I get these

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread moon soo Lee
er can be renamed, and the access it has to >>> interpreter group is based on the parent child relationship, not just by >>> name... >>> >>> Thoughts? >>> >>> >>> >>> >>> >>> >>> On Fri, Feb 5, 2016 at

Re: zeppelin performance debugging?

2016-04-26 Thread moon soo Lee
ds, > Ashish > > On Tue, Apr 26, 2016 at 10:22 PM, moon soo Lee wrote: > >> Hi, >> >> Loading paragraphs Incrementally might be a possible way to reduce data >> handling in front-end side. But I haven't seen any issue related to this >> subject. >>

Re: zeppelin packaging and distribution

2016-04-26 Thread moon soo Lee
No worries. Thanks for asking! On Tue, Apr 26, 2016 at 9:59 AM ashish rawat wrote: > Sorry, not sure how I managed to miss that. Thanks a lot moon. > > On Tue, Apr 26, 2016 at 10:10 PM, moon soo Lee wrote: > >> Hi Ashish, >> >> Adding '-Pbuild-distr' i

Re: zeppelin performance debugging?

2016-04-26 Thread moon soo Lee
of data >> through web sockets. >> >> I am not able to attach a profiling tool, because of server side >> restrictions, would try to do offline analysis. >> >> Regards, >> Ashish >> >> On Tue, Apr 26, 2016 at 7:23 AM, moon soo Lee wrote: >> >

Re: zeppelin packaging and distribution

2016-04-26 Thread moon soo Lee
Hi Ashish, Adding '-Pbuild-distr' in your build command will creates binary distribution under zeppelin-distribution/target directory. https://github.com/apache/incubator-zeppelin#package Hope this helps. Thanks, moon On Tue, Apr 26, 2016 at 6:07 AM ashish rawat wrote: > Hi, > > We want to

Re: Questions regarding cron jobs and notebook/note terminology

2016-04-25 Thread moon soo Lee
Hi Prasad, Good catch. While Notebook.CronJob.execute checks only last last paragraph, it'll misbehave when parallel scheduler is used or paragraphs uses different interpreters. I think this should be fixed. In the beginning, Note was the term for set of Paragraphs and Notebook was the term for s

Re: zeppelin performance debugging?

2016-04-25 Thread moon soo Lee
Hi Ashish, While ZeppelinServer and Interpreter process are running on JVM, I think any JVM profiling tool can be attached to the process. When you're experiencing 10-15s time to retrieve a notebook, is the time includes notebook being displayed on your webbrowser or not? Thanks, moon On Mon, A

Re: ZeppelinContext not found when SPARK_HOME is set.

2016-04-25 Thread moon soo Lee
Hi, Are you able to access 'sc' or 'sqlContext'? And do you see any special error in the log files? While all they're created in similar way [1], i guess if one available, the others available, too. vise versa. Thanks, moon [1] https://github.com/apache/incubator-zeppelin/blob/master/spark/src/m

Re: Disconnected

2016-04-23 Thread moon soo Lee
Hi, Zeppelin uses websocket connection. Do you have some firewall/proxy between your browser and zeppelin server daemon? If that does not pass websocket connection, start page may show 'Disconnected'. Thanks, moon On 2016년 4월 22일 (금) at 오후 5:17 cao...@donson.com.cn wrote: > Hi, > Encounter a p

Re: Seeing strange logging behaviour

2016-04-15 Thread moon soo Lee
Hi, Recently, Jongyoul submitted a related patch https://github.com/apache/incubator-zeppelin/pull/830 and now it's in master branch. Please take a look. Thanks, moon On Sat, Apr 2, 2016 at 1:29 AM Ravi Gurram wrote: > Hi, > I have enabled log4j.debug=true in the log4j.properties and as

Re: Zeppelin Performance

2016-04-15 Thread moon soo Lee
Hi John, Thanks for sharing your feedback. Could you share how big your 4 notes are? Laggy response might comes from two different reasons. First one is size of notebook. Zeppelin front-end built-on AngularJS 1.x. And performance of front-end depends on number of watcher. While more paragraph cr

Re: Line feed ( \r ) behind %pyspark command causes interpreter not found

2016-04-15 Thread moon soo Lee
Hi, Thanks for finding problem and solution. If you can make a pullrequest, that would be really great. Let me know if you have any question on making pullrequest! Best, moon On Tue, Apr 12, 2016 at 9:55 AM TITTMANN, Lucas (Allianz en France) < lucas.titt...@allianz.fr> wrote: > Thank you fo

Re: Create worker Instance in Apache Zeppelin running on Spark Standalone

2016-04-15 Thread moon soo Lee
Hi, To increase the number of worker instance, you'll need change your configuration of Spark standalone cluster. Please check http://spark.apache.org/docs/latest/spark-standalone.html#cluster-launch-scripts and SPARK_WORKER_INSTANCES might help. Thanks, moon On Wed, Apr 13, 2016 at 11:07 AM ka

Re: Interpreter Alias

2016-04-11 Thread moon soo Lee
Hi John, Here's a related thread you might also interested. http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Multiple-spark-interpreters-in-the-same-Zeppelin-instance-tp2171.html Thanks, moon On Tue, Apr 12, 2016 at 7:26 AM Jongyoul Lee wrote: > Hi John, > > Zeppelin do

Re: Zeppelin + remote spark -> problem with runtime libraries

2016-04-07 Thread moon soo Lee
Hi Marcin, Thanks for sharing the problem. In the mailing list, i've seen couple of error reports around jackson library version conflict. I would like to investigate the problem and share the result here. Thanks, moon On Wed, Mar 30, 2016 at 7:40 PM Marcin Pilarczyk < marcin.pilarc...@interia.

Re: Display in JDBC Interpreter

2016-04-07 Thread moon soo Lee
Hi, It is done by frontend side 'formatTableContext' function [1]. Quick workaround is printing cell value in a html format. e.g. instead of '12345', '%html 12345' will not do number formatting. Ideally, i think table component should have formatting option for each columns. Thanks, moon [1] h

Re: Storing Interpreter Passwords

2016-04-07 Thread moon soo Lee
Hi, Thanks for starting this discussion and sharing your idea. I open Zeppelin, then I get a a little lock icon showing me that my > passwords (and thus passwords in JDBC or other storage plugins are not > available) I click on the lock, and then I can enter in a password for the > session. That

Re: Zeppelin UX Design Roadmap Proposal

2016-04-07 Thread moon soo Lee
Hi Jeremy, Thanks for writing and sharing the proposal. The video really helps. I like this good looking theme, too. And Code dock is brilliant idea. That could be really useful. Like 'Show code' toggle button and corresponding toggle button for the result. Their location is much more intuitive

Re: What is inside Zeppelin install image?

2016-04-06 Thread moon soo Lee
Hi, Surprisingly, there is no documentation that listing all interpreters in the package. Interpreter menu in the documentation have submenus for each interpreter. but some interpreters are not listed in the menu. We can do either add separate documentation to list all interpreters, or add missin

Re: Web component

2016-04-06 Thread moon soo Lee
Hi, %html supposed to render without page reload. Could you share simple example that shows the problem? Thanks, moon On Wed, Apr 6, 2016 at 4:30 PM Aurélien Hébert < aurelien.heb...@cityzendata.com> wrote: > Hello, > > I would like to give a nice output to my zeppelin notebook, by integrating

Re: Zeppelin Dashboards

2016-04-06 Thread moon soo Lee
, ashish rawat >> wrote: >> >>> Thanks Moon. I do not have a good understanding of UI but really >>> appreciate the ease with which non-UI folks can get started with Zeppelin. >>> >>> My end goal is to enable the customers to make a dashboard quickl

Re: How to make one side binding between zeppelin paragraph and published paragraph?

2016-04-06 Thread moon soo Lee
Hi, Removing sync is not supported at the moment. For iframe, i think we can introduce new feature that selectively enable sync with parameters such as '?sync=false' in the link. But for notebook level, i think it's bit more complicated because different users can update notebook at the same tim

Re: Spark Job Server

2016-04-04 Thread moon soo Lee
Hi John, A proposal [1] attached in ZEPPELIN-773 [2] shows spark interpreter based on livy [3]. I think this is similar to what you think. Please take a look. Thanks, moon [1] https://docs.google.com/document/d/1AVGcviyVqWmmbHJmkgUo76ZDSwWAMjwHxmKBhZdAav4/edit#heading=h.5uzzc48tw5d8 [2] https://

Re: How many javascript files should I have and make my project works well ?

2016-04-03 Thread moon soo Lee
Hi Mathew Carton, Thanks for sharing your work. If you're planning to reuse javascript files from Zeppelin, i think it's easier to take uncompressed files from https://github.com/apache/incubator-zeppelin/tree/master/zeppelin-web and build your project using them. Do you have any special reason to

Re: [DISCUSS] Update Roadmap

2016-03-29 Thread moon soo Lee
> I've submitted a design approach for Multi-tenancy and Security for > Zeppelin - https://issues.apache.org/jira/browse/ZEPPELIN-773. > > Look forward for the reviews and suggestions on the topic. > > Thanks, > Rohit. > > On Sat, Mar 26, 2016 at 10:04 PM, moon soo Lee wro

Re: [DISCUSS] Update Roadmap

2016-03-26 Thread moon soo Lee
lain: >> >> >> >> Hive View - interacts with Hive >> >> Pig View - interacts with Pig >> >> Workflow Designer - interacts with Oozie >> >> >> >> We have a very similar architecture in Zeppelin where we interact with >> th

Re: How to get username of currently logged user

2016-03-26 Thread moon soo Lee
Hi, If you can use SparkInterpreter, you can get current user by %spark z.getInterpreterContext.getAuthenticationInfo.getUser() I think other interpreters does not provides way to access username inside the notebook. It would be nice if zeppelin has some way to access username inside the noteboo

Re: Python interpreter without spark?

2016-03-26 Thread moon soo Lee
Hi, There is an open issue for python interpreter. https://issues.apache.org/jira/browse/ZEPPELIN-502 I think it'll really help python users. Big +1 for this issue. Thanks, moon On Sat, Mar 26, 2016 at 7:36 AM Darren Govoni wrote: > Hi > > Is there a standalone python interpreter without spark

Re: Spark + Zeppelin on EC2

2016-03-25 Thread moon soo Lee
Hi, Spark workers will open connections to access Spark driver (SparkContext), which is running on Zeppelin instance. So make sure your network configuration (firewall, routing table, etc) allows workers connect to Zeppelin instance. Could you verify spark shell command, not on the master node, b

Re: Zeppelin Dashboards

2016-03-24 Thread moon soo Lee
Hi Ashish, Thanks for the question. I think you'll need to leverage Angular display system [1] to achieve the features you want. With Angular displays system, you can create date picker and update all paragraphs on change. Same to Autocomplete search box. For linked graph (drilling down), i think

Re: Zeppeling Port Assignment

2016-03-23 Thread moon soo Lee
Hi, Which version of Zeppelin are you trying? Since 0.5.5, Zeppelin uses single port for REST and websocket. [1] Thanks, moon [1] https://issues.apache.org/jira/browse/ZEPPELIN-172 On Wed, Mar 23, 2016 at 5:41 PM Max Bridgewater wrote: > Hi Folks, > > I am very new to Zeppelin so please bear

Re: Error in repo

2016-03-22 Thread moon soo Lee
Hi Guillaume, Thanks for reporting the problem. I just tried test master branch with "mvn clean package -Pspark-1.6 -Phadoop-2.6 -Pyarn -Ppyspark" but i couldn't see any test failure. It can be because of flaky test or something. Is it happening everytime you run tests? Thanks, moon On Tue, Ma

Re: Zeppelin 0.5.6 binaries on HDP 2.3 on AWS fails to start

2016-03-22 Thread moon soo Lee
Hi, Is there any special reason to have followings in your .bashrc? If not, could you try without them? CLASSPATH=$ZEPPELIN_HOME/lib CLASSPATH=$CLASSPATH:$ZEPPELIN_HOME/zeppelin-interpreter/target/lib CLASSPATH=$CLASSPATH:$ZEPPELIN_HOME/zeppelin-zengine/target/lib CLASSPATH=$CLASSPATH:$ZEPPELIN_H

Re: Shiro authentication dialog does not appear

2016-03-22 Thread moon soo Lee
>> for single Realm >> [main] >> #ldapRealm = org.apache.shiro.realm.ldap.JndiLdapRealm >> #ldapRealm.userDnTemplate = >> cn={0},cn=engg,ou=testdomain,dc=testdomain,dc=com >> #ldapRealm.contextFactory.url = ldap://ldaphost:389 >> #ldapRealm.contextFactory.au

Re: Zeppelin with Spark 2.0

2016-03-22 Thread moon soo Lee
d of Spark. 2.0 ? I came across the >> following >> >> http://stackoverflow.com/questions/34814836/classnotfoundexception-org-apache-spark-repl-sparkcommandline >> >> On 22 March 2016 at 19:36, moon soo Lee wrote: >> >>> Hi Deenar, >>> >

Re: Zeppelin with Spark 2.0

2016-03-22 Thread moon soo Lee
Hi Deenar, Currently, Zeppelin does not work with Spark 2.0. While Spark 2.0 will be built with scala 2.11 by default [1], Zeppelin need to support scala 2.11 [2] [1] https://issues.apache.org/jira/browse/SPARK-6363 [2] https://issues.apache.org/jira/browse/ZEPPELIN-605 I think there're no jira

Re: sql visualization

2016-03-22 Thread moon soo Lee
Hi, Changing colors and customizing tooltip text for built in visualization is not supported at the moment. Do you mind file an issue for them? Thanks, moon On Mon, Mar 21, 2016 at 4:22 PM Preeti wrote: > > Hi, > > I was wondering if it is possible to change parameters like color of the > poi

Re: Shiro authentication dialog does not appear

2016-03-19 Thread moon soo Lee
Hi Peter, Thanks sharing the problem. That seems unusual. Have you tried clean browser cache? Thanks, moon On Tue, Mar 15, 2016 at 3:48 PM Peter Briggs wrote: > Hi, > > I am having trouble getting the Shiro user authentication to work for > Zeppelin - the issue is that when I open the Zeppelin

Re: Empy Notebook file prevents Zeppelin from starting

2016-03-19 Thread moon soo Lee
Hi, That seems problem Zeppelin can not start when there're invalid json file. Thanks for sharing the problem. Do you mind creating an issue for it? by the way, after https://issues.apache.org/jira/browse/ZEPPELIN-454 being resolved (0.5.6-incubating), i thought it's hard to note.json being corru

Re: Empy Notebook file prevents Zeppelin from starting

2016-03-19 Thread moon soo Lee
> > On Fri, 18 Mar 2016 at 02:09 moon soo Lee wrote: > >> Hi, >> >> That seems problem Zeppelin can not start when there're invalid json file. >> Thanks for sharing the problem. Do you mind creating an issue for it? >> >> by the way, after htt

Re: use of z.run

2016-03-19 Thread moon soo Lee
ould there be a way to register paragraphs to be refreshed and then > trigger a refresh for all of them. > > May be I need to implement that? Or would that be a generic requirement > > Cheers > > > On Thursday, 17 March 2016, moon soo Lee wrote: > >> Hi Bala, >&

Re: use of z.run

2016-03-19 Thread moon soo Lee
Hi Bala, z.run() accept both integer index of paragraph (starts from 0) [1] or paragraph id [2]. So you can do something like %spark (2 to 5).foreach{ idx => z.run(idx) } or %spark import collection.JavaConversions._ z.listParagraphs.foreach(paragraphId=> z.run(paragraphId)) Hope this helps.

Re: Shiro authentication dialog does not appear

2016-03-19 Thread moon soo Lee
onfig files. > > Thanks, > Peter > > On 17 Mar 2016, at 23:03, moon soo Lee wrote: > > Hi Peter, > > Thanks sharing the problem. That seems unusual. Have you tried clean > browser cache? > > Thanks, > moon > > On Tue, Mar 15, 2016 at 3:48 PM Pet

Re: use of z.run

2016-03-18 Thread moon soo Lee
run from %angular, you can try this PR: >> https://github.com/apache/incubator-zeppelin/pull/742 >> >> On Fri, Mar 18, 2016 at 1:55 PM, Balachandar R.A. < >> balachandar...@gmail.com> wrote: >> >>> Hi >>> >>> Thanks for the hint.

Re: use of z.run

2016-03-18 Thread moon soo Lee
#x27;z' in front-end (javascript) side. And that will work in %angular paragraph. Thanks, moon On Thu, Mar 17, 2016 at 9:55 PM Balachandar R.A. wrote: > Hi > > Thanks for the hint. But z.run() is not working inside %angular paragraph > in my notebook. Any idea? > > Regards >

Re: Stop execution if a paragraph errors

2016-03-10 Thread moon soo Lee
see whether next paragraph should be triggered based on the > status of the current paragraph. Also the notebook run can be modified to > use this runAll method. Your thoughts pls. > > Regards > > > Skanda > On 09-Mar-2016 11:38 PM, "moon soo Lee" wrote: > >>

Re: OOM error when run all paragraphs

2016-03-09 Thread moon soo Lee
nal version > > > > Regards, > > Dafeng > > > > *From:* Dafeng Wang [mailto:dafe...@microsoft.com] > *Sent:* Tuesday, March 8, 2016 4:14 PM > *To:* users@zeppelin.incubator.apache.org > *Subject:* RE: OOM error when run all paragraphs > > > >

Re: Stop execution if a paragraph errors

2016-03-09 Thread moon soo Lee
Hi Girish, Currently, I think there're no simple way. Please feel free to file an issue on JIRA. Technically, RunNote function iterates runParagraph in front-end side [1]. To make execution stop on paragraph error, a) Need to iterate it on backend side by calling [2], otherwise closing browser w

Re: Notebook Editor 2-space Indentation?

2016-03-09 Thread moon soo Lee
There're no options to configure the tab size. so you'll need to modify source code to do that. Please feel free to file an issue. Thanks, moon On Mon, Mar 7, 2016 at 11:01 PM Chris Miller wrote: > Hi, > > Is there a way to configure the notebook text editor to use 2-space > indentation when w

Re: Multi-User Zeppelin Deployment?

2016-03-09 Thread moon soo Lee
Hi Chris Miller, - If one user is running a job with an interpreter, can another user simultaneously run a job (such as, in another notebook) with the same interpreter? Short answer is yes, but it depends. Long answer is, first, it depends on which scheduler interpreter implementation u

Re: Overriding guava dependency

2016-03-07 Thread moon soo Lee
Hi Jae, Have you tried export SPARK_SUBMIT_OPTIONS="--packages com.google.guava:guava:18.0" described in http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/interpreter/spark.html ? Or if you're using master, http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSH

Re: OOM error when run all paragraphs

2016-03-04 Thread moon soo Lee
caching 1000 records of output. > > Regards, > Skanda > > On Mon, Feb 29, 2016 at 10:42 PM, moon soo Lee wrote: > >> Thanks for creating an issue. >> Let me look into it more. >> >> Best, >> moon >> >> On Sun, Feb 28, 2016 at 10:14 PM Dafeng

Re: [DISCUSS] Update Roadmap

2016-03-02 Thread moon soo Lee
lin notebooks we use >>>>> https://github.com/airbnb/airflow <https://github.com/airbnb/airflow> >>>>> through the job rest api. It's an enterprise ready and very robust >>>>> solution right now. >>>>> >>>>> &

Re: Multiple JDBC interpreters

2016-03-02 Thread moon soo Lee
a few days ago off the master branch, > I think this is a bug. It would be helpful if anyone else could validate or > refute my findings, it doesn't need to be a Drill JDBC, it can be any set > of JDBC connections. > > Chris Matta > cma...@mapr.com > 215-701-3146 >

Re: Multiple JDBC interpreters

2016-03-02 Thread moon soo Lee
Hi Chris Matta, At the moment, Zeppelin allow one 'Interpreter setting' derived from an interpreter in a notebook. Therefore, Zeppelin will always use the first available interpreter (drilllocal) among your 3 interpreter settings derived from jdbc interpreter drilllocal(%jdbc), jdbc(%jdbc), mysql

Re: error "Could not find creator property with name 'id' "

2016-03-01 Thread moon soo Lee
s!! The fixes proposed in the post resolved my problem. > > On the other hand, if this is happening to everybody (as I assume), maybe > this should be addressed a bit more systematically?? > > Thanks again! > > Enzo > e...@smartinsightsfromdata.com > > > > On

Re: Zeppelin Real Time usecases

2016-03-01 Thread moon soo Lee
Hi Shabeel, Trying https://gist.github.com/granturing/a09aed4a302a7367be92 would help. It displays tweets on the map in realtime, data from spark streaming. Thanks, moon On Tue, Mar 1, 2016 at 12:48 AM Shabeel Syed wrote: > Hi All, > >I'm planning to give a demo tomorrow to my team here on

Re: error "Could not find creator property with name 'id' "

2016-03-01 Thread moon soo Lee
Hi Enzo, It happens when you have multiple version of jackson library in your classpath. Please check following email thread http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/com-fasterxml-jackson-databind-JsonMappingException-td1607.html Thanks, moon On Tue, Mar 1, 2016 a

Re: Math formula on %md model

2016-03-01 Thread moon soo Lee
+1 This would be useful On Tue, Mar 1, 2016 at 7:36 AM Aish Fenton wrote: > +1 that'd be amazing. > On Mon, Feb 29, 2016 at 6:04 PM Trevor Grant > wrote: > >> +1 for math formula support in the mark down interpreter, >> >> Trevor Grant >> Data Scientist >> https://github.com/rawkintrevo >> http

Re: [DISCUSS] Update Roadmap

2016-02-29 Thread moon soo Lee
cheduler can be used with Cron expression or a pre-set >>>>> time. But in an enterprise solution, a notebook might be one piece of the >>>>> workflow. Can we look towards the functionality of scheduling notebook's >>>>> based on other notebooks finishin

Re: OOM error when run all paragraphs

2016-02-29 Thread moon soo Lee
anything else. > > > > Regards, > > Dafeng > > > > *From:* moon soo Lee [mailto:m...@apache.org] > *Sent:* Saturday, February 27, 2016 2:25 AM > > > *To:* users@zeppelin.incubator.apache.org > *Subject:* Re: OOM error when run all paragraphs > > >

Re: %pyspark default??

2016-02-28 Thread moon soo Lee
Hi Enzo, Unfortunately, there're no way to change it in notebook level at the moment. Do you mind create an issue for it? Thanks, moon On Sun, Feb 28, 2016 at 1:41 PM enzo wrote: > Hi > > How can I set *at the notebook level* %pyspark (for example) as default? > > I would like to avoid specify

Re: [DISCUSS] Update Roadmap

2016-02-28 Thread moon soo Lee
nd the related interpreter). A >> possible solution would be to spawn separate instance of the same >> interpreter at every notebook/user level. >> >> Regards, >> Sourav >> >> On Sat, Feb 27, 2016 at 12:48 PM, moon soo Lee wrote: >> >>> Hi Zeppe

Re: [DISCUSS] Update Roadmap

2016-02-28 Thread moon soo Lee
s, moon On Sat, Feb 27, 2016 at 1:15 PM Darren Govoni wrote: > Looks fantastic moon. > > Anything in the community with regards to easier debugging with specific > backends? E.g. spark. > > Sent from my Verizon Wireless 4G LTE smartphone > > > ---- Original message

[DISCUSS] Update Roadmap

2016-02-27 Thread moon soo Lee
Hi Zeppelin users and developers, The roadmap we have published at https://cwiki.apache.org/confluence/display/ZEPPELIN/Zeppelin+Roadmap is almost 9 month old, and it doesn't reflect where the community goes anymore. It's time to update. Based on mailing list, jira issues, pullrequests, feedbacks

Re: OOM error when run all paragraphs

2016-02-26 Thread moon soo Lee
.io.ByteArrayOutputStream > <http://localhost:7000/refsByType/0x6162c3f98>* > > 24 > > *java.util.jar.JarVerifier <http://localhost:7000/refsByType/0x615fc7838>* > > 22 > > *java.util.jar.JarVerifier <http://localhost:7000/refsByType/0x615fc7838>* > >

Re: OOM error when run all paragraphs

2016-02-25 Thread moon soo Lee
Hi Dafeng, Zeppelin keeps notebooks in memory. That may cause OOM when notebooks has a lot of contents (code + result) inside. Unfortunately, unless modify Zeppelin to not keep notebooks in memory, there're no good way to reduce memory usage except for keep result small. Most of notebooks i've se

Re: Error while querying Df temp Tweet table

2016-02-25 Thread moon soo Lee
Could you check `sc.version` matches 1.6.0 (your library version org.apache.spark:spark-streaming-twitter_2.10:jar:1.6.0) ? Thanks, moon On Wed, Feb 24, 2016 at 11:09 PM Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Do u get the same error even in case you use SPARK_SUBMIT_OPTIONS to >

Re: Upgrade Tachyon interpreter to Alluxio interpreter

2016-02-24 Thread moon soo Lee
Hi Mauro, Sure, upgrading would be necessary. Thanks, moon On Tue, Feb 23, 2016 at 7:07 AM Mauro Cortellazzi < mauro.cortella...@radicalbit.io> wrote: > Hi All, I have saw today that the Tachyon project is become Alluxio > project (with a new and improved version of them software). > Do you thi

Re: Cytoscape-qtip and zeppelin

2016-02-24 Thread moon soo Lee
ne' } }, >> { data: { id: 'k', name: 'Kramer' } }, >> { data: { id: 'g', name: 'George' } } >> ], >> edges: [ >> { data: { source: '

Re: sharing angular variable to scala interpreter in zepelin

2016-02-24 Thread moon soo Lee
Hi, Once an AngularObject is created, updated value from front-end side (angular interpreter) automatically propagated to the back-end side. So SparkInterpreter can read it using z.angular(). However, creation of new AngularObject is possible only from the backend side at the moment. So, you'll

Re: how to automatically load jars

2016-02-23 Thread moon soo Lee
uot;: false, > "exclusions": [] > } > ] > 3. Start zeppelin > 4. Run a paragraph with > import com.datastax.spark.connector._ > => error: object datastax is not a member of package com > 5. Edit Spark interpreter settings, save it and rest

Re: how to automatically load jars

2016-02-23 Thread moon soo Lee
interpreter.json supposed to be loaded on launch. Could double check that interpreter.json is not read at zeppelin launch? Or if it keep happening, could you let me know how to reproduce? Thanks, moon On Tue, Feb 23, 2016 at 8:22 AM vincent gromakowski < vincent.gromakow...@gmail.com> wrote: >

Re: ZeppelinContext not injected

2016-02-23 Thread moon soo Lee
variable z is created all together with sc and sqlContext. See https://github.com/apache/incubator-zeppelin/blob/v0.5.6/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java#L494 . It's strange if z is unavailable and but sc is available. Can you access 'sc'? Thanks, moon On Mon, F

Re: Scala 2.11

2016-02-23 Thread moon soo Lee
ould we agree to have partial 2.11 support (only a > portion of the interpreters)? > > > On 23/02/16 17:03, moon soo Lee wrote: > > Hi, > > > > There're some related issues and some discussions in it. > > https://issues.apache.org/jira/browse/ZEPPELIN-605 > &g

Re: Scala 2.11

2016-02-23 Thread moon soo Lee
Hi, There're some related issues and some discussions in it. https://issues.apache.org/jira/browse/ZEPPELIN-605 https://issues.apache.org/jira/browse/ZEPPELIN-450 So far, no patch or pullrequest has been created. It'll be very nice if we could have patch for 2.11. Thanks, moon On Tue, Feb 23, 2

Re: Zeppelin Web UI Customizations

2016-02-22 Thread moon soo Lee
Is there any examples available online where html and javascript > rendering under paragraphs are used ? It will give me some ideas. > > Regards > Shabeel > > On Mon, Feb 22, 2016 at 10:17 PM, moon soo Lee wrote: > >> Hi Shabeel, >> >

Re: Zeppelin Web UI Customizations

2016-02-22 Thread moon soo Lee
Hi Shabeel, You can customize the home page of your Zeppelin instance by setting ZEPPELIN_NOTEBOOK_HOMESCREEN [1]. That'll replace home screen to one of your notebook, and as we know, notebook is customizable. While Zeppelin able to render HTML and Javascript inside of the notebook, you can use 3

Re: Protecting sensitive paragraph information

2016-02-21 Thread moon soo Lee
Hi, Do you mean sensitive information inside of paragraph code or output? Zeppelin itself does not have any special treatment of such contents. If your viewers does not run notebook, then those sensitive informations can packaged into jar and loaded, referenced, like createConnection(com.mycompan

Re: h2o from zeppelin notebook

2016-02-20 Thread moon soo Lee
As Felix mentioned, Loading ai.h2o:sparkling-water-core_2.10 package [1] in SparkInterpreter [2] would let H2O work in Zeppelin. Let me know if it does not work for you. Thanks, moon [1] https://github.com/h2oai/sparkling-water#sparkling-water-as-spark-package [2] http://zeppelin.incubator.apac

Re: Unable to access AVRO method

2016-02-20 Thread moon soo Lee
with spark? > > > > > > On Sat, Feb 20, 2016 at 12:33 AM -0800, "Ankur Jain" > wrote: > > LGTM… > > > > Thanks > > Ankur > > > > *From:* moon soo Lee [mailto:m...@apache.org] > *Sent:* 20 February 2016 11:24 AM > *To:* users@zeppel

Re: Does zeppelin work on windows?

2016-02-20 Thread moon soo Lee
+1 for Windows support. Looking forward windows batch files. I can test on my Windows XP (though, I'm not sure other people still use it) Best, moon On Thu, Feb 11, 2016 at 5:23 AM Silvio Fiorito < silvio.fior...@granturing.com> wrote: > I actually have some Windows batch files that I plan on su

Re: zeppelin.notebook.dir doens't work?

2016-02-19 Thread moon soo Lee
Realized that there were already related issue https://issues.apache.org/jira/browse/ZEPPELIN-408 and patch https://github.com/apache/incubator-zeppelin/pull/420 from Chiwan Park. Please keep track this issue and pr. Best, moon On Fri, Feb 19, 2016 at 10:13 PM moon soo Lee wrote: > Seems

Re: zeppelin.notebook.dir doens't work?

2016-02-19 Thread moon soo Lee
Seems it doesn't work for me, too. I'll take look. Meanwhile you can use ZEPPELIN_NOTEBOOK_DIR environment variable. Thanks, moon On Fri, Feb 19, 2016 at 9:29 PM Zhong Wang wrote: > It seems zeppelin.notebook.dir doesn't work? I changed to another > directory, but Zeppelin still reads from the

Re: Unable to access AVRO method

2016-02-19 Thread moon soo Lee
ependency? The only advantage I was really after with z.load was that >> self-documenting feature. >> >> >> >> >> On Fri, Feb 19, 2016 at 2:11 PM moon soo Lee wrote: >> >>> Right, new UI provides more generalized way for dependency loading for &g

Re: Impala interpreter planned?

2016-02-19 Thread moon soo Lee
Thanks for sharing that it works for impala. Best, moon On Fri, Feb 19, 2016 at 6:58 PM Abhi Basu <9000r...@gmail.com> wrote: > Folks, this setting seems to work, I can see the impala queries being > generated. It would be nice to be able to rename this interpreter to Impala > and keep the hive

Re: Unable to access AVRO method

2016-02-19 Thread moon soo Lee
e quite > commonly share notebooks. > > > > On Fri, Feb 19, 2016 at 10:09 AM moon soo Lee wrote: > >> Hi Ankur, >> >> It's bit depends on you Zeppelin version, but basically >> z.load() inside of Spark interpreter was buggy and we have now removed

Re: Unable to access AVRO method

2016-02-19 Thread moon soo Lee
Hi Ankur, It's bit depends on you Zeppelin version, but basically z.load() inside of Spark interpreter was buggy and we have now removed from master branch. You can check "Dependency Management" section, from http://zeppelin.incubator.apache.org/docs/latest/interpreter/spark.html Basically, two

Re: interpreter

2016-02-19 Thread moon soo Lee
Hi, Could you try add some python code after %pyspark? e.g) %pyspark print("hello pyspark") You basically need two things to setup Zeppelin with your own spark cluster. First, export SPARK_HOME in conf/zeppelin-env.sh. Second configure 'master' property in 'Interpreter' menu on GUI. That's all. Y

Re: Persisted %html

2016-02-18 Thread moon soo Lee
Hi, I think %html is persisted in the notebook file. So it can be displayed without re-running the notebook. Or maybe, am i missing something? Thanks, moon On Thu, Feb 18, 2016 at 5:04 PM Aish Fenton wrote: > Currently %html content isn't persisted in the notebook file (unlike > %table conten

Re: Can I change shortcuts

2016-02-18 Thread moon soo Lee
You can not unless you modify source code https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph.controller.js#L926 It current shortcuts conflicts with some language keyboard layout i think it should be fixed. Could you create an issue for it? T

Re: Zeppelin 0.56 binaries

2016-02-18 Thread moon soo Lee
gt; I want to verify Zeppelin is working on Spark and YARN. > > Thanks, > > Abhi > > On Thu, Feb 18, 2016 at 12:09 PM, moon soo Lee wrote: > >> Right, after https://issues.apache.org/jira/browse/ZEPPELIN-160 resolved, >> Zeppelin supposed to work with any

Re: Zeppelin 0.56 binaries

2016-02-18 Thread moon soo Lee
ous switches. > > Just want to clarify before wasting time building from source :) > > BTW, awesome tool, love it :) > > Thanks, > > Abhi > > On Thu, Feb 18, 2016 at 11:03 AM, moon soo Lee wrote: > >> Hi Abhi, >> >> Zeppelin 0.5.6-incubating binary p

Re: Zeppelin 0.56 binaries

2016-02-18 Thread moon soo Lee
Hi Abhi, Zeppelin 0.5.6-incubating binary package supposed to load installed Spark binaries when SPARK_HOME is exported in conf/zeppelin-env.sh. Please let us know if it does not work with CDH 5.5. Thanks, moon On Wed, Feb 17, 2016 at 10:19 AM Abhi Basu <9000r...@gmail.com> wrote: > Will the

Re: Plotting of K Means cluster

2016-02-18 Thread moon soo Lee
how to use Zeppelin's built > in scatter plot for KmeansModel. > > Thanks > Ashutosh > > On Thu, Feb 18, 2016 at 11:18 AM, moon soo Lee wrote: > >> Hi Ashutosh, >> >> You might have some options to visualize result of KmeansModel. >> If you are

Re: Cron job fails to run a paragraph that runs correctly manually

2016-02-18 Thread moon soo Lee
Hi Jose Rivera, If your script takes more than the timeout defined here https://github.com/apache/incubator-zeppelin/blob/master/shell/src/main/java/org/apache/zeppelin/shell/ShellInterpreter.java#L49, the process will be terminated. Otherwise, it looks like something send SIGTERM (kill) signal to

  1   2   3   4   5   6   >