Re: cassandra interpreter

2016-05-10 Thread DuyHai Doan
cala-compiler-2.11.7.jar* > *scala-xml_2.11-1.0.4.jar* > > Respectfully, > > *Kyle Burke *| Data Science Engineer > *IgnitionOne - *Marketing Technology. Simplified. > Office: 1545 Peachtree St NE, Suite 500 | Atlanta, GA | 30309 > Direct: 404.961.3918 > > >

Re: cassandra interpreter

2016-05-09 Thread DuyHai Doan
> INFO [2016-05-09 13:56:56,601] ({pool-2-thread-2} > Cluster.java[init]:1443) - New Cassandra host /127.0.0.1:9042 added > > INFO [2016-05-09 13:56:56,601] ({pool-2-thread-2} > Cluster.java[init]:1443) - New Cassandra host /X.X.X.X:9042 added > > Respectfully, > > *Kyle

Re: cassandra interpreter

2016-05-06 Thread DuyHai Doan
Hello No you're mistaking, the Cassandra interpreter is only using the binary protocol to communicate with Cassandra (port 9042 by default). In the logs, what you see is the Thrift protocol used by Zeppelin to communicate between the Zeppelin server and the interpreter JVM process. By the way

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread DuyHai Doan
I would agree with John Omernik point about portability of JSON notes because of the strong dependency with configured interpreters. Which gives me an idea: what's about "exporting" interpreters config into note.json file ? Let's say your note has 10 paragraphs but they are just using 3

Re: Guava 16.0 Cassandra Error using Zeppelin 0.60/Spark 1.6.1/Cassandra 3.4

2016-04-13 Thread DuyHai Doan
Ahh yes, forgot that you're using the 0.6.0 build. The guava jar was missing in the 0.5.5 release On Wed, Apr 13, 2016 at 2:03 PM, Sanne de Roever wrote: > Rocking! Vincents suggestion worked. > > I tried a %dep in the notebook first, this did not work. > > The

Re: Guava 16.0 Cassandra Error using Zeppelin 0.60/Spark 1.6.1/Cassandra 3.4

2016-04-13 Thread DuyHai Doan
Easy work-around, in $ZEPPELIN-HOME/interpreter/cassandra/lib folder, add the guava-16.0.1.jar file and it's done. On Wed, Apr 13, 2016 at 1:37 PM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > It's not a configuration error but a well known conflict between guava 12 > in Spark

Re: z.run works only once from onClick function on a button

2016-03-27 Thread DuyHai Doan
Now that https://github.com/apache/incubator-zeppelin/pull/742 is merged, can you try with plain HTML code and call z.runParagraph(paragraphId) ? On Sun, Mar 27, 2016 at 5:27 PM, Deepak Subhramanian < deepak.subhraman...@gmail.com> wrote: > Hi, > > I added a button to run a paragraph with new

Re: REST API

2016-02-24 Thread DuyHai Doan
Done Vincent, here is the pull request: https://github.com/apache/incubator-zeppelin/pull/746 Please follow the test procedure to see if it is working for you as expected. On Wed, Feb 24, 2016 at 5:01 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > Ok, I just checked the so

Re: sharing angular variable to scala interpreter in zepelin

2016-02-24 Thread DuyHai Doan
Creation of AngularObject from front-end will be possible once those PR are tested and merged: https://github.com/apache/incubator-zeppelin/pull/740 https://github.com/apache/incubator-zeppelin/pull/741 https://github.com/apache/incubator-zeppelin/pull/742

Re: REST API

2016-02-24 Thread DuyHai Doan
Just create a JIRA, I will fix it On Wed, Feb 24, 2016 at 4:58 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > Did you try the Run Paragraph Job API ? > > http:// > [zeppelin-server]:[zeppelin-port]/api/notebook/job/[notebookId]/[paragraphId] > > > On Wed, Feb 2

Re: REST API

2016-02-24 Thread DuyHai Doan
annot get > a paragraph result. The only solution I see is to get a notebook and parse > result to get the concerned paragraph result. > Am I right? > > 2016-02-24 16:25 GMT+01:00 DuyHai Doan <doanduy...@gmail.com>: > >> There is a REST API for Notebook : >> ht

Re: Zeppelin 0.5.6 error

2016-02-23 Thread DuyHai Doan
Hello Vincent This is a bug. The original Cassandra interpreter (V1) was working when merged into the master. After that, there were other commits that update the Guava dependency to another version and it broke the Cassandra interpreter (look in the stack trace) because of Guava version

Re: Embed Zeppelin Results in External page

2016-02-16 Thread DuyHai Doan
DO NOT FORGET, when you embed Zeppelin Iframe in external page, to also load the Twitter Bootstrap themes and css otherwise it will look ugly. Copy and paste those import in your external page: On Tue, Feb 16, 2016 at 9:13 AM, Ahyoung Ryu

Re: Rich UI on Zeppelin with AngularView & TableView

2016-02-12 Thread DuyHai Doan
I'm thinking about a major refactoring of the current display system so that we can have, in 1 paragraph, multiple display (table with graph options, simple text, raw HTML ...) But I'll need to finish first the AngularJS utilities functions PR On Fri, Feb 12, 2016 at 8:28 PM, Zhong Wang

Incoming conference for Zeppelin

2016-02-10 Thread DuyHai Doan
Hello I'll give a couple of talks about Zeppelin in the next months: - Voxxed Day Vienna February 29 2016 : http://voxxeddaysvienna2016.sched.org/event/5nPx/apache-zeppelin-the-missing-gui-for-your-big-data-back-end - Riga Dev Days March 3rd 2016 (Day 2): http://rigadevday.lv/#/index - jDays

Re: Incoming conference for Zeppelin

2016-02-10 Thread DuyHai Doan
Looks like you are participating talk continuously, do you mind add you > (cwiki id : doanduyhai) edit permission and let you update? > > Thanks, > moon > > On Wed, Feb 10, 2016 at 11:34 PM DuyHai Doan <doanduy...@gmail.com> wrote: > >> Hello >> >> I'll give a coupl

Re: Incoming conference for Zeppelin

2016-02-10 Thread DuyHai Doan
t anytime without asking. > I think it's always good idea to send mailing list an email about new > talks, so everyone in the mailing list can know about them. > > Thanks, > moon > > > On Thu, Feb 11, 2016 at 6:57 AM DuyHai Doan <doanduy...@gmail.com> wrote: > >>

Re: R Interpreter

2016-02-08 Thread DuyHai Doan
Look at the discussion on the second PR (#702) about this subject of having 2 PR for R On Mon, Feb 8, 2016 at 11:19 AM, Ankur Jain wrote: > Hello Team, > > > > I see 2 R interpreter available. Are both same or different? Which one to > prefer? > > > >

Re: Notebook Authorization Design

2016-01-29 Thread DuyHai Doan
Have you look at the commit done by hayssams for Apache Shiro integration with Zeppelin ? https://github.com/apache/incubator-zeppelin/pull/586 ? There is also a JIRA to implement authorization on notes: https://issues.apache.org/jira/browse/ZEPPELIN-549 On Fri, Jan 29, 2016 at 5:30 AM, Prasad

Re: Writing a Zeppelin Interpreter in Scala

2015-11-05 Thread DuyHai Doan
Hello Martin I faced the same issue as you when I tried to write the Cassandra interpreter using full Scala. You need to know that the magic of interpreter discovery is given by static { Interpreter.register(...) } There is no option to "emulate" a static block in Scala. Putting an init

Re: Access variables instantiated in different interpreter

2015-10-29 Thread DuyHai Doan
I am thinking about a new idea to propose a common in-memory shared storage so that all interpreters can pass around variables. I'll create a JIRA soon to submit the idea and the architecture On Thu, Oct 29, 2015 at 5:40 PM, moon soo Lee wrote: > Hi, > > If your custom

Re: Access variables instantiated in different interpreter

2015-10-29 Thread DuyHai Doan
Look like the https://github.com/Leemoonsoo/incubator-zeppelin/blob/helium/zeppelin-interpreter/src/main/java/org/apache/zeppelin/resource/ResourcePool.java is very similar to my idea :) On Thu, Oct 29, 2015 at 8:57 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > Thanks for th

Re: Detecting change on an Angular variable not works

2015-08-18 Thread DuyHai Doan
This is very tricky. I had a look into the source code of the Angular object binding system and it appears that there is an isolated compile scope: Definition: https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-web/src/app/app.controller.js#L17 Usage:

Re: Multiple instances of the same Interpreter, each with different configuration

2015-07-29 Thread DuyHai Doan
to create new interpreter with name *hiveonspark* which is instance of *hive . * I tried to access with * %hiveonspark* but it does not work. Thanks Karthik *From:* DuyHai Doan [mailto:doanduy...@gmail.com] *Sent:* Wednesday, July 29, 2015 1:49 PM *To:* users@zeppelin.incubator.apache.org

Re: zeppelin vs spark notebook

2015-07-29 Thread DuyHai Doan
I've spotted some differences: 1. Zeppelin can run language/back-end technologies other than Spark Scala (Shell, Markdown, Flink, Tajo, Lens, Cassandra ...) 2. Zeppelin is modular enough so that you can develop your own interpreter, look at the pull request list for other incoming interpreters

Re: Using Trello to Show Mid to High Level features in Apache Zeppelin

2015-07-24 Thread DuyHai Doan
I'm a bit skeptical about duplicating tickets in JIRA Trello for some reasons 1 Single Point Of Failure. As you said yourself: My plan is to check JIRA weekly and only take what in my opinion are mid to high level features within Zeppelin and then, yes, *I would manually add those cards to

Re: Spark Interpreter ::::: java.sql.SQLException: Unsupported type -101

2015-07-17 Thread DuyHai Doan
Well the stack trace is quite explicit: You may have a look at your Oracle table to check wether it's not using exotic types (types that are NOT in the SQL ANSI standard, sometimes vendors like Oracle et al. propose custom types) And I think it's more a Spark SQL issue rather than Zeppelin

Re: why zeppelin SparkInterpreter use FIFOScheduler

2015-07-15 Thread DuyHai Doan
We may introduce some paragraph dependency system to remove this limitation. Indeed, in the InterpreterContext object we can introduce dependency link between different paragraphs so that we guarantee a correct ordering of execution It would imply updating the AngularJS code to add a config

Re:

2015-07-01 Thread DuyHai Doan
What kind of bug ? Can you be more specific about the issue ? On Wed, Jul 1, 2015 at 11:58 AM, tog guillaume.all...@gmail.com wrote: Hi I am using println(s%html ...) to play with new visualisation stuff ... I am having bugs and would like to print javascript variables using console.log

Re: Neat Zeppelin Use Cases

2015-06-30 Thread DuyHai Doan
Hello Daniel I had set up some demos demonstrating the added values of Zeppelin for the Spark over Cassandra combo. Source code here: https://github.com/doanduyhai/incubator-zeppelin/tree/Spark_Cassandra_Demo Video of the meetup I gave in Amsterdam here: https://youtu.be/Y_AjbK4LKB0?t=1118 You

Re: master broken

2015-06-30 Thread DuyHai Doan
I had the same issue, adding -U to the build command mvn clean package -U -P worked for me. The -U forces Maven to update the dependencies Regards On Thu, Jun 25, 2015 at 10:39 PM, tog guillaume.all...@gmail.com wrote: I tried diff -rq this but the list of differences is huge and as I

How to stop a Spark Streaming task

2015-06-02 Thread DuyHai Doan
Hello all I've set up a test with a Twitter streaming example given in the documentation. It works but I do not know how to stop the DStream. Once executed, the Web Interface is blocked and I cannot execute another Paragraph to stop the DStream. Some hints ? Thank You

Re: Plotting

2015-05-29 Thread DuyHai Doan
Hello Hakan I faced the same issue. Suppose you have an RDD[(String,String,Int)] or any type of data. To display tables or plot: var data = new java.lang.StringBuilder(%table Header1\tHeader2\Header3\n) rdd.foreach( tuple =

Renaming notebook

2015-05-20 Thread DuyHai Doan
Hello Maybe I have missed something but I did not see how to rename a Spark notebook. By default the name is generated using a random string. I click on the notebook name to rename it but every time my change is wiped and the original name comes back. Does anybody have the same issue ? Regards

Re: Renaming notebook

2015-05-20 Thread DuyHai Doan
with a default name and you click new note you can't make the difference between your existing and new note. Eran On Wed, May 20, 2015 at 2:30 PM DuyHai Doan doanduy...@gmail.com wrote: Hello Maybe I have missed something but I did not see how to rename a Spark notebook. By default the name

Re: Multi-line codes

2015-05-20 Thread DuyHai Doan
Oh nice trick! Thanks Marty ! On Wed, May 20, 2015 at 11:19 PM, Marty B sp...@mjhb.com wrote: I write as: rdd . map(foo = ...) . reduce(_ + _) putting the '.' at the end of each line to signal line continuation On Wed, May 20, 2015 at 1:56 PM DuyHai Doan doanduy...@gmail.com wrote