Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem

2017-10-06 Thread DuyHai Doan
not switch to > > > call "%bin%\functions.cmd" ADDEACHJARINDIR"%ZEPPELIN_ > HOME%\zeppelin-interpreter\target\lib" > call "%bin%\functions.cmd" ADDEACHJARINDIR"%ZEPPELIN_ > HOME%\lib\interpreter" > call "%bin%\functions.cmd" ADDE

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem

2017-10-05 Thread DuyHai Doan
.scala:59)" >13 = {StackTraceElement@5341} "org.fusesource.scalate. > support.ScalaCompiler$.create(ScalaCompiler.scala:42)" >14 = {StackTraceElement@5342} "org.fusesource.scalate. > TemplateEngine.createCompiler(TemplateEngine.scala:231)" >15 = {StackTraceEl

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.zeppelin.cassandra.DisplaySystem

2017-10-05 Thread DuyHai Doan
The problem is the NoClassDefFoundError exception. We need to know where it comes from, which class cannot be found. Can you please provide full exception stack trace ? On Wed, Oct 4, 2017 at 4:45 PM, Patrick Brunmayr < patrick.brunm...@kpibench.com> wrote: > Hello > > I am having troubles using

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-20 Thread DuyHai Doan
ClassDefFoundError: Could not initialize class > org.apache.zeppelin.cassandra.DisplaySystem$NoResultDisplay$ > at org.apache.zeppelin.cassandra.EnhancedSession.( > EnhancedSession.scala:40) > > Please help. > > On Fri, May 19, 2017 at 3:45 PM, DuyHai Doan <doanduy...@gma

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-19 Thread DuyHai Doan
ly, I installed the Binary package with all interpreters and works > fine. > > On AWS EMR, all the binaries may not be there, and thats where I need > help. > > Thanks > > On Fri, May 19, 2017 at 3:04 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > >> So just use the C

Re: Create cassandra interpreter for Zeppelin on AWS EMR spark cluster

2017-05-19 Thread DuyHai Doan
a cluster on AWS-EC2. > > On Fri, May 19, 2017 at 2:39 PM, DuyHai Doan <doanduy...@gmail.com> wrote: > >> If you're running on AWS EMR Spark Cluster, why do you need a Cassandra >> interpreter Is Cassandra installed on your AWS cluster ? >> >> O

Re: How to create a real time dashboards from spark using web socket?

2017-04-25 Thread DuyHai Doan
Yes, the scheduler applies to the entire note, not just paragraph Le 25 avr. 2017 02:39, "kant kodali" a écrit : > Also it doesn't look like we can run a scheduler on one paragraph? we have > to run the scheduler for the entire notebook always? > > On Mon, Apr 24, 2017 at

Re: Visualize streaming data

2017-02-07 Thread DuyHai Doan
What you want is an auto-refresh of the visualization right ? Why not use the cron-scheduling feature ? On Tue, Feb 7, 2017 at 9:19 AM, Jeff Zhang wrote: > Zeppelin's built-in visualization capability is helpful for batch data > analysis, I am wondering whether zeppelin

Re: [ANNOUNCE] Apache Zeppelin 0.7.0 released

2017-02-06 Thread DuyHai Doan
Congratulations for the team, great release! On Mon, Feb 6, 2017 at 1:34 PM, Vinay Shukla wrote: > Congratulations Zeppelin users, contributors and committers. > > This is a great milestone. > > Before the dust settles on 0.7.0, let's put together our heads together to >

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC2)

2017-01-22 Thread DuyHai Doan
+1 On Sun, Jan 22, 2017 at 8:59 AM, Mina Lee wrote: > I propose the following RC to be released for the Apache Zeppelin 0.7.0 > release. > > The commit id is d0ddf8fdff75b4229543f7ebfd5eb001f685382d which is > corresponds to the tag v0.7.0-rc2: >

Re: programmatically call parameterised notebook paragraph

2016-12-29 Thread DuyHai Doan
Use REST Api with a simple REST client http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/rest-api/rest-notebook.html#run-a-paragraph-synchronously You can inject the Angular param values as POST data to the target paragraph On Thu, Dec 29, 2016 at 5:54 PM, Tushar Kapila wrote:

Re: Adding Angular API to non-Spark interpreters

2016-12-10 Thread DuyHai Doan
All interpreters can leverage the AngularObjectRegistry. The Cassandra interpreter does this here: https://github.com/apache/zeppelin/blob/master/cassandra/src/main/scala/org/apache/zeppelin/cassandra/InterpreterLogic.scala#L316-L356 On Fri, Dec 9, 2016 at 10:45 PM, Goodman, Alexander (398K) <

Re: Zeppelin or Jupiter

2016-11-28 Thread DuyHai Doan
"Granted, these two features are currently only fully supported by the spark interpreter group but work is currently underway to make the API extensible to other interpreters" --> Incorrect, the display system has also an API for front-end:

Re: FW: Issue with Zeppelin setup on Datastax-Spark

2016-11-16 Thread DuyHai Doan
I recommend downloading my pre-built Zeppelin for Datastax. Shared folder link: https://drive.google.com/folderview?id=0B6wR2aj4Cb6wQ01aR3ItR0xUNms On Wed, Nov 16, 2016 at 11:13 AM, DuyHai Doan <doanduy...@gmail.com> wrote: > Ok I understand why you have issue. > > You are us

Re: FW: Issue with Zeppelin setup on Datastax-Spark

2016-11-16 Thread DuyHai Doan
;> I think that `zeppelin.interpreter.host` and `zeppelin.interpreter.port` >> values on Interpreter setting UI should be removed because Interpreter >> will automatically be launched when you run a paragraph. >> >> 2016-09-16 3:56 GMT+09:00 Arpan Saha <arpan

Re: Share variable across notebooks

2016-11-14 Thread DuyHai Doan
You can share variables using ResourcePool: Put a variable - https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/ZeppelinContext.java#L809-L812 Get a variable -

Re: [DISCUSS] Zeppelin 0.7 Roadmap

2016-10-09 Thread DuyHai Doan
I'd also add in the Enterprise section a topic about monitoring (e.g. at least exposing JMX metrics as a 1st step). I guess we cannot pretend to be enterprise ready without at least some means to monitor the Zeppelin server state. Hopefully the monitoring topic will be covered by the big

Re: Some problem of using Zeppelin with Spark

2016-10-07 Thread DuyHai Doan
Try adding -U before -DskipTests On Fri, Oct 7, 2016 at 10:06 PM, mingda li wrote: > Dear all, > > Hi, we are using Zeppelin with Spark and AsterixDB now. The Spark will get > data from AsterixDB and Zeppelin can let users operate the data in Spark. > Now, we can run

Re: Paragraph text editor is very slow when number of notes is large (> 1000)

2016-10-01 Thread DuyHai Doan
The digest function is an Angular stuff and is a well known perf issue related to the way how Angular detects changes in UI components. This perf issue should be fixed with Angular2, which is using native functions for change detection:

Re: Regarding some doubts on usage of zeppelin

2016-09-21 Thread DuyHai Doan
Hello 1) Try to look at the angular js front end API http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/displaysystem/front-end-angular.html 2) Manually format your html output with angular ngif directive. 3) use tag On Wed, Sep 21, 2016 at 6:33 PM, Dipesh Vora

Re: FW: Issue with Zeppelin setup on Datastax-Spark

2016-09-15 Thread DuyHai Doan
ient.createInterpreter( > RemoteInterpreterService.java:168) > at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init( > RemoteInterpreter.java:172) > ... 12 more > ERROR [2016-09-15 16:49:15,118] ({Thread-18} > RemoteInterpreterEventPoller.java[run]:88) > -

Re: zeppelin architecture with multiple users

2016-09-15 Thread DuyHai Doan
Right now, you have some options to isolate the notes. Look at the doc about interpreter binding mode here : http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/manual/interpreters.html#interpreter-binding-mode On Thu, Sep 15, 2016 at 7:15 AM, York Huang wrote: > Hi, > >

Re: Issue with Zeppelin setup on Datastax-Spark

2016-09-15 Thread DuyHai Doan
Can you provide the complete stack trace ? Also, worth reading my blog post about integrating Spark/Zeppelin/C* or DSE : http://www.doanduyhai.com/blog/?p=2325 On Thu, Sep 15, 2016 at 5:17 AM, Arpan Saha wrote: > Hi Team, > > I am trying to integrate Zeppelin 0.6.0

Re: is there way to update(push latest data to) Zeppelin dashboard ?

2016-08-24 Thread DuyHai Doan
> > On Wednesday, August 24, 2016, DuyHai Doan <doanduy...@gmail.com> wrote: > >> "I want the updates to be pushed to the dashboard I dont want keep >> running the query over and over again or do some sort of polling." >> >> In this case the onl

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-17 Thread DuyHai Doan
Congratulations to the whole team for the great job On Tue, Aug 16, 2016 at 6:59 PM, Mohit Jaggi wrote: > awesome! > > Mohit Jaggi > Founder, > Data Orchard LLC > www.dataorchardllc.com > > > > > On Aug 16, 2016, at 6:56 AM, Ahyoung Ryu wrote: > >

Spark/Cassandra/Zeppelin integration: How to

2016-08-08 Thread DuyHai Doan
Hello all For those who are struggling to integrate those 3 stacks (and I know there are quite a few, given the number of questions I got on this topic), I have written a blog post to explain the steps to make it work: http://www.doanduyhai.com/blog/?p=2325 Optionally I have pre-built some

Re: Use embedded Spark for some notebook but use system provided Spark for others

2016-08-08 Thread DuyHai Doan
Easier solution: creates different instances of Spark interpreter for each use case: 1) For embedded Spark, just let the master property to local[*] 2) For system provided Spark, edit the Spark interpreter settings and change the master to some spark://:7077 On Mon, Aug 8, 2016 at 9:52 AM,

Re: Scratching my head around Zeppelin/Spark & Docker

2016-08-06 Thread DuyHai Doan
My host IP is 192.168.1.16 The VM IP is 10.0.2.15 (using Docker4Mac) Indeed I tried many things: 1) using the host network (--net=host) but then I cannot access Zeppelin (localhost:8080 or 127.0.0.1:8080). Zeppelin listens to the address 0.0.0.0 by default (config in zeppelin-site.xml). Changing

Re: Scratching my head around Zeppelin/Spark & Docker

2016-08-05 Thread DuyHai Doan
the Docker container to communicate with the external Spark cluster On Fri, Aug 5, 2016 at 9:00 PM, George Webster <webste...@gmail.com> wrote: > can you share your docker file? also, are you using docker-compose or just > docker-machine > > On Fri, Aug 5, 2016 at 8:46 PM, Du

Scratching my head around Zeppelin/Spark & Docker

2016-08-05 Thread DuyHai Doan
Hello guys Has anyone attempted to run Zeppelin inside Docker that connect to a real Spark cluster running on the host machine ? I've spend a day trying to make it work but unsuccessfully, the job never completed because the driver program (Zeppelin Spark shell) is listening on an Internal IP

Re: Import jars from spark spackages

2016-07-30 Thread DuyHai Doan
What is exactly the error message you have in the logs ? On Sat, Jul 30, 2016 at 2:58 PM, Andrea Santurbano wrote: > Hi all, > i want to import this library: > https://github.com/databricks/spark-corenlp > which is under spark packages: >

Spark/Zeppelin/Cassandra talk

2016-07-06 Thread DuyHai Doan
Hello Zeppelin fans If you're living in the London area, I'll be giving a talk about using Spark/Cassandra and Zeppelin to store, aggregate and visualize particle accelerator metrics: http://www.meetup.com/fr-FR/Spark-London/events/232355493/ Also if you know any event related to Zeppelin,

Re: Input Controls and Visualizations in Zeppelin

2016-05-28 Thread DuyHai Doan
You can design your own input form using plain Bootstrap/Angular and then use the new AngularJS front-end API to interact with paragraphs: http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/displaysystem/front-end-angular.html On Sat, May 28, 2016 at 11:13 AM, ashish rawat