Re: Using Zeppelin with Spark FP

2016-09-15 Thread Mich Talebzadeh
Where are you reading data from Chanh? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use

Re: Using Zeppelin with Spark FP

2016-09-15 Thread Chanh Le
Yes, I used to experience that issue before even I set 1 hour cron for a job to update Spark Cache but it crashed. I didn’t check recently release but ZP cron is not stable I think. > On Sep 15, 2016, at 2:47 PM, Mich Talebzadeh > wrote: > > Thanks Chanh, > > I

Re: Using Zeppelin with Spark FP

2016-09-15 Thread Mich Talebzadeh
Thanks Chanh, I noticed one thing. If you put on a cron refresh say every 30 seconds after a whilt the job crashes with OOM error. Then I stop and restart Zeppelin daemon and it works again! Have you come across it? cheers Dr Mich Talebzadeh LinkedIn *

Re: Using Zeppelin with Spark FP

2016-09-15 Thread Chanh Le
Hi, I am using Zeppelin 0.7 snapshot and it works well both Spark 2.0 and STS of Spark 2.0. > On Sep 12, 2016, at 4:38 PM, Mich Talebzadeh > wrote: > > Hi Sachin, > > Downloaded Zeppelin 0.6.1 > > Now I can see the plot in a tabular format and graph. it looks

Re: Using Zeppelin with Spark FP

2016-09-12 Thread Sachin Janani
Yes zeppelin 0.6.1 works properly with Spark 2.0 On Mon, Sep 12, 2016 at 1:10 PM, Mich Talebzadeh wrote: > Does Zeppelin work OK with Spark 2? > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Using Zeppelin with Spark FP

2016-09-12 Thread Mich Talebzadeh
Does Zeppelin work OK with Spark 2? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it

Re: Using Zeppelin with Spark FP

2016-09-12 Thread Sachin Janani
Zeppelin imports ZeppelinContext object in spark interpreter using which you can plot dataframe,dataset and even rdd.To do so you just need to use "z.show(df)" in the paragraph (here df is the Dataframe which you want to plot) Regards, Sachin Janani On Mon, Sep 12, 2016 at 11:20 AM, andy

Re: Using Zeppelin with Spark FP

2016-09-11 Thread andy petrella
Heya, probably worth giving the Spark Notebook a go then. It can plot any scala data (collection, rdd, df, ds, custom, ...), all are reactive so they can deal with any sort of incoming data. You can ask on the gitter

Re: Using Zeppelin with Spark FP

2016-09-11 Thread Jeff Zhang
You can plot data frame. But it is not supported for RDD AFAIK. On Mon, Sep 12, 2016 at 5:12 AM, Mich Talebzadeh wrote: > Hi, > > Zeppelin is getting better. > > In its description it says: > > [image: Inline images 1] > > So far so good. One feature that I have not

Using Zeppelin with Spark FP

2016-09-11 Thread Mich Talebzadeh
Hi, Zeppelin is getting better. In its description it says: [image: Inline images 1] So far so good. One feature that I have not managed to work out is creating plots with Spark functional programming. I can get SQL going by connecting to Spark thrift server and you can plot the results