Re: Zeppelin and Java 8

2017-05-03 Thread Jun Kim
I created a PR ! Thanks for pointing that out! 2017년 5월 4일 (목) 오후 12:25, Polina Marasanova < polina.marasan...@quantium.com.au>님이 작성: > Thanks for your quick response. We haven't upgraded yet to 0.7.1 but we > plan it in nearest future. > Possibly

Re: Zeppelin best practices/ efficiencies

2017-05-03 Thread Shanmukha Sreenivas Potti
Thanks, Jeff! I'll look into this solution. On Wed, May 3, 2017 at 5:32 PM, Jeff Zhang wrote: > > Regarding interpreter memory issue, this is because zeppelin's spark > interpreter only support yarn-client mode, that means the driver runs in > the same host as zeppelin

RE: Zeppelin and Java 8

2017-05-03 Thread Polina Marasanova
Thanks for your quick response. We haven't upgraded yet to 0.7.1 but we plan it in nearest future. Possibly JAVA_HOME parameter should be changed here https://zeppelin.apache.org/docs/0.7.1/install/install.html Cheers, Polina From: Jun Kim

Re: Zeppelin and Java 8

2017-05-03 Thread Jun Kim
Hi! Zeppelin 0.7.1 is built with Java 8. And it throws an exception if you run it with Java 7. You can see the related issue here: https://issues.apache.org/jira/browse/ZEPPELIN-2405 Thanks :) 2017년 5월 4일 (목) 오전 9:57, Polina Marasanova < polina.marasan...@quantium.com.au>님이 작성: > Hi everyone,

Zeppelin and Java 8

2017-05-03 Thread Polina Marasanova
Hi everyone, We really need to have Java 8 in our Zeppelin. I've seen a pull request about a year ago to upgrade Java version. It was closed as not urgent. Are there any updates regarding this matter? How dangerous it could be if I change the version to 1.8 in a pom.xml myself and rebuild it?

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread Jeff Zhang
Or you can try livy interpreter which support yarn cluster mode https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/interpreter/livy.html Sofiane Cherchalli 于2017年5月4日周四 上午3:49写道: > Hi Moon, > > Great, I am keen to see Zeppelin-2040 resolved soon. But meanwhile is > there any

Re: Zeppelin best practices/ efficiencies

2017-05-03 Thread Jeff Zhang
Regarding interpreter memory issue, this is because zeppelin's spark interpreter only support yarn-client mode, that means the driver runs in the same host as zeppelin server. So it is pretty easy to run out of memory if many users share the same driver (scoped mode you use). You can try livy

Unable to set aggregate user defined case classes

2017-05-03 Thread Anqi Chen
Hi, I’m observing a weird behavior in zeppelin %spark. I have the following in my paragraph: case class Test(a: Int, b: Int) val a = Test(1,2) val b = Test(1,2) val c = Test(2,3) val l = List(a,b,c) val rdd = spark.sparkContext.parallelize(l) rdd.map(v => (1,

Zeppelin best practices/ efficiencies

2017-05-03 Thread Shanmukha Sreenivas Potti
Hello Zeppelin users, I’m reaching out to you for some guidance on best practices. We currently use Zeppelin 0.7.0 on EMR and I have a few questions on gaining efficiencies with this setup that I would like to get addressed. Would really appreciate if any of you can help me with these issues or

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread moon soo Lee
Any workaround except for using client mode, it's difficult to think ... Thanks, moon On Wed, 3 May 2017 at 3:49 PM Sofiane Cherchalli wrote: > Hi Moon, > > Great, I am keen to see Zeppelin-2040 resolved soon. But meanwhile is > there any workaround? > > Thanks. > >

Re: Can't download moderately large data or number of rows to csv

2017-05-03 Thread Paul Brenner
I’m not sure what the best solution is but I created a ticket here:

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread Sofiane Cherchalli
Hi Moon, Great, I am keen to see Zeppelin-2040 resolved soon. But meanwhile is there any workaround? Thanks. Sofiane El El mié, 3 may 2017 a las 20:40, moon soo Lee escribió: > Zeppelin don't need to be installed in every workers. > You can think the way SparkInterpreter in

Trevor Grant has shared a document on Google Docs with you

2017-05-03 Thread trevor . d . grant
Trevor Grant has invited you to view the following document: Open in Docs

Trevor Grant has shared a document on Google Docs with you

2017-05-03 Thread trevor . d . grant
Trevor Grant has invited you to view the following document: Open in Docs

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread moon soo Lee
Zeppelin don't need to be installed in every workers. You can think the way SparkInterpreter in Zeppelin work is very similar to spark-shell (which works in client mode), until ZEPPELIN-2040 is resolved. Therefore, if spark-shell works in a machine with your standalone cluster, Zeppelin will work

Francis Lau has shared a document on Google Docs with you

2017-05-03 Thread francis . lau
Francis Lau has invited you to view the following document: Open in Docs

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread Sofiane Cherchalli
Hi Moon, So in my case, if II have standalone or yarn cluster, the workaround would be to install zeppelin along every worker, proxy them, and run each zeppelin in client mode ? Thanks, Sofiane El El mié, 3 may 2017 a las 19:12, moon soo Lee escribió: > Hi, > > Zeppelin does

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread moon soo Lee
Hi, Zeppelin does not support cluster mode deploy at the moment. Fortunately, there will be a support for cluster mode, soon! Please keep an eye on https://issues.apache.org/jira/browse/ZEPPELIN-2040. Thanks, moon On Wed, May 3, 2017 at 11:00 AM Sofiane Cherchalli wrote:

Re: Zeppelin not loading the index page after redirection from IDP

2017-05-03 Thread Paul Brenner
Unfortunately I haven't seen a ton of Shiro expertise on this list. Maybe someone will know the answer to your problem but my guess is that you are going to have to troubleshoot this by stripping out all that fancy complexity until you get a basic shiro.ini that works and then methodically add

Re: Export Zeppelin notebook with built-int visualization

2017-05-03 Thread Ruslan Dautkhanov
Hope to see this as implemented one day https://issues.apache.org/jira/browse/ZEPPELIN-1774 On Wed, May 3, 2017 at 5:05 AM Petr Knez wrote: > I know about feature (link to paragraph) but it not works if Zeppelin has > enabled Shiro authorization. > It works only for me (if

Re: Running a notebook in a standalone cluster mode issues

2017-05-03 Thread Sofiane Cherchalli
What port does the remote interpreter use? On Wed, May 3, 2017 at 2:14 PM, Sofiane Cherchalli wrote: > Hi Moon and al, > > I have a standalone cluster with one master, one worker. I submit jobs > through zeppelin. master, worker, and zeppelin run in a separate container. >

Running a notebook in a standalone cluster mode issues

2017-05-03 Thread Sofiane Cherchalli
Hi Moon and al, I have a standalone cluster with one master, one worker. I submit jobs through zeppelin. master, worker, and zeppelin run in a separate container. My zeppelin-env.sh: # spark home export SPARK_HOME=/usr/local/spark # set hadoop conf dir export

Re: Export Zeppelin notebook with built-int visualization

2017-05-03 Thread Jeff Zhang
You can export paragraph https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/manual/publish.html Petr Knez 于2017年5月3日周三 下午4:59写道: > I there any option to export notebook with built-in visualization (z.show) > outside zeppelin for users who don't have access Zeppelin, like

Export Zeppelin notebook with built-int visualization

2017-05-03 Thread Petr Knez
I there any option to export notebook with built-in visualization (z.show) outside zeppelin for users who don't have access Zeppelin, like export whole notebook or note (not only code) into html (not .json)? Thanks Petr

Re: Can't download moderately large data or number of rows to csv

2017-05-03 Thread Rick Moritz
I think whether this is an issue or not, depends a lot on how you use Zeppelin, and what tools you need to integrate with. Sadly Excel is still around as a data processing tool, and many people who I introduce to Zeppelin are quite proficient with it, hence the desire to export to csv in a trivial