Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread DuyHai Doan
Congratulations to the whole team for the great job On Tue, Aug 16, 2016 at 6:59 PM, Mohit Jaggi wrote: > awesome! > > Mohit Jaggi > Founder, > Data Orchard LLC > www.dataorchardllc.com > > > > > On Aug 16, 2016, at 6:56 AM, Ahyoung Ryu wrote: > > Congratulations, the Apache Zeppelin team & all

Re: PrintWriter not found

2016-08-16 Thread Jeff Zhang
I can also reproduce it in master, please file a ticket. On Wed, Aug 17, 2016 at 4:56 AM, Daniel Valdivia wrote: > Hi, > > I just upgraded my spark and zeppelin together to their respective latest > versions (2.0 and 0.6.1) however my existing notebooks are running into > problem that I'm not su

Authenticate 1 user per notebook

2016-08-16 Thread Polina Marasanova
Hi everyone, I'm back with my authentication questions. Here is my shiro.ini config file. The problem is that it lets in all users from search base "OU=Users,DC=companyname,DC=local" How can I restrict the access to only one user who owns a notebook? The process zeppelin-daemon.sh is running by

Re: Multiuser support of Zeppelin.

2016-08-16 Thread Jeff Zhang
Hi guys, I create an umbrella ticket for multiple user support for zeppelin as I can see more and more requirement of this from community, feel free to add sub task that I miss. https://issues.apache.org/jira/browse/ZEPPELIN-1337 On Tue, Aug 9, 2016 at 9:20 AM, Alexander Bezzubov wrote: > Hi

PrintWriter not found

2016-08-16 Thread Daniel Valdivia
Hi, I just upgraded my spark and zeppelin together to their respective latest versions (2.0 and 0.6.1) however my existing notebooks are running into problem that I'm not sure how to debug, if I manually append the full namespace this works for example; class Example { def test() {

Re: Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-16 Thread Mina Lee
I also could reproduce it with Spark 2.0.0, but not with Spark 1.6.1. If you want to use Zeppelin with Spark 2.0, one alternative you can try is using [1] "dependencies" in GUI interpreter menu. [1] http://zeppelin.apache.org/docs/0.6.1/manual/dependencymanagement.html On Wed, Aug 17, 2016 at 1:4

Re: Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-16 Thread Jeff Zhang
I can reproduce it in 0.6.1 & master branch, please file a ticket for that. On Wed, Aug 17, 2016 at 4:09 AM, Michael Sells wrote: > Testing out 0.6.1 with Spark 2.0 and discovered the way we load > dependencies doesn't seem to be working with the new update. > > We pass new dependencies in via a

Re: Possible to use Zeppelin Shell Interpreter to start a spark-submit job?

2016-08-16 Thread Jeff Zhang
I tried the latest zeppelin, it can tell me the exact exception when I didn't use spark-submit correctly. What zeppelin version do you use ? Maybe you can try the latest version [image: Inline image 1] On Wed, Aug 17, 2016 at 2:30 AM, Peter DeNicola < peter.denicola.f...@statefarm.com> wrote: >

Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-16 Thread Michael Sells
Testing out 0.6.1 with Spark 2.0 and discovered the way we load dependencies doesn't seem to be working with the new update. We pass new dependencies in via a SPARK_SUBMIT_OPTIONS environment variable pass the following flags: --packages com.databricks:spark-avro_2.11:3.0.0 Now when I try to impo

Re: Possible to use Zeppelin Shell Interpreter to start a spark-submit job?

2016-08-16 Thread Peter DeNicola
The spark shell interpreter logs don’t seem to give me much more info. It says it cannot run the job and the exception given is org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExe

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Mohit Jaggi
awesome! Mohit Jaggi Founder, Data Orchard LLC www.dataorchardllc.com > On Aug 16, 2016, at 6:56 AM, Ahyoung Ryu wrote: > > Congratulations, the Apache Zeppelin team & all community members! > > mailto:sourav.mazumde...@gmail.com>> > Congratulations !!! > > Great turn around with required

Possible to use Zeppelin Shell Interpreter to start a spark-submit job?

2016-08-16 Thread Peter DeNicola
I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin, but all I’m getting back is Process exited with an error: 1 (Exit value: 1) Which I’m not sure what this means. If anyone knows anything about this—or if it is even possible—I could use some help.

Re: Possible to use Zeppelin Shell Interpreter to start a spark-submit job?

2016-08-16 Thread Jeff Zhang
Please check the shell interpreter log. On Tue, Aug 16, 2016 at 10:11 PM, Peter DeNicola < peter.denicola.f...@statefarm.com> wrote: > I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin, > but all I’m getting back is Process exited with an error: 1 (Exit value: > 1) > > > > Wh

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Ahyoung Ryu
Congratulations, the Apache Zeppelin team & all community members! [image: ] > Congratulations !!! > > Great turn around with required spark 2.0 support and fix for SparkR with > Spark2.0. > > Regards, > Sourav > > On Tue, Aug 16, 2016 at 2:02 AM, Hyung Sung Shim > wrote: > >> Congratulations

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Sourav Mazumder
Congratulations !!! Great turn around with required spark 2.0 support and fix for SparkR with Spark2.0. Regards, Sourav On Tue, Aug 16, 2016 at 2:02 AM, Hyung Sung Shim wrote: > Congratulations for 0.6.1 release! > Thank you for everyone especially mina. > > 2016-08-16 16:57 GMT+09:00 Mina Lee

Re: z.show() not working

2016-08-16 Thread Jose Rivera-Rubio
Yes it's very simple. So using the %spark context: val user_meta = sqlContext.load("/vagrant/parquet_tables/user_meta.parquet") user_meta.registerTempTable("user_meta") val user = sqlContext.load("/vagrant/parquet_tables/user.parquet") user.registerTempTable("user") z.show(sqlContext.sql("select

Re: z.show() not working

2016-08-16 Thread Jeff Zhang
Could you share your code ? On Tue, Aug 16, 2016 at 8:41 PM, Jose Rivera-Rubio < jose.riv...@internavenue.com> wrote: > No errors in the interpreter log stored in ./logs but still no HTML table > output after doing z.show() Any other locations where I should check for > logs? > > Thanks! > > PS:

Re: z.show() not working

2016-08-16 Thread Jose Rivera-Rubio
No errors in the interpreter log stored in ./logs but still no HTML table output after doing z.show() Any other locations where I should check for logs? Thanks! PS: I'm using commit 37696ea8bd6a5c3b910f7d24141530f91f80391c of the master branch *Jose Rivera* p.s. We're Hiring

Re: Can I run different versions of spark interpreter in one zeppelin build ?

2016-08-16 Thread Jeff Zhang
Sorry, my bad, export SPARK_HOME doesn't work. I should try this earlier, otherwise it can be merged into 0.6.1 Created ticket https://issues.apache.org/jira/browse/ZEPPELIN-1334 On Thu, Aug 4, 2016 at 12:29 PM, Jeff Zhang wrote: > SparkSession is already available in spark2 support. > > On T

[ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Hyung Sung Shim
Congratulations for 0.6.1 release! Thank you for everyone especially mina. 2016-08-16 16:57 GMT+09:00 Mina Lee >: > The Apache Zeppelin community is pleased to announce the availability of > the 0.6.1 release. > > Zeppelin is a collaborative data analytics and visualization tool for > distributed

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread tog
Congrats to the team! On Tue, 16 Aug 2016 at 10:12 Alexander Bezzubov wrote: > Congratulations, everyone! > > And thank you Mina for putting it all together! > > https://twitter.com/ApacheZeppelin/status/765459508315303936 > > -- > Alex > > On Tue, Aug 16, 2016 at 4:57 PM, Mina Lee wrote: > >>

Re: How to restore the notebook from S3?

2016-08-16 Thread Shuya Tsukamoto
Thank you. Kevin, Jonathan and everyone! I'm Sorry. It was my mis-configuration about AWS IAM Policy. My IAM user couldn't operation as ListObjects. Therefore, I couldn't operation as restore. Thank you! Shuya Tsukamoto 2016-08-16 17:10 GMT+09:00 Jonathan Gough : > Is it supposed to be ZEPPELI

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Alexander Bezzubov
Congratulations, everyone! And thank you Mina for putting it all together! https://twitter.com/ApacheZeppelin/status/765459508315303936 -- Alex On Tue, Aug 16, 2016 at 4:57 PM, Mina Lee wrote: > The Apache Zeppelin community is pleased to announce the availability of > the 0.6.1 release. > >

RE: How to restore the notebook from S3?

2016-08-16 Thread Jonathan Gough
Is it supposed to be ZEPPELIN_NOTEBOOK_USER instead of ZEPPELIN_NOTEBOOK_S3_USER? That’s what I have in my config: [ { "configurations": [ { "classification": "export", "properties": { "ZEPPELIN_NOTEBOOK_S3_BUCKET": "mybucket", "ZEPPELIN_NOTEBOOK_S

Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Anthony Corbacho
Awesome job! On Tue, Aug 16, 2016 at 4:57 PM, Mina Lee wrote: > The Apache Zeppelin community is pleased to announce the availability of > the 0.6.1 release. > > Zeppelin is a collaborative data analytics and visualization tool for > distributed, general-purpose data processing system such as Ap

[ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Mina Lee
The Apache Zeppelin community is pleased to announce the availability of the 0.6.1 release. Zeppelin is a collaborative data analytics and visualization tool for distributed, general-purpose data processing system such as Apache Spark, Apache Flink, etc. The community put significant effort into

Any reason why PostgreSQL is not merged into jdbc interpreter

2016-08-16 Thread Jeff Zhang
Is there anything specific for postgreSQL so that zeppelin didn't merge it into the general jdbc interpreter ? -- Best Regards Jeff Zhang

Re: How to restore the notebook from S3?

2016-08-16 Thread Kevin Kim (Sangwoo)
Hi, In my case, it just restored notebooks, when I re-created EMR clusters. You may look into log files to find out what's going wrong.. - Kevin 2016년 8월 16일 (화) 오후 4:07, Shuya Tsukamoto 님이 작성: > Hi! > > I am using zeppelin 0.5.6 with Amazon EMR (emr-4.7.2). > > I was tried section "Notebook

How to restore the notebook from S3?

2016-08-16 Thread Shuya Tsukamoto
Hi! I am using zeppelin 0.5.6 with Amazon EMR (emr-4.7.2). I was tried section "Notebook Storage in S3". I use the configuration such as the following because my case is EMR. https://blogs.aws.amazon.com/bigdata/post/Tx3K805CZ8WFBRP/ Analyze-Realtime-Data-from-Amazon-Kinesis-Streams-Using- Zeppe