Re: classnotfoundexception using zeppelin with spark authentication

2016-06-27 Thread Hyung Sung Shim
Hi. Could you share your conf/zeppelin-env.sh and spark-defaults.conf ? 2016-06-28 8:52 GMT+09:00 Jonathan Esterhazy : > I am having trouble using zeppelin in a spark cluster that has spark node > authentication turned on (e.g. with spark.authenticate=true, > spark.authenticate.secret=...) > > No

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-28 Thread Jonathan Esterhazy
Hyung, Yes, here they are. zeppelin-env.sh: export ZEPPELIN_PORT=8890 export ZEPPELIN_CONF_DIR=/etc/zeppelin/conf export ZEPPELIN_LOG_DIR=/var/log/zeppelin export ZEPPELIN_PID_DIR=/var/run/zeppelin export ZEPPELIN_PID=$ZEPPELIN_PID_DIR/zeppelin.pid export ZEPPELIN_NOTEBOOK_DIR=/var/lib/zeppelin/

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-28 Thread Hyung Sung Shim
Thank you. Let me try. 2016-06-28 22:18 GMT+09:00 Jonathan Esterhazy : > Hyung, > > Yes, here they are. > > zeppelin-env.sh: > > export ZEPPELIN_PORT=8890 > export ZEPPELIN_CONF_DIR=/etc/zeppelin/conf > export ZEPPELIN_LOG_DIR=/var/log/zeppelin > export ZEPPELIN_PID_DIR=/var/run/zeppelin > expor

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-30 Thread Jonathan Esterhazy
Hyung, did you have any luck w/ zeppelin + spark authentication? I'm quite stumped. thx. On Tue, Jun 28, 2016 at 9:11 PM, Hyung Sung Shim wrote: > Thank you. > Let me try. > > 2016-06-28 22:18 GMT+09:00 Jonathan Esterhazy < > jonathan.esterh...@gmail.com>: > >> Hyung, >> >> Yes, here they are.

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-30 Thread Hyung Sung Shim
Hi Jonathan. It's not easy to build the test environments but I am working on this. I have question for you. Does your code working well on spark-shell in the spark.authenticate mode? 2016-06-30 22:47 GMT+09:00 Jonathan Esterhazy : > Hyung, did you have any luck w/ zeppelin + spark authenticatio

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-30 Thread Jonathan Esterhazy
yes it does. i only see this problem in zeppelin. On Thu, Jun 30, 2016 at 7:05 AM, Hyung Sung Shim wrote: > Hi Jonathan. > It's not easy to build the test environments but I am working on this. > I have question for you. > Does your code working well on spark-shell in the spark.authenticate mode

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-30 Thread Hyung Sung Shim
Please add the *export SPARK_SUBMIT_OPTIONS="--conf spark.authenticate.secret=secret"* in conf/zeppelin-env.sh and restart zeppelin and retry your code. 2016-06-30 23:34 GMT+09:00 Jonathan Esterhazy : > yes it does. i only see this problem in zeppelin. > > On Thu, Jun 30, 2016 at 7:05 AM, Hyung

Re: classnotfoundexception using zeppelin with spark authentication

2016-06-30 Thread Jonathan Esterhazy
I added this and still get the same exception. The same property is also set in spark-defaults.conf. After that didn't work, I also tried adding --conf spark.authenticate=true and --conf spark.authenticate.enableSaslEncryption=true, to match the other related settings in spark-defaults.conf. Still

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-01 Thread Hyung Sung Shim
Hi Jonathan. Unfortunately I got same error in my test bed. Do you mind create an jira issue for this? 2016-07-01 3:19 GMT+09:00 Jonathan Esterhazy : > I added this and still get the same exception. The same property is also > set in spark-defaults.conf. > > After that didn't work, I also tried a

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-01 Thread Jonathan Esterhazy
Hyung, thx for your help. I opened these: https://issues.apache.org/jira/browse/ZEPPELIN-1096 (this scala problem) https://issues.apache.org/jira/browse/ZEPPELIN-1097 (similar looking python problem) LMK if I can provide more info or help in some way. On Fri, Jul 1, 2016 at 5:08 AM, Hyung Sung S

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-07 Thread Hyung Sung Shim
Hi. Jonathan. If it is possible, could you use the zeppelin master on the github? Zeppelin is working well with spark authentication when i tested. 2016-07-02 3:05 GMT+09:00 Jonathan Esterhazy : > Hyung, thx for your help. I opened these: > > https://issues.apache.org/jira/browse/ZEPPELIN-1096

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-27 Thread Jonathan Esterhazy
I just tried this with using zeppelin master, and the classnotfound error is still there. On Thu, Jul 7, 2016 at 7:07 AM, Hyung Sung Shim wrote: > Hi. Jonathan. > If it is possible, could you use the zeppelin master on the github? > Zeppelin is working well with spark authentication when i test

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-27 Thread Jeff Zhang
I think it is fixed in https://github.com/apache/zeppelin/pull/1237, please try that. On Thu, Jul 28, 2016 at 1:58 AM, Jonathan Esterhazy < jonathan.esterh...@gmail.com> wrote: > I just tried this with using zeppelin master, and the classnotfound error > is still there. > > > On Thu, Jul 7, 2016

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-28 Thread Jonathan Esterhazy
yes, this PR fixes my classnotfoundexceptions. awesome! any idea when it might make it into a release? On Wed, Jul 27, 2016 at 11:25 PM, Jeff Zhang wrote: > I think it is fixed in https://github.com/apache/zeppelin/pull/1237, > please try that. > > On Thu, Jul 28, 2016 at 1:58 AM, Jonathan Este

Re: classnotfoundexception using zeppelin with spark authentication

2016-07-28 Thread Jeff Zhang
I think it is safe to merge into 0.6.1 On Fri, Jul 29, 2016 at 1:08 AM, Jonathan Esterhazy < jonathan.esterh...@gmail.com> wrote: > yes, this PR fixes my classnotfoundexceptions. awesome! > > any idea when it might make it into a release? > > On Wed, Jul 27, 2016 at 11:25 PM, Jeff Zhang wrote: