Re: "output disappears" after running a paragraph - on recent master snapshot
Great to hear problem's gone!
Thanks for sharing the details.
Best,
moon
On Tue, 31 Jan 2017 at 3:31 AM Ruslan Dautkhanov
wrote:
> Can't reproduce this now even on that user's PC.
> We blame browser's cache.
> After upgrade some of the older .js/ .cs and other static files might have
> still been cached
> and were interfering with new zeppelin dynamic pages loaded from the
> server.
> Other users also confirmed no issues for them.
> Please disregard this issue report.
> Zeppelin rocks.
>
>
>
>
> --
> Ruslan Dautkhanov
>
> On Mon, Jan 30, 2017 at 10:15 AM, Ruslan Dautkhanov
> wrote:
>
> Thanks for the follow up Moon.
>
> I just happened to witness this blinking paragraph's output on his PC.
> It's interesting that it only happens in Chrome for him.
> (I use the same version of Chrome as him, and can't reproduce it)
>
> We also checked that it happens for different interpreters - %sh and
> %spark both show output, then it disappers very quickly.
>
> It doesn't happen in IE for that user. (IE has other issues like it
> doesn't show "Took x min y sec. Last updated by z at ..." at the bottom
> of a paragraph).
>
> ps. We also checked that user doesn't have ad blocking extensions in
> Chrome or anything like that.
>
>
>
> --
> Ruslan Dautkhanov
>
> On Sun, Jan 29, 2017 at 2:43 PM, moon soo Lee wrote:
>
> Hi,
>
> I'm not sure which action can possibly make output blinks and disappears.
> But
>
> ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1}
> AppendOutputRunner.java[run]:68) - Wait for OutputBuffer queue interrupted:
> null
>
> can occur when interpreter process is terminating (e.g. user click
> interpreter restart).
>
> Thanks,
> moon
>
>
> On Sun, Jan 29, 2017 at 6:18 AM Ruslan Dautkhanov
> wrote:
>
> We upgraded our Zeppelin to yesterday's master snapshot.
>
> One of users complains that all his notes don't produces output
> after the upgrade. It "blinks" with output and then output disappears.
>
> Here's quote from his email:
>
> My notebooks are having problems printing output. I can see the output
> flash on the screen but then it disappears.
>
>
> See that user's log attached. It has exceptions, including:
>
> ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1}
> AppendOutputRunner.java[run]:68) - Wait for OutputBuffer queue interrupted:
> null
> ERROR [2017-01-28 11:41:53,272] ({qtp691893263-18}
> ResourcePoolUtils.java[getAllResourcesExcept]:64) -
>
>
> I can't reproduce this issue, but we're running Zeppelin instances out of
> the same
> Zeppelin installation (running under different users though), so wanted to
> bounce
> this at other users. Have you seen this error before? Is this a known
> issue?
>
>
> Thanks,
> Ruslan Dautkhanov
>
>
>
>
Re: "output disappears" after running a paragraph - on recent master snapshot
Can't reproduce this now even on that user's PC.
We blame browser's cache.
After upgrade some of the older .js/ .cs and other static files might have
still been cached
and were interfering with new zeppelin dynamic pages loaded from the server.
Other users also confirmed no issues for them.
Please disregard this issue report.
Zeppelin rocks.
--
Ruslan Dautkhanov
On Mon, Jan 30, 2017 at 10:15 AM, Ruslan Dautkhanov
wrote:
> Thanks for the follow up Moon.
>
> I just happened to witness this blinking paragraph's output on his PC.
> It's interesting that it only happens in Chrome for him.
> (I use the same version of Chrome as him, and can't reproduce it)
>
> We also checked that it happens for different interpreters - %sh and
> %spark both show output, then it disappers very quickly.
>
> It doesn't happen in IE for that user. (IE has other issues like it
> doesn't show "Took x min y sec. Last updated by z at ..." at the bottom
> of a paragraph).
>
> ps. We also checked that user doesn't have ad blocking extensions in
> Chrome or anything like that.
>
>
>
> --
> Ruslan Dautkhanov
>
> On Sun, Jan 29, 2017 at 2:43 PM, moon soo Lee wrote:
>
>> Hi,
>>
>> I'm not sure which action can possibly make output blinks and disappears.
>> But
>>
>> ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1}
>> AppendOutputRunner.java[run]:68) - Wait for OutputBuffer queue
>> interrupted: null
>>
>> can occur when interpreter process is terminating (e.g. user click
>> interpreter restart).
>>
>> Thanks,
>> moon
>>
>>
>> On Sun, Jan 29, 2017 at 6:18 AM Ruslan Dautkhanov
>> wrote:
>>
>>> We upgraded our Zeppelin to yesterday's master snapshot.
>>>
>>> One of users complains that all his notes don't produces output
>>> after the upgrade. It "blinks" with output and then output disappears.
>>>
>>> Here's quote from his email:
>>>
>>> My notebooks are having problems printing output. I can see the output
>>> flash on the screen but then it disappears.
>>>
>>>
>>> See that user's log attached. It has exceptions, including:
>>>
>>> ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1}
>>> AppendOutputRunner.java[run]:68) - Wait for OutputBuffer queue
>>> interrupted: null
>>> ERROR [2017-01-28 11:41:53,272] ({qtp691893263-18}
>>> ResourcePoolUtils.java[getAllResourcesExcept]:64) -
>>>
>>>
>>> I can't reproduce this issue, but we're running Zeppelin instances out
>>> of the same
>>> Zeppelin installation (running under different users though), so wanted
>>> to bounce
>>> this at other users. Have you seen this error before? Is this a known
>>> issue?
>>>
>>>
>>> Thanks,
>>> Ruslan Dautkhanov
>>>
>>
>
Re: "output disappears" after running a paragraph - on recent master snapshot
Thanks for the follow up Moon.
I just happened to witness this blinking paragraph's output on his PC.
It's interesting that it only happens in Chrome for him.
(I use the same version of Chrome as him, and can't reproduce it)
We also checked that it happens for different interpreters - %sh and %spark
both show output, then it disappers very quickly.
It doesn't happen in IE for that user. (IE has other issues like it doesn't
show "Took x min y sec. Last updated by z at ..." at the bottom of a
paragraph).
ps. We also checked that user doesn't have ad blocking extensions in Chrome
or anything like that.
--
Ruslan Dautkhanov
On Sun, Jan 29, 2017 at 2:43 PM, moon soo Lee wrote:
> Hi,
>
> I'm not sure which action can possibly make output blinks and disappears.
> But
>
> ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1}
> AppendOutputRunner.java[run]:68) - Wait for OutputBuffer queue
> interrupted: null
>
> can occur when interpreter process is terminating (e.g. user click
> interpreter restart).
>
> Thanks,
> moon
>
>
> On Sun, Jan 29, 2017 at 6:18 AM Ruslan Dautkhanov
> wrote:
>
>> We upgraded our Zeppelin to yesterday's master snapshot.
>>
>> One of users complains that all his notes don't produces output
>> after the upgrade. It "blinks" with output and then output disappears.
>>
>> Here's quote from his email:
>>
>> My notebooks are having problems printing output. I can see the output
>> flash on the screen but then it disappears.
>>
>>
>> See that user's log attached. It has exceptions, including:
>>
>> ERROR [2017-01-28 11:13:53,338] ({pool-4-thread-1}
>> AppendOutputRunner.java[run]:68) - Wait for OutputBuffer queue
>> interrupted: null
>> ERROR [2017-01-28 11:41:53,272] ({qtp691893263-18}
>> ResourcePoolUtils.java[getAllResourcesExcept]:64)
>> -
>>
>>
>> I can't reproduce this issue, but we're running Zeppelin instances out of
>> the same
>> Zeppelin installation (running under different users though), so wanted
>> to bounce
>> this at other users. Have you seen this error before? Is this a known
>> issue?
>>
>>
>> Thanks,
>> Ruslan Dautkhanov
>>
>
Re: SSL with Elasticsearch / Shield
Thank you Bruno. I have switched to trying to use just Shield on 9300. I have
copied the latest Shield jar here:
/zeppelin/interpreter/elasticsearch/shield-2.4.4.jar and edited the
/zeppelin/elasticsearch/pom.xml dependency per:
https://www.elastic.co/guide/en/shield/current/_using_elasticsearch_java_clients_with_shield.html
I have restarted my ES interpreter with the correct shield settings
(shield.ssl.user, shield.ssl.keystore.path) - the same that my main application
uses successfully.
My issue it seems is that the Shield plugin is not being loaded. Per
zeppelin-interpreter-elasticsearch-root-ip-xx-xx-xx-xx.log
INFO [2017-01-30 16:06:29,471] ({pool-2-thread-2}
ElasticsearchInterpreter.java[open]:132)- prop={elasticsearch.result.size=10...
INFO [2017-01-30 16:06:29,572] ({pool-2-thread-2}
PluginsService.java[]:180) - [Vashti] modules [], plugins [], sites []
INFO [2017-01-30 16:06:31,248] ({pool-2-thread-2}
TransportClientNodesService.java[doSample]:420) - [Vashti] failed to get node
info for {#transport#-1}{xx.xx.xx.xx}{xx.xx.xx.xx:9300}, disconnecting...
I would expect to see something in the plugins[] ^. Any additional pointers
appreciated.
Thanks, Jonathan
On 2017-01-28 15:18 (-0500), Bruno Bonnin wrote:
> Hello,
>
> For the moment, in Zeppelin, the HTTP client for elasticsearch does not
> support SSL.
> If you want to use the elasticsearch transport client, maybe you should try
> to use the port 9300 and for SSL, you have to add other parameters, such as
> "shield.ssl.keystore.path" and "shield.ssl.keystore.password" (there are a
> description of some of them here:
> https://www.elastic.co/guide/en/shield/current/_using_elasticsearch_java_clients_with_shield.html
> )
>
> Bruno
>
>
> 2017-01-28 15:44 GMT+01:00 Jonathan Greenleaf :
>
> > I have been able to start the server on 8443, but have not been able to
> > make a connection to my Elasticsearch data node over SSL. I verified I can
> > curl (curl --insecure -v -u user:pwd https:xx.xx.xx.xx:9200/...) the ES box
> > with the Shield credentials.
> >
> > Within the interpreter I have
> > name -> value
> > shield.user -> user:pwd
> > shield.transport.ssl -> true
> >
> > we use port 9200 and force the gets/searches to require https.
> >
> > and I don't know if this is even used but I included this dependency:
> > /zeppelin/interpreter/elasticsearch/shield-2.4.4.jar
> > based on what I read here: https://zeppelin.apache.org/
> > docs/0.7.0-SNAPSHOT/interpreter/elasticsearch.html
> >
> > /zeppelin/logs/zeppelin-root-ip-10-2-3-144.log
> > INFO [2017-01-27 20:38:44,556] ({main} AbstractConnector.java[doStart]:266)
> > - Started ServerConnector@30aba78f{SSL-HTTP/1.1}{0.0.0.0:8443}
> >
> > elasticsearch log complains:
> > [2017-01-27 21:23:18,161][WARN ][shield.transport.netty ] [esdata3]
> > received plaintext http traffic on a https channel, closing connection [id:
> > 0xf43a9b2f, /xx.xx.xx.xx:36188 => /xx.xx.xx.xx:9200]
> >
> > I built from source - 0.8.0-SNAPSHOT. I also added this to
> > /zeppelin/elasticsearch/pom.xml
> >
> >
> >
> > org.elasticsearch.plugin
> > shield
> > 2.4.4
> >
> >
> > I'm confused what I need to do with Shield on the Zeppelin server. Do I
> > need to copy a cert from my existing Shield setup on my data node?
> >
> > Any pointers appreciated.
> > Thanks - Jonathan
> >
>
Re:
If you enable impersonation in livy server side, the spark application should be launched as the user who login zeppelin. Did you enable impersonation in livy server ? Michał Kabocik 于2017年1月30日周一 下午7:01写道： > Thank you for the reply. > > I know that impersonation is done by livy, but when I have user > impersonation disabled on livy.spark interpreter, then livy impersonates > zeppelin user, not my user. On ranger audit and in yarn history manager I > see zeppelin via livy-session. > What I want to achieve is to have my user (logged in to zeppelin after AD > authentication) impersonated. I need this to be able to apply ranger data > access policies based on the users/groups from AD. > Is there a way to implement this scenario? > > I'll appreciate any suggestions. > Kind regards, > Michał > >
[no subject]
Thank you for the reply. I know that impersonation is done by livy, but when I have user impersonation disabled on livy.spark interpreter, then livy impersonates zeppelin user, not my user. On ranger audit and in yarn history manager I see zeppelin via livy-session. What I want to achieve is to have my user (logged in to zeppelin after AD authentication) impersonated. I need this to be able to apply ranger data access policies based on the users/groups from AD. Is there a way to implement this scenario? I'll appreciate any suggestions. Kind regards, MichaÅ
