Although zeppelin has died a few times since this email came up, today was the
first time where I was able to actually check the number of interpreters.
All started interpreters:
7
Spark started interpreters:
5
That doesn’t seem unreasonable to me.
Here is what top is showing me, which doesn’t look like much load to me:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
30815 yarn
20 0 5021872 1.318g 35740 S 2.0 8.5 43:29.53 java
14828 yarn 20 0 4882384 991068 18944 S 0.7 6.1 21:27.67 java
37266 yarn
20 0 4991372 1.025g 35696 S 0.7 6.6 15:50.97 java
39201 yarn 20 0 4981424 1.221g 34944 S 0.7 7.9 14:00.73 java
43625 yarn
20 0 4970028 1.137g 34012 S 0.7 7.3 6:30.84 java
29054 yarn 20 0 4895580 1.509g 39428 S 0.3 9.7 112:33.44 java
46094 yarn
20 0 4092848 137112 12884 S 0.3 0.8 2:27.30 java
29042 yarn 20 0 113124 1580 1320 S 0.0 0.0 0:00.00
interpreter.sh
29053 yarn 20 0 113120 648 392 S 0.0 0.0 0:00.00
interpreter.sh
30803 yarn 20 0 113124 1576 1320 S 0.0 0.0 0:00.00
interpreter.sh
30814 yarn 20 0 113120 644 392 S 0.0 0.0 0:00.00
interpreter.sh
37253 yarn 20 0 113124 1564 1308 S 0.0 0.0 0:00.00
interpreter.sh
37265 yarn 20 0 113120 652 396 S 0.0 0.0 0:00.00
interpreter.sh
39188 yarn 20 0 113124 1580 1320 S 0.0 0.0 0:00.00
interpreter.sh
39200 yarn 20 0 113120 648 392 S 0.0 0.0 0:00.00
interpreter.sh
43612 yarn 20 0 113124 1576 1320 S 0.0 0.0 0:00.00
interpreter.sh
43624 yarn 20 0 113120 644 392 S 0.0 0.0 0:00.00
interpreter.sh
46636 yarn 20 0 113124 1516 1268 S 0.0 0.0 0:00.00
interpreter.sh
46647 yarn 20 0 113120 848 600 S 0.0 0.0 0:00.00
interpreter.sh
46648 yarn 20 0 4026284 150560 13024 S 0.0 0.9 1:56.46 java
finally here is what I see in the logs… I don’t know what is going on with that
authorization cache complaint but I assume not related?
INFO [2017-10-17 17:53:08,312] ({qtp1286783232-8117}
NotebookServer.java[onOpen]:156) - New connection from 10.201.12.29 : 54311
INFO [2017-10-17 17:53:08,394] ({qtp1286783232-8113}
NotebookServer.java[sendNote]:705) - New operation from 10.201.12.29 : 54311 :
gprabhu : GET_NOTE : 2CVZZ1XWN
INFO [2017-10-17 17:53:09,297] ({qtp1286783232-8117}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-10-17 17:53:09,317] ({qtp1286783232-8117}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
INFO [2017-10-17 17:53:09,351] ({qtp1286783232-8117}
AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
cacheManager properties have been set. Authorization cache cannot be obtained.
WARN [2017-10-17 17:53:09,381] ({qtp1286783232-8117}
SecurityRestApi.java[ticket]:87) -
{"status":"OK","message":"","body":{"principal":"gprabhu","ticket":"d7d18244-99c5-4eeb-941c-243dc7cc0ca3","roles":"[]"}}
( http://www.placeiq.com/ ) ( http://www.placeiq.com/ ) (
http://www.placeiq.com/ ) Paul Brenner ( https://twitter.com/placeiq ) (
https://twitter.com/placeiq ) ( https://twitter.com/placeiq ) (
https://www.facebook.com/PlaceIQ ) ( https://www.facebook.com/PlaceIQ ) (
https://www.linkedin.com/company/placeiq ) (
https://www.linkedin.com/company/placeiq ) DATA SCIENTIST (217) 390-3033
(
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/
) (
http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/
) (
http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP
) (
http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/
) (
http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/
) (
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
) (
http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
) PlaceIQ:Landmark by PlaceIQ (
https://www.placeiq.com/2017/05/placeiqs-landmark-powers-location-based-insight-innovation-for-ansible-gstv-havas-media-the-media-kitchen-and-more/
)
On Sat, Oct 14, 2017 at 6:02 AM "Fabian Böhnlein" < ">"Fabian Böhnlein" > wrote:
>
>
>
> Usually 2-3 interpreter running and use, where multiple users might be
> using the same interpreter in Per Note, Scoped setting.
>
>
>
> Though it might also happen with just 1-2 interpreter running and only
> single user on the UI.
>
>
> Belousov Maksim Eduardovich < m.belou...@tinkoff.ru > schrieb am Fr., 13.
> Okt. 2017, 10:44:
>
>
>>
>>
>> Paul, Ben, Fabian,
>>
>>
>>
>> please share your workload at time when notes are not loading.
>>
>>
>>
>>
>>
>>
>>
>> How much interpreters were started at that moment?
>>
>>
>>
>>
>>
>>
>>
>> You can find all started interpreters in linux command line with:
>>
>>
>>
>> ps -ef | grep ZeppelinServer | grep -v grep | awk "NR==1" | awk -F' '
>> '{print $2}' | xargs ps -f --ppid | wc -l
>>
>>
>>
>>
>>
>>
>>
>> And spark started interpreters:
>>
>>
>>
>> ps -ef | grep ZeppelinServer | grep -v grep | awk "NR==1" | awk -F' '
>> '{print $2}' | xargs ps -f --ppid | grep spark | wc -l
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *Максим Белоусов
>> * Архитектор
>>
>>
>>
>> Отдел отчетности и витрин данных
>>
>>
>>
>> Управление хранилищ данных и отчетности
>> Тел.: +7 495 648-10-00, доб. 2271
>>
>>
>>
>>
>>
>>
>>
>> **
>>
>>
>>
>>
>
>
> From: Paul Brenner [mailto: pbren...@placeiq.com ]
> *Sent:* Thursday, October 12, 2017 7:45 PM
> *To:* Geoffrey Cheng < geoffrey.ch...@gmail.com >; users@zeppelin.apache.org
>
> *Subject:* Re: Zeppelin Stops Loading Notes
Does this issue need a Jira ticket? The problem is that I have no idea how to
reproduce and I’m not sure if there is anything in the logs that is relevant.
Any ideas how we can produce an actionable Jira ticket out of this?
*(
https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
)*
*Paul Brenner*
*(
https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZojLilY_WX_-46hlEhnQRoJQ5C8ZUOAZ_meLvDY6KQBZnwrKf3cwh
)*
*(
https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZojLilYzWQaWq7ggPh3QT5Mo2BcgeARshCZs0ppfv-LV-hngHpFNLsF5ATLw=
)*
*(
https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZojLilYzWQaWg5gUBgH8V4co2BcgeMhgtGp8TjpaTMUh2Wq03z9OD4aUg11CUGcU9yEL4_w==
)*
*DATA SCIENTIST*
(217) 390-3033
(
https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZojLilYzWQaW84woJgHINoYc6B4oDYUZ3Rc5I2MmPPEpwVrU1x8Pd-h7kgaEp2PmxIoT_tnZw0F4lZkAE7HpAzeDFFzRzsHtaDud_bh8gaTb74PmhEpip4QXf0VEygkoUgKc2f7rhbUUoJRUQknz4IMq8HRG0szWYU_wILfijdrpZk438rNYQMeJqJYuVbQlccKmyp6E93LdOTBFuPE8b
)
On Thu, Oct 12, 2017 at 8:31 AM Geoffrey Cheng < Geoffrey Cheng (
geoffrey%20cheng%20%3cgeoffrey.ch...@gmail.com%3e ) > wrote:
>
>
>
> we have the same issue. usually when multiple ppl using it, only header
> loads.
>
>
>
>
>
>
>
>
> we tried couldn't find solution, so we restart every single time. in
> fact , we have to restart daily at least.
>
>
>
>
>
>
>
>
>
>
>
>
> On Oct 12, 2017 2:40 AM, "Fabian Böhnlein" < fabian.boehnl...@gmail.com >
> wrote:
>
>
>
>
>
>>
>>
>> Hi Paul, Ben,
>>
>>
>>
>>
>>
>>
>>
>>
>> we also see this happen regularly. It's more likely to happen when a
>> handful of people are using it.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> We mostly run one spark interpreter per person. We also don't observe
>> anything in the logs. The 'header' that you mentioned is actually still in
>> the cache.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Sometimes it's specific notes that don't load.
>>
>>
>>
>>
>> Sometimes there's a hanging Spark interpreter, once it's killed notes load
>> again.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> We're pretty clueless about it.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> Any front-end related logs we could enable to find out more?
>>
>>
>>
>>
>>
>>
>>
>>
>
>
>
>
>
>>
>>
>> On Sat, 19 Aug 2017 at 20:19 Ben Vogan < b...@shopkick.com > wrote:
>>
>>
>>
>>>
>>>
>>> I have seen Zeppelin get into this state once. I restarted it without
>>> investigating the logs however so I don't have anything useful to go on as
>>> to why.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --Ben
>>>
>>>
>>>
>>>
>>
>>
>>
>>
>>
>>
>>
>
>
>
>
>>
>>
>> On Sat, Aug 19, 2017 at 8:17 AM, Paul Brenner < pbren...@placeiq.com >
>> wrote:
>>
>>
>>
>
>
>
>
>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> You were correct. We had "export ZEPPELIN_SSL_PORT=false” in our
>>> zeppelin-env.sh. I’m going to comment that out. I suspect it is actually
>>> unrelated to the behavior we are seeing where pages stop loading though.
>>> Anyone else see this happen?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> I’ll report back if that happens again after the fix.
>>>
>>>
>>>
>>
>>
>>
>
>
>
>
>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> *(
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )*
>>>
>>>
>>>
>>> *Paul Brenner (
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )*
>>>
>>>
>>>
>>> *(
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )*
>>>
>>>
>>>
>>> *(
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )*
>>>
>>>
>>>
>>> *(
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )*
>>>
>>>
>>>
>>> *DATA SCIENTIST (
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )*
>>>
>>>
>>>
>>> (217) 390-3033 (
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> (
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )
>>>
>>>
>>>
>>>
>>>
>>>
>>> (
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )
>>>
>>>
>>>
>>
>>
>
>
>
>
>>
>>>
>>>
>>> On Fri, Aug 18, 2017 at 6:37 PM moon soo Lee < moon soo Lee > wrote: (
>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>> )
>>>
>>>
>>>
>>>
>>
>>
>
>
>
>
>>
>>>
>>>>
>>>>
>>>> Hi, (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>> (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> One of configuration value in your conf/zeppelin-env.sh or
>>>> conf/zeppelin-site.xml seems "false" which expected to be to a number. (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> Do you have any environment variable or property set to "false" for the
>>>> configurations below? (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> ZEPPELIN_PORT, zeppelin.server.port (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> ZEPPELIN_SSL_PORT, zeppelin.server.ssl.port (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> ZEPPELIN_INTERPRETER_CONNECT_TIMEOUT, zeppelin.interpreter.connect.timeout
>>>> (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> ZEPPELIN_INTERPRETER_MAX_POOL_SIZE, zeppelin.interpreter.max.poolsize (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> ZEPPELIN_INTERPRETER_OUTPUT_LIMIT, zeppelin.interpreter.output.limit (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>> Thanks,
>>>> moon (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>> (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Fri, Aug 18, 2017 at 2:30 PM Paul Brenner < pbren...@placeiq.com >
>>>> wrote: (
>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>> )
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>
>>
>
>
>
>
>>
>>>
>>>>
>>>>>
>>>>>
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>> We have a team of 5 users who all use the same zeppelin server. Lately a
>>>>> few times we have run into a case where zeppelin notes stop responding and
>>>>> then when we try refreshing the webpage for the note all that loads is the
>>>>> zeppelin header with no note. When I look at the logs I see: (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:23:06,569] ({qtp1286783232-14114}
>>>>> NotebookServer.java[sendNote]:705) - New operation from 10.201.12.26 :
>>>>> 55178 : nshah : GET_NOTE : 2CR2ANDEX (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:24:05,740] ({qtp1286783232-14115}
>>>>> NotebookServer.java[onClose]:363) - Closed connection to 10.201.12.22 :
>>>>> 57366. (1001) Idle Timeout (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:24:08,084] ({qtp1286783232-14121}
>>>>> NotebookServer.java[onClose]:363) - Closed connection to 10.201.12.22 :
>>>>> 57461. (1001) Idle Timeout (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:25:10,133] ({qtp1286783232-14122}
>>>>> AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
>>>>> cacheManager properties have been set. Authorization cache cannot be
>>>>> obtained. (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:25:10,157] ({qtp1286783232-14122}
>>>>> AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
>>>>> cacheManager properties have been set. Authorization cache cannot be
>>>>> obtained. (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:25:10,172] ({qtp1286783232-14122}
>>>>> AuthorizingRealm.java[getAuthorizationCacheLazy]:248) - No cache or
>>>>> cacheManager properties have been set. Authorization cache cannot be
>>>>> obtained. (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> WARN [2017-08-18 21:25:10,192] ({qtp1286783232-14122}
>>>>> SecurityRestApi.java[ticket]:87) -
>>>>> {"status":"OK","message":"","body":{"principal":"pbrenner","ticket":"5f717a1a-46df-4178-bc9a-690f66064d0e","roles":"[]"}}
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> INFO [2017-08-18 21:25:10,252] ({qtp1286783232-14123}
>>>>> NotebookServer.java[onOpen]:156) - New connection from 10.201.12.48 :
>>>>> 62413 (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ERROR [2017-08-18 21:25:10,353] ({qtp1286783232-14122}
>>>>> NotebookServer.java[onMessage]:357) - Can't handle message (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> java.lang.NumberFormatException: For input string: "false" (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Integer.parseInt(Integer.java:580) (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Integer.parseInt(Integer.java:615) (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.apache.zeppelin.conf.ZeppelinConfiguration.getInt(ZeppelinConfiguration.java:213)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.apache.zeppelin.conf.ZeppelinConfiguration.getInt(ZeppelinConfiguration.java:208)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.apache.zeppelin.conf.ZeppelinConfiguration.dumpConfigurations(ZeppelinConfiguration.java:496)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.apache.zeppelin.socket.NotebookServer.sendAllConfigurations(NotebookServer.java:1680)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:318)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:59)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258) (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.eclipse.jetty.websocket.
>>>>> common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at org.eclipse.jetty.websocket.
>>>>> common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at
>>>>> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> at java.lang.Thread.run(Thread.java:745) (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Anyone have any idea what is going on or how we could trouble shoot? (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>>
>>
>>
>
>
>
>
>>
>>>
>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> *(
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )*
>>>>>
>>>>>
>>>>>
>>>>> *Paul Brenner (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )*
>>>>>
>>>>>
>>>>>
>>>>> *(
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )*
>>>>>
>>>>>
>>>>>
>>>>> *(
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )*
>>>>>
>>>>>
>>>>>
>>>>> *(
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )*
>>>>>
>>>>>
>>>>>
>>>>> *DATA SCIENTIST (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )*
>>>>>
>>>>>
>>>>>
>>>>> (217) 390-3033 (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> (
>>>>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>>>>> )
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>>
>>>
>>
>>
>>
>>
>>
>> (
>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>> )
>>
>>
>>
>> (
>> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
>> )
>>
>>
>>
>>
>>
>
>
>
>
>
>
> -- (
> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
> )
>
>
>
> *BENJAMIN VOGAN | Data Platform Team Lead (
> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
> )*
>
>
>
>
> (
> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
> )
>
>
>
>
>
> (
> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
> )
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> (
> https://share.polymail.io/v1/z/b/NTllNjQzODFmNDll/dwh-E8LFTRBMMANBc5ZA0jwVltP6IPgd4ScRVgd4R6PBKV8XFBDxxvIdOqXqDYXjorvVSj6leFHYK_O5_sgBQBSlz0IYGZ81ChRMB6MTjRdQbqk4O0lyZIQeRtIhs5s_w5sZ0nQzberZ6yfizYzWGPug7ggPjGpS7Is4RTlmcytN94mpvyl8cs79XVI=
> )
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
