Re: [Geoserver-users] [Geoserver-devel] [JIRA] (GEOS-8218) Layer Groups page crashes when trying to reorder layers

[Steve Omondi]

Hey Gnafu,

*I am having this same Runtime Exception in Styles Page. (Geoserver
2.11.2).*

Oops, something went wrong...

Sorry, something unexpected happened on the server.

Here's an error report you can include in a JIRA bug report
 about this issue:
java.lang.RuntimeException: Could not deserialize object from byte[]


When I go to* Add New Styles* -> The *New Style* Page Open well. But any
action that reloads the page makes it crash.

For example in the *Format* Combo Box when I change the Format of choice,
or even under *Style Content*: *Generate a default style*, when I choose
any primitive like *Point* it crashes with same Exception


java.lang.RuntimeException: Could not deserialize object from byte[] at
org.apache.wicket.serialize.java.JavaSerializer.deserialize(JavaSerializer.java:139)
at
org.apache.wicket.pageStore.AbstractPageStore.deserializePage(AbstractPageStore.java:152)
at
org.apache.wicket.pageStore.AbstractCachingPageStore.getPage(AbstractCachingPageStore.java:67)
at
org.apache.wicket.page.PageStoreManager$SessionEntry.getPage(PageStoreManager.java:211)
at
org.apache.wicket.page.PageStoreManager$PersistentRequestAdapter.getPage(PageStoreManager.java:367)
at
org.apache.wicket.page.AbstractPageManager.getPage(AbstractPageManager.java:82)
at
org.apache.wicket.page.PageManagerDecorator.getPage(PageManagerDecorator.java:50)
at
org.apache.wicket.page.PageAccessSynchronizer$2.getPage(PageAccessSynchronizer.java:246)
at
org.apache.wicket.DefaultMapperContext.getPageInstance(DefaultMapperContext.java:113)
at
org.apache.wicket.core.request.handler.PageProvider.getStoredPage(PageProvider.java:299)
at
org.apache.wicket.core.request.handler.PageProvider.isNewPageInstance(PageProvider.java:211)
at
org.apache.wicket.core.request.mapper.AbstractBookmarkableMapper.checkExpiration(AbstractBookmarkableMapper.java:336)
at
org.apache.wicket.core.request.mapper.AbstractBookmarkableMapper.processListener(AbstractBookmarkableMapper.java:310)
at
org.apache.wicket.core.request.mapper.AbstractBookmarkableMapper.mapRequest(AbstractBookmarkableMapper.java:370)
at
org.apache.wicket.request.mapper.CompoundRequestMapper.mapRequest(CompoundRequestMapper.java:147)
at
org.geoserver.web.DynamicCryptoMapper.mapRequest(DynamicCryptoMapper.java:45)
at
org.apache.wicket.request.cycle.RequestCycle.resolveRequestHandler(RequestCycle.java:189)
at
org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:219)
at
org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:293)
at
org.apache.wicket.protocol.http.WicketFilter.processRequestCycle(WicketFilter.java:261)
at
org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203)
at
org.apache.wicket.protocol.http.WicketServlet.doPost(WicketServlet.java:159)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:661) at
javax.servlet.http.HttpServlet.service(HttpServlet.java:742) at
org.springframework.web.servlet.mvc.ServletWrappingController.handleRequestInternal(ServletWrappingController.java:158)
at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:147)
at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:50)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:959)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:893)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:968)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:870)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:661) at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:844)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742) at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at
org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
at
org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
at org.geoserver.monitor.MonitorFilter

Re: [Geoserver-users] Apparent race condition under load causes "Out of Memory" with WMS regardless of heapsize

[Andrea Aime]

Hi Walter,
looking at the code and doing a bit of searches around, it seems that
indeed it is prone to
run out of threads if the GC cannot reclaim the timer threads fast enough
(those are VM threads,
not response threads, so one should run out at 32k threads, not a few
hundreds...)

That said, I don't remember seeing this issue in the wild (or at least,
it's uncommon enough that I can't remember
about it), so I'm wondering if there is anything peculiar in your setup or
GC configuration
making it more likely to accumulate unreclaimed garbage?

About alternatives... hum... wondering if it could be replaced by usage of
a single ScheduledExecutorService
instead. Pull requests welcomed :-)

Hope this helps

Cheers
Andrea


On Fri, Sep 8, 2017 at 12:31 PM, Walter Stovall 
wrote:

> I’m load testing a 2.8 geoserver.  Geoserver runs in tomcat on the backend
> of an apache web server processing requests thru AJP.  I have a jmeter load
> test setup to send WMS GetMap requests (to get a JPEG image) for 40 users
> continually.  The test was running for about 10 seconds and processing
> hundreds of requests and then failed with an Out of Memory exception.  I
> doubled the heapsize from 1024MB to 2048MB and it ran for longer and then
> still reported Out of Memory.
>
>
>
> But the problem would appear to be threads and not memory…my exception
> reads:
>
>  ServiceExceptionReport SYSTEM "https://svcdev1.byers.com:
> 443/geoserver/schemas/wms/1.1.1/WMS_exception_1_1_1.dtd">
>
>
>   java.lang.OutOfMemoryError: unable to create new native thread
>
> unable to create new native thread
>
> 
>
>
>
> The code is apparently running out of threads, not memory.  This is
> related to the timer threads that WMS creates to detect the rendering
> taking too long.
>
>
>
> My tomcat thread pool is sized to 50 threads and I’ve confirmed that only
> that many are created.  But by doing a threaddump while the system is
> running under this jmeter load I see many more threads getting created
> which are simply the timer threads each request is creating.  For example I
> might see 50 threads that are blocked on the Oracle database while there
> are 157 of the timer threads.
>
>
>
> It would appear that the timers get canceled but the timer thread itself
> does not find an opportunity to exit/die before more timer threads are
> started.  Creating a Timer for every GetMap request would seem to be an
> inefficient way to attack the problem which invites this issue – there is
> apparently no Thread.join in scope to ensure these threads die.
>
>
>
> How can I get a more graceful failure under load? In general my policy
> with load is to size the tomcat thread pool so as to not have too many
> threads for reasonable throughput.  Then if more requests are received
> apache will say the server is overloaded/retry.  I don’t want various other
> exceptions that are supposed to indicate too much load but require
> judgement to that effect by non-technical users.
>
>
>
> Walter Stovall – Byers Engineering Company
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Geoserver-users mailing list
>
> Please make sure you read the following two resources before posting to
> this list:
> - Earning your support instead of buying it, but Ian Turton:
> http://www.ianturton.com/talks/foss4g.html#/
> - The GeoServer user list posting guidelines: http://geoserver.org/comm/
> userlist-guidelines.html
>
> Geoserver-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>
>


-- 

Regards,

Andrea Aime

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V
for more information.
==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39  339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary

[Geoserver-users] Apparent race condition under load causes "Out of Memory" with WMS regardless of heapsize

[Walter Stovall]

I'm load testing a 2.8 geoserver.  Geoserver runs in tomcat on the backend of 
an apache web server processing requests thru AJP.  I have a jmeter load test 
setup to send WMS GetMap requests (to get a JPEG image) for 40 users 
continually.  The test was running for about 10 seconds and processing hundreds 
of requests and then failed with an Out of Memory exception.  I doubled the 
heapsize from 1024MB to 2048MB and it ran for longer and then still reported 
Out of Memory.

But the problem would appear to be threads and not memory...my exception reads:
https://svcdev1.byers.com:443/geoserver/schemas/wms/1.1.1/WMS_exception_1_1_1.dtd";>

  java.lang.OutOfMemoryError: unable to create new native thread
unable to create new native thread


The code is apparently running out of threads, not memory.  This is related to 
the timer threads that WMS creates to detect the rendering taking too long.

My tomcat thread pool is sized to 50 threads and I've confirmed that only that 
many are created.  But by doing a threaddump while the system is running under 
this jmeter load I see many more threads getting created which are simply the 
timer threads each request is creating.  For example I might see 50 threads 
that are blocked on the Oracle database while there are 157 of the timer 
threads.

It would appear that the timers get canceled but the timer thread itself does 
not find an opportunity to exit/die before more timer threads are started.  
Creating a Timer for every GetMap request would seem to be an inefficient way 
to attack the problem which invites this issue - there is apparently no 
Thread.join in scope to ensure these threads die.

How can I get a more graceful failure under load? In general my policy with 
load is to size the tomcat thread pool so as to not have too many threads for 
reasonable throughput.  Then if more requests are received apache will say the 
server is overloaded/retry.  I don't want various other exceptions that are 
supposed to indicate too much load but require judgement to that effect by 
non-technical users.

Walter Stovall - Byers Engineering Company
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] StyleNotDefined error

[Oscar Diago Alonso]

Thanks for your answer!

I was afraid of that.

A couple of months ago I commented the fact that I couldn’t change the 
workspace of the style, but at that momento wasn’t an issue ☹

https://osgeo-org.atlassian.net/browse/GEOS-8225?filter=-2

Best regards!

Óscar Diago Alonso
Desarrollador GIS / GIS Developer

Tel: +34 945131372 e-mail: mailto:oscar.di...@geograma.com
Calle Pintor Clemente Arraiz, 3 Bajo 01008 Vitoria-Gasteiz
Geograma.  Expertos en GeoInformación

[GEOGRAMA]  [Certification_Badges-EDDA]
www.geograma.com

De acuerdo con la LO 15/1999, de Protección de Datos, y  la Ley 34/2002 
(LSSICE), se informa que su dirección de correo electrónico figura en nuestros 
archivos, al objeto de mantener el contacto y  remitirle publicidad e 
información empresarial sobre las actividades de Geograma, S.L. Si no desea 
recibir publicidad e información empresarial sobre las actividades de Geograma 
SL le rogamos que nos lo comunique a la siguiente dirección de correo 
electrónico: geogr...@geograma.com Podrá ejercer 
los derechos de acceso, cancelación, rectificación y oposición reconocidos por 
la LOPD mediante solicitud escrita y firmada a Geograma, S.L. a la siguiente 
dirección  C/ Castillo de Eskibel, 2 Bajo de Vitoria (C.P. 01007), adjuntando 
en todo caso copia de su DNI. En caso de modificación de sus datos deberá 
notificarlo en la misma dirección, declinando toda responsabilidad para la 
empresa en caso de no hacerlo. Si no es Ud. el destinatario y ha recibido este 
mensaje por error, agradecemos que lo comunique inmediatamente al remitente sin 
difundir, almacenar o copiar su contenido.

De: Ian Turton [mailto:ijtur...@gmail.com]
Enviado el: viernes, 08 de septiembre de 2017 11:23
Para: Oscar Diago Alonso 
CC: geoserver-users@lists.sourceforge.net
Asunto: Re: [Geoserver-users] StyleNotDefined error

The problem is that those styles are in a different workspace (cite) and form 
what you say your user doesn't have permission to see that workspace so you 
can't use them to style your layer.

Ian

2017-09-08 9:09 GMT+01:00 Oscar Diago Alonso 
mailto:oscar.di...@geograma.com>>:
Good morning!

I have a layer that has 4 different styles:

· cite:CP.CadastralParcel.Default
· cite:CP.CadastralParcel.LabelOnReferencePoint
· cite:CP.CadastralParcel.BoundariesOnly
· cite:CP.CadastralParcel.ReferencePointOnly

The layer is in the workspace “inspire”, but I can’t assign the same workspace 
to the styles (my user only has permissions to admin “inspire” workspace, so 
the combobox for the workspace in the SLD form is disabled).

If I add the WMS service to QGis I can see the the layer in the default style. 
But, if I pick the other styles, I get this error:

No such style: 
cite:CP.CadastralParcel.BoundariesOnly

Any idea why this is happening? I don’t have access to the logs, sorry.

I’m using GeoServer 2.11.1

Best regards!

Óscar Diago Alonso
Desarrollador GIS / GIS Developer

Tel: +34 945131372 e-mail: 
mailto:oscar.di...@geograma.com
Calle Pintor Clemente Arraiz, 3 Bajo 01008 Vitoria-Gasteiz
Geograma.  Expertos en GeoInformación

[cid:image005.jpg@01D32896.04F225A0]  
[cid:image006.jpg@01D32896.04F225A0]
www.geograma.com

De acuerdo con la LO 15/1999, de Protección de Datos, y  la Ley 34/2002 
(LSSICE), se informa que su dirección de correo electrónico figura en nuestros 
archivos, al objeto de mantener el contacto y  remitirle publicidad e 
información empresarial sobre las actividades de Geograma, S.L. Si no desea 
recibir publicidad e información empresarial sobre las actividades de Geograma 
SL le rogamos que nos lo comunique a la siguiente dirección de correo 
electrónico: geogr...@geograma.com Podrá ejercer 
los derechos de acceso, cancelación, rectificación y oposición reconocidos por 
la LOPD mediante solicitud escrita y firmada a Geograma, S.L. a la siguiente 
dirección  C/ Castillo de Eskibel, 2 Bajo de Vitoria (C.P. 01007), adjuntando 
en todo caso copia de su DNI. En caso de modificación de sus datos deberá 
notificarlo en la misma dirección, declinando toda responsabilidad para la 
empresa en caso de no hacerlo. Si no es Ud. el destinatario y ha recibido este 
mensaje por error, agradecemos que lo comunique inmediatamente al remitente sin 
difundir, almacenar o copiar su contenido.




--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserv

Re: [Geoserver-users] StyleNotDefined error

[Ian Turton]

The problem is that those styles are in a different workspace (cite) and
form what you say your user doesn't have permission to see that workspace
so you can't use them to style your layer.

Ian

2017-09-08 9:09 GMT+01:00 Oscar Diago Alonso :

> Good morning!
>
> I have a layer that has 4 different styles:
>
>
>- *cite:CP.CadastralParcel.Default*
>- *cite:CP.CadastralParcel.LabelOnReferencePoint*
>- *cite:CP.CadastralParcel.BoundariesOnly*
>- *cite:CP.CadastralParcel.ReferencePointOnly*
>
>
> The layer is in the workspace “inspire”, but I can’t assign the same
> workspace to the styles (my user only has permissions to admin “inspire”
> workspace, so the combobox for the workspace in the SLD form is disabled).
>
> If I add the WMS service to QGis I can see the the layer in the default
> style. But, if I pick the other styles, I get this error:
>
> *No such style:
> cite:CP.CadastralParcel.BoundariesOnly*
>
> Any idea why this is happening? I don’t have access to the logs, sorry.
>
> I’m using GeoServer 2.11.1
>
> Best regards!
>
> *Óscar Diago Alonso *
> *Desarrollador GIS** / **GIS Developer*
>
> Tel: +34 945131372 <+34%20945%2013%2013%2072> e-mail:
> *mailto:oscar.di...@geograma.com* 
> Calle Pintor Clemente Arraiz, 3 Bajo 01008 Vitoria-Gasteiz
> *Geograma*.  Expertos en GeoInformación
>
>
> *www.geograma.com* 
>
> De acuerdo con la LO 15/1999, de Protección de Datos, y  la Ley 34/2002
> (LSSICE), se informa que su dirección de correo electrónico figura en
> nuestros archivos, al objeto de mantener el contacto y  remitirle
> publicidad e información empresarial sobre las actividades de Geograma,
> S.L. Si no desea recibir publicidad e información empresarial sobre las
> actividades de Geograma SL le rogamos que nos lo comunique a la siguiente
> dirección de correo electrónico: *geogr...@geograma.com*
>  Podrá ejercer los derechos de acceso,
> cancelación, rectificación y oposición reconocidos por la LOPD mediante
> solicitud escrita y firmada a Geograma, S.L. a la siguiente dirección  C/
> Castillo de Eskibel, 2 Bajo de Vitoria (C.P. 01007), adjuntando en todo
> caso copia de su DNI. En caso de modificación de sus datos deberá
> notificarlo en la misma dirección, declinando toda responsabilidad para la
> empresa en caso de no hacerlo. Si no es Ud. el destinatario y ha recibido
> este mensaje por error, agradecemos que lo comunique inmediatamente al
> remitente sin difundir, almacenar o copiar su contenido.
>
>
>
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Geoserver-users mailing list
>
> Please make sure you read the following two resources before posting to
> this list:
> - Earning your support instead of buying it, but Ian Turton:
> http://www.ianturton.com/talks/foss4g.html#/
> - The GeoServer user list posting guidelines: http://geoserver.org/comm/
> userlist-guidelines.html
>
> Geoserver-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>
>


-- 
Ian Turton
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Geoserver-users] StyleNotDefined error

[Oscar Diago Alonso]

Good morning!

I have a layer that has 4 different styles:

-   cite:CP.CadastralParcel.Default
-   cite:CP.CadastralParcel.LabelOnReferencePoint
-   cite:CP.CadastralParcel.BoundariesOnly
-   cite:CP.CadastralParcel.ReferencePointOnly

The layer is in the workspace "inspire", but I can't assign the same workspace 
to the styles (my user only has permissions to admin "inspire" workspace, so 
the combobox for the workspace in the SLD form is disabled).

If I add the WMS service to QGis I can see the the layer in the default style. 
But, if I pick the other styles, I get this error:

No such style: 
cite:CP.CadastralParcel.BoundariesOnly

Any idea why this is happening? I don't have access to the logs, sorry.

I'm using GeoServer 2.11.1

Best regards!

Óscar Diago Alonso
Desarrollador GIS / GIS Developer

Tel: +34 945131372 e-mail: mailto:oscar.di...@geograma.com
Calle Pintor Clemente Arraiz, 3 Bajo 01008 Vitoria-Gasteiz
Geograma.  Expertos en GeoInformación

 [cid:image002.png@01D26517.F6475990]
www.geograma.com

De acuerdo con la LO 15/1999, de Protección de Datos, y  la Ley 34/2002 
(LSSICE), se informa que su dirección de correo electrónico figura en nuestros 
archivos, al objeto de mantener el contacto y  remitirle publicidad e 
información empresarial sobre las actividades de Geograma, S.L. Si no desea 
recibir publicidad e información empresarial sobre las actividades de Geograma 
SL le rogamos que nos lo comunique a la siguiente dirección de correo 
electrónico: geogr...@geograma.com Podrá ejercer 
los derechos de acceso, cancelación, rectificación y oposición reconocidos por 
la LOPD mediante solicitud escrita y firmada a Geograma, S.L. a la siguiente 
dirección  C/ Castillo de Eskibel, 2 Bajo de Vitoria (C.P. 01007), adjuntando 
en todo caso copia de su DNI. En caso de modificación de sus datos deberá 
notificarlo en la misma dirección, declinando toda responsabilidad para la 
empresa en caso de no hacerlo. Si no es Ud. el destinatario y ha recibido este 
mensaje por error, agradecemos que lo comunique inmediatamente al remitente sin 
difundir, almacenar o copiar su contenido.



--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users