Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
Thanks for the advice. I am using a build from the 2.1.x branch so it is a very recent version. I think the jmap tool will have to be used.. Problem with that is we now have a system of restarting it so that the OOM doesn't happen. I guess I need to try to reproduce the issue on dev. But it doesn't get enough traffic to kill it... I just wanted to see if there were any big known issues. Sounds like ECW might be an issue. Some very large extractions are made perhaps they are responsible. Next month I should have some time to look at the issue in detail and I will update you all with what I find. Thanks again for the information. Jesse On Thu, Dec 22, 2011 at 11:23 PM, Rahkonen Jukka wrote: > Hi, > > I have seen sometimes with other programs that the ECW driver from ER > Mapper/Leica reserves whole lot of memory for a while. It made OpenJUMP to > jam if I had many ECW files open at the same time and I did a lot of > panning and zooming. The driver is caching some data for speeding up thing > things if the same area is visited again and it releases the memory after > 10 or 20 minutes if I remember it right. > I do not know if this is the same thing. However, all the desktop GIS > softwares using ECW SDK 3.x based drivers seem to behave in a similar way > when it comes to memory consumption. > > With OpenJUMP it took more memory to use many ecw files as a mosaic than > when I used only one big ecw file. And JPEG2000 images opened with the same > ECWJPEG2000 driver behaved in a similar way. > > It is possible that this has nothing to do with Geoserver and your problem. > > -Jukka Rahkonen- > > > Jesse Eichar wrote: > > > > Hi, > > > We are having to restart Geoserver once a week because of OutOfMemory > errors. I wanted to see if anyone knows of particular configurations that > can cause this. Rough statistics of our server: > > > * 6GM RAM > * 71 Stores > * 381 Layers > * 45 Workspaces > * Most raster data is ECW and most of those are ImageMosaics > * 27-30 of the Vector Stores are postgis (We are not yet using JNDI but > I am trying to find time to set that up). We have set the connections > perstore to 2 for most of them and have 200 permitted connections so we are > not running out of connections > * We have at least one JP2ECW Stores > * We have a couple proxied WMS Stores > * Some raster stores are published multiple times in different > workspaces > * We heavily use "virtual" workspaces > > Any ideas where I should look for the memory leak? > > Thanks, > > jesse > -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
[Geoserver-users] TIle maps authentication
I am curious if GeoServer support any authentication method for tile maps? -- Pozdrawiam AR -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
Hi, I have seen sometimes with other programs that the ECW driver from ER Mapper/Leica reserves whole lot of memory for a while. It made OpenJUMP to jam if I had many ECW files open at the same time and I did a lot of panning and zooming. The driver is caching some data for speeding up thing things if the same area is visited again and it releases the memory after 10 or 20 minutes if I remember it right. I do not know if this is the same thing. However, all the desktop GIS softwares using ECW SDK 3.x based drivers seem to behave in a similar way when it comes to memory consumption. With OpenJUMP it took more memory to use many ecw files as a mosaic than when I used only one big ecw file. And JPEG2000 images opened with the same ECWJPEG2000 driver behaved in a similar way. It is possible that this has nothing to do with Geoserver and your problem. -Jukka Rahkonen- Jesse Eichar wrote: > Hi, > We are having to restart Geoserver once a week because of OutOfMemory errors. > I wanted to see if anyone knows of particular configurations that can cause > this. Rough statistics of our server: * 6GM RAM * 71 Stores * 381 Layers * 45 Workspaces * Most raster data is ECW and most of those are ImageMosaics * 27-30 of the Vector Stores are postgis (We are not yet using JNDI but I am trying to find time to set that up). We have set the connections perstore to 2 for most of them and have 200 permitted connections so we are not running out of connections * We have at least one JP2ECW Stores * We have a couple proxied WMS Stores * Some raster stores are published multiple times in different workspaces * We heavily use "virtual" workspaces Any ideas where I should look for the memory leak? Thanks, jesse -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
Hey, have you checked your tomcat-logs? If it's like this "... java.lang.OutOfMemoryError: PermGen space ...", you should check your tomcat's configuration. Have a look at the catalina.sh of your Tomcat (Linux). In the JAVA_OPTS you have to set "...-XX:PermSize=512m...". 512 MB is an empirical value. Our server works fine since we did this... More information you can get by searching for "PermGen Space". There are also some descriptions for Windows-servers. Markus On Thu, 2011-12-22 at 14:56 +0100, Jesse Eichar wrote: > Hi, > > > We are having to restart Geoserver once a week because of OutOfMemory > errors. I wanted to see if anyone knows of particular configurations > that can cause this. Rough statistics of our server: > > > * 6GM RAM > * 71 Stores > * 381 Layers > * 45 Workspaces > * Most raster data is ECW and most of those are ImageMosaics > * 27-30 of the Vector Stores are postgis (We are not yet using > JNDI but I am trying to find time to set that up). We have > set the connections perstore to 2 for most of them and have > 200 permitted connections so we are not running out of > connections > * We have at least one JP2ECW Stores > * We have a couple proxied WMS Stores > * Some raster stores are published multiple times in different > workspaces > * We heavily use "virtual" workspaces > > > Any ideas where I should look for the memory leak? > > > Thanks, > > > jesse > -- > Write once. Port to many. > Get the SDK and tools to simplify cross-platform app development. Create > new or port existing apps to sell to consumers worldwide. Explore the > Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join > http://p.sf.net/sfu/intel-appdev > ___ Geoserver-users mailing list > Geoserver-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/geoserver-users -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
On Thu, Dec 22, 2011 at 3:27 PM, Benjamin Mearns wrote: > I'm having to restart nightly with many fewer layers/stores configured. > Was getting the oom with 2 layers groups with around 5 layers each that > were drawing on a single postgis database. My SLDs are pretty complex ... > doing a lot of labeling and scale depedencies. Am on a Windows server > though, so could be coming from somewhere totally different. At this point > I'm now running one of the 2.2 nightly builds from a few months ago. Could > it be a layer group or postgis issue? Either are unlikely. The same recipe I suggested for Jesse applies to you as well: - run a recent version of GeoServer - use jmap -histo on the command line close to the OOM to see what the leak is made of Cheers Andrea -- --- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob:+39 339 8844549 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf Please take note that GeoSolutions will be closed for Christmas holidays from 27/12 to 30/12 --- -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
I'm having to restart nightly with many fewer layers/stores configured. Was getting the oom with 2 layers groups with around 5 layers each that were drawing on a single postgis database. My SLDs are pretty complex ... doing a lot of labeling and scale depedencies. Am on a Windows server though, so could be coming from somewhere totally different. At this point I'm now running one of the 2.2 nightly builds from a few months ago. Could it be a layer group or postgis issue? Ben On Thu, Dec 22, 2011 at 8:56 AM, Jesse Eichar wrote: > Hi, > > We are having to restart Geoserver once a week because of OutOfMemory > errors. I wanted to see if anyone knows of particular configurations that > can cause this. Rough statistics of our server: > > >- 6GM RAM >- 71 Stores >- 381 Layers >- 45 Workspaces >- Most raster data is ECW and most of those are ImageMosaics >- 27-30 of the Vector Stores are postgis (We are not yet using JNDI >but I am trying to find time to set that up). We have set the connections >perstore to 2 for most of them and have 200 permitted connections so we are >not running out of connections >- We have at least one JP2ECW Stores >- We have a couple proxied WMS Stores >- Some raster stores are published multiple times in different >workspaces >- We heavily use "virtual" workspaces > > > Any ideas where I should look for the memory leak? > > Thanks, > > jesse > > > -- > Write once. Port to many. > Get the SDK and tools to simplify cross-platform app development. Create > new or port existing apps to sell to consumers worldwide. Explore the > Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join > http://p.sf.net/sfu/intel-appdev > ___ > Geoserver-users mailing list > Geoserver-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > -- Ben Mearns Lead Geospatial Information Consultant IT-Client Support & Services University of Delaware mea...@udel.edu : 302.831.1978 -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
On Thu, Dec 22, 2011 at 2:56 PM, Jesse Eichar wrote: > Hi, > > We are having to restart Geoserver once a week because of OutOfMemory > errors. I wanted to see if anyone knows of particular configurations that > can cause this. Rough statistics of our server: > > >- 6GM RAM >- 71 Stores >- 381 Layers >- 45 Workspaces >- Most raster data is ECW and most of those are ImageMosaics >- 27-30 of the Vector Stores are postgis (We are not yet using JNDI >but I am trying to find time to set that up). We have set the connections >perstore to 2 for most of them and have 200 permitted connections so we are >not running out of connections >- We have at least one JP2ECW Stores >- We have a couple proxied WMS Stores >- Some raster stores are published multiple times in different >workspaces >- We heavily use "virtual" workspaces > > > Any ideas where I should look for the memory leak? > Once you get close to the OOM you should try running jmap -histo as suggested here: http://docs.geoserver.org/latest/en/user/production/troubleshooting.html#jmap And of course run a recent version of GeoServer, some memory leaks were fixed at the beginning of the 2.1.x series Cheers Andrea -- --- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob:+39 339 8844549 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf Please take note that GeoSolutions will be closed for Christmas holidays from 27/12 to 30/12 --- -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] Searching for cause of OutOfMemory exceptions
First question is probably what version of geoserver are you using? And if anything but the latest have you tried upgrading to the latest? On Thu, Dec 22, 2011 at 8:56 AM, Jesse Eichar wrote: > Hi, > > We are having to restart Geoserver once a week because of OutOfMemory > errors. I wanted to see if anyone knows of particular configurations that > can cause this. Rough statistics of our server: > > >- 6GM RAM >- 71 Stores >- 381 Layers >- 45 Workspaces >- Most raster data is ECW and most of those are ImageMosaics >- 27-30 of the Vector Stores are postgis (We are not yet using JNDI >but I am trying to find time to set that up). We have set the connections >perstore to 2 for most of them and have 200 permitted connections so we are >not running out of connections >- We have at least one JP2ECW Stores >- We have a couple proxied WMS Stores >- Some raster stores are published multiple times in different >workspaces >- We heavily use "virtual" workspaces > > > Any ideas where I should look for the memory leak? > > Thanks, > > jesse > > > -- > Write once. Port to many. > Get the SDK and tools to simplify cross-platform app development. Create > new or port existing apps to sell to consumers worldwide. Explore the > Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join > http://p.sf.net/sfu/intel-appdev > ___ > Geoserver-users mailing list > Geoserver-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
[Geoserver-users] Searching for cause of OutOfMemory exceptions
Hi, We are having to restart Geoserver once a week because of OutOfMemory errors. I wanted to see if anyone knows of particular configurations that can cause this. Rough statistics of our server: - 6GM RAM - 71 Stores - 381 Layers - 45 Workspaces - Most raster data is ECW and most of those are ImageMosaics - 27-30 of the Vector Stores are postgis (We are not yet using JNDI but I am trying to find time to set that up). We have set the connections perstore to 2 for most of them and have 200 permitted connections so we are not running out of connections - We have at least one JP2ECW Stores - We have a couple proxied WMS Stores - Some raster stores are published multiple times in different workspaces - We heavily use "virtual" workspaces Any ideas where I should look for the memory leak? Thanks, jesse -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
[Geoserver-users] GetLegendGraphic questions
Hi list! A couple of questions regarding GetLegendGraphic request: 1. How can I request a layer group to get legend? 2. When I have a layer with a chart symbol (http://chart? in ExternalGraphic tag), GetLegendGraphic returns a blank picture. I suppose this is because a chart symbol is attribute driven, so GetLegendGraphic doesn't know how to draw the legend symbols. Can I pass some default params of the chart in the request just to get the legend? Or maybe it can find the first matching feature for each rule in the style ad return the rendered symbol? 3. I have a multiband raster layer with just a default "raster" style (i.e. a scanned map). I also have another image with a legend (just a plain scanned jpg). Can I override a GetLegendGraphic response somehow to return this jpg to the client? Or I have to do this substitution on the client side? -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
Re: [Geoserver-users] how to move configuration from one geoserver instance to another
On Thu, Dec 22, 2011 at 9:37 AM, Pierluigi Santin Fintel wrote: > > Hi ! > > I have to move configuration from geoserver in developer pc to the production > server. > Is there a way to do this safely? > > In the past we moved all files in the folder DATA\WORKSPACE from one machine > to the other but we had to change some GUID in the xml files, but we do not > have had great success: some layers disappeared after TOMCAT restart. Is > there a way to do it safely? You have to copy the entire data dir, not just the workspace folder Cheers Andrea -- --- Ing. Andrea Aime GeoSolutions S.A.S. Tech lead Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 339 8844549 http://www.geo-solutions.it http://geo-solutions.blogspot.com/ http://www.youtube.com/user/GeoSolutionsIT http://www.linkedin.com/in/andreaaime http://twitter.com/geowolf Please take note that GeoSolutions will be closed for Christmas holidays from 27/12 to 30/12 --- -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
[Geoserver-users] how to move configuration from one geoserver instance to another
Hi ! I have to move configuration from geoserver in developer pc to the production server. Is there a way to do this safely? In the past we moved all files in the folder DATA\WORKSPACE from one machine to the other but we had to change some GUID in the xml files, but we do not have had great success: some layers disappeared after TOMCAT restart. Is there a way to do it safely? Thanks in advance -- Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev ___ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
