Re: [mapserver-users] LABEL-formatting options
Hello Steve, Lime, Steve D (DNR) steve.l...@state.mn.us, [20100309 - 22:35:51] Hi Stephan: This is an increasingly asked question but at the moment I don't have a good solution or workaround, it's just not possible at the moment. There's a ticket already filed on the subject and it will be addressed in 6.0. Are you in a position where you could apply a patch to deal with the problem if one were available? Sure I am, I would be happy to test a patch and give feedback. I will CC myself to the ticket[1], hopefully I have found the right one, there is another one with a similar topic[2] which seems only apply for templating. Anyway, thanks for your response, I am awaiting your patches for testing :) Cheers Stephan [1] http://trac.osgeo.org/mapserver/ticket/60 [2] http://trac.osgeo.org/mapserver/ticket/1634 Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner signature.asc Description: PGP signature ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] LABEL-formatting options
Hello Brent, pcr...@pcreso.com, [20100309 - 23:49:56] Hi Stephan, Can you not add an appropriate column automatically as the shapefile is generated? Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or perhaps script something with the shapelib libraries or tools or the ogr tools? Yes, it is possible. But: I think it is a feature which mapserver should deal with. I have found that using Postgis rather than shapefiles gives you the ability to easily manage such issues as the data retrieved by mapserver is derived from an SQL query which allows the creation of virtual columns for labels on the fly. In our case we do not have a chance to use any DB at all, since the infrastructure permits it. The data are retrieved from caclculations, which are itself done on a (remote) server. Treating this sort of problem as a data management problem, in terms of supplying the desired data derived on the fly from the stored data, allows a tool such a Postgis to do what a database is designed for. A script using shp2pgsql or ogr2ogr to automatically turn your shapefile into a Postgis table, and render this using mapserver instead of the shapefile should fix your problem. As said, the specific infrastructure (sadly) does not allow to use PostGIS and the like (yet) I am after a more general approach (in order to make MapServer a little better), for my usecase it is easy to add a 'display'-column with the right decimal values trimmed. Cheers Stephan On Behalf Of Stephan Holl [stephan.h...@intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner signature.asc Description: PGP signature ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] LABEL-formatting options
Yep, always frustrating to suffer such constraints. Can you not define the layer in mapserver as an ogr layer rather than a native shapefile, and use ogr's pseudo-sql to cast/retrieve the value as a numeric more suitable for labeling with? http://www.gdal.org/ogr/ogr_sql.html Then in your mapfile use connectiontype ogr, as in: http://mapserver.org/input/vector/ogr.html (see example 4 with shapefiles joined in an ogr query) I agree it would be nice to have mapserver able to do this, but until then there should be some workaround (like this) that will suffice. Cheers, Brent --- On Wed, 3/10/10, Stephan Holl stephan.h...@intevation.de wrote: From: Stephan Holl stephan.h...@intevation.de Subject: Re: [mapserver-users] LABEL-formatting options To: pcr...@pcreso.com Cc: mapserver-users@lists.osgeo.org Date: Wednesday, March 10, 2010, 9:09 PM Hello Brent, pcr...@pcreso.com, [20100309 - 23:49:56] Hi Stephan, Can you not add an appropriate column automatically as the shapefile is generated? Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or perhaps script something with the shapelib libraries or tools or the ogr tools? Yes, it is possible. But: I think it is a feature which mapserver should deal with. I have found that using Postgis rather than shapefiles gives you the ability to easily manage such issues as the data retrieved by mapserver is derived from an SQL query which allows the creation of virtual columns for labels on the fly. In our case we do not have a chance to use any DB at all, since the infrastructure permits it. The data are retrieved from caclculations, which are itself done on a (remote) server. Treating this sort of problem as a data management problem, in terms of supplying the desired data derived on the fly from the stored data, allows a tool such a Postgis to do what a database is designed for. A script using shp2pgsql or ogr2ogr to automatically turn your shapefile into a Postgis table, and render this using mapserver instead of the shapefile should fix your problem. As said, the specific infrastructure (sadly) does not allow to use PostGIS and the like (yet) I am after a more general approach (in order to make MapServer a little better), for my usecase it is easy to add a 'display'-column with the right decimal values trimmed. Cheers Stephan On Behalf Of Stephan Holl [stephan.h...@intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] LABEL-formatting options
Hello Brent, pcr...@pcreso.com, [20100310 - 00:25:21] Yep, always frustrating to suffer such constraints. Can you not define the layer in mapserver as an ogr layer rather than a native shapefile, and use ogr's pseudo-sql to cast/retrieve the value as a numeric more suitable for labeling with? http://www.gdal.org/ogr/ogr_sql.html Then in your mapfile use connectiontype ogr, as in: http://mapserver.org/input/vector/ogr.html (see example 4 with shapefiles joined in an ogr query) I have seen this example, but have not done any experiences in a productive env. Can you say anything about performance for this sort of ogr-layer? Is this comparable to shapefiles? I agree it would be nice to have mapserver able to do this, but until then there should be some workaround (like this) that will suffice. yes, sure. I guess it will be only some more lines of java-code to add another column with trim()ed values to the shape, but a generic solution will be even better. Cheers Stephan --- On Wed, 3/10/10, Stephan Holl stephan.h...@intevation.de wrote: From: Stephan Holl stephan.h...@intevation.de Subject: Re: [mapserver-users] LABEL-formatting options To: pcr...@pcreso.com Cc: mapserver-users@lists.osgeo.org Date: Wednesday, March 10, 2010, 9:09 PM Hello Brent, pcr...@pcreso.com, [20100309 - 23:49:56] Hi Stephan, Can you not add an appropriate column automatically as the shapefile is generated? Tools such as dbfscript (http://www.whitetown.com/dbf-script/) or perhaps script something with the shapelib libraries or tools or the ogr tools? Yes, it is possible. But: I think it is a feature which mapserver should deal with. I have found that using Postgis rather than shapefiles gives you the ability to easily manage such issues as the data retrieved by mapserver is derived from an SQL query which allows the creation of virtual columns for labels on the fly. In our case we do not have a chance to use any DB at all, since the infrastructure permits it. The data are retrieved from caclculations, which are itself done on a (remote) server. Treating this sort of problem as a data management problem, in terms of supplying the desired data derived on the fly from the stored data, allows a tool such a Postgis to do what a database is designed for. A script using shp2pgsql or ogr2ogr to automatically turn your shapefile into a Postgis table, and render this using mapserver instead of the shapefile should fix your problem. As said, the specific infrastructure (sadly) does not allow to use PostGIS and the like (yet) I am after a more general approach (in order to make MapServer a little better), for my usecase it is easy to add a 'display'-column with the right decimal values trimmed. Cheers Stephan On Behalf Of Stephan Holl [stephan.h...@intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner signature.asc Description: PGP signature ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http
Re: [mapserver-users] LABEL-formatting options
I also would be very happy to test any patch that added label formatting capabilities. Cheers, Stephen On Wednesday 10 March 2010 15:05:51 Lime, Steve D (DNR) wrote: Hi Stephan: This is an increasingly asked question but at the moment I don't have a good solution or workaround, it's just not possible at the moment. There's a ticket already filed on the subject and it will be addressed in 6.0. Are you in a position where you could apply a patch to deal with the problem if one were available? Steve From: mapserver-users-boun...@lists.osgeo.org [mapserver-users-boun...@lists.osgeo.org] On Behalf Of Stephan Holl [stephan.h...@intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner -- = Stephen Davies Consulting P/L Voice: 08-8177 1595 Adelaide, South Australia.Fax : 08-8177 0133 Computing Network solutions.Mobile:040 304 0583 ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
Nobody suggests anything?? -Mensaje original- De: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users@lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ·· David Alda Fernández de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n · 01192 · Arkaute (Araba) ·· Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ·· email: da...@ikt.esweb: www.ikt.es ·· ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
On Wed, 10 Mar 2010 03:20:35 -0800, David Alda Fernandez de Lezea da...@ikt.es wrote: So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. I'm relatively new to MapServer so my experience is pretty limited. One of the tests we did was on a Dell Inspiron 8500 laptop that dual-booted Windows XP and Ubuntu 9.04 Desktop. On that machine our MapServer application ran about 14% faster on Linux than when running Windows. The limiting factor was CPU time. Our production server has 4GB of RAM and runs Windows Server 2008 64-bit. It provides good performance for our MapServer application, but it is not under heavy load and our data-set is less than one-tenth the size of yours. Multiple network connections sounds like a good plan to ensure that you can get data from your Oracle server quickly enough. -- James Card California CAD Solutions, Inc. 209-578-5580 - Voice 209-521-6493 - FAX ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
RE: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
Hi David Check out Building a GIS System Architecture Design Strategies for Managers from Dave Peters - Esri Press. Just as a start point. Cheers JC -Mensaje original- De: David Alda Fernandez de Lezea [mailto:da...@ikt.es] Enviado el: Miércoles, 10 de Marzo de 2010 08:21 a.m. Para: mapserver-users@lists.osgeo.org Asunto: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Nobody suggests anything?? -Mensaje original- De: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users@lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ·· David Alda Fernández de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n · 01192 · Arkaute (Araba) ·· Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ·· email: da...@ikt.esweb: www.ikt.es ·· ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
Hi, Maybe this can help you. http://2009.foss4g.org/presentations/#presentation_109 []'s Luigi Castro Cardeles 2010/3/10 Fuchs Juan Carlos jf...@indec.mecon.gov.ar: Hi David Check out Building a GIS System Architecture Design Strategies for Managers from Dave Peters - Esri Press. Just as a start point. Cheers JC -Mensaje original- De: David Alda Fernandez de Lezea [mailto:da...@ikt.es] Enviado el: Miércoles, 10 de Marzo de 2010 08:21 a.m. Para: mapserver-users@lists.osgeo.org Asunto: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Nobody suggests anything?? -Mensaje original- De: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users@lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ·· David Alda Fernández de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n · 01192 · Arkaute (Araba) ·· Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ·· email: da...@ikt.es web: www.ikt.es ·· ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
RE: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
Thanks Luigi, I'll have a look. -Mensaje original- De: Luigi Castro Cardeles [mailto:luigi.carde...@gmail.com] Enviado el: miércoles, 10 de marzo de 2010 14:43 Para: Fuchs Juan Carlos CC: David Alda Fernandez de Lezea; mapserver-users@lists.osgeo.org Asunto: Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Hi, Maybe this can help you. http://2009.foss4g.org/presentations/#presentation_109 []'s Luigi Castro Cardeles 2010/3/10 Fuchs Juan Carlos jf...@indec.mecon.gov.ar: Hi David Check out Building a GIS System Architecture Design Strategies for Managers from Dave Peters - Esri Press. Just as a start point. Cheers JC -Mensaje original- De: David Alda Fernandez de Lezea [mailto:da...@ikt.es] Enviado el: Miércoles, 10 de Marzo de 2010 08:21 a.m. Para: mapserver-users@lists.osgeo.org Asunto: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements Nobody suggests anything?? -Mensaje original- De: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users@lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ·· ·· ·· David Alda Fernández de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n · 01192 · Arkaute (Araba) ·· ·· ·· Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ·· ·· ·· email: da...@ikt.es web: www.ikt.es ·· ·· ·· ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
RE: [mapserver-users] LABEL-formatting options
Stephan, Since there isn't a MapServer solution until 6.0, a work around could be a python/php/other language script to populate a new column with a lower precision value. It wouldn't be that hard to write. David. -Original Message- From: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of Lime, Steve D (DNR) Sent: Tuesday, March 09, 2010 10:36 PM To: Stephan Holl; mapserver-users@lists.osgeo.org Subject: RE: [mapserver-users] LABEL-formatting options Hi Stephan: This is an increasingly asked question but at the moment I don't have a good solution or workaround, it's just not possible at the moment. There's a ticket already filed on the subject and it will be addressed in 6.0. Are you in a position where you could apply a patch to deal with the problem if one were available? Steve From: mapserver-users-boun...@lists.osgeo.org [mapserver-users-boun...@lists.osgeo.org] On Behalf Of Stephan Holl [stephan.h...@intevation.de] Sent: Tuesday, March 09, 2010 7:54 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] LABEL-formatting options Hello mapservers, we are using MapServer for visualizing shapefiles with double entries inside. Mainly this are contour-lines from waterdepth. The double values have 32 decimal places and mapserver tries to render them _all_ along a contourline. This does not look nice... Is there an option to trim the values with a dedicated mapfile-parameter, e.g. where a prinft-syntax can be used to format the values? The shapefiles are generated automatically so adding another column with trunc()ed or round()ed values is no option. Are there any options to format label-values/strings? I have not found anything in the docs. TIA Stephan -- Stephan Holl stephan.h...@intevation.de | Tel.: +49 (0)541-33 508 3663 Intevation GmbH, Neuer Graben 17, 49074 OS | AG Osnabrück - HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
RE: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements
Steve, Thanks for your response. The thing is that the technology we have to use is MapServer + TileCache + OL, so there's no possible discussion about this, it's not my decision. We have now everything setted up in a test environment (it's an Intel Core 2 Duo E4600 at 2.4 GHz PC with 2 GB of RAM, and it's used for some other tasks, apart from web mapping). I think that the performance now it's OK, but not for a production level, I just needed some guidelines or suggestions on hardware requirements for a server that will serve geographical data. I'll have to investigate a bit more with the information taken from your responses. Thanks again. David. -Mensaje original- De: Steve Kelly [mailto:st...@sjk.net.au] Enviado el: miércoles, 10 de marzo de 2010 13:08 Para: David Alda Fernandez de Lezea Asunto: RE: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements David, If you want we can have a skype chat and I can help you with some of the settings and setting things up - we render billions of images here a year using mapserver. I am also keen to talk to you about our tilecache technology and map engine (to replace openlayers and the tilecahce you are using) If you want to have a talk over Skype - add me Stephen.kelly2 (I am based in Australia GMT+10) But am around for the next hour or so on and off I look forward to a chat Thanks Steve -Original Message- From: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of David Alda Fernandez de Lezea Sent: Wednesday, 10 March 2010 9:30 PM To: mapserver-users@lists.osgeo.org Subject: RV: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Nobody suggests anything?? -Mensaje original- De: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] En nombre de David Alda Fernandez de Lezea Enviado el: martes, 09 de marzo de 2010 11:35 Para: mapserver-users@lists.osgeo.org Asunto: [mapserver-users] Looking for advice for OGC Services Serverhardware requirements Hello list, In our company, we are planning to set up a OGC Services Server using MapServer (we are currently using version 5.2.1, and at the moment it's working fine) to serve amounts of geographical data. We are going to serve big raster files (45 GB aprox each raster), so we need a big HDD (we know this). We are planning to have this raster files tiled with TileCache. We also are going to serve data via MapServer from another server in which we have an Oracle Spatial DataBase with very big tables and millions of rows, so we think that the communication between these 2 servers should be very fluid. All this services will be consumed by our own employees (50 aprox) or other people using desktop GIS software like gvSIG, Kosmo or ArcGIS. Besides, we are developing some web applications using OpenLayers, and this web apps will also consume those ogc services. So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... IMPORTANT: Take into account that this is going to be at PRODUCTION LEVEL. Hope someone can help me. Thanks!! Un saludo, ·· David Alda Fernández de Lezea Lurralde eta Biodibertsitate Saila / Dpto. de Territorio y Biodiversidad IKT Granja Modelo s/n · 01192 · Arkaute (Araba) ·· Tlfnos.: 945-00-32-95 Fax: 945-00.32.90 ·· email: da...@ikt.esweb: www.ikt.es ·· ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
[mapserver-users] WMS TIME parameter slow
Hello,
using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo
locations in the PostGIS db results in very slow speed when using the WMS TIME
parameter:
(in this example the number is about 4000 datapoints for this day, timing
measurements with DEBUG OFF).
1) Very fast using FILTER, approx. 5 seconds:
CONNECTION user={BF961C25A57BA226} password={C9748CA35D48D049}
dbname={6B40E65B12B92106} host=localhost
DATA geocoord from xyz_ref using unique datum
VALIDATION
'filter' ^datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum =
'[0-9]{4}-[0-9]{2}-[0-9]{2}'
END
FILTER datum = '2007-12-10' and datum '2007-12-11'
2) Very slow using WMS TIME, approx 210 and more seconds:
(Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't
change a thing)
...
METADATA
wms_timeextent 1970-01-01/2030-12-31
wms_timeitem datum
wms_timedefault 2007-12-10/2007-12-11
wms_title xyz_r
wms_srs init=epsg:-1
END
...
The MS ERRORFILE is very noisy spilling out all datapoints when running 2).
This does not happen when running 1).
Database is the same. No other changes have been made.
Why is mapserver so slow when using the WMS TIME parameter ?
It would be nice to stick to the official WMS configuration and not to
introduce a vendor specific workaround.
Thanks and Regards
Heiko
#
##
/var/www/localhost/cgi-bin/mapserv -v
MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP
OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV
SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7
INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE
A complete Layer definition:
LAYER
EXTENT -180 -90 180 90
CONNECTIONTYPE POSTGIS
NAME SACURA_REF_R
PROCESSING CLOSE_CONNECTION=DEFER
OPACITY 60
STATUS ON
METADATA
# wms_timeextent 1970-01-01/2030-12-31
# wms_timeitem datum
# wms_timedefault 2007-12-10/2007-12-11
wms_title xyz_ref_r
wms_srs init=epsg:-1
END
PROJECTION
init=epsg:4326
END
CONNECTION user={BF961C25A57BA226} password={C9748CA35D48D049}
dbname={6B40E65B12B92106} host=localhost
DATA geocoord from xyz_ref using unique datum
VALIDATION
'filter' ^datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}' and
datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}'
END
FILTER datum = '2007-12-10' and datum '2007-12-11'
TYPE POLYGON
SIZEUNITS meters
CLASS
DEBUG OFF
NAME xyz_ref_class
STYLE
OUTLINECOLOR 0 0 0
COLOR [rfarbe]
END
END
END # Layer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
RE: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
Hi Frank, I know it's difficult to answer those questions, I just needed some guidelines, or some indications of where search. I appreciate the answers and help of these kind people. Now I have some ideas. Thanks. David. -Mensaje original- De: Frank Warmerdam [mailto:warmer...@pobox.com] Enviado el: miércoles, 10 de marzo de 2010 16:21 Para: David Alda Fernandez de Lezea Asunto: Re: RV: [mapserver-users] Looking for advice for OGC Services Server hardware requirements David Alda Fernandez de Lezea wrote: Nobody suggests anything?? David, Hardware requirement requests traditionally do not result in specific answers. Really you need to benchmark your workload to have a good sense. There are just too many variables. I think folks have just given up trying to respond to them because they are essentially unanswerable. Best regards, -- ---+ ---+-- I set the clouds in motion - turn up | Frank Warmerdam, warmer...@pobox.com light and sound - activate the windows | http://pobox.com/~warmerdam and watch the world go round - Rush| Geospatial Programmer for Rent ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
On 3/9/2010 4:34 AM, David Alda Fernandez de Lezea wrote: Hello list, So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... Disclamer: I am a linux guy. Processor is a little hard, a faster processor will grind through the imagery faster. Imagery is CPU intensive. A fast processor is better than multi-core. For one user. There is probably a sweet spot for multi-user's between fast core and many core. You'll have to test. Memory is easy. Buy as much as you can. HDD is hard. Everyone think's CPU, CPU, CPU, and they never pay attention to IO. Lots of loads are IO bound and not CPU bound, so buying more and faster CPU's wont help at all. Here is where OS choice will come into play. Linux has fantastic software raid. I can recommend Linux 100% for fast drive IO across multiple SATA drives. NIC's: that's really dependent on your load. If you have the imagery local and only get shapes from across the network, then it wouldn't require too much network bandwidth. You didnt give us near enough info to help you decide. You'll have to test. OS: That's not the right question. You have a hammer and screw driver in your tool chest. Use the right tool for the right job. CGI, for example, is faster on Linux because of the way it spawns processes. FastCGI/mapscript/threads/etc will be similar on both OS's. The biggest question is what your admins are better at. Making a windows person admin a linux box is just asking for trouble. A windows person will get 10 times the performance from a windows box than a linux box. Other: You asked a huge question and gave very little usage info. I'd suggest you test, and benchmark. Set something cheap up and load test it. If you find you are CPU bound, then you'll know where you need to invest money. If you cant make it go any faster and the CPU's are not at 100%, then its either NIC or IO. You'll have to understand your load before you buy hardware for it. I run mapserver on a slackware linux box, with PostGIS db. cpu: AMD 64 X2 Dual Core Processor 3800+ hd: 3 1TB green Western Digital in raid 5. I get 100+ Mbs write, and 130 Mbs read. The cpu's sit around 5% usage. I get 70k hits a day. I have 180 gig of imagery, and PostGis db is 2.6 gig. The box was hand built for $350 bucks, with a few old parts and a few new. PRODUCTION LEVEL: this means different things. To me it means having a second $350 box sitting at standby ready to take over if my first box dies. To you it means, (based on your questions and a lot of guessing on my part) spending a lot of money on one box that'll be really good. I guess, in the end, my advice would be: if money is no object, get whatever. Otherwise, start small and try to understand your load requirements. A $350 linux box will go really far (but then my load is neither CPU or IO bound... I just dont have that much traffic). Don't you hate it when you ask a question, only to be asked more questions? -Andy ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] WMS TIME parameter slow
Firstly, 2 seconds is not fast, so you have another performance troll
beyond this one.
Secondly, it's impossible to know what's going on inside the database
without seeing the actual SQL being generated. Turn on statement
loggging in PgSQL and extract the SQL that is being run against the
database. Then you can put that into PgAdmin or psql and get EXPLAIN
ANALYZE results which will tell you why there's a problem, hopefully.
P.
On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schröter
schro...@iup.physik.uni-bremen.de wrote:
Hello,
using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo
locations in the PostGIS db results in very slow speed when using the WMS
TIME parameter:
(in this example the number is about 4000 datapoints for this day, timing
measurements with DEBUG OFF).
1) Very fast using FILTER, approx. 5 seconds:
CONNECTION user={BF961C25A57BA226} password={C9748CA35D48D049}
dbname={6B40E65B12B92106} host=localhost
DATA geocoord from xyz_ref using unique datum
VALIDATION
'filter' ^datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum =
'[0-9]{4}-[0-9]{2}-[0-9]{2}'
END
FILTER datum = '2007-12-10' and datum '2007-12-11'
2) Very slow using WMS TIME, approx 210 and more seconds:
(Leaving the VALIDATION/FILTER on or leaving out 'using unique datum' doesn't
change a thing)
...
METADATA
wms_timeextent 1970-01-01/2030-12-31
wms_timeitem datum
wms_timedefault 2007-12-10/2007-12-11
wms_title xyz_r
wms_srs init=epsg:-1
END
...
The MS ERRORFILE is very noisy spilling out all datapoints when running 2).
This does not happen when running 1).
Database is the same. No other changes have been made.
Why is mapserver so slow when using the WMS TIME parameter ?
It would be nice to stick to the official WMS configuration and not to
introduce a vendor specific workaround.
Thanks and Regards
Heiko
#
##
/var/www/localhost/cgi-bin/mapserv -v
MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP
OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV
SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7
INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE
A complete Layer definition:
LAYER
EXTENT -180 -90 180 90
CONNECTIONTYPE POSTGIS
NAME SACURA_REF_R
PROCESSING CLOSE_CONNECTION=DEFER
OPACITY 60
STATUS ON
METADATA
# wms_timeextent 1970-01-01/2030-12-31
# wms_timeitem datum
# wms_timedefault 2007-12-10/2007-12-11
wms_title xyz_ref_r
wms_srs init=epsg:-1
END
PROJECTION
init=epsg:4326
END
CONNECTION user={BF961C25A57BA226}
password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost
DATA geocoord from xyz_ref using unique datum
VALIDATION
'filter' ^datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}' and
datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}'
END
FILTER datum = '2007-12-10' and datum '2007-12-11'
TYPE POLYGON
SIZEUNITS meters
CLASS
DEBUG OFF
NAME xyz_ref_class
STYLE
OUTLINECOLOR 0 0 0
COLOR [rfarbe]
END
END
END # Layer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
RE: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
David, I don't remember all of your original post, so forgive me if you have already covered this. When looking at performance, make sure that you have done everything possible to optimize your data. -tiles and pyramids for rasters -all data in the output spatial reference system -precompute any complex classification expressions that you can Etc. David. -Original Message- From: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of Andy Colson Sent: Wednesday, March 10, 2010 9:33 AM To: David Alda Fernandez de Lezea Cc: mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements On 3/9/2010 4:34 AM, David Alda Fernandez de Lezea wrote: Hello list, So, our doubts have to do with the following subjects: - Processor - RAM Memory - HDD (we know that has to be large, i.e. 1TB - 2TB) - Number of network adapters (is advisable to have more than one?) - Which OS is best for MapServer, Linux or Windows 2003 (in terms of performance) - Other suggestions... Disclamer: I am a linux guy. Processor is a little hard, a faster processor will grind through the imagery faster. Imagery is CPU intensive. A fast processor is better than multi-core. For one user. There is probably a sweet spot for multi-user's between fast core and many core. You'll have to test. Memory is easy. Buy as much as you can. HDD is hard. Everyone think's CPU, CPU, CPU, and they never pay attention to IO. Lots of loads are IO bound and not CPU bound, so buying more and faster CPU's wont help at all. Here is where OS choice will come into play. Linux has fantastic software raid. I can recommend Linux 100% for fast drive IO across multiple SATA drives. NIC's: that's really dependent on your load. If you have the imagery local and only get shapes from across the network, then it wouldn't require too much network bandwidth. You didnt give us near enough info to help you decide. You'll have to test. OS: That's not the right question. You have a hammer and screw driver in your tool chest. Use the right tool for the right job. CGI, for example, is faster on Linux because of the way it spawns processes. FastCGI/mapscript/threads/etc will be similar on both OS's. The biggest question is what your admins are better at. Making a windows person admin a linux box is just asking for trouble. A windows person will get 10 times the performance from a windows box than a linux box. Other: You asked a huge question and gave very little usage info. I'd suggest you test, and benchmark. Set something cheap up and load test it. If you find you are CPU bound, then you'll know where you need to invest money. If you cant make it go any faster and the CPU's are not at 100%, then its either NIC or IO. You'll have to understand your load before you buy hardware for it. I run mapserver on a slackware linux box, with PostGIS db. cpu: AMD 64 X2 Dual Core Processor 3800+ hd: 3 1TB green Western Digital in raid 5. I get 100+ Mbs write, and 130 Mbs read. The cpu's sit around 5% usage. I get 70k hits a day. I have 180 gig of imagery, and PostGis db is 2.6 gig. The box was hand built for $350 bucks, with a few old parts and a few new. PRODUCTION LEVEL: this means different things. To me it means having a second $350 box sitting at standby ready to take over if my first box dies. To you it means, (based on your questions and a lot of guessing on my part) spending a lot of money on one box that'll be really good. I guess, in the end, my advice would be: if money is no object, get whatever. Otherwise, start small and try to understand your load requirements. A $350 linux box will go really far (but then my load is neither CPU or IO bound... I just dont have that much traffic). Don't you hate it when you ask a question, only to be asked more questions? -Andy ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] WMS TIME parameter slow
Am Mittwoch 10 März 2010 16:42:02 schrieben Sie:
Thanks for the hint.
Hm, i thought 4000 out of 4.5 Millions datasets for the whole year in 5 sec
would be not that bad
The timing figure shall just show the huge difference between the two types of
requests.
I will follow your advice and test the db. And yes the db is indexed.
Heiko
Firstly, 2 seconds is not fast, so you have another performance troll
beyond this one.
Secondly, it's impossible to know what's going on inside the database
without seeing the actual SQL being generated. Turn on statement
loggging in PgSQL and extract the SQL that is being run against the
database. Then you can put that into PgAdmin or psql and get EXPLAIN
ANALYZE results which will tell you why there's a problem, hopefully.
P.
On Wed, Mar 10, 2010 at 7:22 AM, Heiko Schröter
schro...@iup.physik.uni-bremen.de wrote:
Hello,
using mapserv (5.6.1) with PostGIS (8.3) and accessing ten-thousands of geo
locations in the PostGIS db results in very slow speed when using the WMS
TIME parameter:
(in this example the number is about 4000 datapoints for this day, timing
measurements with DEBUG OFF).
1) Very fast using FILTER, approx. 5 seconds:
CONNECTION user={BF961C25A57BA226} password={C9748CA35D48D049}
dbname={6B40E65B12B92106} host=localhost
DATA geocoord from xyz_ref using unique datum
VALIDATION
'filter' ^datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}' and datum =
'[0-9]{4}-[0-9]{2}-[0-9]{2}'
END
FILTER datum = '2007-12-10' and datum '2007-12-11'
2) Very slow using WMS TIME, approx 210 and more seconds:
(Leaving the VALIDATION/FILTER on or leaving out 'using unique datum'
doesn't change a thing)
...
METADATA
wms_timeextent 1970-01-01/2030-12-31
wms_timeitem datum
wms_timedefault 2007-12-10/2007-12-11
wms_title xyz_r
wms_srs init=epsg:-1
END
...
The MS ERRORFILE is very noisy spilling out all datapoints when running 2).
This does not happen when running 1).
Database is the same. No other changes have been made.
Why is mapserver so slow when using the WMS TIME parameter ?
It would be nice to stick to the official WMS configuration and not to
introduce a vendor specific workaround.
Thanks and Regards
Heiko
#
##
/var/www/localhost/cgi-bin/mapserv -v
MapServer version 5.6.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP
OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=ICONV
SUPPORTS=WMS_SERVER SUPPORTS=WFS_SERVER SUPPORTS=WCS_SERVER INPUT=EPPL7
INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE
A complete Layer definition:
LAYER
EXTENT -180 -90 180 90
CONNECTIONTYPE POSTGIS
NAME SACURA_REF_R
PROCESSING CLOSE_CONNECTION=DEFER
OPACITY 60
STATUS ON
METADATA
# wms_timeextent 1970-01-01/2030-12-31
# wms_timeitem datum
# wms_timedefault 2007-12-10/2007-12-11
wms_title xyz_ref_r
wms_srs init=epsg:-1
END
PROJECTION
init=epsg:4326
END
CONNECTION user={BF961C25A57BA226}
password={C9748CA35D48D049} dbname={6B40E65B12B92106} host=localhost
DATA geocoord from xyz_ref using unique datum
VALIDATION
'filter' ^datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}' and
datum = '[0-9]{4}-[0-9]{2}-[0-9]{2}'
END
FILTER datum = '2007-12-10' and datum '2007-12-11'
TYPE POLYGON
SIZEUNITS meters
CLASS
DEBUG OFF
NAME xyz_ref_class
STYLE
OUTLINECOLOR 0 0 0
COLOR [rfarbe]
END
END
END # Layer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
[mapserver-users] Something odd with queries in 5.6.1
Hi all,
I noticed something odd when I do a query with the new 5.6.1 version.
The getFeature method seems to return a NULL value, when it was working good
before the new version update.
Here's the code:
$n = $map-numlayers;
for ($i = 0; $i $n; $i++) {
$theme = $map-GetLayer($i);
if ($tema-isVisible()) {
if (($regs = $theme-getNumResults()) == 0) {
continue;
}
}
else {
continue;
}
$theme-open();
$values = $theme-getitems();
unset($atts);
for ($reg = 0; $reg $regs; $reg++) {
$result = $theme-getResult($reg);
// getFeature is returning NULL with the 5.6.1 version
$element = $theme-getFeature($result-shapeindex, $result-tileindex);
for ($value = 0; $value count($values); $value++) {
$atts[] = $values[$value] . . $element-values[$values[$value]];
}
// php crash because $element is a non object
$element-free();
}
$theme-close();
...
}
Any help or idea will be appreciated.
Thanks in advance
IC Carlos Ruiz
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Something odd with queries in 5.6.1
On 3/10/2010 3:53 PM, Carlos Ruiz wrote:
Hi all,
I noticed something odd when I do a query with the new 5.6.1 version.
The getFeature method seems to return a NULL value, when it was working
good before the new version update.
Here's the code:
$n = $map-numlayers;
for ($i = 0; $i $n; $i++) {
$theme = $map-GetLayer($i);
if ($tema-isVisible()) {
^
theme?
if (($regs = $theme-getNumResults()) == 0) {
continue;
}
}
else {
continue;
}
$theme-open();
$values = $theme-getitems();
unset($atts);
for ($reg = 0; $reg $regs; $reg++) {
$result = $theme-getResult($reg);
// getFeature is returning NULL with the 5.6.1 version
$element = $theme-getFeature($result-shapeindex, $result-tileindex);
for ($value = 0; $value count($values); $value++) {
$atts[] = $values[$value] . . $element-values[$values[$value]];
}
// php crash because $element is a non object
$element-free();
}
$theme-close();
...
}
Any help or idea will be appreciated.
Thanks in advance
IC Carlos Ruiz
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Something odd with queries in 5.6.1
Carlos Ruiz wrote: Hi all, I noticed something odd when I do a query with the new 5.6.1 version. The getFeature method seems to return a NULL value, when it was working good before the new version update. Due to a change in the handling of queries in version 5.6, ols scripts must be updated to use the new $layer-resultsGetShape() method instead of $layer-GetShape() or $layer-GetFeature() to read query results. There is a mention of this change in the migration guide, but it may not be clear enough (contributions welcome): http://trac.osgeo.org/mapserver/browser/branches/branch-5-6/mapserver/MIGRATION_GUIDE.TXT Daniel -- Daniel Morissette http://www.mapgears.com/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Looking for advice for OGC Services Server hardware requirements
Luigi Castro Cardeles wrote: Hi, Maybe this can help you. http://2009.foss4g.org/presentations/#presentation_109 I would like to add that there is at least some off-list talk of some Windows vs Unix benchmarking for the 2010 exercise (http://wiki.osgeo.org/wiki/Benchmarking_2010). As the maintainer of MapServer 4 Windows (MS4W) I can tell you that the download/use statistics are staggering (very popular); it is used in production environments for both government and private industry. I encourage you to give it a try (even though most developers on this MapServer mailing list are unix-based, don't let them scare you away from Windows, if you are more comfortable in that environment). Hope this helps a little. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
