VS: [mapserver-users] Mapserver search performance

2011-05-05 Thread Eichner, Andreas - SID-NLKM
Have a look at http://www.gdal.org/ogr/ogr_sql.html and http://www.gdal.org/ogr2ogr.html If you have base.{shp,shx,dbf} and addon.dbf that look like $ ogrinfo -al -so base.shp INFO: Open of `base.shp' using driver `ESRI Shapefile' successful. Layer name: base Geometry: Multi

AW: VS: [mapserver-users] Mapserver search performance

2011-05-04 Thread Eichner, Andreas - SID-NLKM
Hi. The first thing to note: editing a DBF with Excel Co. seems to be a _really_ bad idea. Those who tried that got Shapes wired to wrong attribute lines. So DBF, SHP, SHX and QIX files have to be used as a whole or will usually end up in a corrupted dataset. I would suggest ogr2ogr from the

Re: VS: [mapserver-users] Mapserver search performance

2011-05-04 Thread Mark Korver
I agree with Andreas, if you just want to manipulate the shapefile and continue to use a moded shapefile with MapServer then Spatialite ( or ogr2ogr ) can help you, but if you want query flexibility with MapServer then postGIS is the way to go. On Wed, May 4, 2011 at 3:23 AM, Eichner, Andreas -

Re: VS: [mapserver-users] Mapserver search performance

2011-05-04 Thread Varun saraf
Hi Andreas, I have looked and looked but could not find how to use ogr2ogr to do the operation I am interested in. Could you point me in the right direction here as to how can ogr2ogr be used to add new fields to an existing dbf file from another dbf file. The external dbf file from which I need

Re: VS: [mapserver-users] Mapserver search performance

2011-05-03 Thread Varun saraf
Hi, Thanks a lot Andreas. That JOIN was the culprit as you rightly suggested. Once I removed the join, the performance increased exponentially. The 5 minute cgi run now took under 5 seconds which is simply amazing. I just need one more help. Is there a DBF editor out there that can be used to

Re: VS: [mapserver-users] Mapserver search performance

2011-05-03 Thread Mr. Puneet Kishor
On May 3, 2011, at 3:36 PM, Varun saraf wrote: Hi Puneet, Thanks a lot for the prompt reply. I tried using Excel 2007 and was not able to re-save the dbf file after editing. Also, I am having DBF files with about a million records and Excel tends to hang for these operations. Now you

Re: VS: [mapserver-users] Mapserver search performance

2011-05-03 Thread Varun saraf
Hi, Thanks a lot for the quick help. I am a PHP/Java guy. I shall try my luck with some sort of PHP scripting as I need a solution fairly quickly. I had made the suggestion of shifting to a PostGIS system quite some time back but I guess you know how it is with approvals :) Thanks again, Varun

Re: VS: [mapserver-users] Mapserver search performance

2011-05-03 Thread Mark Korver
Spatialite jumps into my mind. http://www.gaia-gis.it/spatialite/ On Tue, May 3, 2011 at 3:19 PM, Varun saraf vsaraf@gmail.com wrote: Hi, Thanks a lot Andreas. That JOIN was the culprit as you rightly suggested. Once I removed the join, the performance increased exponentially. The 5

RE: VS: [mapserver-users] Mapserver search performance

2011-05-03 Thread Fawcett, David (MPCA)
, 2011 4:06 PM To: Varun saraf Cc: mapserver-users@lists.osgeo.org Subject: Re: VS: [mapserver-users] Mapserver search performance Spatialite jumps into my mind. http://www.gaia-gis.it/spatialite/ ___ mapserver-users mailing list mapserver-users

AW: VS: [mapserver-users] Mapserver search performance

2011-04-15 Thread Eichner, Andreas - SID-NLKM
Hi, AFAIK dBase files don't provide an index themselves and there's no other way to provide one. shptree only creates an spatial index. Therefore only queries like 'does this geometry touch/intersect/lie within a given rectangle'can be accelerated. I tried the shptree tool but did not see any

Re: VS: [mapserver-users] Mapserver search performance

2011-04-14 Thread Varun saraf
Hi, I tried the shptree tool but did not see any performance improvement. It fetched results about 4-5 seconds faster. Without QIX files, it was 5 minutes and with QIX files, it took about 4 minutes and 56 seconds. All of my requests are based on the MAPSHAPE parameter in NQUERY mode. I noticed

[mapserver-users] Mapserver search performance

2011-04-11 Thread Varun saraf
Hello Everyone, I have programmed a GIS application using Mapserver, Google maps and Tilecache. The functionality of this GIS application is to extract the data (from the dbf file) for all features (Points) within a randomly drawn user shape and doing some statistical operation on that data. I

VS: [mapserver-users] Mapserver search performance

2011-04-11 Thread Rahkonen Jukka
Hi, Shptree will help and stopwatch will tell you how much. Without spatial index Mapserver needs to go through the whole shapefile every time. Have a try, it will not take very many seconds to run shptree. Make different requests, take times with and without .qix files and you will some numbers.

Re: VS: [mapserver-users] Mapserver search performance

2011-04-11 Thread Varun saraf
Thanks a lot for the quick reply. I will give it a try. On Mon, Apr 11, 2011 at 1:50 PM, Rahkonen Jukka jukka.rahko...@mmmtike.fi wrote: Hi, Shptree will help and stopwatch will tell you how much. Without spatial index Mapserver needs to go through the whole shapefile every time. Have a try,