Re: [pmapper-users] Hello!
Thankyou all for the responses... I have evidentet these techniques: - Slippy Maps (that is integreted in MapServer but i will show how it works) - Zooming layering (show only some maps in some zooming levels) - Tile Index ( i love it) - Database optimisation (i have an experience with thousands geospaical records ...so i think it is important) I will take into consideration your advice too... I will send my paper in two conferences here in Balkan. The rule is to not publish the paper until they make a decision to accept it or not So I will show it up for you after May 2013 :) On Mon, Feb 18, 2013 at 10:27 PM, Armin Burger wrote: > http://mapserver.org/optimization/index.html > http://mapserver.org/input/raster.html#raster-display-performance-tips > > > On 02/16/2013 06:35 PM, yllka baci wrote: > > Hello Pmapper users > > I'm going to write a paper on techniques that speed up data visualisation > > on Web GIS applications. > > Can any one of you tell me the techniques that he (she) knows? > > > > ps: pmapper.net will be the main reference of this paper :) thank you > very > > much for the support. > > > > > -- > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly > thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. > http://goparallel.sourceforge.net/ > ___ > pmapper-users mailing list > pmapper-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/pmapper-users > -- Yllka Baci -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb ___ pmapper-users mailing list pmapper-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pmapper-users
Re: [pmapper-users] Hello!
http://mapserver.org/optimization/index.html http://mapserver.org/input/raster.html#raster-display-performance-tips On 02/16/2013 06:35 PM, yllka baci wrote: > Hello Pmapper users > I'm going to write a paper on techniques that speed up data visualisation > on Web GIS applications. > Can any one of you tell me the techniques that he (she) knows? > > ps: pmapper.net will be the main reference of this paper :) thank you very > much for the support. > -- The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials, tech docs, whitepapers, evaluation guides, and opinion stories. Check out the most recent posts - join the conversation now. http://goparallel.sourceforge.net/ ___ pmapper-users mailing list pmapper-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pmapper-users
Re: [pmapper-users] Hello!
Thanks!
Le 18/02/2013 11:19, Chris forum a écrit :
>>> Put the generated/temp files from Mapserver on a RAM disk (IMAGEPATH
>>> parameter of the mapfile).
>> Have you got doc for this point please?
> Here under how it is set up on my Debian server, for a 8GB directory on
> RAM:
>
> mkdir /data/disk_on_ram/
> mount -o size=8G -t tmpfs tmpfs /data/disk_on_ram/
> mkdir /data/disk_on_ram/pmapper_temp
> chown www-data:users /data/disk_on_ram/pmapper_temp/
>
> Then to let Apache use it:
>
> In /etc/apache2/httpd.conf
> Include /etc/apache2/pmapper_tmpdir.conf
>
> In /etc/apache2/pmapper_tmpdir.conf
> #Alias /tmp/ /data/dataweb/tmp/
>
> AllowOverride All
> Options All
> Order allow,deny
> Allow from all
>
>
> In /data/dataweb/tmp/
> ln -s /data/disk_on_ram/pmapper_temp/
>
> Finally in the mapfile:
> IMAGEPATH "/data/disk_on_ram/pmapper_temp/"
> IMAGEURL "/tmp/pmapper_temp/"
>
>
>
>> For Raster data, you can use tiles (use gdaltindex) and then create the
>> QIX file.
> Also with raster data, gdaladdo is very usefull as it adds pyramidal / less
> detailed views of the image (downsampling), in the image itself. Mapserver
> knows how to use them depending on the scale of the map.
>
>
>
>
>
>
> On Mon, Feb 18, 2013 at 10:26 AM, Thomas RAFFIN wrote:
>
>> Le 18/02/2013 10:15, Chris forum a écrit :
>>> Hi,
>>>
>>> Yllka> Interesting topic! If possible, don't forget to show us your final
>>> results!
>>>
>>> Thomas> Thanx, very interesting tip! Should try it asap!
>>> (On your example, beware on the UNIQUE typo ; )
>> Oops!
>>
>>
>>> With a Shapefile, using an index file (QIX) speeds up data visualisation
>>> for sure.
>> In this case, don't specify file extension in the "DATA".
>>
>>> Tiling to speed up access to WMS layers, with TileCache or the Mapserver
>>> Mapcache.
>>> Put the generated/temp files from Mapserver on a RAM disk (IMAGEPATH
>>> parameter of the mapfile).
>> Have you got doc for this point please?
>>
>>
>> For Raster data, you can use tiles (use gdaltindex) and then create the
>> QIX file.
>>
>>
>> Generally, be careful with mapserver on the fly re-projection. It is to
>> avoid if you want to speed up MapServer response.
>>
>>> Chris
>>>
>>>
>>> On Mon, Feb 18, 2013 at 9:43 AM, Thomas RAFFIN wrote:
>>>
Hi,
I've made a hack in pmapper few years ago. This one allows you to
specify 2 data sources for each layer:
LAYER
.
DATA "the_geom FROM your_heavy_view USING UNQIUE gid"
METADATA
PM_RESULT_DATASUBSTITION "the_geom FROM your_geo_table USING
UNQIUE gid"
...
END
...
END
For instance " your_heavy_view" is a view that join a geographical table
("your_geo_table") with many other tables. The attributes "the_geom" and
"gid" have to be the same names and values in both table and view.
The "DATA" value is the habitual one whereas "PM_RESULT_DATASUBSTITION"
is used to draw / select / query graphically / etc... to speed up
>> pmapper.
Be careful : all attributes used for label, classitem, binding, etc..
have to be in the main table.
It has only been tested with postgreSQL/postigs but could works with
other data types.
Thomas
Le 16/02/2013 18:35, yllka baci a écrit :
> Hello Pmapper users
> I'm going to write a paper on techniques that speed up data
>> visualisation
> on Web GIS applications.
> Can any one of you tell me the techniques that he (she) knows?
>
> ps: pmapper.net will be the main reference of this paper :) thank you
very
> much for the support.
--
>> --
The Go Parallel Website, sponsored by Intel - in partnership with
>> Geeknet,
is your hub for all things parallel software development, from weekly
thought
leadership blogs to news, videos, case studies, tutorials, tech docs,
whitepapers, evaluation guides, and opinion stories. Check out the most
recent posts - join the conversation now.
http://goparallel.sourceforge.net/
___
pmapper-users mailing list
pmapper-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pmapper-users
>> --
>>> The Go Parallel Website, sponsored by Intel - in partnership with
>> Geeknet,
>>> is your hub for all things parallel software development, from weekly
>> thought
>>> leadership blogs to news, videos, case studies, tutorials, tech docs,
>>> whitepapers, evaluation guides, and opinion stories. Check out the most
>>> recent posts - join the conversation now.
>> http://goparallel.sourceforge.net/
>>> ___
>>> pmapper-users mailing list
>>> pmapper-users@lists.sourceforge.net
>
Re: [pmapper-users] Hello!
>> Put the generated/temp files from Mapserver on a RAM disk (IMAGEPATH
>> parameter of the mapfile).
> Have you got doc for this point please?
Here under how it is set up on my Debian server, for a 8GB directory on
RAM:
mkdir /data/disk_on_ram/
mount -o size=8G -t tmpfs tmpfs /data/disk_on_ram/
mkdir /data/disk_on_ram/pmapper_temp
chown www-data:users /data/disk_on_ram/pmapper_temp/
Then to let Apache use it:
In /etc/apache2/httpd.conf
Include /etc/apache2/pmapper_tmpdir.conf
In /etc/apache2/pmapper_tmpdir.conf
#Alias /tmp/ /data/dataweb/tmp/
AllowOverride All
Options All
Order allow,deny
Allow from all
In /data/dataweb/tmp/
ln -s /data/disk_on_ram/pmapper_temp/
Finally in the mapfile:
IMAGEPATH "/data/disk_on_ram/pmapper_temp/"
IMAGEURL "/tmp/pmapper_temp/"
> For Raster data, you can use tiles (use gdaltindex) and then create the
> QIX file.
Also with raster data, gdaladdo is very usefull as it adds pyramidal / less
detailed views of the image (downsampling), in the image itself. Mapserver
knows how to use them depending on the scale of the map.
On Mon, Feb 18, 2013 at 10:26 AM, Thomas RAFFIN wrote:
>
> Le 18/02/2013 10:15, Chris forum a écrit :
> > Hi,
> >
> > Yllka> Interesting topic! If possible, don't forget to show us your final
> > results!
> >
> > Thomas> Thanx, very interesting tip! Should try it asap!
> > (On your example, beware on the UNIQUE typo ; )
>
> Oops!
>
>
> >
> > With a Shapefile, using an index file (QIX) speeds up data visualisation
> > for sure.
>
> In this case, don't specify file extension in the "DATA".
>
> > Tiling to speed up access to WMS layers, with TileCache or the Mapserver
> > Mapcache.
> > Put the generated/temp files from Mapserver on a RAM disk (IMAGEPATH
> > parameter of the mapfile).
>
> Have you got doc for this point please?
>
>
> For Raster data, you can use tiles (use gdaltindex) and then create the
> QIX file.
>
>
> Generally, be careful with mapserver on the fly re-projection. It is to
> avoid if you want to speed up MapServer response.
>
> >
> > Chris
> >
> >
> > On Mon, Feb 18, 2013 at 9:43 AM, Thomas RAFFIN wrote:
> >
> >> Hi,
> >>
> >> I've made a hack in pmapper few years ago. This one allows you to
> >> specify 2 data sources for each layer:
> >> LAYER
> >> .
> >> DATA "the_geom FROM your_heavy_view USING UNQIUE gid"
> >> METADATA
> >> PM_RESULT_DATASUBSTITION "the_geom FROM your_geo_table USING
> >> UNQIUE gid"
> >> ...
> >> END
> >> ...
> >> END
> >>
> >> For instance " your_heavy_view" is a view that join a geographical table
> >> ("your_geo_table") with many other tables. The attributes "the_geom" and
> >> "gid" have to be the same names and values in both table and view.
> >>
> >> The "DATA" value is the habitual one whereas "PM_RESULT_DATASUBSTITION"
> >> is used to draw / select / query graphically / etc... to speed up
> pmapper.
> >>
> >> Be careful : all attributes used for label, classitem, binding, etc..
> >> have to be in the main table.
> >>
> >> It has only been tested with postgreSQL/postigs but could works with
> >> other data types.
> >>
> >> Thomas
> >>
> >> Le 16/02/2013 18:35, yllka baci a écrit :
> >>> Hello Pmapper users
> >>> I'm going to write a paper on techniques that speed up data
> visualisation
> >>> on Web GIS applications.
> >>> Can any one of you tell me the techniques that he (she) knows?
> >>>
> >>> ps: pmapper.net will be the main reference of this paper :) thank you
> >> very
> >>> much for the support.
> >> --
> >>
> >>
> >>
> --
> >> The Go Parallel Website, sponsored by Intel - in partnership with
> Geeknet,
> >> is your hub for all things parallel software development, from weekly
> >> thought
> >> leadership blogs to news, videos, case studies, tutorials, tech docs,
> >> whitepapers, evaluation guides, and opinion stories. Check out the most
> >> recent posts - join the conversation now.
> >> http://goparallel.sourceforge.net/
> >> ___
> >> pmapper-users mailing list
> >> pmapper-users@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/pmapper-users
> >>
> >
> --
> > The Go Parallel Website, sponsored by Intel - in partnership with
> Geeknet,
> > is your hub for all things parallel software development, from weekly
> thought
> > leadership blogs to news, videos, case studies, tutorials, tech docs,
> > whitepapers, evaluation guides, and opinion stories. Check out the most
> > recent posts - join the conversation now.
> http://goparallel.sourceforge.net/
> > ___
> > pmapper-users mailing list
> > pmapper-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/pmapper-users
> >
> >
>
> --
>
>
> Thomas RAFFIN
> Chef de Projet Internet
> traf...@
Re: [pmapper-users] Hello!
Le 18/02/2013 10:15, Chris forum a écrit :
> Hi,
>
> Yllka> Interesting topic! If possible, don't forget to show us your final
> results!
>
> Thomas> Thanx, very interesting tip! Should try it asap!
> (On your example, beware on the UNIQUE typo ; )
Oops!
>
> With a Shapefile, using an index file (QIX) speeds up data visualisation
> for sure.
In this case, don't specify file extension in the "DATA".
> Tiling to speed up access to WMS layers, with TileCache or the Mapserver
> Mapcache.
> Put the generated/temp files from Mapserver on a RAM disk (IMAGEPATH
> parameter of the mapfile).
Have you got doc for this point please?
For Raster data, you can use tiles (use gdaltindex) and then create the
QIX file.
Generally, be careful with mapserver on the fly re-projection. It is to
avoid if you want to speed up MapServer response.
>
> Chris
>
>
> On Mon, Feb 18, 2013 at 9:43 AM, Thomas RAFFIN wrote:
>
>> Hi,
>>
>> I've made a hack in pmapper few years ago. This one allows you to
>> specify 2 data sources for each layer:
>> LAYER
>> .
>> DATA "the_geom FROM your_heavy_view USING UNQIUE gid"
>> METADATA
>> PM_RESULT_DATASUBSTITION "the_geom FROM your_geo_table USING
>> UNQIUE gid"
>> ...
>> END
>> ...
>> END
>>
>> For instance " your_heavy_view" is a view that join a geographical table
>> ("your_geo_table") with many other tables. The attributes "the_geom" and
>> "gid" have to be the same names and values in both table and view.
>>
>> The "DATA" value is the habitual one whereas "PM_RESULT_DATASUBSTITION"
>> is used to draw / select / query graphically / etc... to speed up pmapper.
>>
>> Be careful : all attributes used for label, classitem, binding, etc..
>> have to be in the main table.
>>
>> It has only been tested with postgreSQL/postigs but could works with
>> other data types.
>>
>> Thomas
>>
>> Le 16/02/2013 18:35, yllka baci a écrit :
>>> Hello Pmapper users
>>> I'm going to write a paper on techniques that speed up data visualisation
>>> on Web GIS applications.
>>> Can any one of you tell me the techniques that he (she) knows?
>>>
>>> ps: pmapper.net will be the main reference of this paper :) thank you
>> very
>>> much for the support.
>> --
>>
>>
>> --
>> The Go Parallel Website, sponsored by Intel - in partnership with Geeknet,
>> is your hub for all things parallel software development, from weekly
>> thought
>> leadership blogs to news, videos, case studies, tutorials, tech docs,
>> whitepapers, evaluation guides, and opinion stories. Check out the most
>> recent posts - join the conversation now.
>> http://goparallel.sourceforge.net/
>> ___
>> pmapper-users mailing list
>> pmapper-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/pmapper-users
>>
> --
> The Go Parallel Website, sponsored by Intel - in partnership with Geeknet,
> is your hub for all things parallel software development, from weekly thought
> leadership blogs to news, videos, case studies, tutorials, tech docs,
> whitepapers, evaluation guides, and opinion stories. Check out the most
> recent posts - join the conversation now. http://goparallel.sourceforge.net/
> ___
> pmapper-users mailing list
> pmapper-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/pmapper-users
>
>
--
Thomas RAFFIN
Chef de Projet Internet
traf...@sirap.fr Sirap
Tel
: 04 75 72 84 10
Fax : 04 75 70 07 98
Rue Paul Louis Héroult - BP 253
26106 Romans cedex
--
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet,
is your hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials, tech docs,
whitepapers, evaluation guides, and opinion stories. Check out the most
recent posts - join the conversation now. http://goparallel.sourceforge.net/
___
pmapper-users mailing list
pmapper-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pmapper-users
Re: [pmapper-users] Hello!
Hi,
Yllka> Interesting topic! If possible, don't forget to show us your final
results!
Thomas> Thanx, very interesting tip! Should try it asap!
(On your example, beware on the UNIQUE typo ; )
With a Shapefile, using an index file (QIX) speeds up data visualisation
for sure.
Tiling to speed up access to WMS layers, with TileCache or the Mapserver
Mapcache.
Put the generated/temp files from Mapserver on a RAM disk (IMAGEPATH
parameter of the mapfile).
Chris
On Mon, Feb 18, 2013 at 9:43 AM, Thomas RAFFIN wrote:
> Hi,
>
> I've made a hack in pmapper few years ago. This one allows you to
> specify 2 data sources for each layer:
> LAYER
> .
> DATA "the_geom FROM your_heavy_view USING UNQIUE gid"
> METADATA
> PM_RESULT_DATASUBSTITION "the_geom FROM your_geo_table USING
> UNQIUE gid"
> ...
> END
> ...
> END
>
> For instance " your_heavy_view" is a view that join a geographical table
> ("your_geo_table") with many other tables. The attributes "the_geom" and
> "gid" have to be the same names and values in both table and view.
>
> The "DATA" value is the habitual one whereas "PM_RESULT_DATASUBSTITION"
> is used to draw / select / query graphically / etc... to speed up pmapper.
>
> Be careful : all attributes used for label, classitem, binding, etc..
> have to be in the main table.
>
> It has only been tested with postgreSQL/postigs but could works with
> other data types.
>
> Thomas
>
> Le 16/02/2013 18:35, yllka baci a écrit :
> > Hello Pmapper users
> > I'm going to write a paper on techniques that speed up data visualisation
> > on Web GIS applications.
> > Can any one of you tell me the techniques that he (she) knows?
> >
> > ps: pmapper.net will be the main reference of this paper :) thank you
> very
> > much for the support.
>
> --
>
>
> --
> The Go Parallel Website, sponsored by Intel - in partnership with Geeknet,
> is your hub for all things parallel software development, from weekly
> thought
> leadership blogs to news, videos, case studies, tutorials, tech docs,
> whitepapers, evaluation guides, and opinion stories. Check out the most
> recent posts - join the conversation now.
> http://goparallel.sourceforge.net/
> ___
> pmapper-users mailing list
> pmapper-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/pmapper-users
>
--
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet,
is your hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials, tech docs,
whitepapers, evaluation guides, and opinion stories. Check out the most
recent posts - join the conversation now. http://goparallel.sourceforge.net/
___
pmapper-users mailing list
pmapper-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pmapper-users
Re: [pmapper-users] Hello!
Hi,
I've made a hack in pmapper few years ago. This one allows you to
specify 2 data sources for each layer:
LAYER
.
DATA "the_geom FROM your_heavy_view USING UNQIUE gid"
METADATA
PM_RESULT_DATASUBSTITION "the_geom FROM your_geo_table USING
UNQIUE gid"
...
END
...
END
For instance " your_heavy_view" is a view that join a geographical table
("your_geo_table") with many other tables. The attributes "the_geom" and
"gid" have to be the same names and values in both table and view.
The "DATA" value is the habitual one whereas "PM_RESULT_DATASUBSTITION"
is used to draw / select / query graphically / etc... to speed up pmapper.
Be careful : all attributes used for label, classitem, binding, etc..
have to be in the main table.
It has only been tested with postgreSQL/postigs but could works with
other data types.
Thomas
Le 16/02/2013 18:35, yllka baci a écrit :
> Hello Pmapper users
> I'm going to write a paper on techniques that speed up data visualisation
> on Web GIS applications.
> Can any one of you tell me the techniques that he (she) knows?
>
> ps: pmapper.net will be the main reference of this paper :) thank you very
> much for the support.
--
--
The Go Parallel Website, sponsored by Intel - in partnership with Geeknet,
is your hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials, tech docs,
whitepapers, evaluation guides, and opinion stories. Check out the most
recent posts - join the conversation now. http://goparallel.sourceforge.net/
___
pmapper-users mailing list
pmapper-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pmapper-users
