This is my cache setup

  <cache name="cache_sqlite" type="sqlite3">
<dbfile>/var/www/path..../maps/cache/{tileset}/{grid}/{z}/{x}-{y}.sqlite3</dbfile>
<xcount>10000</xcount>
<ycount>10000</ycount>
<pragma name="max_page_count">1573741823</pragma>
  </cache>

  <grid name="bcgrid">
               <metadata>
                              <title>this is a custom grid I made up for an 
example</title>
               </metadata>
               <srs>EPSG:27700</srs>
               <size>128 128</size>
               <extent>0 0 700000 1250000</extent>
<resolutions>70 28 14 7 6.16 2.8 1.4 0.7 0.28 0.14 0.07</resolutions>
</grid>

  <tileset name="bccache">
    <source>bcmaps</source>
    <cache>cache_sqlite</cache>
    <grid>bcgrid</grid>
    <format>JPEG</format>
    <metatile>4 4</metatile>
    <metabuffer>0</metabuffer>
    <expires>31536000</expires>
  </tileset>


Sebastiano Laini
Web Developer
Buchanan Computing
227 Shepherds Bush Road London W6 7AS
020 8846 3220

Web: http://www.BuchananComputing.co.uk<http://www.buchanancomputing.co.uk/>
For general or urgent enquiries please write to: 
supp...@buchanancomputing.co.uk<mailto:supp...@buchanancomputing.co.uk>

Buchanan Computing Ltd. Registered at the above office, no. 3274424 (England & 
Wales)

This message is intended solely for the individual/entity to whom it is 
addressed.  It may contain confidential or legally privileged information.  Any 
unauthorised disclosure or copying is prohibited and my be unlawful.  If you 
have received this communication in error, please notify the sender immediately 
and delete it from your system.

From: Sebastiano Laini
Sent: 17 October 2018 13:39
To: 'mapserver-users@lists.osgeo.org' <mapserver-users@lists.osgeo.org>
Cc: 'Rahkonen Jukka (MML)' <jukka.rahko...@maanmittauslaitos.fi>
Subject: RE: mapcache fastcgi

Hi,

It appears in both ways, when I'm seeding and when is requested from a 
pre-seeded cache, today I can't because I need to move the dev domain in 
another server but tomorrow I will pass you the link to the 2 cache so you can 
see the difference.

Tonight I will let it seed the whole area.

The cache is on a normal HDD, I think all out servers are 10000 RPM, and the 
test was done on a brand new server so the disk is new.

Sebastiano Laini
Web Developer
Buchanan Computing
From: Rahkonen Jukka (MML) [mailto:jukka.rahko...@maanmittauslaitos.fi]
Sent: 17 October 2018 13:35
To: Sebastiano Laini 
<sebastiano.la...@buchanancomputing.co.uk<mailto:sebastiano.la...@buchanancomputing.co.uk>>;
 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Subject: RE: mapcache fastcgi

Hi,

In which way does the slowness appear? Is it when seeding or when serving from 
a pre-seeded cache? Can you give metrics about the difference in speed?

In this comparison the differences were rather small 
http://blog.sogeo.services/blog/2016/07/01/mapcache-disk-vs-sqlite.html

Also by the documentation the speed should be only "a bit slower"

The SQLite based caches are a bit slower than the disk based caches, and may 
have write-locking issues at seed time if a high number of threads all try to 
insert new tiles concurrently.

You wrote that SQLite cache is very slow for you which makes me think that 
there is something sub-optimal in your installation. First thing to check is if 
the SQLite database is on a fast disk.
If SQLite cache is slow then MBTiles cache should be slow as well but I would 
make a test to be sure.

-Jukka Rahkonen-


Lähettäjä: Sebastiano Laini [mailto:sebastiano.la...@buchanancomputing.co.uk]
Lähetetty: 17. lokakuuta 2018 15:00
Vastaanottaja: 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Kopio: Rahkonen Jukka (MML) 
<jukka.rahko...@maanmittauslaitos.fi<mailto:jukka.rahko...@maanmittauslaitos.fi>>
Aihe: RE: mapcache fastcgi

Is there a way to improve the speed and match the speed of the sqLite3 cache 
with the disk one?

We have 80 websites connected to MapCache and when I tried the sqLite3 I was 
testing it just on one website and on a complete different server with nothing 
in it.

Sebastiano Laini
Web Developer
Buchanan Computing
From: Sebastiano Laini
Sent: 17 October 2018 12:43
To: 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Cc: 'Rahkonen Jukka (MML)' 
<jukka.rahko...@maanmittauslaitos.fi<mailto:jukka.rahko...@maanmittauslaitos.fi>>
Subject: RE: mapcache fastcgi

Still it redirect you to that link, and btw it seems that mapcache can be used 
also as a fastCGI.

https://mapserver.org/mapcache/install.html#cgi-fastcgi-specific-instructions

Though is true that I'm reading now in the CMaker Builder section

MapCache can run as a FastCGI executable. Note that the overhead of FastCGI is 
non-negligible with respect to the throughput you may obtain with a native 
Apache module. The FastCGI build is less tested, and may lag behind the Apache 
module version on some minor details. YMMV.

Sebastiano Laini
Web Developer
Buchanan Computing

From: Rahkonen Jukka (MML) [mailto:jukka.rahko...@maanmittauslaitos.fi]
Sent: 17 October 2018 12:39
To: Sebastiano Laini 
<sebastiano.la...@buchanancomputing.co.uk<mailto:sebastiano.la...@buchanancomputing.co.uk>>;
 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Subject: VS: mapcache fastcgi

Hi,

That documentation is about Mapserver, Mapcache is another software. It does 
belong to the same Mapserver but is not the same.

MapCache is documented here:
https://mapserver.org/mapcache/index.html#mapcache

-Jukka Rahkonen-

Lähettäjä: Sebastiano Laini [mailto:sebastiano.la...@buchanancomputing.co.uk]
Lähetetty: 17. lokakuuta 2018 14:33
Vastaanottaja: 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Kopio: Rahkonen Jukka (MML) 
<jukka.rahko...@maanmittauslaitos.fi<mailto:jukka.rahko...@maanmittauslaitos.fi>>
Aihe: RE: mapcache fastcgi


Well, for what I can read in the documentation of mapserver:

https://mapserver.org/optimization/fastcgi.html

FastCGI is a protocol for keeping cgi-bin style web applications running as a 
daemon to take advantage of preserving memory caches, and amortizing other high 
startup costs (like heavy database connections) over many requests.

It seems that using mapcache as fastCGI over apache modules it that should 
improve speed also.

Sebastiano Laini
Web Developer
Buchanan Computing

From: Rahkonen Jukka (MML) [mailto:jukka.rahko...@maanmittauslaitos.fi]
Sent: 17 October 2018 12:30
To: Sebastiano Laini 
<sebastiano.la...@buchanancomputing.co.uk<mailto:sebastiano.la...@buchanancomputing.co.uk>>;
 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Subject: Re: mapcache fastcgi

Hi,

Could you explain your plan with some more details? What I have understood is 
that you have experienced that SQLite cache is slower than disk cache in your 
environment.

What I do not understand is what you are going to reach by running Mapcache as 
fastcgi instead of running it as Apache module which should be the faster 
option, and if this has some connection with the SQLite cache vs. disk cache 
comparison. Do you guess that fastcgi woud make SQLite cache faster?

-Jukka Rahkonen-


Lähettäjä: mapserver-users [mailto:mapserver-users-boun...@lists.osgeo.org] 
Puolesta Sebastiano Laini
Lähetetty: 17. lokakuuta 2018 12:16
Vastaanottaja: 'mapserver-users@lists.osgeo.org' 
<mapserver-users@lists.osgeo.org<mailto:mapserver-users@lists.osgeo.org>>
Aihe: [mapserver-users] mapcache fastcgi

Hi all,

In the end I tried MapCache with sqlite3 cache but it's very slow compared with 
the disk cache, so I want to setup MapCache with fastCGI on CentOS 7.

I don't understand what I need to install as the fastCGI link in the 
documentation is broken and I don't know if is up to date.

I already have apache fgcid installed from default in the httpd folder and I 
use PHP in fastCGI in all the domains, so I'm sure that fastCGI it works, 
though, I still need the fastCGI library? How can I install it in CentOS 7?

In my apache conf I've already added the lines to load the mapcache module and 
the mapcache.xml file

LoadModule mapcache_module    modules/mod_mapcache.so

<IfModule mapcache_module>
   <Directory /path/to/directory>
      Require all granted
   </Directory>
   MapCacheAlias /mapcache "/path/to/directory/mapcache.xml"
</IfModule>


I need to leave the previous configuration and add these new lines in the conf 
files?

FcgidInitialEnv "MAPCACHE_CONFIG_FILE" "/path/to/mapcache/mapcache.xml

<IfModule mod_fcgid.c>
   IPCCommTimeout 120
   MaxProcessCount 10
   FcgidInitialEnv "MAPCACHE_CONFIG_FILE" "/path/to/mapcache/mapcache.xml"
   <Location /map.fcgi>
      Order Allow,Deny
      Allow from all
      SetHandler fcgid-script
   </Location>
  ScriptAlias /map.fcgi "/path/to/mapcache/src/mapcache"
</IfModule>


And then instead of http://myserver/mapcache I need to use 
http://myserver/fcgi-bin to access mapcache fcgi?

Regards,

Sebastiano Laini
Web Developer
Buchanan Computing
_______________________________________________
mapserver-users mailing list
mapserver-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

Reply via email to