[mapserver-users] mapcache error -1 on seeding transfer

[Travis Kirstine]

When running mapcache in transfer mode I will sometimes get a failed transfer 
like this:

Retry 1 in riak_has_tile for tile gmaps-20-293584-667321 from cache riak due to 
error -1

What is error -1?
Is it possible to restart the transfer from the last failed tile?

The logging (-L) of the failed transfer doesn't appear to work for this type of 
failure



Travis Kirstine
Project Supervisor
140 Renfrew Drive, Suite 100
Markham, Ontario L3R 6B3 Canada
[cid:image003.png@01D202D8.298354F0]
T: 905.477.3600 Ext 267 | C: 647

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [mapserver-users] mapcache, datasources examples

[thomas bonfort]

there is not documentation yet, feel free to submit some...

this should get you started:


  /path/to/gdal/file


On 30 August 2016 at 14:34, Jukka Sirviö  wrote:
>
> http://mapserver.org/mapcache/sources.html
>
> It would be nice to have some examples for example on GDAL (wmts) datasource 
> on above page? currently only WMS datasource is included.
>
> Would it?
>
>
>
>
>
> 
>
> Tämä sähköpostiviesti (liitteineen) saattaa sisältää luottamuksellista 
> tietoa, joka on tarkoitettu
> vain vastaanottajalleen. Jos et ole oikea vastaanottaja, ilmoita viestin 
> lähettäjälle tapahtuneesta
> virheestä ja tuhoa viesti välittömästi. Viestin luvaton julkaiseminen, 
> kopioiminen, jakelu tai muu
> käyttö tai toimenpiteisiin ryhtyminen sen perusteella on ehdottomasti 
> kielletty.
>
> This message (including any attachments) may contain confidential information 
> intended for
> the person or entity to which it is addressed. If you are not the intended 
> recipient, notify the
> sender and delete this message immediately. Notice that disclosing, copying, 
> distributing or any
> other use of the message and its information, or taking any action based on 
> it, is strictly prohibited.
>
> 
> ___
> mapserver-users mailing list
> mapserver-users@lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users

[mapserver-users] mapcache, datasources examples

[Jukka Sirviö]

http://mapserver.org/mapcache/sources.html

It would be nice to have some examples for example on GDAL (wmts) datasource on 
above page? currently only WMS datasource is included.

Would it?







Tämä sähköpostiviesti (liitteineen) saattaa sisältää luottamuksellista tietoa, 
joka on tarkoitettu
vain vastaanottajalleen. Jos et ole oikea vastaanottaja, ilmoita viestin 
lähettäjälle tapahtuneesta
virheestä ja tuhoa viesti välittömästi. Viestin luvaton julkaiseminen, 
kopioiminen, jakelu tai muu
käyttö tai toimenpiteisiin ryhtyminen sen perusteella on ehdottomasti kielletty.

This message (including any attachments) may contain confidential information 
intended for
the person or entity to which it is addressed. If you are not the intended 
recipient, notify the
sender and delete this message immediately. Notice that disclosing, copying, 
distributing or any
other use of the message and its information, or taking any action based on it, 
is strictly prohibited.


___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [mapserver-users] mapcache question

[Jukka Sirviö]

I was not able to solve the problems on fresh CentOS 7 environment with all the 
latest libraries/dependencies included. on old test environment, I did 
upgrade/build to gdal 2.1.1 and also latest mapcache master. this environment 
is working as one would expect according given instructions in 
http://mapserver.org/mapcache/install.html.  

so basically now I'm back on the already achieved square 1, with that 
difference, that the versions of mapcache and gdal are upgraded. ==> now I'm 
able to proceed with Thomas suggestion with GDAL data source and GDAL WMTS 
driver. 

From this point of view, this post is completed, thus, more questions will come!

Thanks for patience..


-Alkuperäinen viesti-
Lähettäjä: thomas bonfort [mailto:thomas.bonf...@gmail.com] 
Lähetetty: 30. elokuuta 2016 13:19
Vastaanottaja: Jukka Sirviö
Kopio: mapserver-users@lists.osgeo.org
Aihe: Re: [mapserver-users] mapcache question

The demo file in master parses correctly. Again, if you're having an issue it 
is either because you have made invalid (in the xml sense) modifications to it, 
or that your apache user doesn't have access rights to it (or to the 
directories above it).

--
thomas

On 30 August 2016 at 12:11, Jukka Sirviö  wrote:
>
> file and directory rights should be ok, mapcache.xml is the demo file 
> included in master.
> of-course, have tried this with quite a lot of ways without success, starting 
> to feel numb.
>
>
> -Alkuperäinen viesti-
> Lähettäjä: mapserver-users 
> [mailto:mapserver-users-boun...@lists.osgeo.org] Puolesta Guillaume 
> Sueur
> Lähetetty: 29. elokuuta 2016 16:51
> Vastaanottaja: mapserver-users@lists.osgeo.org
> Aihe: Re: [mapserver-users] mapcache question
>
> Hi,
>
> Actually it just says there is an error in your mapcache.xml file (or maybe 
> apache can't even access/read it). Check the files rights, check the file 
> itself, and you should find what the problem is.
>
> Best regards
>
> Guillaume
>
> Le 28/08/2016 à 19:45, Jukka Sirviö a écrit :
>>
>> Hi,
>> Thank you all for good answers and suggestions, Thomas proposal, is more or 
>> less, ideal solution for me.
>>
>> Mapcache master is compiled according instructions at 
>> http://mapserver.org/mapcache/install.html successfully on CentOS 7 (and 
>> MapServer master & GDAL etc), but httpd fail's to start if following line 
>> "MapCacheAlias /mapcache "/bla/blabla/mapcache.xml" is included in 
>> httpd.conf. error message is:
>>
>> AH00526: Syntax error on line 335 of /etc/httpd/conf/httpd.conf:
>> failed to parse file /home/mapcacheconf/mapcache.xml. Is it valid XML?
>>
>> Need some hint's how to proceed? Thank's in advance!
>>
>>
>> -Jukka
>>
>>
>>
>>
>> -Alkuperäinen viesti-
>> Lähettäjä: thomas bonfort [mailto:thomas.bonf...@gmail.com]
>> Lähetetty: 25. elokuuta 2016 15:56
>> Vastaanottaja: Travis Kirstine
>> Kopio: Lime, Steve D (MNIT); Jukka Sirviö; 
>> mapserver-users@lists.osgeo.org
>> Aihe: Re: [mapserver-users] mapcache question
>>
>> The reprojection is done inside MapCache, i.e. as a client of the 
>> original tiles. You don't need an additional WMS :)
>>
>> --
>> thomas
>>
>> On 25 August 2016 at 14:50, Travis Kirstine 
>>  wrote:
>>> I believe that there still would be an issue as the reprojection from X to 
>>> Y, the reprojection would need to be done on the source WMTS side.  I guess 
>>> you could proxy the source WMTS using mapserver with the gdal mini driver  
>>> and reproject to create a WMS to feed mapcache?
>>>
>>> -Original Message-
>>> From: thomas bonfort [mailto:thomas.bonf...@gmail.com]
>>> Sent: August-25-16 3:55 AM
>>> To: Lime, Steve D (MNIT) 
>>> Cc: Travis Kirstine ; Jukka Sirviö 
>>> ; mapserver-users@lists.osgeo.org
>>> Subject: Re: [mapserver-users] mapcache question
>>>
>>> Jukka,
>>> in master, there is also support for any GDAL dataset as a mapcache source 
>>> (i.e. in addition to wms). If you use that in addition to a GDAL 
>>> TMS/WMS/WMTS minidriver you'll be able to reproject/store third party tiles 
>>> on the fly.
>>>
>>> --
>>> thomas
>>>
>>> On 24 August 2016 at 21:58, Lime, Steve D (MNIT)  
>>> wrote:
 I would think reprojection of individual tiles into another set of tiles 
 that would stitch back together without artifacts would be difficult. I 
 thought MapCache did support native MapServer mode=map as a source which 
 could useful if GDAL supports WMTS and you could create a corresponding 
 MapServer layer.

 -Original Message-
 From: mapserver-users
 [mailto:mapserver-users-boun...@lists.osgeo.org]
 On Behalf Of Travis Kirstine
 Sent: Wednesday, August 24, 2016 1:14 PM
 To: Jukka Sirviö ; 
 mapserver-users@lists.osgeo.org
 Subject: Re: [mapserver-users] mapcache question

 Jukka,

 According to the docs mapcache only support WMS as input.

 " A source is a service mod-mapcache can query to obtain image data. This 
 is typically a WMS server accessible by a URL. (Th

Re: [mapserver-users] mapcache question

[thomas bonfort]

The demo file in master parses correctly. Again, if you're having an
issue it is either because you have made invalid (in the xml sense)
modifications to it, or that your apache user doesn't have access
rights to it (or to the directories above it).

--
thomas

On 30 August 2016 at 12:11, Jukka Sirviö  wrote:
>
> file and directory rights should be ok, mapcache.xml is the demo file 
> included in master.
> of-course, have tried this with quite a lot of ways without success, starting 
> to feel numb.
>
>
> -Alkuperäinen viesti-
> Lähettäjä: mapserver-users [mailto:mapserver-users-boun...@lists.osgeo.org] 
> Puolesta Guillaume Sueur
> Lähetetty: 29. elokuuta 2016 16:51
> Vastaanottaja: mapserver-users@lists.osgeo.org
> Aihe: Re: [mapserver-users] mapcache question
>
> Hi,
>
> Actually it just says there is an error in your mapcache.xml file (or maybe 
> apache can't even access/read it). Check the files rights, check the file 
> itself, and you should find what the problem is.
>
> Best regards
>
> Guillaume
>
> Le 28/08/2016 à 19:45, Jukka Sirviö a écrit :
>>
>> Hi,
>> Thank you all for good answers and suggestions, Thomas proposal, is more or 
>> less, ideal solution for me.
>>
>> Mapcache master is compiled according instructions at 
>> http://mapserver.org/mapcache/install.html successfully on CentOS 7 (and 
>> MapServer master & GDAL etc), but httpd fail's to start if following line 
>> "MapCacheAlias /mapcache "/bla/blabla/mapcache.xml" is included in 
>> httpd.conf. error message is:
>>
>> AH00526: Syntax error on line 335 of /etc/httpd/conf/httpd.conf:
>> failed to parse file /home/mapcacheconf/mapcache.xml. Is it valid XML?
>>
>> Need some hint's how to proceed? Thank's in advance!
>>
>>
>> -Jukka
>>
>>
>>
>>
>> -Alkuperäinen viesti-
>> Lähettäjä: thomas bonfort [mailto:thomas.bonf...@gmail.com]
>> Lähetetty: 25. elokuuta 2016 15:56
>> Vastaanottaja: Travis Kirstine
>> Kopio: Lime, Steve D (MNIT); Jukka Sirviö;
>> mapserver-users@lists.osgeo.org
>> Aihe: Re: [mapserver-users] mapcache question
>>
>> The reprojection is done inside MapCache, i.e. as a client of the
>> original tiles. You don't need an additional WMS :)
>>
>> --
>> thomas
>>
>> On 25 August 2016 at 14:50, Travis Kirstine 
>>  wrote:
>>> I believe that there still would be an issue as the reprojection from X to 
>>> Y, the reprojection would need to be done on the source WMTS side.  I guess 
>>> you could proxy the source WMTS using mapserver with the gdal mini driver  
>>> and reproject to create a WMS to feed mapcache?
>>>
>>> -Original Message-
>>> From: thomas bonfort [mailto:thomas.bonf...@gmail.com]
>>> Sent: August-25-16 3:55 AM
>>> To: Lime, Steve D (MNIT) 
>>> Cc: Travis Kirstine ; Jukka Sirviö
>>> ; mapserver-users@lists.osgeo.org
>>> Subject: Re: [mapserver-users] mapcache question
>>>
>>> Jukka,
>>> in master, there is also support for any GDAL dataset as a mapcache source 
>>> (i.e. in addition to wms). If you use that in addition to a GDAL 
>>> TMS/WMS/WMTS minidriver you'll be able to reproject/store third party tiles 
>>> on the fly.
>>>
>>> --
>>> thomas
>>>
>>> On 24 August 2016 at 21:58, Lime, Steve D (MNIT)  
>>> wrote:
 I would think reprojection of individual tiles into another set of tiles 
 that would stitch back together without artifacts would be difficult. I 
 thought MapCache did support native MapServer mode=map as a source which 
 could useful if GDAL supports WMTS and you could create a corresponding 
 MapServer layer.

 -Original Message-
 From: mapserver-users
 [mailto:mapserver-users-boun...@lists.osgeo.org]
 On Behalf Of Travis Kirstine
 Sent: Wednesday, August 24, 2016 1:14 PM
 To: Jukka Sirviö ;
 mapserver-users@lists.osgeo.org
 Subject: Re: [mapserver-users] mapcache question

 Jukka,

 According to the docs mapcache only support WMS as input.

 " A source is a service mod-mapcache can query to obtain image data. This 
 is typically a WMS server accessible by a URL. (There are currently no 
 sources other than WMS implemented, though others may be added later if 
 the need arises)"

 If this is still true then your proposed chain will not work.

 MapProxy will support a tiled source and I know TMS works  (not sure
 about WMTS) and handle the reprojection

 Regards

 -Original Message-
 From: mapserver-users
 [mailto:mapserver-users-boun...@lists.osgeo.org]
 On Behalf Of Jukka Sirviö
 Sent: August-24-16 10:09 AM
 To: mapserver-users@lists.osgeo.org
 Subject: [mapserver-users] mapcache question


 Hello,
 I would like to put a mapcache to be in the middle, in the following chain:

 1) original wmts service in local/national crs x   -->  2) mapcache wmts, 
 reprojection to world-wide crs y (3857) -->  3) user interface (OpenLayers 
 v2, Qgis), also in crs y

 Mapcache was co

Re: [mapserver-users] mapcache question

[Jukka Sirviö]

file and directory rights should be ok, mapcache.xml is the demo file included 
in master. 
of-course, have tried this with quite a lot of ways without success, starting 
to feel numb.


-Alkuperäinen viesti-
Lähettäjä: mapserver-users [mailto:mapserver-users-boun...@lists.osgeo.org] 
Puolesta Guillaume Sueur
Lähetetty: 29. elokuuta 2016 16:51
Vastaanottaja: mapserver-users@lists.osgeo.org
Aihe: Re: [mapserver-users] mapcache question

Hi,

Actually it just says there is an error in your mapcache.xml file (or maybe 
apache can't even access/read it). Check the files rights, check the file 
itself, and you should find what the problem is.

Best regards

Guillaume

Le 28/08/2016 à 19:45, Jukka Sirviö a écrit :
> 
> Hi,
> Thank you all for good answers and suggestions, Thomas proposal, is more or 
> less, ideal solution for me.
> 
> Mapcache master is compiled according instructions at 
> http://mapserver.org/mapcache/install.html successfully on CentOS 7 (and 
> MapServer master & GDAL etc), but httpd fail's to start if following line 
> "MapCacheAlias /mapcache "/bla/blabla/mapcache.xml" is included in 
> httpd.conf. error message is:
> 
> AH00526: Syntax error on line 335 of /etc/httpd/conf/httpd.conf:
> failed to parse file /home/mapcacheconf/mapcache.xml. Is it valid XML?
> 
> Need some hint's how to proceed? Thank's in advance!
> 
> 
> -Jukka
> 
> 
> 
> 
> -Alkuperäinen viesti-
> Lähettäjä: thomas bonfort [mailto:thomas.bonf...@gmail.com]
> Lähetetty: 25. elokuuta 2016 15:56
> Vastaanottaja: Travis Kirstine
> Kopio: Lime, Steve D (MNIT); Jukka Sirviö; 
> mapserver-users@lists.osgeo.org
> Aihe: Re: [mapserver-users] mapcache question
> 
> The reprojection is done inside MapCache, i.e. as a client of the 
> original tiles. You don't need an additional WMS :)
> 
> --
> thomas
> 
> On 25 August 2016 at 14:50, Travis Kirstine 
>  wrote:
>> I believe that there still would be an issue as the reprojection from X to 
>> Y, the reprojection would need to be done on the source WMTS side.  I guess 
>> you could proxy the source WMTS using mapserver with the gdal mini driver  
>> and reproject to create a WMS to feed mapcache?
>>
>> -Original Message-
>> From: thomas bonfort [mailto:thomas.bonf...@gmail.com]
>> Sent: August-25-16 3:55 AM
>> To: Lime, Steve D (MNIT) 
>> Cc: Travis Kirstine ; Jukka Sirviö 
>> ; mapserver-users@lists.osgeo.org
>> Subject: Re: [mapserver-users] mapcache question
>>
>> Jukka,
>> in master, there is also support for any GDAL dataset as a mapcache source 
>> (i.e. in addition to wms). If you use that in addition to a GDAL 
>> TMS/WMS/WMTS minidriver you'll be able to reproject/store third party tiles 
>> on the fly.
>>
>> --
>> thomas
>>
>> On 24 August 2016 at 21:58, Lime, Steve D (MNIT)  
>> wrote:
>>> I would think reprojection of individual tiles into another set of tiles 
>>> that would stitch back together without artifacts would be difficult. I 
>>> thought MapCache did support native MapServer mode=map as a source which 
>>> could useful if GDAL supports WMTS and you could create a corresponding 
>>> MapServer layer.
>>>
>>> -Original Message-
>>> From: mapserver-users
>>> [mailto:mapserver-users-boun...@lists.osgeo.org]
>>> On Behalf Of Travis Kirstine
>>> Sent: Wednesday, August 24, 2016 1:14 PM
>>> To: Jukka Sirviö ; 
>>> mapserver-users@lists.osgeo.org
>>> Subject: Re: [mapserver-users] mapcache question
>>>
>>> Jukka,
>>>
>>> According to the docs mapcache only support WMS as input.
>>>
>>> " A source is a service mod-mapcache can query to obtain image data. This 
>>> is typically a WMS server accessible by a URL. (There are currently no 
>>> sources other than WMS implemented, though others may be added later if the 
>>> need arises)"
>>>
>>> If this is still true then your proposed chain will not work.
>>>
>>> MapProxy will support a tiled source and I know TMS works  (not sure 
>>> about WMTS) and handle the reprojection
>>>
>>> Regards
>>>
>>> -Original Message-
>>> From: mapserver-users
>>> [mailto:mapserver-users-boun...@lists.osgeo.org]
>>> On Behalf Of Jukka Sirviö
>>> Sent: August-24-16 10:09 AM
>>> To: mapserver-users@lists.osgeo.org
>>> Subject: [mapserver-users] mapcache question
>>>
>>>
>>> Hello,
>>> I would like to put a mapcache to be in the middle, in the following chain:
>>>
>>> 1) original wmts service in local/national crs x   -->  2) mapcache wmts, 
>>> reprojection to world-wide crs y (3857) -->  3) user interface (OpenLayers 
>>> v2, Qgis), also in crs y
>>>
>>> Mapcache was compiled, and is working a-ok with demo data. But I have 
>>> trouble to configure mapcache to work as a part in the above chain. As 
>>> planned, Mapcache should work as a WMTS client down towards target 1 and 
>>> WMTS server up against target 3, ie. kind of a proxy with crs reprojection 
>>> and basic auth. Anyway, does this make any sense at all, or is the draft 
>>> totally irrational?
>>>
>>> If the draft is reasonable, could you give s