Re: [Geoserver-users] RV: Questions regarding ImageMosaic

David Alda Fernandez de Lezea Thu, 15 Dec 2016 23:59:20 -0800

Hi Daniele,

Thanks for your response. I don’t have any tiff inside the directory but 
there’s a subdirectory in which I store some other tiff files, and I suspect 
that it reads that directory first and then jumps to its parent because I made 
a test in which I duplicated an ecw file and renamed to “0” so that it’s the 
first file read and it fills the table correctly….

I’ve also set the following in the properties file but I think it doesn’t do
anything..

Recursive=false
Wildcard=*.ecw

I don’t know if they’re properly set though..

If I remove and add the imagemosaic again with this new params it would change
anything?

Thanks.

Regards,
Agur bero bat,

David Alda Fernández de Lezea
Área de Sistemas de Información Geográfica, Planificación Territorial y
Forestal Informazio Geografikoen Sistemak, Lurralde eta Baso Antolaketaren
Arloa.
da...@hazi.eus | www.hazi.eus
T 945 003 240 – M 627 923 170 – F 945 003 290
Hazi | Granja Modelo de Arkaute s/n | 01192 Arkaute – Araba
********************* LEGE OHARRA ******************* AVISOLEGAL
******************* DISCLAIMER *****************************
Mezu hau pertsonala eta isilpekoa da eta baimenik gabeko erabilera debekatua
dago legalki. Jasotzailea ez bazara ezabatu mezua, bidali eta kontserbatu gabe.
Este mensaje es personal y confidencial y su uso no autorizado está prohibido
legalmente. Si usted no es el destinatario, proceda a borrarlo, sin reenviarlo
ni conservarlo.
This message is personal and confidential, unauthorised use is legally
prohibited. If you are not the intended recipient, delete it without resending
or backing it.

De: dany.geoto...@gmail.com [mailto:dany.geoto...@gmail.com] En nombre de
Daniele Romagnoli
Enviado el: jueves, 15 de diciembre de 2016 14:19
Para: David Alda Fernandez de Lezea
CC: GeoServer Users
Asunto: Re: [Geoserver-users] RV: Questions regarding ImageMosaic

Hi David,
it seems to me from the log that you still have both GeoTIFFs and ECWs on the
same ImageMosaic store folder.
So I assume that the first file being found during re-harvest is a GeoTIFF so
that the cached GeoTIFFFormat is unable (as expected) to parse the ECW files.
(also note that the logs report some files being skipped due to a different
coordinate reference system).

I would definitely suggest to have them separated OR specify the Wildcard
parameter on your indexer to filter granules on extension too.
http://docs.geoserver.org/maintain/en/user/data/raster/imagemosaic/configuration.html#indexer-properties

Hope this helps.
Cheers,
Daniele

On Thu, Dec 15, 2016 at 11:59 AM, David Alda Fernandez de Lezea
<da...@hazi.eus> wrote:
Hi Daniele,

I’ve attached the full stack log with the verbose option enabled.

I forgot to mention that I'm using GeoServer 2.8.0.

Thanks in advance.

Agur bero bat,

De: dany.geoto...@gmail.com [mailto:dany.geoto...@gmail.com] En nombre de
Daniele Romagnoli
Enviado el: jueves, 15 de diciembre de 2016 10:35
Para: David Alda Fernandez de Lezea
CC: GeoServer Users
Asunto: Re: [Geoserver-users] RV: Questions regarding ImageMosaic

Hi again David,

On Thu, Dec 15, 2016 at 8:32 AM, David Alda Fernandez de Lezea <da...@hazi.eus>
wrote:
Hi again,

I moved my ECW imagemosaic storage from default shapefile to PostGIS. The first
time, when I create the datastore, the table in DB is created a filled
perfectly with all the data, but when I launch a re-harvest operation,
Which request are you sending to do that?
it empties the table and doesn’t add anything. In fact in the log I see that
all ECW are skipped
(but all files can be viewed individually ).

SENTINEL2.properties

Levels=10.0,10.0
Heterogeneous=false
ElevationAttribute=elevation
TimeAttribute=ingestion
AbsolutePath=false
Name=SENTINEL2
TypeName=SENTINEL2
Caching=false
ExpandToRGB=false
LocationAttribute=location
SuggestedSPI=it.geosolutions.imageio.plugins.ecw.ECWImageReaderSpi
#SuggestedSPI=org.geotools.coverageio.gdal.ecw.ECWFormatReader
CheckAuxiliaryMetadata=false
LevelsNum=1

The log shows the following

2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Now indexing file
S2A_OPER_MSI_L1C_DS_EPA_20150818T110635806Z_IrRG.ecw
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Skipped file
\\Hknas01.iktlan.net\Cartografia$\IMAGENES_SATELITE\PUBLICACION_GEOSERVER\SENTINEL2\S2A_OPER_MSI_L1C_DS_EPA_20150818T110635806Z_IrRG.ecw:
File format is not supported.
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Now indexing file
S2A_OPER_MSI_L1C_DS_EPA_20150818T110635806Z_RGB.ecw
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Skipped file
\\Hknas01.iktlan.net\Cartografia$\IMAGENES_SATELITE\PUBLICACION_GEOSERVER\SENTINEL2\S2A_OPER_MSI_L1C_DS_EPA_20150818T110635806Z_RGB.ecw:
File format is not supported.
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Now indexing file
S2A_OPER_MSI_L1C_DS_EPA_20150821T111616945Z_IrRG.ecw
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Skipped file
\\Hknas01.iktlan.net\Cartografia$\IMAGENES_SATELITE\PUBLICACION_GEOSERVER\SENTINEL2\S2A_OPER_MSI_L1C_DS_EPA_20150821T111616945Z_IrRG.ecw:
File format is not supported.
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Now indexing file
S2A_OPER_MSI_L1C_DS_EPA_20150821T111616945Z_RGB.ecw
2016-12-14 16:02:25,162 INFO [org.geotools.gce.imagemosaic] - Skipped file
\\Hknas01.iktlan.net\Cartografia$\IMAGENES_SATELITE\PUBLICACION_GEOSERVER\SENTINEL2\S2A_OPER_MSI_L1C_DS_EPA_20150821T111616945Z_RGB.ecw:
File format is not supported.
2016-12-14 16:02:25,178 INFO [org.geotools.gce.imagemosaic] - Now indexing file
S2A_OPER_MSI_L1C_DS_EPA_20150828T110656454Z_IrRG.ecw
2016-12-14 16:02:25,178 INFO [org.geotools.gce.imagemosaic] - Skipped file
\\Hknas01.iktlan.net\Cartografia$\IMAGENES_SATELITE\PUBLICACION_GEOSERVER\SENTINEL2\S2A_OPER_MSI_L1C_DS_EPA_20150828T110656454Z_IrRG.ecw:
File format is not supported.
2016-12-14 16:02:25,178 INFO [org.geotools.gce.imagemosaic] - Now indexing file
S2A_OPER_MSI_L1C_DS_EPA_20150828T110656454Z_RGB.ecw

As you can see I’ve also tried with another SPI (the one that is commented) but
it just doesn’t work and throws another error..
Yep, that is expected since the suggestedSPI refers to the low-level imageio
SPI (Image readers) whilst you have specified an high-level GridCoverage SPI
(GridCoverage readers) which will not work.

Any Ideas?
Do you have any chance to raise the logging level to VERBOSE and repeat the
steps, looking for some additional info in the logs?
(So we can see if the GridFormatFinder can't find the ECWFormat or the
ECWFormat can't accept the file or the underlying spi can't decode the file or
whatelse)

Cheers,
Daniele

Thanks in advance.

Agur bero bat,

De: dany.geoto...@gmail.com [mailto:dany.geoto...@gmail.com] En nombre de
Daniele Romagnoli
Enviado el: viernes, 25 de noviembre de 2016 12:46
Para: David Alda Fernandez de Lezea
CC: GeoServer Users
Asunto: Re: [Geoserver-users] RV: Questions regarding ImageMosaic

Hi David,

On Fri, Nov 25, 2016 at 8:06 AM, David Alda Fernandez de Lezea <da...@hazi.eus>
wrote:
Hi Daniele,
Thanks for your response. I’ve been out of the office..
I’ll answer you below as well:
| Are you sure that your ImageMosaic is really serving both of them?
Looking at this:
https://github.com/geotools/geotools/blob/master/modules/plugin/imagemosaic/src/main/java/org/geotools/gce/imagemosaic/ImageMosaicWalker.java#L164
Once the coverage Format has been cached for the first prototype file,
additional files are checked against it. If the format doesn't accept them,
they are skipped. You may want to check your catalog index to see if it
contains all of them.
No they’re not, that’s the problem, once I created the data store I wanted to
add more files (ECW and TIFF) to the ImageMosaic so I re-harvest it but the
TIFF files are not added.

Ah ok. Now it makes sense. From your first email I was thinking that you had
the Mosaic successfully configured with both of them.
(I have a directory in which I have ecw and tiff files (all of them are
sentinel images with the same name structure), I have the datasore created and
working fine)
One thing I’ve noticed is that in the workspace.properties file I’ve got the
following line
SuggestedSPI=it.geosolutions.imageio.plugins.ecw.ECWImageReaderSpi
What makes me think that there’s no way in which I’d get the tiff files
harvested for this ImageMosaic. I guess I’ll have to create another
ImageMosaic for tiff files.

Right. This is what I was referring to in the previous email: files not being
supported by the reference Coverage Format are skipped.
https://github.com/geotools/geotools/blob/master/modules/plugin/imagemosaic/src/main/java/org/geotools/gce/imagemosaic/ImageMosaicWalker.java#L164
Hope this helps.
Cheers,
Daniele
As for the time filter values and QGIS I’ll continue making different tests
with different configurations. Let’s see if anyone can point me to the right
direction.
Thanks.
Regards,
Agur bero bat,

Any comments on this? Any ideas?

Thanks in advance.

Agur bero bat,

David Alda Fernández de Lezea
Área de Sistemas de Información Geográfica, Planificación Territorial y
Forestal Informazio Geografikoen Sistemak, Lurralde eta Baso Antolaketaren
Arloa.
da...@hazi.eus | www.hazi.eus
T 945 003 240 - M 627 923 170 - F 945 003 290
Hazi | Granja Modelo de Arkaute s/n | 01192 Arkaute - Araba
********************* LEGE OHARRA ******************* AVISOLEGAL
******************* DISCLAIMER *****************************
Mezu hau pertsonala eta isilpekoa da eta baimenik gabeko erabilera debekatua
dago legalki. Jasotzailea ez bazara ezabatu mezua, bidali eta kontserbatu gabe.
Este mensaje es personal y confidencial y su uso no autorizado está prohibido
legalmente. Si usted no es el destinatario, proceda a borrarlo, sin reenviarlo
ni conservarlo.
This message is personal and confidential, unauthorised use is legally
prohibited. If you are not the intended recipient, delete it without resending
or backing it.

-----Mensaje original-----
De: David Alda Fernandez de Lezea [mailto:da...@hazi.eus]
Enviado el: jueves, 17 de noviembre de 2016 12:19
Para: GeoServer Users
Asunto: [Geoserver-users] Questions regarding ImageMosaic

Hi list,

I finally managed to get my imagemosaic data store & layer working but now I'm
facing two problems..

Problem 1.
Situation: I have a directory in which I have ecw and tiff files (all of them
are sentinel images with the same name structure), I have the datasore created
and working fine.
Are you sure that your ImageMosaic is really serving both of them?
Looking at this:
https://github.com/geotools/geotools/blob/master/modules/plugin/imagemosaic/src/main/java/org/geotools/gce/imagemosaic/ImageMosaicWalker.java#L164
Once the coverage Format has been cached for the first prototype file,
additional files are checked against it. If the format doesn't accept them,
they are skipped. You may want to check your catalog index to see if it
contains all of them.
The thing is that when I re-harvest the datastore content it only adds the new
ecw files but not the tiff files.

Is it possible to have two different type of files inside the same directory
and the same ImageMosaic working for both of them?

Problem2.
Situation: I have an imagemosaic layer configured with the time-dimension
enabled and with the following configuration:
Presentation: List
Default Value: Smallest Domain Value
When I load the layer into QGIS and using the TimeManager, I set all the fields
properly but when it comes to start the animation, it's behavior is a bit
strange. It loads the first image but when it has to change t another date in
which there's no data it doesn't maintain the previous image, it shows a
blank/white image until it finds another coincidence. It isn't supposed to keep
the smallest value until it finds another one bigger?

My Dimension values are:
Taken from getcapabilities
<Dimension name="time" default="2015-08-18T00:00:00Z" units="ISO8601">
2015-08-18T00:00:00.000Z,2015-08-21T00:00:00.000Z,2015-08-28T00:00:00.000Z,2015-12-06T00:00:00.000Z,2015-12-09T00:00:00.000Z,2015-12-26T00:00:00.000Z,2016-03-15T00:00:00.000Z,2016-05-04T00:00:00.000Z,2016-07-03T00:00:00.000Z,2016-07-13T00:00:00.000Z,2016-09-01T00:00:00.000Z,2016-09-04T00:00:00.000Z,2016-09-11T00:00:00.000Z,2016-09-14T00:00:00.000Z,2016-09-21T00:00:00.000Z,2016-10-01T00:00:00.000Z,2016-10-04T00:00:00.000Z,2016-10-21T00:00:00.000Z,2016-10-31T00:00:00.000Z
</Dimension>
As far as I remember from the WMS specification, the WMS won't interpolate
between time values if it doesn't report supporting that specific nearest-value
functionality, as far as I know, is not the currently supported. So it simply
returns a background value (the white image you see) instead of an invalid
dimension exception.
(while writing this reply, I have found the reference: [1])
In QGIS I set the initial date to 2015-08-18 and end date 2016-08-18.

I don't know if I've got it properly configured .. Any ideas What could be
wrong?
I'm not familiar with QGIS time-based animation. Wondering if it has any way to
parse the available times from the capabilities and scan from these values.
Let's see if anyone can chime in on this topic.
Cheers,
Daniele
[1]: Annex C.4.3 from OGC® 06-042 OpenGIS® Web Map Server Implementation
Specification

Thanks in advance.

Regards,

Agur bero bat,

David Alda Fernández de Lezea
Área de Sistemas de Información Geográfica, Planificación Territorial y
Forestal Informazio Geografikoen Sistemak, Lurralde eta Baso Antolaketaren
Arloa.
da...@hazi.eus | www.hazi.eus
T 945 003 240 - M 627 923 170 - F 945 003 290 Hazi | Granja Modelo de Arkaute
s/n | 01192 Arkaute - Araba
********************* LEGE OHARRA ******************* AVISOLEGAL
******************* DISCLAIMER ***************************** Mezu hau
pertsonala eta isilpekoa da eta baimenik gabeko erabilera debekatua dago
legalki. Jasotzailea ez bazara ezabatu mezua, bidali eta kontserbatu gabe.
Este mensaje es personal y confidencial y su uso no autorizado está prohibido
legalmente. Si usted no es el destinatario, proceda a borrarlo, sin reenviarlo
ni conservarlo.
This message is personal and confidential, unauthorised use is legally
prohibited. If you are not the intended recipient, delete it without resending
or backing it.

------------------------------------------------------------------------------
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

--
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i
file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo
è consentito esclusivamente al destinatario del messaggio, per le finalità
indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne
il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di
procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro
sistema. Conservare il messaggio stesso, divulgarlo anche in parte,
distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse,
costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.
The information in this message and/or attachments, is intended solely for the
attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act (Legislative
Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in
accord with its purpose, any disclosure, reproduction, copying, distribution,
or either dissemination, either whole or partial, is strictly forbidden except
previous formal approval of the named addressee(s). If you are not the intended
recipient, please contact immediately the sender by telephone, fax or e-mail
and delete the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content, accuracy
or completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of e-mail
transmission, viruses, etc.

--
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

--
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

--
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] RV: Questions regarding ImageMosaic

Reply via email to