Hi,
I do have an odd Problem that I can't resolve on my own.
I have 7TB of orthophotos of several years which we combine to one imagemosaic
dataset (with the newest available picture on top via "location D"). We have
already done this successful for 2015 (with some dataset dating back up to
2011), now trying this for 2021 (back to 2017).
I modified the GeoTiff we got with the Python Bindings of GDAL, calculating
Overviews, added the correct (and current) Projection and guessing and writing
in nodata-values. All the Data is written into the tif file, not correspondent
by .tfw. The Files look good from my somewhat unexperienced perspective (using
gdalinfo which sais its only read from the tif-file).
Some of our original data didn't held any location information, but we could
manage to reconstruct those missing information from file name.
Now we shovel this collection of folders into the ImageMosaic and wait for the
creation of the index. This takes up to 10 hours. While doing this I write a
verbose log, so in case of breaking I see where the dataset has to be fixed. So
I realize - and this is also recognizable in the final index - that in some
files (actually whole datafolders) the projection isn't recognized and instead
of EPSG:25832 I get EPSG:404000. Please take a look into the log excerpts below
and the output of gdalinfo.
I find a difference between the 2021 service and the 2015 service in their
*.properties: The 2015 has chosen to use the geotiff format, the 2021 the
WorldImageFormat (see below). I double checked all my tif files in the folders
and they all hold the correct projections and hold the correct coordinates
within its file, so they must be GeoTiff, don't they? Only the Geotools seem to
choose to not use that.
But if I create the properties-Documents myself (and not let the
imagemosaic-plugin create it), then I get an error from geoserver (I can manage
to recreate but save the time not doing this for now... please ask if you want
to know).
Any Ideas how to fix this?
Thank you for your time!
Kind regards, Janne Fleischer
2021:
...
SuggestedFormat=org.geotools.gce.image.WorldImageFormat
Name=dop2021
SuggestedSPI=it.geosolutions.imageioimpl.plugins.tiff.TIFFImageReaderSpi
...
2015:
...
SuggestedFormat=org.geotools.gce.geotiff.GeoTiffFormat
Name=dop2015
SuggestedSPI=it.geosolutions.imageioimpl.plugins.tiff.TIFFImageReaderSpi
...
GDALINFO-Output:
user@user-dop:~$ gdalinfo /dop2021/th/2020/dop20rgb_32_695_5655_1.tif
Driver: GTiff/GeoTIFF
Files: /dop2021/th/2020/dop20rgb_32_695_5655_1.tif
Size is 5000, 5000
Coordinate System is:
PROJCRS["ETRS89 / UTM zone 32N",
BASEGEOGCRS["ETRS89",
DATUM["European Terrestrial Reference System 1989",
ELLIPSOID["GRS 1980",6378137,298.257222101,
LENGTHUNIT["metre",1]]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
ID["EPSG",4258]],
CONVERSION["UTM zone 32N",
METHOD["Transverse Mercator",
ID["EPSG",9807]],
PARAMETER["Latitude of natural origin",0,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8801]],
PARAMETER["Longitude of natural origin",9,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8802]],
PARAMETER["Scale factor at natural origin",0.9996,
SCALEUNIT["unity",1],
ID["EPSG",8805]],
PARAMETER["False easting",500000,
LENGTHUNIT["metre",1],
ID["EPSG",8806]],
PARAMETER["False northing",0,
LENGTHUNIT["metre",1],
ID["EPSG",8807]]],
CS[Cartesian,2],
AXIS["(E)",east,
ORDER[1],
LENGTHUNIT["metre",1]],
AXIS["(N)",north,
ORDER[2],
LENGTHUNIT["metre",1]],
USAGE[
SCOPE["unknown"],
AREA["Europe - 6°E to 12°E and ETRS89 by country"],
BBOX[38.76,6,83.92,12]],
ID["EPSG",25832]]
Data axis to CRS axis mapping: 1,2
Origin = (695000.000000000000000,5656000.000000000000000)
Pixel Size = (0.200000000000000,-0.200000000000000)
Metadata:
AREA_OR_POINT=Area
Image Structure Metadata:
COMPRESSION=YCbCr JPEG
INTERLEAVE=PIXEL
SOURCE_COLOR_SPACE=YCbCr
Corner Coordinates:
Upper Left ( 695000.000, 5656000.000) ( 11d46'49.98"E, 51d 1'20.79"N)
Lower Left ( 695000.000, 5655000.000) ( 11d46'48.04"E, 51d 0'48.45"N)
Upper Right ( 696000.000, 5656000.000) ( 11d47'41.25"E, 51d 1'19.56"N)
Lower Right ( 696000.000, 5655000.000) ( 11d47'39.30"E, 51d 0'47.23"N)
Center ( 695500.000, 5655500.000) ( 11d47'14.64"E, 51d 1' 4.01"N)
Band 1 Block=256x256 Type=Byte, ColorInterp=Red
Overviews: 2500x2500, 1250x1250, 625x625, 313x313, 157x157, 79x79
Band 2 Block=256x256 Type=Byte, ColorInterp=Green
Overviews: 2500x2500, 1250x1250, 625x625, 313x313, 157x157, 79x79
Band 3 Block=256x256 Type=Byte, ColorInterp=Blue
Overviews: 2500x2500, 1250x1250, 625x625, 313x313, 157x157, 79x79
VERBOSE-LOG Geoserver:
2022-04-19 18:16:39,790 INFO [gce.imagemosaic] - Now indexing file
dop20rgb_32_695_5655_1.tif
2022-04-19 18:16:39,790 DEBUG [gce.imagemosaic] - Thread Name
http-nio-8080-exec-7
class org.geotools.gce.imagemosaic.ImageMosaicEventHandlers
Now indexing file dop20rgb_32_695_5655_1.tif
2022-04-19 18:16:39,790 DEBUG [gce.image] - Unable to find crs, continuing with
default CRS
2022-04-19 18:16:39,819 WARN [gce.image] - Could not find a world transform
file for dop20rgb_32_695_5655_1, assuming the identity transform
2022-04-19 18:16:39,819 DEBUG [data.util] - CRSConverterFactory can be applied
from Strings to CRS only.
2022-04-19 18:16:39,819 DEBUG [data.util] - InterpolationConverterFactory can
be applied from Strings to Interpolation only.
2022-04-19 18:16:39,819 DEBUG [data.jdbc] - exporting LogicFilter
2022-04-19 18:16:39,819 DEBUG [data.jdbc] - exporting SQL ComparisonFilter
2022-04-19 18:16:39,819 DEBUG [data.jdbc] - exporting PropertyName
2022-04-19 18:16:39,819 DEBUG [data.jdbc] - exporting PropertyName
2022-04-19 18:16:39,819 DEBUG [geotools.jdbc] - SELECT count(*) FROM
"public"."dop2021" WHERE ("location" = ? AND "location" IS NOT NULL )
2022-04-19 18:16:39,819 DEBUG [geotools.jdbc] - 1 =
th/2020/dop20rgb_32_695_5655_1.tif
2022-04-19 18:16:39,850 DEBUG [geotools.jdbc] - SELECT
"fid",ST_AsEWKB("the_geom") as "the_geom","location","crs","resolution" FROM
"public"."dop2021" LIMIT 1
2022-04-19 18:16:39,850 DEBUG [geotools.jdbc] - SELECT
ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM
"public"."dop2021"
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - SELECT
"fid",ST_AsEWKB("the_geom") as "the_geom","location","crs","resolution" FROM
"public"."dop2021" WHERE 0 = 1
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting the_geom to POLYGON
((-0.5 -0.5, 4999.5 -0.5, 4999.5 4999.5, -0.5 4999.5, -0.5 -0.5))
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting 0 to POLYGON ((-0.5
-0.5, 4999.5 -0.5, 4999.5 4999.5, -0.5 4999.5, -0.5 -0.5))
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting location to
th/2020/dop20rgb_32_695_5655_1.tif
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting 1 to
th/2020/dop20rgb_32_695_5655_1.tif
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting crs to EPSG:404000
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting 2 to EPSG:404000
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting resolution to 1.0
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Setting 3 to 1.0
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - Inserting new features with ps:
INSERT INTO "public"."dop2021" ( "the_geom","location","crs","resolution" )
VALUES ( ST_GeomFromWKB(?, 3857),?,?,?)
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - 1 = POLYGON ((-0.5 -0.5, 4999.5
-0.5, 4999.5 4999.5, -0.5 4999.5, -0.5 -0.5))
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - 2 =
th/2020/dop20rgb_32_695_5655_1.tif
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - 3 = EPSG:404000
2022-04-19 18:16:39,919 DEBUG [geotools.jdbc] - 4 = 1.0
2022-04-19 18:16:39,920 DEBUG [gce.imagemosaic] - Done with file
/var/local/geoserver/dop2021/th/2020/dop20rgb_32_695_5655_1.tif
Build Information
GeoServer Version
2.20.1
Git Revision
6a644b86e10fedce78fadfe824a7efd93dc883ce
Build Date
18-Nov-2021 15:18
GeoTools Version
26.1 (rev 96fbeb558ff4e7e5cb0444b61788173c8400a7cf)
GeoWebCache Version
1.20.0 (rev 1.20.x/d7c7f26f15eca11d49f4d1fca579f123fde69741)
__
Janne Jakob Fleischer
GuM Geoinformation und Monitoring
Wissenschaftlich-Technischer Mitarbeiter
ILS
Institut für Landes- und Stadtentwicklungsforschung gGmbH
Research Institute for Regional and Urban Development gGmbH
Tel.: +49 (0)231 9051-145
E-Mail:
[email protected]<mailto:[email protected]>
Brüderweg 22-24, 44135 Dortmund
Postfach / P.O.Box 101764, 44017 Dortmund, GERMANY
Website: http://www.ils-forschung.de<http://www.ils-forschung.de/>
Twitter:
@ils_forschung<https://twitter.com/ILS_forschung?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor>
(dt. Account) / @ils_research<https://twitter.com/ils_research> (engl. Account)
Facebook: @ilsforschung<https://www.facebook.com/ilsforschung>
Sitz: Dortmund
Geschäftsführung: Prof. Dr. Stefan Siedentop, Michael Paul
Amtsgericht Dortmund HRB 20966
_____________________________________________________________
VERTRAULICHKEITSHINWEIS
Der Inhalt dieser Email ist vertraulich und für den Nutzer der Email-Adresse
bestimmt, an den die Nachricht geschickt wurde; sie kann darüber hinaus durch
besondere Bestimmungen geschützt sein. Wenn Sie nicht der Adressat dieser Email
sind, dürfen Sie diese nicht kopieren, weiterleiten, weitergeben oder sie ganz
oder teilweise in irgendeiner Weise nutzen. Wenn Sie diese Email
fälschlicherweise erhalten haben, benachrichtigen Sie bitte den Absender, indem
Sie auf diese Nachricht antworten.
_____________________________________________________________
CONFIDENTIALITY NOTICE
The information contained in this email message may be confidential. If you are
not the intended recipient, any use, interference with, disclosure or copying
of this material is unauthorised and prohibited. If you have received this
message in error, please notify us by return and delete the message and any
attachments.
_______________________________________________
Geoserver-users mailing list
Please make sure you read the following two resources before posting to this
list:
- Earning your support instead of buying it, but Ian Turton:
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines:
http://geoserver.org/comm/userlist-guidelines.html
If you want to request a feature or an improvement, also see this:
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
[email protected]
https://lists.sourceforge.net/lists/listinfo/geoserver-users
