I also found in the logs that for the file that failed it could not find the property collectors
022-01-18 20:05:33,900 DEBUG [org.geotools.gce.imagemosaic] (default task-83) No properties collector have been found 2022-01-18 20:05:33,900 INFO [org.geotools.gce.imagemosaic] (default task-83) Now indexing file COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif Dominique Bessette Senior Software Engineer T 619.881.2478 From: Bessette-Halsema, Dominique E via Geoserver-users <geoserver-users@lists.sourceforge.net> Sent: Tuesday, January 18, 2022 2:15 PM To: geoserver-users@lists.sourceforge.net Subject: Re: [Geoserver-users] ImageMosaic JDBC entering in null values for attributes [External: Use caution with links & attachments] Is there a configuration or way to make it so the imagemosaic tables for the granules are "Not Null"? This way at least the bad entry will be thrown out and all other ingested layers can be used. Dominique From: Bessette-Halsema, Dominique E via Geoserver-users <geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net>> Sent: Tuesday, January 18, 2022 12:54 PM To: geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net> Subject: [Geoserver-users] ImageMosaic JDBC entering in null values for attributes [External: Use caution with links & attachments] Hello I'm using ImageMosaic with the JDBC extension. I found that when GeoServer is under heavy load, intermittently the JDBC code will insert null values for the attributes. This causes the WMS getCapabilities to fail with the following Warning WARN [org.geoserver.wms.capabilities] (default task-91) Error writing metadata; skipping layer: AFGHAN-n2-a1.grad_mod_refr.ht_sfc: java.lang.NullPointerException This essentially makes that layer unusable until the database entry is deleted. I extracted the geotools jdbc code where it is setting the values to null. What I'm looking for is some insight into why this is happening or a possible fix. Has this issue been documented? 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting LogicFilter 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting SQL ComparisonFilter 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting PropertyName 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting PropertyName 2022-01-18 20:05:34,023 DEBUG [org.geotools.jdbc] (default task-83) SELECT count(*) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" WHERE ("location" = ? AND "location" IS NOT NULL ) 2022-01-18 20:05:34,023 DEBUG [org.geotools.jdbc] (default task-83) 1 = COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,024 DEBUG [org.geotools.jdbc] (default task-83) SELECT "fid",ST_AsEWKB("the_geom") as "the_geom","location","validtime","analysis_time","elevation" FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" LIMIT 1 2022-01-18 20:05:34,029 DEBUG [org.geotools.jdbc] (default task-83) SELECT ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" 2022-01-18 20:05:34,029 WARN [org.hibernate.orm.deprecation] (default task-55) HHH90000022: Hibernate's legacy org.hibernate.Criteria API is deprecated; use the JPA javax.persistence.criteria.CriteriaQuery instead 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) SELECT "fid",ST_AsEWKB("the_geom") as "the_geom","location","validtime","analysis_time","elevation" FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" WHERE 0 = 1 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting the_geom to POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025)) 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 0 to POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025)) 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting location to COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 1 to COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting validtime to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 2 to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting analysis_time to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 3 to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting elevation to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 4 to null 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) Inserting new features with ps: INSERT INTO "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" ( "the_geom","location","validtime","analysis_time","elevation" ) VALUES ( ST_GeomFromWKB(?, 4326),?,?,?,?) 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 1 = POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025)) 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 2 = COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 3 = null 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 4 = null 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 5 = null 2022-01-18 20:05:34,049 DEBUG [org.geotools.gce.imagemosaic] (default task-83) Done with file /gis/geoserver/external/data/dynamic/isisgridcoverage/COAMPS-AFGHAN/AFGHAN-n2-a1/grad_mod_refr/COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc/COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,060 DEBUG [org.geotools.jdbc] (default task-83) CLOSE CONNECTION 2022-01-18 20:05:34,060 DEBUG [org.geotools.jdbc] (default task-83) CREATE CONNECTION 2022-01-18 20:05:34,072 DEBUG [org.geotools.jdbc] (default task-83) SELECT ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" 2022-01-18 20:05:34,073 DEBUG [org.geotools.jdbc] (default task-83) CLOSE CONNECTION 2022-01-18 20:05:34,073 INFO [org.geotools.gce.imagemosaic] (default task-83) Creating final properties file 2022-01-18 20:05:34,073 DEBUG [org.geotools.gce.imagemosaic] (default task-83) Done!!! 2022-01-18 20:05:34,078 DEBUG [org.geotools.jdbc] (default task-83) CREATE CONNECTION 2022-01-18 20:05:34,086 DEBUG [org.geotools.jdbc] (default task-83) SELECT ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" 2022-01-18 20:05:34,090 DEBUG [org.geotools.jdbc] (default task-83) CLOSE CONNECTION 2022-01-18 20:05:34,091 INFO [org.geoserver.filters] (default task-83) 10.0.2.15 "POST /geoserver/rest/workspaces/COAMPS-AFGHAN/coveragestores/AFGHAN-n2-a1.grad_mod_refr.ht_sfc/external.imagemosaic%3Frecalculate=nativebbox,latlonbbox" took 546ms 2022-01-18 20:05:34,091 TRACE [mil.navy.fnmoc.gis.commons.geoserver.rest.GeoServerRESTInvoker] (DefaultMessageListenerContainer-3) 3073 * Client in-bound response 3073 < 202 3073 < X-Frame-Options: SAMEORIGIN 3073 < Connection: keep-alive 3073 < Content-Length: 0 3073 < Date: Tue, 18 Jan 2022 20:05:34 GMT 3073 < Dominique Bessette
_______________________________________________ Geoserver-users mailing list Please make sure you read the following two resources before posting to this list: - Earning your support instead of buying it, but Ian Turton: http://www.ianturton.com/talks/foss4g.html#/ - The GeoServer user list posting guidelines: http://geoserver.org/comm/userlist-guidelines.html If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
