Hello. This code is in the imagemosaic and jdbc geotools v24 modules. Sorry for the confusion
Dominique Bessette From: Andrea Aime <andrea.a...@geosolutionsgroup.com> Sent: Saturday, January 22, 2022 9:12 AM To: Bessette-Halsema, Dominique E <dominique.besse...@gdit.com> Cc: GeoServer Users <geoserver-users@lists.sourceforge.net> Subject: Re: [Geoserver-users] ImageMosaic JDBC entering in null values for attributes [External: Use caution with links & attachments] Hi Dominique, the imagemosaic jdbc module has been removed from both the GeoTools and GeoServer source code, due to persistent lack of a maintainer. It's also generating no business for core developers (which could have justified other developers picking up the module). Long story short, the module is gone. If you or someone from your organization is interested in stepping up and maintaining the module, it can be restored from the version control. Same could happen if any of the core devs would get business around it. Cheers Andrea On Wed, Jan 19, 2022 at 12:35 AM Bessette-Halsema, Dominique E via Geoserver-users <geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net>> wrote: I also found in the logs that for the file that failed it could not find the property collectors 022-01-18 20:05:33,900 DEBUG [org.geotools.gce.imagemosaic] (default task-83) No properties collector have been found 2022-01-18 20:05:33,900 INFO [org.geotools.gce.imagemosaic] (default task-83) Now indexing file COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif Dominique Bessette Senior Software Engineer T 619.881.2478 From: Bessette-Halsema, Dominique E via Geoserver-users <geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net>> Sent: Tuesday, January 18, 2022 2:15 PM To: geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net> Subject: Re: [Geoserver-users] ImageMosaic JDBC entering in null values for attributes [External: Use caution with links & attachments] Is there a configuration or way to make it so the imagemosaic tables for the granules are “Not Null”? This way at least the bad entry will be thrown out and all other ingested layers can be used. Dominique From: Bessette-Halsema, Dominique E via Geoserver-users <geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net>> Sent: Tuesday, January 18, 2022 12:54 PM To: geoserver-users@lists.sourceforge.net<mailto:geoserver-users@lists.sourceforge.net> Subject: [Geoserver-users] ImageMosaic JDBC entering in null values for attributes [External: Use caution with links & attachments] Hello I’m using ImageMosaic with the JDBC extension. I found that when GeoServer is under heavy load, intermittently the JDBC code will insert null values for the attributes. This causes the WMS getCapabilities to fail with the following Warning WARN [org.geoserver.wms.capabilities] (default task-91) Error writing metadata; skipping layer: AFGHAN-n2-a1.grad_mod_refr.ht_sfc: java.lang.NullPointerException This essentially makes that layer unusable until the database entry is deleted. I extracted the geotools jdbc code where it is setting the values to null. What I’m looking for is some insight into why this is happening or a possible fix. Has this issue been documented? 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting LogicFilter 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting SQL ComparisonFilter 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting PropertyName 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83) exporting PropertyName 2022-01-18 20:05:34,023 DEBUG [org.geotools.jdbc] (default task-83) SELECT count(*) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" WHERE ("location" = ? AND "location" IS NOT NULL ) 2022-01-18 20:05:34,023 DEBUG [org.geotools.jdbc] (default task-83) 1 = COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,024 DEBUG [org.geotools.jdbc] (default task-83) SELECT "fid",ST_AsEWKB("the_geom") as "the_geom","location","validtime","analysis_time","elevation" FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" LIMIT 1 2022-01-18 20:05:34,029 DEBUG [org.geotools.jdbc] (default task-83) SELECT ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" 2022-01-18 20:05:34,029 WARN [org.hibernate.orm.deprecation] (default task-55) HHH90000022: Hibernate's legacy org.hibernate.Criteria API is deprecated; use the JPA javax.persistence.criteria.CriteriaQuery instead 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) SELECT "fid",ST_AsEWKB("the_geom") as "the_geom","location","validtime","analysis_time","elevation" FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" WHERE 0 = 1 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting the_geom to POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025)) 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 0 to POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025)) 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting location to COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 1 to COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting validtime to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 2 to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting analysis_time to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 3 to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting elevation to null 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) Setting 4 to null 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) Inserting new features with ps: INSERT INTO "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" ( "the_geom","location","validtime","analysis_time","elevation" ) VALUES ( ST_GeomFromWKB(?, 4326),?,?,?,?) 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 1 = POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025)) 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 2 = COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 3 = null 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 4 = null 2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 5 = null 2022-01-18 20:05:34,049 DEBUG [org.geotools.gce.imagemosaic] (default task-83) Done with file /gis/geoserver/external/data/dynamic/isisgridcoverage/COAMPS-AFGHAN/AFGHAN-n2-a1/grad_mod_refr/COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc/COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif 2022-01-18 20:05:34,060 DEBUG [org.geotools.jdbc] (default task-83) CLOSE CONNECTION 2022-01-18 20:05:34,060 DEBUG [org.geotools.jdbc] (default task-83) CREATE CONNECTION 2022-01-18 20:05:34,072 DEBUG [org.geotools.jdbc] (default task-83) SELECT ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" 2022-01-18 20:05:34,073 DEBUG [org.geotools.jdbc] (default task-83) CLOSE CONNECTION 2022-01-18 20:05:34,073 INFO [org.geotools.gce.imagemosaic] (default task-83) Creating final properties file 2022-01-18 20:05:34,073 DEBUG [org.geotools.gce.imagemosaic] (default task-83) Done!!! 2022-01-18 20:05:34,078 DEBUG [org.geotools.jdbc] (default task-83) CREATE CONNECTION 2022-01-18 20:05:34,086 DEBUG [org.geotools.jdbc] (default task-83) SELECT ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" 2022-01-18 20:05:34,090 DEBUG [org.geotools.jdbc] (default task-83) CLOSE CONNECTION 2022-01-18 20:05:34,091 INFO [org.geoserver.filters] (default task-83) 10.0.2.15 "POST /geoserver/rest/workspaces/COAMPS-AFGHAN/coveragestores/AFGHAN-n2-a1.grad_mod_refr.ht_sfc/external.imagemosaic%3Frecalculate=nativebbox,latlonbbox" took 546ms 2022-01-18 20:05:34,091 TRACE [mil.navy.fnmoc.gis.commons.geoserver.rest.GeoServerRESTInvoker] (DefaultMessageListenerContainer-3) 3073 * Client in-bound response 3073 < 202 3073 < X-Frame-Options: SAMEORIGIN 3073 < Connection: keep-alive 3073 < Content-Length: 0 3073 < Date: Tue, 18 Jan 2022 20:05:34 GMT 3073 < Dominique Bessette _______________________________________________ Geoserver-users mailing list Please make sure you read the following two resources before posting to this list: - Earning your support instead of buying it, but Ian Turton: http://www.ianturton.com/talks/foss4g.html#/<https://urldefense.us/v3/__http:/www.ianturton.com/talks/foss4g.html*/__;Iw!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbzfbeHXqw$> - The GeoServer user list posting guidelines: http://geoserver.org/comm/userlist-guidelines.html<https://urldefense.us/v3/__http:/geoserver.org/comm/userlist-guidelines.html__;!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbzP37XAiQ$> If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer<https://urldefense.us/v3/__https:/github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer__;!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbzqVQVLvQ$> Geoserver-users@lists.sourceforge.net<mailto:Geoserver-users@lists.sourceforge.net> https://lists.sourceforge.net/lists/listinfo/geoserver-users<https://urldefense.us/v3/__https:/lists.sourceforge.net/lists/listinfo/geoserver-users__;!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbzVsT0n_g$> -- Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://bit.ly/gs-services-us<https://urldefense.us/v3/__http:/bit.ly/gs-services-us__;!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbxcKJVeCQ$> for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions Group phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 333 8128928 https://www.geosolutionsgroup.com/<https://urldefense.us/v3/__https:/www.geosolutionsgroup.com/__;!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbwneOF_2Q$> http://twitter.com/geosolutions_it<https://urldefense.us/v3/__http:/twitter.com/geosolutions_it__;!!JRQnnSFuzw7wjAKq6ti6!jCn1tdye1RD8M6PiEcfJ9VthA4QFM8ORikrmBHsNJYkAOYUdNCleKTu6r1xQNbw4P7Y6-Q$> ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail
_______________________________________________ Geoserver-users mailing list Please make sure you read the following two resources before posting to this list: - Earning your support instead of buying it, but Ian Turton: http://www.ianturton.com/talks/foss4g.html#/ - The GeoServer user list posting guidelines: http://geoserver.org/comm/userlist-guidelines.html If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
