Hi Dominique,
the imagemosaic jdbc module has been removed from both the GeoTools and
GeoServer
source code, due to persistent lack of a maintainer. It's also generating
no business for core
developers (which could have justified other developers picking up the
module).
Long story short, the module is gone.
If you or someone from your organization is interested in stepping up and
maintaining the module,
it can be restored from the version control. Same could happen if any of
the core devs would get
business around it.
Cheers
Andrea
On Wed, Jan 19, 2022 at 12:35 AM Bessette-Halsema, Dominique E via
Geoserver-users <geoserver-users@lists.sourceforge.net> wrote:
> I also found in the logs that for the file that failed it could not find
> the property collectors
>
>
>
> 022-01-18 20:05:33,900 DEBUG [org.geotools.gce.imagemosaic] (default
> task-83) No properties collector have been found
>
> 2022-01-18 20:05:33,900 INFO [org.geotools.gce.imagemosaic] (default
> task-83) Now indexing file
> COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif
>
>
>
> Dominique Bessette
>
> Senior Software Engineer
> T 619.881.2478
>
>
>
> *From:* Bessette-Halsema, Dominique E via Geoserver-users <
> geoserver-users@lists.sourceforge.net>
> *Sent:* Tuesday, January 18, 2022 2:15 PM
> *To:* geoserver-users@lists.sourceforge.net
> *Subject:* Re: [Geoserver-users] ImageMosaic JDBC entering in null values
> for attributes
>
>
>
>
>
> *[External: Use caution with links & attachments]*
>
>
>
> Is there a configuration or way to make it so the imagemosaic tables for
> the granules are “Not Null”? This way at least the bad entry will be
> thrown out and all other ingested layers can be used.
>
>
>
> Dominique
>
>
>
> *From:* Bessette-Halsema, Dominique E via Geoserver-users <
> geoserver-users@lists.sourceforge.net>
> *Sent:* Tuesday, January 18, 2022 12:54 PM
> *To:* geoserver-users@lists.sourceforge.net
> *Subject:* [Geoserver-users] ImageMosaic JDBC entering in null values for
> attributes
>
>
>
>
>
> *[External: Use caution with links & attachments]*
>
>
>
> Hello
>
>
>
> I’m using ImageMosaic with the JDBC extension. I found that when
> GeoServer is under heavy load, intermittently the JDBC code will insert
> null values for the attributes. This causes the WMS getCapabilities to
> fail with the following Warning
>
>
>
> WARN [org.geoserver.wms.capabilities] (default task-91) Error writing
> metadata; skipping layer: AFGHAN-n2-a1.grad_mod_refr.ht_sfc:
> java.lang.NullPointerException
>
>
>
> This essentially makes that layer unusable until the database entry is
> deleted. I extracted the geotools jdbc code where it is setting the values
> to null. What I’m looking for is some insight into why this is happening
> or a possible fix. Has this issue been documented?
>
>
>
> 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83)
> exporting LogicFilter
>
> 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83)
> exporting SQL ComparisonFilter
>
> 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83)
> exporting PropertyName
>
> 2022-01-18 20:05:34,023 DEBUG [org.geotools.data.jdbc] (default task-83)
> exporting PropertyName
>
> 2022-01-18 20:05:34,023 DEBUG [org.geotools.jdbc] (default task-83) SELECT
> count(*) FROM
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc"
> WHERE ("location" = ? AND "location" IS NOT NULL )
>
> 2022-01-18 20:05:34,023 DEBUG [org.geotools.jdbc] (default task-83) 1 =
> COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif
>
> 2022-01-18 20:05:34,024 DEBUG [org.geotools.jdbc] (default task-83) SELECT
> "fid",ST_AsEWKB("the_geom") as
> "the_geom","location","validtime","analysis_time","elevation" FROM
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc"
> LIMIT 1
>
> 2022-01-18 20:05:34,029 DEBUG [org.geotools.jdbc] (default task-83) SELECT
> ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc"
>
> 2022-01-18 20:05:34,029 WARN [org.hibernate.orm.deprecation] (default
> task-55) HHH90000022: Hibernate's legacy org.hibernate.Criteria API is
> deprecated; use the JPA javax.persistence.criteria.CriteriaQuery instead
>
> 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83) SELECT
> "fid",ST_AsEWKB("the_geom") as
> "the_geom","location","validtime","analysis_time","elevation" FROM
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc"
> WHERE 0 = 1
>
> 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting the_geom to POLYGON ((47.474999999999994 19.025, 47.474999999999994
> 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025))
>
> 2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting 0 to POLYGON ((47.474999999999994 19.025, 47.474999999999994
> 40.775, 78.525 40.775, 78.525 19.025, 47.474999999999994 19.025))
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting location to
> COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting 1 to
> COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting validtime to null*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting 2 to null*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting analysis_time to null*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting 3 to null*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting elevation to null*
>
> *2022-01-18 20:05:34,030 DEBUG [org.geotools.jdbc] (default task-83)
> Setting 4 to null*
>
> *2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83)
> Inserting new features with ps: INSERT INTO
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc" (
> "the_geom","location","validtime","analysis_time","elevation" ) VALUES (
> ST_GeomFromWKB(?, 4326),?,?,?,?)*
>
> *2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 1 =
> POLYGON ((47.474999999999994 19.025, 47.474999999999994 40.775, 78.525
> 40.775, 78.525 19.025, 47.474999999999994 19.025))*
>
> *2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 2 =
> COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif*
>
> *2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 3 =
> null*
>
> *2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 4 =
> null*
>
> *2022-01-18 20:05:34,031 DEBUG [org.geotools.jdbc] (default task-83) 5 =
> null*
>
> 2022-01-18 20:05:34,049 DEBUG [org.geotools.gce.imagemosaic] (default
> task-83) Done with file
> /gis/geoserver/external/data/dynamic/isisgridcoverage/COAMPS-AFGHAN/AFGHAN-n2-a1/grad_mod_refr/COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc/COAMPS-AFGHAN-W18000000S09000000E18000000N09000000-FNMOC_GRID_2022011800_0000007315.00000_202201180000.tif
>
> 2022-01-18 20:05:34,060 DEBUG [org.geotools.jdbc] (default task-83) CLOSE
> CONNECTION
>
> 2022-01-18 20:05:34,060 DEBUG [org.geotools.jdbc] (default task-83) CREATE
> CONNECTION
>
> 2022-01-18 20:05:34,072 DEBUG [org.geotools.jdbc] (default task-83) SELECT
> ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc"
>
> 2022-01-18 20:05:34,073 DEBUG [org.geotools.jdbc] (default task-83) CLOSE
> CONNECTION
>
> 2022-01-18 20:05:34,073 INFO [org.geotools.gce.imagemosaic] (default
> task-83) Creating final properties file
>
> 2022-01-18 20:05:34,073 DEBUG [org.geotools.gce.imagemosaic] (default
> task-83) Done!!!
>
> 2022-01-18 20:05:34,078 DEBUG [org.geotools.jdbc] (default task-83) CREATE
> CONNECTION
>
> 2022-01-18 20:05:34,086 DEBUG [org.geotools.jdbc] (default task-83) SELECT
> ST_AsText(ST_Force2D(ST_Envelope(ST_Extent("the_geom"::geometry)))) FROM
> "forecast_grid_mosaic"."COAMPS-AFGHAN^AFGHAN-n2-a1^grad_mod_refr^ht_sfc"
>
> 2022-01-18 20:05:34,090 DEBUG [org.geotools.jdbc] (default task-83) CLOSE
> CONNECTION
>
> 2022-01-18 20:05:34,091 INFO [org.geoserver.filters] (default task-83)
> 10.0.2.15 "POST
> /geoserver/rest/workspaces/COAMPS-AFGHAN/coveragestores/AFGHAN-n2-a1.grad_mod_refr.ht_sfc/external.imagemosaic%3Frecalculate=nativebbox,latlonbbox"
> took 546ms
>
> 2022-01-18 20:05:34,091 TRACE
> [mil.navy.fnmoc.gis.commons.geoserver.rest.GeoServerRESTInvoker]
> (DefaultMessageListenerContainer-3) 3073 * Client in-bound response
>
> 3073 < 202
>
> 3073 < X-Frame-Options: SAMEORIGIN
>
> 3073 < Connection: keep-alive
>
> 3073 < Content-Length: 0
>
> 3073 < Date: Tue, 18 Jan 2022 20:05:34 GMT
>
> 3073 <
>
>
>
>
>
>
>
> Dominique Bessette
> _______________________________________________
> Geoserver-users mailing list
>
> Please make sure you read the following two resources before posting to
> this list:
> - Earning your support instead of buying it, but Ian Turton:
> http://www.ianturton.com/talks/foss4g.html#/
> - The GeoServer user list posting guidelines:
> http://geoserver.org/comm/userlist-guidelines.html
>
> If you want to request a feature or an improvement, also see this:
> https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
>
>
> Geoserver-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>
--
Regards,
Andrea Aime
==
GeoServer Professional Services from the experts!
Visit http://bit.ly/gs-services-us for more information.
==
Ing. Andrea Aime
@geowolf
Technical Lead
GeoSolutions Group
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928
https://www.geosolutionsgroup.com/
http://twitter.com/geosolutions_it
-------------------------------------------------------
Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE
2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
precisa che ogni circostanza inerente alla presente email (il suo
contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
This email is intended only for the person or entity to which it is
addressed and may contain information that is privileged, confidential or
otherwise protected from disclosure. We remind that - as provided by
European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
e-mail or the information herein by anyone other than the intended
recipient is prohibited. If you have received this email by mistake, please
notify us immediately by telephone or e-mail
_______________________________________________
Geoserver-users mailing list
Please make sure you read the following two resources before posting to this
list:
- Earning your support instead of buying it, but Ian Turton:
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines:
http://geoserver.org/comm/userlist-guidelines.html
If you want to request a feature or an improvement, also see this:
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
