Re: [Geoserver-devel] [Geotools-devel] GeoServer/GeoTools PMC Meeting at 17:30 UTC tomorrow

2020-12-22 Thread Roar Brænden 
Hi,

For this meeting I would very much like a discussion on my development of a 
factory for HTTPClient's.
https://github.com/geotools/geotools/pull/3256 


I haven't heard anyone complaining about introducing such a factory. The 
discussion has more been on my approach to create a new project gt-http. After 
taking a look at the JUnit cases surrounding http clients, I think that it 
makes sense to bring in a new, easy to find library. But I'm open for any 
decision.

Another point has been the usage of commons-httpclient. This is an old, 
unmaintained library that today are used by gt-wms and gt-wfs in their own 
MultithreadedHttpClients. I was looking a bit on this, but I see no advantage 
of using it, so I reverted all my changes. There are some bugs related to these 
two clients, so it would make sense to introduce a new unsupported plugin 
gt-http-commons with the MultithreadedHttpClient from gt-wms. I'm open for 
doing this, but maybe in a new PR when this is done.

What I do want to work on is the new HttpClient in JDK 11. My initial plan has 
been to introduce a new plugin gt-http-ng, but that will be introduced in a new 
Jira / PR.

The timing of this meeting isn't very practical for me, so I'm afraid I can't 
attain, but I'm open for any input whether it's at the maillist, JIRA or Github.

Regards,

Roar Brænden

> 21. des. 2020 kl. 18:44 skrev Torben Barsballe :
> 
> Reminder that the next PMC meeting is scheduled for tomorrow, December 22, at 
> 17:30  
> UTC.
> 
> You can join the meeting via Jitsi: https://meet.jit.si/GeoServerMeeting 
> 
> 
> Cheers,
> --
> Torben Barsballe
> Professional Services Engineer
> Planet
> torben.barsba...@planet.com <>___
> GeoTools-Devel mailing list
> geotools-de...@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geotools-devel

___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

[Geoserver-devel] [JIRA] (GEOS-9840) Update Jackson 2 libraries from 2.10.1 to 2.10.5 / 2.10.5.1

2020-12-22 Thread Mark Prins (JIRA) 
Mark Prins ( 
https://osgeo-org.atlassian.net/secure/ViewProfile.jspa?accountId=5d68e9f964bfb10c11a29d83
 ) *created* an issue

GeoServer ( 
https://osgeo-org.atlassian.net/browse/GEOS?atlOrigin=eyJpIjoiZTZhMjVjNjhlOGE1NDAxNzk3ODVjYmU4YmYxY2I0YjUiLCJwIjoiaiJ9
 ) / Task ( 
https://osgeo-org.atlassian.net/browse/GEOS-9840?atlOrigin=eyJpIjoiZTZhMjVjNjhlOGE1NDAxNzk3ODVjYmU4YmYxY2I0YjUiLCJwIjoiaiJ9
 ) GEOS-9840 ( 
https://osgeo-org.atlassian.net/browse/GEOS-9840?atlOrigin=eyJpIjoiZTZhMjVjNjhlOGE1NDAxNzk3ODVjYmU4YmYxY2I0YjUiLCJwIjoiaiJ9
 ) Update Jackson 2 libraries from 2.10.1 to 2.10.5 / 2.10.5.1 ( 
https://osgeo-org.atlassian.net/browse/GEOS-9840?atlOrigin=eyJpIjoiZTZhMjVjNjhlOGE1NDAxNzk3ODVjYmU4YmYxY2I0YjUiLCJwIjoiaiJ9
 )

Issue Type: Task Affects Versions: 2.18.1, 2.19-RC, 2.17.4 Assignee: Mark Prins 
( 
https://osgeo-org.atlassian.net/secure/ViewProfile.jspa?accountId=5d68e9f964bfb10c11a29d83
 ) Created: 22/Dec/20 10:04 AM Priority: Medium Reporter: Mark Prins ( 
https://osgeo-org.atlassian.net/secure/ViewProfile.jspa?accountId=5d68e9f964bfb10c11a29d83
 )

n the Jackson project the following CVE-2020-25649 was fixed, as well as 
various other bugfixes.

( 
https://osgeo-org.atlassian.net/browse/GEOS-9840#add-comment?atlOrigin=eyJpIjoiZTZhMjVjNjhlOGE1NDAxNzk3ODVjYmU4YmYxY2I0YjUiLCJwIjoiaiJ9
 ) Add Comment ( 
https://osgeo-org.atlassian.net/browse/GEOS-9840#add-comment?atlOrigin=eyJpIjoiZTZhMjVjNjhlOGE1NDAxNzk3ODVjYmU4YmYxY2I0YjUiLCJwIjoiaiJ9
 )

Get Jira notifications on your phone! Download the Jira Cloud app for Android ( 
https://play.google.com/store/apps/details?id=com.atlassian.android.jira.core&referrer=utm_source%3DNotificationLink%26utm_medium%3DEmail
 ) or iOS ( 
https://itunes.apple.com/app/apple-store/id1006972087?pt=696495&ct=EmailNotificationLink&mt=8
 ) This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100153- 
sha1:55cb54c )___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: [Geoserver-devel] [Geotools-devel] GeoServer/GeoTools PMC Meeting at 17:30 UTC tomorrow

2020-12-22 Thread Andrea Aime 
On Tue, Dec 22, 2020 at 9:05 AM Roar Brænden 
wrote:

>
> Another point has been the usage of commons-httpclient. This is an old,
> unmaintained library that today are used by gt-wms and gt-wfs in their own
> MultithreadedHttpClients. I was looking a bit on this, but I see no
> advantage of using it, so I reverted all my changes.
>

No advantage compared to the Java 8 client? Performs better as far as I
know. I always have it on in GeoServer deploys, leaving the Java 8 client
for
cases where


> There are some bugs related to these two clients, so it would make sense
> to introduce a new unsupported plugin gt-http-commons with the
> MultithreadedHttpClient from gt-wms. I'm open for doing this, but maybe in
> a new PR when this is done.
>

Having a module for it would make sense indeed.


> What I do want to work on is the new HttpClient in JDK 11. My initial plan
> has been to introduce a new plugin gt-http-ng, but that will be introduced
> in a new Jira / PR.
>

For this to work, we need to discuss switching to JDK 11 as the minimum
supported version (release packages are built with Java 8, Java 11 is in
the builds
to make sure projects work with it, though we have issues with modularity
as no one of core devs is really using it).
Normally the discussion open when the next LTS is released, which will be
Java 17 in September 2021... historically, we do a code sprint a few months
later to
add support for the new LTS and drop the old one (so the switch would be
from Java 8 and Java 11, to Java 11 and Java 17).
At the same time, Java 8 is supported until 2026, and Java 11 only up to
2024*, which is not ideal, a switch would actually reduce the time the
servers deploying
those versions can stay up without an overhaul.

Cheers
Andrea

*: https://adoptopenjdk.net/support.html


== GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf
Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa
(LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549
http://www.geo-solutions.it http://twitter.com/geosolutions_it
--- *Con riferimento
alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 -
Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni
circostanza inerente alla presente email (il suo contenuto, gli eventuali
allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i
destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per
errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le
sarei comunque grato se potesse darmene notizia. This email is intended
only for the person or entity to which it is addressed and may contain
information that is privileged, confidential or otherwise protected from
disclosure. We remind that - as provided by European Regulation 2016/679
“GDPR” - copying, dissemination or use of this e-mail or the information
herein by anyone other than the intended recipient is prohibited. If you
have received this email by mistake, please notify us immediately by
telephone or e-mail.*
___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: [Geoserver-devel] [Geotools-devel] GeoServer/GeoTools PMC Meeting at 17:30 UTC tomorrow

2020-12-22 Thread Roar Brænden 


> 22. des. 2020 kl. 11:23 skrev Andrea Aime :
> 
> On Tue, Dec 22, 2020 at 9:05 AM Roar Brænden  > wrote:
> 
> Another point has been the usage of commons-httpclient. This is an old, 
> unmaintained library that today are used by gt-wms and gt-wfs in their own 
> MultithreadedHttpClients. I was looking a bit on this, but I see no advantage 
> of using it, so I reverted all my changes.
> 
> No advantage compared to the Java 8 client? Performs better as far as I know. 
> I always have it on in GeoServer deploys, leaving the Java 8 client for
> cases where

My assumption was based on a little test case. If you have experienced 
something else, I wan't argue with that.

>  
> There are some bugs related to these two clients, so it would make sense to 
> introduce a new unsupported plugin gt-http-commons with the 
> MultithreadedHttpClient from gt-wms. I'm open for doing this, but maybe in a 
> new PR when this is done.
> 
> Having a module for it would make sense indeed.

I will incorporate it in the PR. Which is having trouble with the Github checks.

>  
> What I do want to work on is the new HttpClient in JDK 11. My initial plan 
> has been to introduce a new plugin gt-http-ng, but that will be introduced in 
> a new Jira / PR.
> 
> For this to work, we need to discuss switching to JDK 11 as the minimum 
> supported version (release packages are built with Java 8, Java 11 is in the 
> builds
> to make sure projects work with it, though we have issues with modularity as 
> no one of core devs is really using it).
> Normally the discussion open when the next LTS is released, which will be 
> Java 17 in September 2021... historically, we do a code sprint a few months 
> later to
> add support for the new LTS and drop the old one (so the switch would be from 
> Java 8 and Java 11, to Java 11 and Java 17).
> At the same time, Java 8 is supported until 2026, and Java 11 only up to 
> 2024*, which is not ideal, a switch would actually reduce the time the 
> servers deploying
> those versions can stay up without an overhaul.


Would it make sense to make a plugin with a HTTPClient based on Apache 
HttpComponents then?

Regards,

Roar Brænden



___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

[Geoserver-devel] [JIRA] (GEOS-9841) [Community] [WPS JDBC] Create User documentation

2020-12-22 Thread Alessio Fabiani (JIRA) 
Alessio Fabiani ( 
https://osgeo-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A0027cfac-890c-48e1-8af0-974f12f7b9dc
 ) *created* an issue

GeoServer ( 
https://osgeo-org.atlassian.net/browse/GEOS?atlOrigin=eyJpIjoiNDU1Y2FjNGZlY2UwNGRkM2JmYmVjZjc0YWJhMjk5ZDciLCJwIjoiaiJ9
 ) / Improvement ( 
https://osgeo-org.atlassian.net/browse/GEOS-9841?atlOrigin=eyJpIjoiNDU1Y2FjNGZlY2UwNGRkM2JmYmVjZjc0YWJhMjk5ZDciLCJwIjoiaiJ9
 ) GEOS-9841 ( 
https://osgeo-org.atlassian.net/browse/GEOS-9841?atlOrigin=eyJpIjoiNDU1Y2FjNGZlY2UwNGRkM2JmYmVjZjc0YWJhMjk5ZDciLCJwIjoiaiJ9
 ) [Community] [WPS JDBC] Create User documentation ( 
https://osgeo-org.atlassian.net/browse/GEOS-9841?atlOrigin=eyJpIjoiNDU1Y2FjNGZlY2UwNGRkM2JmYmVjZjc0YWJhMjk5ZDciLCJwIjoiaiJ9
 )

Issue Type: Improvement Assignee: Alessio Fabiani ( 
https://osgeo-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A0027cfac-890c-48e1-8af0-974f12f7b9dc
 ) Created: 22/Dec/20 5:58 PM Priority: Medium Reporter: Alessio Fabiani ( 
https://osgeo-org.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A0027cfac-890c-48e1-8af0-974f12f7b9dc
 )

Add documentation on how to install and configure the WPS JDBC plugin

( 
https://osgeo-org.atlassian.net/browse/GEOS-9841#add-comment?atlOrigin=eyJpIjoiNDU1Y2FjNGZlY2UwNGRkM2JmYmVjZjc0YWJhMjk5ZDciLCJwIjoiaiJ9
 ) Add Comment ( 
https://osgeo-org.atlassian.net/browse/GEOS-9841#add-comment?atlOrigin=eyJpIjoiNDU1Y2FjNGZlY2UwNGRkM2JmYmVjZjc0YWJhMjk5ZDciLCJwIjoiaiJ9
 )

Get Jira notifications on your phone! Download the Jira Cloud app for Android ( 
https://play.google.com/store/apps/details?id=com.atlassian.android.jira.core&referrer=utm_source%3DNotificationLink%26utm_medium%3DEmail
 ) or iOS ( 
https://itunes.apple.com/app/apple-store/id1006972087?pt=696495&ct=EmailNotificationLink&mt=8
 ) This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100153- 
sha1:55cb54c )___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Re: [Geoserver-devel] [Geotools-devel] GeoServer/GeoTools PMC Meeting at 17:30 UTC tomorrow

2020-12-22 Thread Andrea Aime 
On Tue, Dec 22, 2020 at 11:52 AM Roar Brænden 
wrote:

> Would it make sense to make a plugin with a HTTPClient based on Apache
> HttpComponents then?
>

Sure, I'd love to see that personally. We'll have the meeting in half an
hour and discuss this and the other points

Cheers
Andrea

== GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf
Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa
(LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549
http://www.geo-solutions.it http://twitter.com/geosolutions_it
--- *Con riferimento
alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 -
Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni
circostanza inerente alla presente email (il suo contenuto, gli eventuali
allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i
destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per
errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le
sarei comunque grato se potesse darmene notizia. This email is intended
only for the person or entity to which it is addressed and may contain
information that is privileged, confidential or otherwise protected from
disclosure. We remind that - as provided by European Regulation 2016/679
“GDPR” - copying, dissemination or use of this e-mail or the information
herein by anyone other than the intended recipient is prohibited. If you
have received this email by mistake, please notify us immediately by
telephone or e-mail.*
___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

[Geoserver-devel] GeoTools / GeoServer PMC meeting 2020-12-22

2020-12-22 Thread Jody Garnett 
GeoTools / GeoServer PMC meeting - 2020-12-22Attending

Torben Barsballe

Kevin Smith

Ian Turton

Jody Garnett

Andrea Aime

Jukka Rahkonnen

Alessandro Parma

Jim Hughes

Nuno Oliveira

Actions from last meeting:

   -

   [DONE] Thank Brad and Mark for the migration work :)

Agenda

   1.

   JTS 1.18 Upgrade
   2.

   CITE Test contract
   3.

   Remaining 2020 budget
   4.

   HTTP client in GeoTools
   5.

   GeoServer Docker image alternatives
   6.

   More codebase cleanups

Actions

   -

   Jody: Start email PSC vote this year to pay out of our 2020 budget for
   CITE test contract, and then send authorization to treasurer when work is
   complete
   -


JTS 1.18 Upgrade

JTS 1.18 upgrade, featuring Overlay NG (robust etc…)

   -

   New in 1.18
   -

   Setting to turn off / on (usual geotools system property setting)
   -

   Performance improvements
   -

   Address topology exceptions (stability)
   -

  Such improvement it is used always for precision sensitive operations
  like GeometryPrecisionReducer

James:

   -

   Testing against GeoTools / GeoServer build chain before release
   -

   Some ZM handling for a unit test involving shapefiles
   -

   Testing on https://gitter.im/locationtech/jts later today
   -

   Git branch is https://github.com/jnh5y/geotools/tree/jts1.18.0


Discussion:

   -

   Approach: enable “ng” on master, disable on “stable”, …
   -

   Flag is jts.overlay=ng is jts.overlay=old
   -

   Backporting dependency changes can be troublesome, had some recent
   experience with GeoTools being affected by linear rings api change

CITE Test contract

Are we coming up to the end 2020 budget for this activity?

   -

   What do we want to do? With respect to payment out of 2020 budget …
   -

  Action: Start email PSC vote this year … to pay out of our 2020
  budget, and then send authorization to treasurer when work is complete
  -

   Work is still in progress, some delays (see 2020 :) )
   -

  Anything we can do to help? Not really …

Remaining 2020 Budget:

Other discussion:

   -

   Essential software ranking? Migrate from jira to github to improve
   score….
   -

  GeoTools at position 70
  -

  https://github.com/ossf/criticality_score
  -


  https://commondatastorage.googleapis.com/ossf-criticality-score/index.html

  -

   Windows installer?
   -

  GeoCat may be interested in a contract?
  -

   MacOS installer?
   -

  Amazon now rents a mac mini if you needed it :P


If you wish to take action, please send a motion to the appropriate
developer list?
HTTP client in GeoTools

Q: What is the story with this? Roar Brænden

GeoTools HTTPClient interface:

   -

   Java implementation
   -

   Multithreaded using http commons


Got a few threads that clients are difficult to find, generally useful,
duplication gt-wms and gt-wfs both implement…

Someone implemented a PR: https://github.com/geotools/geotools/pull/3256

   -

   Move to gt-main? Not a good idea as we would get dependency on apache
   commons ...
   -

   Isolate into a single interface
   -

   Build a new implementation using apache http commons (replace http
   commons)
   -

   Implement Java 11 (but we cannot do java 11 only code)
   -

   Additional ideas, example async


Action:

   -

   Jody: Will write it up as a proposal library/gt-http and
   plugin/gt-http-components and send it to email for vote?

GeoServer Docker image alternatives

Existing activity: https://github.com/geoserver/docker

   -

   What happened here? There is one PR waiting on feedback …
   -

   This sets up at runtime ...


Alsandro would like to propose an alternative approach:

   -

   Rather than setup at runtime (the above approach), repare a webapp at
   build time, and then pull into docker, …
   -

   GeoCat does this with maven builds and war overlay (maven) and then
   packages result into Docker
   -

   GeoSolutions does this with DockerHub downloading source forge war,
   monitor and control-flow
   -

  Dockerhub build:
  
https://hub.docker.com/r/geosolutionsit/geoserver/tags?page=1&ordering=last_updated&name=test-



Discussion notes:

   -

   The two approaches could be used together, you could always add more
   extensions by hand after if needed.
   -

   How to include this stuff in the geoserver release chain?
   -

  Edit a text file in the repository used by DockerHub, trigger rebuild
  and publish of docker?
  -

  Would I need to add this to the release process?
  -

   Advantage is that you do not have a delay each time you run the
   container ...


If you want to change the extensions, you need to build locally, with
different list extensions

   -

   See custombuild.sh used to make a war (requires linux)


Discussion

   -

   How to include gdal (g-dal / or goo-dle for italians) native binaries,
   built custom gdal to get java bindings …
   -

  See link from torben here:
  
https://gith