Re: [Geoserver-users] Hazelcast clustering

[Jason Cradit]

Hey Andrea,

Thanks so much for the info!  I really appreciate your prospective.  I'm
still struggling to get JMS setup in AWS.  I had thought of using AmazonMQ
(hosted ActiveMQ) service as the broker service.  My thought is that I
would just be able to update the brokerURL with that of the AmazonMQ
instance, disable the embedded Broker.  However, i get this error:

2019-05-01 16:32:17,923 WARN [client.JMSContainer] - Setup of JMS message
listener invoker failed for destination
'queue://Consumer.46883c30-cd00-4097-84d1-b68adceedf8e.VirtualTopic.geoserver'
- trying to recover. Cause: java.lang.IllegalStateException: Pool not open


I'm clearly doing something wrong or misunderstanding the config.  Anyone
know if AmazonMQ would even work?  Or if i'm missing a configuration step
here.

Thanks!
Jason

On Wed, May 1, 2019 at 1:36 AM Andrea Aime 
wrote:

> On Wed, May 1, 2019 at 6:50 AM Jason Cradit  wrote:
>
>> With the JMS extension, it seems that if we use the JDBC extension it
>> won't even start the container.  So it's like JDBC and JMS can't be
>> installed together.  That may not be true, but that's what i'm seeing,
>> currently.  There is also an issue with using multi-cast in AWS, it doesn't
>> work.  So i'm reading to figure out how that challenge could be overcome.
>>
>
> While JMS works mostly off generic catalog interfaces, it has never been
> used, as far as I know, along with JDBCConfig, so not surprised if you get
> in trouble there.
>
> One note about JDBCConfig, make sure that's the long term direction you
> want to go, once you have the data in the database, I don't believe there
> is a procedure to get it back out on the file system.
> Also, if the configuration elements in GeoServer change (e.g., a field
> disappears), I don't recall any presence of an upgrade procedures either
> (the module maps certain properties out of the XML blobs into indexable
> columns, it might not work properly anymore if one of those disappear).
> The same goes if the module is modified to map out new attributes to get
> better performance in some use cases (which has happened in the past), also
> in the case there is, AFAIK,  no procedure
> to map out the new attribute from XML blobs already stored in the DB.
>
> Might not be like that anymore, that seemed to be the case when I tried it
> out years ago, but I'd at least double check.
>
> Cheers
> Andrea
>
> ==
>
> GeoServer Professional Services from the experts! Visit
> http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf
> Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa
> (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549
> http://www.geo-solutions.it http://twitter.com/geosolutions_it
> --- *Con riferimento
> alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 -
> Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni
> circostanza inerente alla presente email (il suo contenuto, gli eventuali
> allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i
> destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per
> errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le
> sarei comunque grato se potesse darmene notizia. This email is intended
> only for the person or entity to which it is addressed and may contain
> information that is privileged, confidential or otherwise protected from
> disclosure. We remind that - as provided by European Regulation 2016/679
> “GDPR” - copying, dissemination or use of this e-mail or the information
> herein by anyone other than the intended recipient is prohibited. If you
> have received this email by mistake, please notify us immediately by
> telephone or e-mail.*
>
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see this: 
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] Hazelcast clustering

[Jason Cradit]

Thanks so much for the information!  I've built the JMS clustering locally
but, i've run into issues getting it to work in AWS.

Our current config is using a shared file system and JDBC - so when a
configuration change occurs, we've used the REST endpoint to reload config
across all our GeoServers.  We are looking to move away from this setup and
have it automatically sync the config changes; like a change in a layer.

Using Hazelcast, it just sorta plugged into our current environment and
took away our need to hit the endpoint to reload configs.  So it feels like
a win.

With the JMS extension, it seems that if we use the JDBC extension it won't
even start the container.  So it's like JDBC and JMS can't be installed
together.  That may not be true, but that's what i'm seeing, currently.
There is also an issue with using multi-cast in AWS, it doesn't work.  So
i'm reading to figure out how that challenge could be overcome.

On Mon, Apr 29, 2019 at 10:39 AM Gabriel Roldan 
wrote:

> Hi Jason,
>
> As a side note, I found the JMS cluster module pretty easy to set up on a
> scalable cluster deployment using docker and docker-compose.
> Check out this docker-compose file [1]
>
> It sets up a proxy and a scalable geoserver image. You should be able to do
> docker-compose up -d
> docker-compose scale geoserver=5 #ramp up to 5 instances
> docker-compose scale geoserver=1 #ramp down to 1 instance
>
> All that while using sticky sessions to access the UI through the proxy at
> localthost:8000
>
> As for the Hazelcast approach, it's been years since I've used it, but I
> concur events instead of reload is the way to go.
>
> [1] <
> https://github.com/groldan/2019_foss4g-ar_taller_geoserver/blob/master/docker/broker_externo_scale/docker-compose.yml
> >
>
>
> El lun., 15 de abr. de 2019 a la(s) 14:26, Jason Cradit (
> jasoncra...@gmail.com) escribió:
>
>> Hello - I've been looking into clustering and would like to follow the
>> Hazelcast approach instead of the JMS.  However, I'm striking out finding
>> the installation.  I don't see it in the community modules.
>>
>> Any guidance on finding the download for it?
>>
>> Thanks,
>> Jason
>> ___
>> Geoserver-users mailing list
>>
>> Please make sure you read the following two resources before posting to
>> this list:
>> - Earning your support instead of buying it, but Ian Turton:
>> http://www.ianturton.com/talks/foss4g.html#/
>> - The GeoServer user list posting guidelines:
>> http://geoserver.org/comm/userlist-guidelines.html
>>
>> If you want to request a feature or an improvement, also see this:
>> https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
>>
>>
>> Geoserver-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>>
>
>
> --
> Gabriel Roldán
>
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see this: 
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] Hazelcast clustering

[Gabriel Roldan]

Hi Jason,

As a side note, I found the JMS cluster module pretty easy to set up on a
scalable cluster deployment using docker and docker-compose.
Check out this docker-compose file [1]

It sets up a proxy and a scalable geoserver image. You should be able to do
docker-compose up -d
docker-compose scale geoserver=5 #ramp up to 5 instances
docker-compose scale geoserver=1 #ramp down to 1 instance

All that while using sticky sessions to access the UI through the proxy at
localthost:8000

As for the Hazelcast approach, it's been years since I've used it, but I
concur events instead of reload is the way to go.

[1] <
https://github.com/groldan/2019_foss4g-ar_taller_geoserver/blob/master/docker/broker_externo_scale/docker-compose.yml
>


El lun., 15 de abr. de 2019 a la(s) 14:26, Jason Cradit (
jasoncra...@gmail.com) escribió:

> Hello - I've been looking into clustering and would like to follow the
> Hazelcast approach instead of the JMS.  However, I'm striking out finding
> the installation.  I don't see it in the community modules.
>
> Any guidance on finding the download for it?
>
> Thanks,
> Jason
> ___
> Geoserver-users mailing list
>
> Please make sure you read the following two resources before posting to
> this list:
> - Earning your support instead of buying it, but Ian Turton:
> http://www.ianturton.com/talks/foss4g.html#/
> - The GeoServer user list posting guidelines:
> http://geoserver.org/comm/userlist-guidelines.html
>
> If you want to request a feature or an improvement, also see this:
> https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
>
>
> Geoserver-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>


-- 
Gabriel Roldán
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see this: 
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] Hazelcast clustering

[Niels Charlier]

Hello Jason,

The event clustering option is in my opinion much better, I'm not sure 
why "reload" is the default. The event option is indeed much smarter, it 
will distribute catalog events across the different nodes, so that every 
node can update its cache just for the item that changed only, without 
the need to reload the entire configuration. I found that reload can 
cause serious performance issues and even a deadlock if many events 
happen after each other. "Event" is definitely the way to go. I think we 
should make it the default, especially if more people give positive 
feedback on this.


I also have quite some experience with running jdbcconfig with 
hz-cluster, so do not hesitate to ask me any more questions if you have any.


Kind Regards

Niels

On 22/04/2019 16:27, Jason Cradit wrote:

Hey Andrea,

Thanks for the reply!  I appreciate your input!

Sure enough - that was the module (hz-cluster-plugin). I've installed 
it and it works great, alongside JDBC and also using AWS EFS for the 
Geoserver data directory.  I think I agree with your assessment, it's 
not really clustering as much as it is just keeping the configuration 
in sync across all nodes.


For anyone using Hazelcast or has some idea - does anyone know if I 
set the clustering option to event instead of reload in 
clustering.properties does it still do a full reload of the config?  
Or is it only updating the single change across all nodes?  I.e. if I 
change a style in a layer on one node, I can confirm that change is 
replicated across all nodes, but did it just run a reload config on 
all the other nodes or is it a bit smarter than that?


Any guidance or documentation I could read would be helpful!  Thanks 
so much for all your support!


Thanks,
Jason

On Fri, Apr 19, 2019 at 12:53 PM Andrea Aime 
mailto:andrea.a...@geo-solutions.it>> 
wrote:


Hi Jason,
I believe the Hazelcast clustering module alone does not really
clusters anything, it just helps
to keep the cluster up to date when you are using jdbcconfig.

The community modules are not part of releases (as they lack a
maintainer), if they are built at all you can
find them among the nightly builds, see here:
https://build.geoserver.org/geoserver/
in particular, say you want the community modules for 2.15.x, here:
https://build.geoserver.org/geoserver/2.15.x/community-latest/

I see a hz-cluster module in there, should be the one (not 100%
sure, I'm not using it).

Cheers
Andrea



On Mon, Apr 15, 2019 at 7:28 PM Jason Cradit
mailto:jasoncra...@gmail.com>> wrote:

Hello - I've been looking into clustering and would like to
follow the Hazelcast approach instead of the JMS.  However,
I'm striking out finding the installation.  I don't see it in
the community modules.

Any guidance on finding the download for it?

Thanks,
Jason
___
Geoserver-users mailing list

Please make sure you read the following two resources before
posting to this list:
- Earning your support instead of buying it, but Ian Turton:
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines:
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see
this:

https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net

https://lists.sourceforge.net/lists/listinfo/geoserver-users



-- 


Regards, Andrea Aime == GeoServer Professional Services from the
experts! Visit http://goo.gl/it488V for more information. == Ing.
Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di
Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax:
+39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it
http://twitter.com/geosolutions_it
--- /Con
riferimento alla normativa sul trattamento dei dati personali
(Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati
“GDPR”), si precisa che ogni circostanza inerente alla presente
email (il suo contenuto, gli eventuali allegati, etc.) è un dato
la cui conoscenza è riservata al/i solo/i destinatario/i indicati
dallo scrivente. Se il messaggio Le è giunto per errore, è
tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei
comunque grato se potesse darmene notizia. This email is intended
only for the person or entity to which it is addressed and may
contain information that is privileged, confidential or otherwise
protected from disclosure. We remind that - as provided by
European Regulation 2016/679 

Re: [Geoserver-users] Hazelcast clustering

[Jason Cradit]

Hey Andrea,

Thanks for the reply!  I appreciate your input!

Sure enough - that was the module (hz-cluster-plugin).  I've installed it
and it works great, alongside JDBC and also using AWS EFS for the Geoserver
data directory.  I think I agree with your assessment, it's not really
clustering as much as it is just keeping the configuration in sync across
all nodes.

For anyone using Hazelcast or has some idea - does anyone know if I set the
clustering option to event instead of reload in clustering.properties does
it still do a full reload of the config?  Or is it only updating the single
change across all nodes?  I.e. if I change a style in a layer on one node,
I can confirm that change is replicated across all nodes, but did it just
run a reload config on all the other nodes or is it a bit smarter than that?

Any guidance or documentation I could read would be helpful!  Thanks so
much for all your support!

Thanks,
Jason

On Fri, Apr 19, 2019 at 12:53 PM Andrea Aime 
wrote:

> Hi Jason,
> I believe the Hazelcast clustering module alone does not really clusters
> anything, it just helps
> to keep the cluster up to date when you are using jdbcconfig.
>
> The community modules are not part of releases (as they lack a
> maintainer), if they are built at all you can
> find them among the nightly builds, see here:
> https://build.geoserver.org/geoserver/
> in particular, say you want the community modules for 2.15.x, here:
> https://build.geoserver.org/geoserver/2.15.x/community-latest/
>
> I see a hz-cluster module in there, should be the one (not 100% sure, I'm
> not using it).
>
> Cheers
> Andrea
>
>
>
> On Mon, Apr 15, 2019 at 7:28 PM Jason Cradit 
> wrote:
>
>> Hello - I've been looking into clustering and would like to follow the
>> Hazelcast approach instead of the JMS.  However, I'm striking out finding
>> the installation.  I don't see it in the community modules.
>>
>> Any guidance on finding the download for it?
>>
>> Thanks,
>> Jason
>> ___
>> Geoserver-users mailing list
>>
>> Please make sure you read the following two resources before posting to
>> this list:
>> - Earning your support instead of buying it, but Ian Turton:
>> http://www.ianturton.com/talks/foss4g.html#/
>> - The GeoServer user list posting guidelines:
>> http://geoserver.org/comm/userlist-guidelines.html
>>
>> If you want to request a feature or an improvement, also see this:
>> https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
>>
>>
>> Geoserver-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>>
>
>
> --
>
> Regards, Andrea Aime == GeoServer Professional Services from the experts!
> Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime
> @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054
> Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339
> 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it
> --- *Con riferimento
> alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 -
> Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni
> circostanza inerente alla presente email (il suo contenuto, gli eventuali
> allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i
> destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per
> errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le
> sarei comunque grato se potesse darmene notizia. This email is intended
> only for the person or entity to which it is addressed and may contain
> information that is privileged, confidential or otherwise protected from
> disclosure. We remind that - as provided by European Regulation 2016/679
> “GDPR” - copying, dissemination or use of this e-mail or the information
> herein by anyone other than the intended recipient is prohibited. If you
> have received this email by mistake, please notify us immediately by
> telephone or e-mail.*
>
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see this: 
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] Hazelcast clustering

[Andrea Aime]

Hi Jason,
I believe the Hazelcast clustering module alone does not really clusters
anything, it just helps
to keep the cluster up to date when you are using jdbcconfig.

The community modules are not part of releases (as they lack a maintainer),
if they are built at all you can
find them among the nightly builds, see here:
https://build.geoserver.org/geoserver/
in particular, say you want the community modules for 2.15.x, here:
https://build.geoserver.org/geoserver/2.15.x/community-latest/

I see a hz-cluster module in there, should be the one (not 100% sure, I'm
not using it).

Cheers
Andrea



On Mon, Apr 15, 2019 at 7:28 PM Jason Cradit  wrote:

> Hello - I've been looking into clustering and would like to follow the
> Hazelcast approach instead of the JMS.  However, I'm striking out finding
> the installation.  I don't see it in the community modules.
>
> Any guidance on finding the download for it?
>
> Thanks,
> Jason
> ___
> Geoserver-users mailing list
>
> Please make sure you read the following two resources before posting to
> this list:
> - Earning your support instead of buying it, but Ian Turton:
> http://www.ianturton.com/talks/foss4g.html#/
> - The GeoServer user list posting guidelines:
> http://geoserver.org/comm/userlist-guidelines.html
>
> If you want to request a feature or an improvement, also see this:
> https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer
>
>
> Geoserver-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>


-- 

Regards, Andrea Aime == GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime
@geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054
Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339
8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it
--- *Con riferimento
alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 -
Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni
circostanza inerente alla presente email (il suo contenuto, gli eventuali
allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i
destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per
errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le
sarei comunque grato se potesse darmene notizia. This email is intended
only for the person or entity to which it is addressed and may contain
information that is privileged, confidential or otherwise protected from
disclosure. We remind that - as provided by European Regulation 2016/679
“GDPR” - copying, dissemination or use of this e-mail or the information
herein by anyone other than the intended recipient is prohibited. If you
have received this email by mistake, please notify us immediately by
telephone or e-mail.*
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see this: 
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Geoserver-users] Hazelcast clustering

[Jason Cradit]

Hello - I've been looking into clustering and would like to follow the
Hazelcast approach instead of the JMS.  However, I'm striking out finding
the installation.  I don't see it in the community modules.

Any guidance on finding the download for it?

Thanks,
Jason
___
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this 
list:
- Earning your support instead of buying it, but Ian Turton: 
http://www.ianturton.com/talks/foss4g.html#/
- The GeoServer user list posting guidelines: 
http://geoserver.org/comm/userlist-guidelines.html

If you want to request a feature or an improvement, also see this: 
https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer


Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users