[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
Re: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
All, this issue is killing me. I was supposed to go live with this version tomorrow morning but this issue forced me to cancel. The symptom I am seeing is that ST’s can’t be validated. I believe this because tickets are not being replicated across my 2 CAS servers. The back channel ST validation is failing because of this. I checked and re-checked my ehcache-replication.xml configuration. Both servers are listening on port 40001. I am running on RHEL and have verified that there are no firewalls in place. I can telnet from each server to the other on port 40001. I have set the remote port in ehcache-replication.xml to 40002 yet neither server seems to be listening on this port. Does anyone have suggestions for log4j settings I should set to get additional debug info. I did note that my pom.xml has a dependency for ehcache, but I think that is built into the 3.5.2 overlay and I may not need that dependency. Ehcache has work well on our 3.4.12 CAS for many years, I am now stumped. Part of me says Dump ehcache and go to Hazelcast… JPA ticket registry is out of the question. Cheers, Bryan From: Bryan Wooten mailto:bryan.woo...@utah.edu>> Reply-To: "cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org>" mailto:cas-user@lists.jasig.org>> Date: Tuesday, February 17, 2015 at 10:21 AM To: "cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org>" mailto:cas-user@lists.jasig.org>> Subject: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bryan.woo...@utah.edu<mailto:bryan.woo...@utah.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
Re: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
If anything I'd suggest going with Hazelcast, but then it'd be really a decision for you to make. We've had many successful HazelcastTicketRegistry deployments and I'm not aware of any serious "woes" with it so far. D. Sent from my iPhone > On Feb 17, 2015, at 18:18, Bryan Wooten wrote: > > All, this issue is killing me. I was supposed to go live with this version > tomorrow morning but this issue forced me to cancel. > > The symptom I am seeing is that ST’s can’t be validated. I believe this > because tickets are not being replicated across my 2 CAS servers. The back > channel ST validation is failing because of this. > > I checked and re-checked my ehcache-replication.xml configuration. Both > servers are listening on port 40001. > > I am running on RHEL and have verified that there are no firewalls in place. > I can telnet from each server to the other on port 40001. > > I have set the remote port in ehcache-replication.xml to 40002 yet neither > server seems to be listening on this port. > > Does anyone have suggestions for log4j settings I should set to get > additional debug info. > > I did note that my pom.xml has a dependency for ehcache, but I think that is > built into the 3.5.2 overlay and I may not need that dependency. > > Ehcache has work well on our 3.4.12 CAS for many years, I am now stumped. > Part of me says Dump ehcache and go to Hazelcast… JPA ticket registry is out > of the question. > > Cheers, > > Bryan > > From: Bryan Wooten > Reply-To: "cas-user@lists.jasig.org" > Date: Tuesday, February 17, 2015 at 10:21 AM > To: "cas-user@lists.jasig.org" > Subject: [cas-user] ERROR > net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator > > My cas.log is filled with this error: (CAS 3.5.2) > > 2015-02-17 07:53:18,138 ERROR > [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on > flushing of replication queue: null. Continuing... > java.lang.NullPointerException > at > net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) > at > net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) > at > net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) > at > net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) > at > net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) > > I found this: > > https://issues.jasig.org/browse/CAS-1174 > > But I am not using ClearPass. > > > Bryan Wooten > > UIT-Common Infrastructure Systems > > -- > You are currently subscribed to cas-user@lists.jasig.org as: > bryan.woo...@utah.edu > To unsubscribe, change settings or access archives, see > http://www.ja-sig.org/wiki/display/JSG/cas-user > -- > You are currently subscribed to cas-user@lists.jasig.org as: > dkopyle...@unicon.net > To unsubscribe, change settings or access archives, see > http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
RE:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
Hi Bryan! I remember I've already seen this issue. I am using CAS 4.0 with EH Cache. I found the solution here: https://www.mail-archive.com/cas-user@lists.jasig.org/msg12970.html Please check the definition of bean "cacheManager" in ticketRegistry.xml. You should have set property "shared" to true like in this example: At least this is what helped in my case. Best Regards, Jarda From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: 17. February 2015 6:21 odp. To: cas-user@lists.jasig.org Subject: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: jka...@idc.com<mailto:jka...@idc.com> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
RE:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
Thanks! We made the change to shared=true and the ehcache exception has gone away. But unfortunately the behavior has not changed... Still get ticket validation exceptions. Sigh -Bryan From: Jaroslav Kacer [mailto:jka...@idc.com] Sent: Wednesday, February 18, 2015 1:15 AM To: cas-user@lists.jasig.org Subject: RE:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator Hi Bryan! I remember I've already seen this issue. I am using CAS 4.0 with EH Cache. I found the solution here: https://www.mail-archive.com/cas-user@lists.jasig.org/msg12970.html Please check the definition of bean "cacheManager" in ticketRegistry.xml. You should have set property "shared" to true like in this example: At least this is what helped in my case. Best Regards, Jarda From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: 17. February 2015 6:21 odp. To: cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> Subject: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: jka...@idc.com<mailto:jka...@idc.com> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bwoo...@acs.utah.edu<mailto:bwoo...@acs.utah.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
RE:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
Bryan, I haven't seen anyone ask these questions, so I'll start with these. 1. In your ticketRegistry.xml, have you configured your ticket caches for your ServiceTicketsCache and your TicketGrantingTicketCache? 2. In your ehcache-replicated.xml, do you have your rmiUrls configured properly? Example: rmiUrls=//cas01.example.com:41001/org.jasig.ticket.ServiceTicket|//cas01.example.com:41001/org.jasig.ticket.TicketGrantingTicket? Also, if you wouldn't mind posting a pastebin of your configs (please scrub them for sensitive material before posting), that would really helpful. Ben Branch UNIX/Linux Administrator University of Central Oklahoma ITIL Foundation v3, Network+, RHCE 100 N. University Drive, Box 122 Edmond, OK 73034 D: 405.974.2649 | M: 405.550.6804 | bbranch@uco.<mailto:bbranch@uco.>edu | www.uco.edu<http://www.uco.edu/> "I am wiser than this man, for neither of us appears to know anything great and good; but he fancies he knows something, although he knows nothing; whereas I, as I do not know anything, so I do not fancy I do. In this trifling particular, then, I appear to be wiser than he, because I do not fancy I know what I do not know." - Socrates From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: Wednesday, February 18, 2015 8:18 AM To: cas-user@lists.jasig.org Subject: RE:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator Thanks! We made the change to shared=true and the ehcache exception has gone away. But unfortunately the behavior has not changed... Still get ticket validation exceptions. Sigh -Bryan From: Jaroslav Kacer [mailto:jka...@idc.com] Sent: Wednesday, February 18, 2015 1:15 AM To: cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> Subject: RE:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator Hi Bryan! I remember I've already seen this issue. I am using CAS 4.0 with EH Cache. I found the solution here: https://www.mail-archive.com/cas-user@lists.jasig.org/msg12970.html Please check the definition of bean "cacheManager" in ticketRegistry.xml. You should have set property "shared" to true like in this example: At least this is what helped in my case. Best Regards, Jarda From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: 17. February 2015 6:21 odp. To: cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> Subject: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: jka...@idc.com<mailto:jka...@idc.com> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bwoo...@acs.utah.edu<mailto:bwoo...@acs.utah.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bbra...@uco.edu<mailto:bbra...@uco.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
RE: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
Hi again Bryan! I would try adding this to your Log4J config: And you should see if the data is being exchanged between your nodes. This could be a good start. If you can't see anything interesting, please provide us your EH Cache configuration, as Ben suggests. Best Regards, Jarda From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: 18. February 2015 12:19 dop. To: cas-user@lists.jasig.org Cc: mmoay...@unicon.net Subject: Re: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator All, this issue is killing me. I was supposed to go live with this version tomorrow morning but this issue forced me to cancel. The symptom I am seeing is that ST's can't be validated. I believe this because tickets are not being replicated across my 2 CAS servers. The back channel ST validation is failing because of this. I checked and re-checked my ehcache-replication.xml configuration. Both servers are listening on port 40001. I am running on RHEL and have verified that there are no firewalls in place. I can telnet from each server to the other on port 40001. I have set the remote port in ehcache-replication.xml to 40002 yet neither server seems to be listening on this port. Does anyone have suggestions for log4j settings I should set to get additional debug info. I did note that my pom.xml has a dependency for ehcache, but I think that is built into the 3.5.2 overlay and I may not need that dependency. Ehcache has work well on our 3.4.12 CAS for many years, I am now stumped. Part of me says Dump ehcache and go to Hazelcast... JPA ticket registry is out of the question. Cheers, Bryan From: Bryan Wooten mailto:bryan.woo...@utah.edu>> Reply-To: "cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org>" mailto:cas-user@lists.jasig.org>> Date: Tuesday, February 17, 2015 at 10:21 AM To: "cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org>" mailto:cas-user@lists.jasig.org>> Subject: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bryan.woo...@utah.edu<mailto:bryan.woo...@utah.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: jka...@idc.com<mailto:jka...@idc.com> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
RE: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
Ok, here is an update. After not getting ehcache to work I went ahead and configured Hazelcast. Hazelcast failed in the exact same way. So we took our current production cas.war (3.4.12 with ehcache) and deployed to our test environment. It works just fine. It seems we have a much deeper and serious problem. I should point out our build is really 3.5.2 but with MFA M6 overlay: https://github.com/Unicon/cas-mfa/wiki/CAS-MFA-v1.0.0-M6-Overlay-Integration-Strategy All the MFA stuff works fine, it seems as soon as we add a second CAS server we start getting ST validation errors. The error occurs whether or not the user is using MFA. Thanks everyone, Bryan From: Jaroslav Kacer [mailto:jka...@idc.com] Sent: Wednesday, February 18, 2015 8:30 AM To: cas-user@lists.jasig.org Subject: RE: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator Hi again Bryan! I would try adding this to your Log4J config: And you should see if the data is being exchanged between your nodes. This could be a good start. If you can't see anything interesting, please provide us your EH Cache configuration, as Ben suggests. Best Regards, Jarda From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: 18. February 2015 12:19 dop. To: cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> Cc: mmoay...@unicon.net<mailto:mmoay...@unicon.net> Subject: Re: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator All, this issue is killing me. I was supposed to go live with this version tomorrow morning but this issue forced me to cancel. The symptom I am seeing is that ST's can't be validated. I believe this because tickets are not being replicated across my 2 CAS servers. The back channel ST validation is failing because of this. I checked and re-checked my ehcache-replication.xml configuration. Both servers are listening on port 40001. I am running on RHEL and have verified that there are no firewalls in place. I can telnet from each server to the other on port 40001. I have set the remote port in ehcache-replication.xml to 40002 yet neither server seems to be listening on this port. Does anyone have suggestions for log4j settings I should set to get additional debug info. I did note that my pom.xml has a dependency for ehcache, but I think that is built into the 3.5.2 overlay and I may not need that dependency. Ehcache has work well on our 3.4.12 CAS for many years, I am now stumped. Part of me says Dump ehcache and go to Hazelcast... JPA ticket registry is out of the question. Cheers, Bryan From: Bryan Wooten mailto:bryan.woo...@utah.edu>> Reply-To: "cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org>" mailto:cas-user@lists.jasig.org>> Date: Tuesday, February 17, 2015 at 10:21 AM To: "cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org>" mailto:cas-user@lists.jasig.org>> Subject: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator My cas.log is filled with this error: (CAS 3.5.2) 2015-02-17 07:53:18,138 ERROR [net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator] - Exception on flushing of replication queue: null. Continuing... java.lang.NullPointerException at net.sf.ehcache.distribution.RMISynchronousCacheReplicator.listRemoteCachePeers(RMISynchronousCacheReplicator.java:335) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.writeReplicationQueue(RMIAsynchronousCacheReplicator.java:312) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.replicationThreadMain(RMIAsynchronousCacheReplicator.java:127) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator.access$000(RMIAsynchronousCacheReplicator.java:58) at net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator$ReplicationThread.run(RMIAsynchronousCacheReplicator.java:389) I found this: https://issues.jasig.org/browse/CAS-1174 But I am not using ClearPass. Bryan Wooten UIT-Common Infrastructure Systems -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bryan.woo...@utah.edu<mailto:bryan.woo...@utah.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: jka...@idc.com<mailto:jka...@idc.com> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> as: bryan.woo...@utah.edu<mailto:bryan.woo...@utah.edu> To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
RE: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
I am digging deeper and decided to run a tcpdump between my 2 CAS servers and I find this: 155.97.165.81.33378 > 155.97.165.82.41001: Flags [P.], cksum 0x81e2 (incorrect -> 0x054d), seq 633005888:633005973, ack 986232864, win 296, options [nop,nop,TS val 598826537 ecr 598440177], length 85 0x: 4500 0089 d556 4000 4006 e3b1 9b61 a551 EV@.@a.Q 0x0010: 9b61 a552 8262 a029 25ba e740 3ac8 b820 .a.R.b.)%..@:... 0x0020: 8018 0128 81e2 0101 080a 23b1 5e29 ...(#.^) 0x0030: 23ab 78f1 50ac ed00 0577 2200 #.x.Pw". 0x0040: 0x0050: 0244 154d c9d4 e63b df74 0029 .D.M...;.t.) 0x0060: 6f72 672e 6a61 7369 672e 6361 732e 7469 org.jasig.cas.ti 0x0070: 636b 6574 2e54 6963 6b65 7447 7261 6e74 cket.TicketGrant 0x0080: 696e 6754 6963 6b65 74 ingTicket 10:23:11.353558 IP (tos 0x0, ttl 64, id 50960, offset 0, flags [DF], proto TCP (6), length 1509) 155.97.165.82.41001 > 155.97.165.81.33378: Flags [.], seq 986232864:986234321, ack 633005973, win 114, options [nop,nop,TS val 598440179 ecr 598826537], length 1457 0x: 4500 05e5 c710 4000 4006 ec9b 9b61 a552 E.@.@a.R 0x0010: 9b61 a551 a029 8262 3ac8 b820 25ba e795 .a.Q.).b:...%... 0x0020: 8010 0072 c56e 0101 080a 23ab 78f3 ...r.n..#.x. 0x0030: 23b1 5e29 51ac ed00 0577 0f02 42b5 a534 #.^)Qw..B..4 0x0040: 014b 9d8f ae8e 80be 7372 001a 6a61 ...K..sr..ja 0x0050: 7661 2e72 6d69 2e4e 6f74 426f 756e 6445 va.rmi.NotBoundE 0x0060: 7863 6570 7469 6f6e e637 f9a7 2d7c 3afb xception.7..-|:. 0x0070: 0200 0070 7872 0013 6a61 7661 2e6c 616e ...pxr..java.lan 0x0080: 672e 4578 6365 7074 696f 6ed0 fd1f 3e1a g.Exception...>. So I am getting a java.rmi.NotBoundException. That would explain the issue I am seeing. Now just to figure out why the ehcahce-replicated.xml works with on version of CAS and not the other. -Bryan From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: Wednesday, February 18, 2015 9:53 AM To: cas-user@lists.jasig.org Subject: RE: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator Ok, here is an update. After not getting ehcache to work I went ahead and configured Hazelcast. Hazelcast failed in the exact same way. So we took our current production cas.war (3.4.12 with ehcache) and deployed to our test environment. It works just fine. It seems we have a much deeper and serious problem. I should point out our build is really 3.5.2 but with MFA M6 overlay: https://github.com/Unicon/cas-mfa/wiki/CAS-MFA-v1.0.0-M6-Overlay-Integration-Strategy All the MFA stuff works fine, it seems as soon as we add a second CAS server we start getting ST validation errors. The error occurs whether or not the user is using MFA. Thanks everyone, Bryan From: Jaroslav Kacer [mailto:jka...@idc.com] Sent: Wednesday, February 18, 2015 8:30 AM To: cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> Subject: RE: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator Hi again Bryan! I would try adding this to your Log4J config: And you should see if the data is being exchanged between your nodes. This could be a good start. If you can't see anything interesting, please provide us your EH Cache configuration, as Ben suggests. Best Regards, Jarda From: Bryan Wooten [mailto:bryan.woo...@utah.edu] Sent: 18. February 2015 12:19 dop. To: cas-user@lists.jasig.org<mailto:cas-user@lists.jasig.org> Cc: mmoay...@unicon.net<mailto:mmoay...@unicon.net> Subject: Re: [cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator All, this issue is killing me. I was supposed to go live with this version tomorrow morning but this issue forced me to cancel. The symptom I am seeing is that ST's can't be validated. I believe this because tickets are not being replicated across my 2 CAS servers. The back channel ST validation is failing because of this. I checked and re-checked my ehcache-replication.xml configuration. Both servers are listening on port 40001. I am running on RHEL and have verified that there are no firewalls in place. I can telnet from each server to the other on port 40001. I have set the remote port in ehcache-replication.xml to 40002 yet neither server seems to be listening on this port. Does anyone have suggestions for log4j settings I should set to get additional debug info. I did note that my pom.xml has a dependency for ehcache, but I think that is built into the 3.5.2 overlay and I may not need that dependency. Ehcache has work well on our 3.4.12 CAS for many years, I am now stumped. Part of me says Dump ehcache and go to Hazelcast... JPA ticket registry is out of the question. C
Re:[cas-user] ERROR net.sf.ehcache.distribution.RMIAsynchronousCacheReplicator
Try setting all your ports to 40001. The example docs (https://github.com/Jasig/cas/blob/master/cas-server-integration-ehcache/src/test/resources/ehcache-replicated.xml) work if both cas servers are on a single machine (same ip address). When the cas servers are on different machines (urls have ip address and not localhost) they can both listen on the same port. In other words, ehcache-replicated.xml will look the same except for ip changes. Ray -- You are currently subscribed to cas-user@lists.jasig.org as: arch...@mail-archive.com To unsubscribe, change settings or access archives, see http://www.ja-sig.org/wiki/display/JSG/cas-user
