Hi, We are running our application in load balanced mode in Tomcat 6.0 with session replication. When we are starting the servers in load balanced mode, then in the console we are getting the following error :
2010-04-14 11:47:51,078 (main) [ VfsLog.java:122:INFO ] Using "C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\vfs_cache" as temporary files store. 2010-04-14 11:48:05,140 (GroupChannel-Heartbeat-1) [ GroupChannel.java:665:ERROR] Unable to send heartbeat through Tribes interceptor stack. Will try to sleep again. java.util.ConcurrentModificationException at java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372) at java.util.AbstractList$Itr.next(AbstractList.java:343) at org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:152) at org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661) class org.webslinger.commons.vfs.flat.FlatFileProvider 2010-04-14 11:48:09,937 (main) [ ChannelSocket.java:387:INFO ] JK: ajp13 listening on /0.0.0.0:8009 2010-04-14 11:48:09,984 (main) [ JkMain.java:344:INFO ] Jk running ID=0 time=16/78 config=null 2010-04-14 11:48:10,125 (main) [ Http11Protocol.java:209:INFO ] Starting Coyote HTTP/1.1 on http-0.0.0.0-8080 When we are testing 100 concurrent users using JMeter, it is giving following error after 5-10 mins. 0-04-14 09:46:10,703 (GroupChannel-Heartbeat-1) [ BioSender.java:287:WARN ] Unable to read acknowledgement from [/192.168.1.3:1,93 a.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.net.SocketInputStream.read(SocketInputStream.java:182) at org.apache.catalina.tribes.transport.bio.BioSender.waitForAck(BioSender.java:263) at org.apache.catalina.tribes.transport.bio.BioSender.pushMessage(BioSender.java:245) at org.apache.catalina.tribes.transport.bio.BioSender.sendMessage(BioSender.java:125) at org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:52) at org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51) at org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80) at org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78) at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75) at org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87) at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75) at org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73) at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75) at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:216) at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:175) at org.apache.catalina.tribes.group.RpcChannel.send(RpcChannel.java:89) at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.ping(AbstractReplicatedMap.java:253) at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.heartbeat(AbstractReplicatedMap.java:793) at org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:153) at org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661) 0-04-14 09:46:13,718 (GroupChannel-Heartbeat-1) [AbstractReplicatedMap.java:795:ERROR] Unable to send AbstractReplicatedMap.ping message .apache.catalina.tribes.ChannelException: java.net.SocketTimeoutException: Read timed out; Faulty members:tcp://{-64, -88, 1, 3}:4001; at org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:54) at org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51) at org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80) at org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78) at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75) at org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87) at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75) at org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73) at org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75) at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:216) at org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:175) at org.apache.catalina.tribes.group.RpcChannel.send(RpcChannel.java:89) at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.ping(AbstractReplicatedMap.java:253) at org.apache.catalina.tribes.tipis.AbstractReplicatedMap.heartbeat(AbstractReplicatedMap.java:793) at org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:153) at org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661) sed by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.net.SocketInputStream.read(SocketInputStream.java:182) at org.apache.catalina.tribes.transport.bio.BioSender.waitForAck(BioSender.java:263) at org.apache.catalina.tribes.transport.bio.BioSender.pushMessage(BioSender.java:245) at org.apache.catalina.tribes.transport.bio.BioSender.sendMessage(BioSender.java:134) at org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:52) ... 15 more Please give suggestion /solution of this load balance problem. Thanks & Regards Pradeep Ruhil L& T Infotech Mahape, Vashi Mumbai ________________________________ This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system. ______________________________________________________________________