RE: Appserver Queues Filling Up

2010-05-11 Thread Ben Knight
Hey Chris,

Thanks for the reply.  We have yet to do a thread dump.  I was actually
waiting for the queues to fill up again to do just that.

In the meantime, I have JBoss v. 5.1.0GA and JBoss web v. 2.1.3GA.

Which versions of Tomcat have had problems?

Thanks
Ben


-Original Message-
From: Christopher Schultz [mailto:ch...@christopherschultz.net]
Sent: Tuesday, May 11, 2010 12:40 PM
To: Tomcat Users List
Subject: Re: Appserver Queues Filling Up

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Ben,

On 5/10/2010 4:35 PM, Ben Knight wrote:
> We are having a Wicket-based Java application deployed in a production
> server cluster using Apache (2.2.3) with mod_jk (1.2.30) as load balancing
> component w/ sticky session and Jboss 5 as application container for the
> Java application.

Do you know what version of Tomcat is being used in that version of
JBoss? Recently, there have been some problems identified with a few
connectors that can cause deadlock at the connector level.

Have you looked at a thread dump of your webapp to see what the request
processor threads are doing?

- -chris
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkvpiGAACgkQ9CaO5/Lv0PDfTgCgwHUyW57kRx02K9xn5AsWN41y
wZoAnRDiXNuv71fruZE3ejPTWlqA2Jyx
=h6dq
-END PGP SIGNATURE-

-
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org

-
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org



Appserver Queues Filling Up

2010-05-10 Thread Ben Knight
Apache version:2.2.3

JBoss version:  5

JBoss Web: 2.1.3.GA <http://2.1.3.ga/>

mod_jk:   1.2.30



Dear community,



We are having a Wicket-based Java application deployed in a production
server cluster using Apache (2.2.3) with mod_jk (1.2.30) as load balancing
component w/ sticky session and Jboss 5 as application container for the
Java application.



We are inconsistently seeing an issue in our production environment where
our AJP queues between Apache and Jboss as shown in the JMX console fill up
with requests to the point where the application server is no longer taking
on any new requests. When looking at all involved system components (overall
traffic, load db, process list db, load of all clustered application server
nodes) nothing points towards a capacity issue which would explain why the
calls are being stalled in the AJP queue. Instead all systems appear
sufficiently idle.



So far, our only remedy to this issue is to restart the appservers and the
load balancer which only occasionally clears the AJP queues.



We are trying to figure out why the queues are filling up to the point that
no calls get returned to the end user although the system is not under a
high load.



Has anyone else experienced similar problems?

Are there any other system metrics we should monitor that could explain the
queuing behavior?

Is this potentially a mod_jk issue? If so, is it advisable to swap mod_jk
with mod_cluster to resolve the issue?



Any advice is highly appreciated. If I can provide additional information
for the sake of troubleshooting I would be more than willing to do so.



/Ben





*Ben Knight*
System Engineer • Fi



*T:* +1 212 941 5220 / *M:* +1 917 664 0297
ben.kni...@f-i.com / www.f-i.com



This communication is confidential and is only intended for
the use of the individual or entity to which it is directed.
It may contain information that is privileged and exempt from
disclosure under applicable law. If you are not the Intended
recipient, please notify us immediately. You should not copy
it or disclose its content to any other person.