RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Eric Robinson
Chris, > -Original Message- > From: Christopher Schultz > Sent: Friday, May 31, 2024 12:50 PM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Eric, > > On 5/31/24 13:44, Eric Robinson wrote: > >>

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Terence M. Bandoian
On 5/31/2024 11:44 AM, Mark Thomas wrote: On 31/05/2024 16:09, Eric Robinson wrote: The results are looking great so far. Excellent. Here's what we know: Before the patch, we had 2 load-balanced tomcats in production for this customer. Due to the driver search bottleneck, we were seeing

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Christopher Schultz
Eric, On 5/31/24 13:44, Eric Robinson wrote: -Original Message- From: Christopher Schultz Sent: Friday, May 31, 2024 12:38 PM To: users@tomcat.apache.org Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All) Mark, On 5/31/24 12:44, Mark Thomas

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Eric Robinson
> -Original Message- > From: Christopher Schultz > Sent: Friday, May 31, 2024 12:38 PM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Mark, > > On 5/31/24 12:44, Mark Thomas wrote: > > On 31/05/2024 16:09,

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Christopher Schultz
Mark, On 5/31/24 12:44, Mark Thomas wrote: On 31/05/2024 16:09, Eric Robinson wrote: The results are looking great so far. Excellent. Here's what we know: Before the patch, we had 2 load-balanced tomcats in production for this customer. Due to the driver search bottleneck, we were seeing

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Christopher Schultz
Eric, On 5/31/24 11:09, Eric Robinson wrote: The results are looking great so far. Here's what we know: Before the patch, we had 2 load-balanced tomcats in production for this customer. Due to the driver search bottleneck, we were seeing hundreds of stuck threads during the slowdown

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Eric Robinson
> -Original Message- > From: Mark Thomas > Sent: Friday, May 31, 2024 11:45 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > On 31/05/2024 16:09, Eric Robinson wrote: > > The results are looking great so

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Mark Thomas
On 31/05/2024 16:09, Eric Robinson wrote: The results are looking great so far. Excellent. Here's what we know: Before the patch, we had 2 load-balanced tomcats in production for this customer. Due to the driver search bottleneck, we were seeing hundreds of stuck threads during the

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Eric Robinson
The results are looking great so far. Here's what we know: Before the patch, we had 2 load-balanced tomcats in production for this customer. Due to the driver search bottleneck, we were seeing hundreds of stuck threads during the slowdown periods. To work around this problem, we threw more

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-31 Thread Eric Robinson
Mark, > -Original Message- > From: Mark Thomas > Sent: Thursday, May 30, 2024 9:30 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > OK. > > This is an interim binary patch for 9.0.80 only. > > The

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-30 Thread Eric Robinson
Hi Mark, > -Original Message- > From: Mark Thomas > Sent: Thursday, May 30, 2024 9:30 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > OK. > > This is an interim binary patch for 9.0.80 only. > > The

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-30 Thread Konstantin Kolinko
ср, 29 мая 2024 г. в 13:34, Mark Thomas : > > > > It is also problem number 3. The reason it is expensive is that class > loaders don't cache misses so if a web application has a large number of > JARs, they all get scanned every time the DriverManager tries to create > a new connection. > > > The

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-30 Thread Mark Thomas
OK. This is an interim binary patch for 9.0.80 only. The purpose is to: - confirm the proposed change fixes the problem - provide you with a workaround in the short term This is the binary patch: https://people.apache.org/~markt/dev/classloader-not-found-cache-9.0.80-v1.zip Extract the

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-30 Thread Christopher Schultz
Eric, On 5/29/24 12:10, Eric Robinson wrote: -Original Message- From: Mark Thomas Sent: Wednesday, May 29, 2024 10:19 AM To: users@tomcat.apache.org Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All) On 29/05/2024 16:08, Eric Robinson wrote:

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-30 Thread Mark Thomas
On 29/05/2024 17:03, Eric Robinson wrote: One of the webapps is related to voice reminder messages that go out to people. The reminders go out sometime after 9 am, which tracks with the slowdowns. Ack. Something to try while I work on a patch is setting archiveIndexStrategy="bloom" on

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Eric Robinson
> -Original Message- > From: Mark Thomas > Sent: Wednesday, May 29, 2024 10:19 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > On 29/05/2024 16:08, Eric Robinson wrote: > > > I believe your assessment

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Eric Robinson
Hi Mark, > -Original Message- > From: Mark Thomas > Sent: Wednesday, May 29, 2024 10:10 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > On 29/05/2024 13:38, Eric Robinson wrote: > >> -Original

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Mark Thomas
On 29/05/2024 16:08, Eric Robinson wrote: I believe your assessment is correct. How hard is it to enable pooling? Can it be bolted on, so to speak, through changes to the app context, such that the webapp itself does not necessarily need to implement special code? It looks like - from the

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Mark Thomas
On 29/05/2024 13:38, Eric Robinson wrote: -Original Message- From: Mark Thomas I intend to wok on a patch for Tomcat that will add caching that should speed things up considerably. I hope to have something for Eric to test today but it might take me until tomorrow as I have a few

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Eric Robinson
Mark, A few other thoughts come to mind. See below. > -Original Message- > From: Eric Robinson > Sent: Wednesday, May 29, 2024 7:39 AM > To: Tomcat Users List > Subject: RE: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Hi Mark, > > > >

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Eric Robinson
Hi Mark, > -Original Message- > From: Mark Thomas > Sent: Wednesday, May 29, 2024 5:35 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > On 29/05/2024 10:26, Mark Thomas wrote: > > On 28/05/2024 16:26,

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Mark Thomas
On 29/05/2024 10:26, Mark Thomas wrote: On 28/05/2024 16:26, Eric Robinson wrote: Took a bunch of thread and heap dumps during today's painful debacle. Will send a link to those as soon as I can. Thanks. I have them. I have taken a look and I am starting to form a theory. To help with

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-29 Thread Mark Thomas
On 28/05/2024 16:26, Eric Robinson wrote: Took a bunch of thread and heap dumps during today's painful debacle. Will send a link to those as soon as I can. Thanks. I have them. I have taken a look and I am starting to form a theory. To help with that I have a couple of questions. 1.

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-28 Thread Eric Robinson
Hi Mark, See comments below. > -Original Message- > From: Mark Thomas > Sent: Tuesday, May 28, 2024 9:32 AM > To: Tomcat Users List > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Hi Eric, > > Follow-up observsations and comments

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-28 Thread Mark Thomas
Hi Eric, Follow-up observsations and comments in-line. What time does this problem start? It typically starts around 9:15 am EDT and goes until around 10:30 am. Does that match the time of highest request load from the customer? Rather than a spike, I'm wondering if the problem is

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-28 Thread Eric Robinson
Hi Mark, > -Original Message- > From: Mark Thomas > Sent: Tuesday, May 28, 2024 3:42 AM > To: users@tomcat.apache.org > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Hi Eric, > > I have a some follow-up questions in-line. I have also

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-28 Thread Mark Thomas
Hi Eric, I have a some follow-up questions in-line. I have also read the other messages in this thread and added a couple of additional questions based on what I read in those threads. On 26/05/2024 02:58, Eric Robinson wrote: One of our hosting customers is a medical practice using a

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-26 Thread Eric Robinson
Hi Chuck, > -Original Message- > From: Chuck Caldarale > Sent: Sunday, May 26, 2024 2:21 PM > To: Tomcat Users List > Subject: Re: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > > > On May 25, 2024, at 20:58, Eric Robinson wrote: > > > > One of

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-26 Thread Eric Robinson
Hi Thomas, > -Original Message- > From: Thomas Hoffmann (Speed4Trade GmbH) > > Sent: Sunday, May 26, 2024 3:30 PM > To: Tomcat Users List > Subject: AW: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Hello, > > > -Ursprüngliche Nachricht-

Re: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-26 Thread Chuck Caldarale
> On May 25, 2024, at 20:58, Eric Robinson wrote: > > One of our hosting customers is a medical practice using a commercial EMR > running on tomcat+mysql. It has operated well for over a year, but users have > suddenly begun experiencing slowness for about an hour at the same time every >

RE: Database Connection Requests Initiated but Not Sent on the Wire (Some, Not All)

2024-05-26 Thread Eric Robinson
Hi Thomas, > -Original Message- > From: Thomas Hoffmann (Speed4Trade GmbH) > > Sent: Sunday, May 26, 2024 2:52 AM > To: Tomcat Users List > Subject: AW: Database Connection Requests Initiated but Not Sent on the Wire > (Some, Not All) > > Hello Eric, > > > -Ursprüngliche