Re: Intermittent JSP Caching/Compiling Issue while under load

2019-12-05 Thread Mark Thomas
On 05/12/2019 19:17, Tim K wrote: > Was the fix for this added to 9.0.28 or 9.0.29 official releases? 9.0.28 but it triggered multiple regressions that will be fixed in 9.0.30. Mark - To unsubscribe, e-mail:

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-12-05 Thread Tim K
Was the fix for this added to 9.0.28 or 9.0.29 official releases? Thanks, Tim

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-08 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Mark, On 11/7/19 11:43, Mark Thomas wrote: >> Mark, >> >> On 11/7/19 06:40, Mark Thomas wrote: >>> On 06/11/2019 20:04, Mark Thomas wrote: I've found the root cause. When checking the timestamps of JSPs, the JSP engine (because

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Tim K
On Thu, Nov 7, 2019, 1:58 PM Mark Thomas wrote: > On 07/11/2019 18:04, Mark Thomas wrote: > > On 07/11/2019 16:44, Mark Thomas wrote: > >> On 07/11/2019 14:14, Tim K wrote: > >> > >> > >>> I pulled the latest code from GitHub, I see the commit related to this > >>> email thread in the log, I

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Mark Thomas
On 07/11/2019 18:04, Mark Thomas wrote: > On 07/11/2019 16:44, Mark Thomas wrote: >> On 07/11/2019 14:14, Tim K wrote: >> >> >>> I pulled the latest code from GitHub, I see the commit related to this >>> email thread in the log, I built from master with ant (9.0.28-dev) >> >> Thanks. This is

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Mark Thomas
On 07/11/2019 16:44, Mark Thomas wrote: > On 07/11/2019 14:14, Tim K wrote: > > >> I pulled the latest code from GitHub, I see the commit related to this >> email thread in the log, I built from master with ant (9.0.28-dev) > > Thanks. This is really helpful. > >> and I'm >> still experiencing

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Mark Thomas
On 07/11/2019 14:14, Tim K wrote: > I pulled the latest code from GitHub, I see the commit related to this > email thread in the log, I built from master with ant (9.0.28-dev) Thanks. This is really helpful. > and I'm > still experiencing the issue... I have a curl command executing every >

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Mark Thomas
> Mark, > > On 11/7/19 06:40, Mark Thomas wrote: >> On 06/11/2019 20:04, Mark Thomas wrote: >>> I've found the root cause. >>> >>> When checking the timestamps of JSPs, the JSP engine (because it >>> has to access all resources via the Servlet API) requests a URL >>> for the JSP, opens a

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Tim K
On Thu, Nov 7, 2019, 6:40 AM Mark Thomas wrote: > On 06/11/2019 20:04, Mark Thomas wrote: > > I've found the root cause. > > > > When checking the timestamps of JSPs, the JSP engine (because it has to > > access all resources via the Servlet API) requests a URL for the JSP, > > opens a

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Mark, On 11/7/19 06:40, Mark Thomas wrote: > On 06/11/2019 20:04, Mark Thomas wrote: >> I've found the root cause. >> >> When checking the timestamps of JSPs, the JSP engine (because it >> has to access all resources via the Servlet API) requests

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-07 Thread Mark Thomas
On 06/11/2019 20:04, Mark Thomas wrote: > I've found the root cause. > > When checking the timestamps of JSPs, the JSP engine (because it has to > access all resources via the Servlet API) requests a URL for the JSP, > opens a connection to the URL and then checks the last modified time. > This

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-06 Thread Mark Thomas
I've found the root cause. When checking the timestamps of JSPs, the JSP engine (because it has to access all resources via the Servlet API) requests a URL for the JSP, opens a connection to the URL and then checks the last modified time. This goes directly to the on-disk file. When reading the

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-05 Thread Tim K
On Tue, Nov 5, 2019 at 3:01 AM Mark Thomas wrote: > This looks like some sort of concurrency issue. In your test > environment, how likely is it that: > - there are concurrent (or at least very close together) changes to a > JSP > - that there are concurrent requests for a modified JSP? In my

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-05 Thread Mark Thomas
On 05/11/2019 02:51, Tim K wrote: > The cached JSP actually survives a tomcat restart because the work > directory still contains the cached JSP content even though the timestamp > of the class/java files appear to match that of the latest JSP file's > content. Ah. That is useful new

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Tim K
On Mon, Nov 4, 2019, 6:19 PM M. Manna wrote: > I’m just trying to understand, is there really a plausible solution here ? > Unless we have loadbalanced tomcat instances, can we truly ever stop such > behaviour (or more importantly, does it make sense to do so)? > > For my use case, We do it in

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread M. Manna
I’m just trying to understand, is there really a plausible solution here ? Unless we have loadbalanced tomcat instances, can we truly ever stop such behaviour (or more importantly, does it make sense to do so)? For my use case, We do it in production almost every other day for patching, but we do

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Alex O'Ree
Sounds a lot like the issue I reported a few months ago On Mon, Nov 4, 2019, 3:12 PM Tim K wrote: > On Mon, Nov 4, 2019, 10:30 AM Mark Thomas wrote: > > > > > Thanks. That helps as it means the issue should be reproducible on a > > single, stand-alone instance. > > > > Mark > > > > I was

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Tim K
On Mon, Nov 4, 2019, 10:30 AM Mark Thomas wrote: > > Thanks. That helps as it means the issue should be reproducible on a > single, stand-alone instance. > > Mark > I was able to reproduce this behavior with a single server running a vanilla 9.0.21 using the example hello.jsp file... I was

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Mark, On 11/4/19 11:56, Mark Thomas wrote: > On 04/11/2019 15:30, Mark Thomas wrote: >> On 04/11/2019 15:11, Tim K wrote: >>> On Mon, Nov 4, 2019, 10:06 AM Mark Thomas >>> wrote: >>> How are you distributing the updates to the JSP to

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Mark Thomas
On 04/11/2019 15:30, Mark Thomas wrote: > On 04/11/2019 15:11, Tim K wrote: >> On Mon, Nov 4, 2019, 10:06 AM Mark Thomas wrote: >> >>> >>> How are you distributing the updates to the JSP to all 4 servers? >>> >>> Is there a shared file system involved? If yes, exactly what is shared >>> between

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Mark Thomas
On 04/11/2019 15:11, Tim K wrote: > On Mon, Nov 4, 2019, 10:06 AM Mark Thomas wrote: > >> >> How are you distributing the updates to the JSP to all 4 servers? >> >> Is there a shared file system involved? If yes, exactly what is shared >> between the instances? >> >> Mark >> > > Common NFS

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Tim K
On Mon, Nov 4, 2019, 10:06 AM Mark Thomas wrote: > > How are you distributing the updates to the JSP to all 4 servers? > > Is there a shared file system involved? If yes, exactly what is shared > between the instances? > > Mark > Common NFS storage included via (DirResourceSet) within the of

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Mark Thomas
On 04/11/2019 13:55, Tim K wrote: >> >> In my tests when hitting it every second, I make a few changes and it >> works fine (all within the same min). Then I'll let it go for a few mins, >> make a change and more often than not, one or more of the servers gets >> stuck on the previous jsp

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-04 Thread Tim K
> > In my tests when hitting it every second, I make a few changes and it > works fine (all within the same min). Then I'll let it go for a few mins, > make a change and more often than not, one or more of the servers gets > stuck on the previous jsp change... I'm pretty sure the class/java >

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-03 Thread Tim K
On Fri, Nov 1, 2019, 3:11 AM Mark Thomas wrote: > On 31/10/2019 22:07, Mark Thomas wrote: > > > > > > On 29/10/2019 14:31, Tim K wrote: > >> I'm on Tomcat 9.0.21 on Linux. I have Jsps that get updated while > >> Tomcat is running. I believe development mode is set to true by > >> default, I do

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-11-01 Thread Mark Thomas
On 31/10/2019 22:07, Mark Thomas wrote: > > > On 29/10/2019 14:31, Tim K wrote: >> I'm on Tomcat 9.0.21 on Linux. I have Jsps that get updated while >> Tomcat is running. I believe development mode is set to true by >> default, I do not have it set to true or false in the >>

Re: Intermittent JSP Caching/Compiling Issue while under load

2019-10-31 Thread Mark Thomas
On 29/10/2019 14:31, Tim K wrote: > I'm on Tomcat 9.0.21 on Linux. I have Jsps that get updated while > Tomcat is running. I believe development mode is set to true by > default, I do not have it set to true or false in the > $CATALINA_BASE/conf/web.xml for the Jsp servlet init-params. I

Intermittent JSP Caching/Compiling Issue while under load

2019-10-29 Thread Tim K
I'm on Tomcat 9.0.21 on Linux. I have Jsps that get updated while Tomcat is running. I believe development mode is set to true by default, I do not have it set to true or false in the $CATALINA_BASE/conf/web.xml for the Jsp servlet init-params. I have a cluster of 4-8 servers across different