RE: JRun Clustering problem - Instance keeps "shutting down"
I just poked around my server a bit... Exactly what log file did you past from in the OP. If you have a dedicated IIS box and depending on your OS, I'm not sure if the directories will be the same, but do you have anything useful in these logs: C:\JRun4\lib\wsconfig\wsconfig.log C:\JRun4\lib\wsconfig\1\LogFiles\jrun_iis6_wildcard00.log In the last log, the "1" directory corresponds to the clusters set up in C:\JRun4\lib\wsconfig\wsconfig.properties. I obviously have IIS6, and the number on the end of the file name is auto-incrementing. ~Brad -Original Message- From: Brad Wood [mailto:[EMAIL PROTECTED] Sent: Thursday, February 28, 2008 8:21 AM To: CF-Talk Subject: RE: JRun Clustering problem - Instance keeps "shutting down" Is it possible there is a connectivity issue which is causing the JRun connectors (which are loaded on the IIS box and control load balancing) to think that instance is down? I don't know off the top of my head if there is a log file on the IIS box. ~Brad ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300077 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: JRun Clustering problem - Instance keeps "shutting down"
Is it possible there is a connectivity issue which is causing the JRun connectors (which are loaded on the IIS box and control load balancing) to think that instance is down? I don't know off the top of my head if there is a log file on the IIS box. ~Brad -Original Message- From: James Buckingham [mailto:[EMAIL PROTECTED] Sent: Thursday, February 28, 2008 7:17 AM To: CF-Talk Subject: Re: JRun Clustering problem - Instance keeps "shutting down" Thanks AJ. Is that the "give it a kick" approach :-) We actually had a phase before all this started where IIS stopped processing requests and then "very kindly" jammed up both server instances, stopping the site completely. It wasn't until we restarted it or the server that it would release the other instance. We've not had an IIS-related problem now since the 24th of January so I don't think this is related to that. That and the fact that JRun is actually telling us that it's dropping the instance while IIS shows normal activity. ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300072 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: JRun Clustering problem - Instance keeps "shutting down"
That is probably because the JRun connector loaded in IIS is what divvies up the requests. ~Brad -Original Message- From: AJ Mercer [mailto:[EMAIL PROTECTED] Sent: Thursday, February 28, 2008 6:38 AM To: CF-Talk Subject: Re: JRun Clustering problem - Instance keeps "shutting down" I don't know if it is of any help, but when one of our instances stops receiving any requests, it takes a IIS restart to pick it up again. Bouncing the instance has no effect ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300071 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: JRun Clustering problem - Instance keeps "shutting down"
Thanks AJ. Is that the "give it a kick" approach :-) We actually had a phase before all this started where IIS stopped processing requests and then "very kindly" jammed up both server instances, stopping the site completely. It wasn't until we restarted it or the server that it would release the other instance. We've not had an IIS-related problem now since the 24th of January so I don't think this is related to that. That and the fact that JRun is actually telling us that it's dropping the instance while IIS shows normal activity. Cheers, James >I don't know if it is of any help, but when one of our instances stops >receiving any requests, it takes a IIS restart to pick it up again. > >Bouncing the instance has no effect >On Thu, Feb 28, 2008 at 7:02 PM, James Buckingham <[EMAIL PROTECTED]> >wrote: > >> ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300066 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: JRun Clustering problem - Instance keeps "shutting down"
Thanks AJ. Is that the "give it a kick" approach :-) We actually had a phase before all this started where IIS stopped processing requests and then "very kindly" jammed up both server instances, stopping the site completely. It wasn't until we restarted it or the server that it would release the other instance. We've not had an IIS-related problem now since the 24th of January so I don't think this is related to that. That and the fact that JRun is actually telling us that it's dropping the instance while IIS shows normal activity. ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300065 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: JRun Clustering problem - Instance keeps "shutting down"
I don't know if it is of any help, but when one of our instances stops receiving any requests, it takes a IIS restart to pick it up again. Bouncing the instance has no effect On Thu, Feb 28, 2008 at 7:02 PM, James Buckingham <[EMAIL PROTECTED]> wrote: > Hi there, > > We've been having a lot of problems recently with one of our Cluster > instances whereby it keeps either shutting itself down or starts to reject > threads. There isn't a set pattern to when this happens but it is only > happening on one instance (we have four in total separated 50/50 on two > servers). > > When JRun starts rejecting requests we're seeing this kind of thing in the > logs: > > 27/02 10:44:01 metrics Web threads (busy/total): 0/10 Sessions: 4520 Total > Memory=65472 Free=8732 > 27/02 10:45:01 metrics Web threads (busy/total): 0/11 Sessions: 4515 Total > Memory=56320 Free=8533 > 27/02 10:46:01 metrics Web threads (busy/total): 1/10 Sessions: 4512 Total > Memory=57600 Free=7505 > 27/02 10:47:01 metrics Web threads (busy/total): 0/10 Sessions: 4518 Total > Memory=57920 Free=6622 > 27/02 10:48:01 metrics Web threads (busy/total): 1/10 Sessions: 4503 Total > Memory=57216 Free=9725 > 27/02 10:49:01 metrics Web threads (busy/total): 0/10 Sessions: 4501 Total > Memory=54976 Free=7224 > 27/02 10:50:01 metrics Web threads (busy/total): 0/9 Sessions: 4431 Total > Memory=61376 Free=12289 > 27/02 10:50:41 info Clusterable service JRunProxyClusterHelper > successfully removed a peer when that peer left the cluster > 27/02 10:51:01 metrics Web threads (busy/total): 0/9 Sessions: 4413 Total > Memory=56832 Free=11473 > 27/02 10:52:01 metrics Web threads (busy/total): 0/9 Sessions: 4377 Total > Memory=56064 Free=11637 > 27/02 10:53:01 metrics Web threads (busy/total): 0/9 Sessions: 4341 Total > Memory=53504 Free=11657 > 27/02 10:54:02 metrics Web threads (busy/total): 0/9 Sessions: 4300 Total > Memory=53568 Free=11636 > 27/02 10:55:02 metrics Web threads (busy/total): 0/9 Sessions: 4263 Total > Memory=53568 Free=11543 > 27/02 10:56:02 metrics Web threads (busy/total): 0/1 Sessions: 4213 Total > Memory=53504 Free=11598 > 27/02 10:57:02 metrics Web threads (busy/total): 0/1 Sessions: 4173 Total > Memory=52544 Free=11585 > 27/02 10:58:02 metrics Web threads (busy/total): 0/1 Sessions: 4132 Total > Memory=52608 Free=11501 > 27/02 10:59:02 metrics Web threads (busy/total): 0/1 Sessions: 4089 Total > Memory=52608 Free=11370 > 27/02 11:00:02 metrics Web threads (busy/total): 0/1 Sessions: 4051 Total > Memory=52608 Free=11454 > 27/02 11:01:02 metrics Web threads (busy/total): 0/1 Sessions: 4014 Total > Memory=52096 Free=11537 > 27/02 11:02:02 metrics Web threads (busy/total): 0/1 Sessions: 3967 Total > Memory=52096 Free=11190 > > .so note that JRun rejects the instance from the cluster but the logs > carry on. Also note that the Web Threads just carry on as 0/1 until the > instance is started up again. The frequency of this has started to increase > and we're now getting this at least once a day. > > The server is a virtual machine, Win Server 2003, CF7.0 with multiserver > JRun. We have it setup on Round Robin with sticky sessions. > > Just to give you a breakdown on what we've tried already > > The problem started on the 29th of Jan this year and looking at our logs > nothing has changed on or around this time apart from an upgrade to our > backup software on the other "working" server. So I wouldn't expect this to > effect the one that is now faulty. > > We started to add Hotfixes to the server on the 5th of Feb but this hasn't > resolved the problem. These included JRun Updater 7 and CF HotFix 3 which > had stability fixes for clustering. This was applied to both servers. > > Checking logs in IIS I'm not seeing anything abnormal. > > We've compared the setup of the failing instance to the other server > instance and apart from a few unique configuration settings both are > identifical in JRun. We are considering the option of rebuilding the > instance using the working one but to be honest that drawing at straws. > > Has anybody else had a similar kind of problem or can think of any other > ideas as to what might be causing this. > > Your help would be appreciated and if there is anymore information you > need please let me know. > > Cheers, > James > > ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300064 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
JRun Clustering problem - Instance keeps "shutting down"
Hi there, We've been having a lot of problems recently with one of our Cluster instances whereby it keeps either shutting itself down or starts to reject threads. There isn't a set pattern to when this happens but it is only happening on one instance (we have four in total separated 50/50 on two servers). When JRun starts rejecting requests we're seeing this kind of thing in the logs: 27/02 10:44:01 metrics Web threads (busy/total): 0/10 Sessions: 4520 Total Memory=65472 Free=8732 27/02 10:45:01 metrics Web threads (busy/total): 0/11 Sessions: 4515 Total Memory=56320 Free=8533 27/02 10:46:01 metrics Web threads (busy/total): 1/10 Sessions: 4512 Total Memory=57600 Free=7505 27/02 10:47:01 metrics Web threads (busy/total): 0/10 Sessions: 4518 Total Memory=57920 Free=6622 27/02 10:48:01 metrics Web threads (busy/total): 1/10 Sessions: 4503 Total Memory=57216 Free=9725 27/02 10:49:01 metrics Web threads (busy/total): 0/10 Sessions: 4501 Total Memory=54976 Free=7224 27/02 10:50:01 metrics Web threads (busy/total): 0/9 Sessions: 4431 Total Memory=61376 Free=12289 27/02 10:50:41 info Clusterable service JRunProxyClusterHelper successfully removed a peer when that peer left the cluster 27/02 10:51:01 metrics Web threads (busy/total): 0/9 Sessions: 4413 Total Memory=56832 Free=11473 27/02 10:52:01 metrics Web threads (busy/total): 0/9 Sessions: 4377 Total Memory=56064 Free=11637 27/02 10:53:01 metrics Web threads (busy/total): 0/9 Sessions: 4341 Total Memory=53504 Free=11657 27/02 10:54:02 metrics Web threads (busy/total): 0/9 Sessions: 4300 Total Memory=53568 Free=11636 27/02 10:55:02 metrics Web threads (busy/total): 0/9 Sessions: 4263 Total Memory=53568 Free=11543 27/02 10:56:02 metrics Web threads (busy/total): 0/1 Sessions: 4213 Total Memory=53504 Free=11598 27/02 10:57:02 metrics Web threads (busy/total): 0/1 Sessions: 4173 Total Memory=52544 Free=11585 27/02 10:58:02 metrics Web threads (busy/total): 0/1 Sessions: 4132 Total Memory=52608 Free=11501 27/02 10:59:02 metrics Web threads (busy/total): 0/1 Sessions: 4089 Total Memory=52608 Free=11370 27/02 11:00:02 metrics Web threads (busy/total): 0/1 Sessions: 4051 Total Memory=52608 Free=11454 27/02 11:01:02 metrics Web threads (busy/total): 0/1 Sessions: 4014 Total Memory=52096 Free=11537 27/02 11:02:02 metrics Web threads (busy/total): 0/1 Sessions: 3967 Total Memory=52096 Free=11190 .so note that JRun rejects the instance from the cluster but the logs carry on. Also note that the Web Threads just carry on as 0/1 until the instance is started up again. The frequency of this has started to increase and we're now getting this at least once a day. The server is a virtual machine, Win Server 2003, CF7.0 with multiserver JRun. We have it setup on Round Robin with sticky sessions. Just to give you a breakdown on what we've tried already The problem started on the 29th of Jan this year and looking at our logs nothing has changed on or around this time apart from an upgrade to our backup software on the other "working" server. So I wouldn't expect this to effect the one that is now faulty. We started to add Hotfixes to the server on the 5th of Feb but this hasn't resolved the problem. These included JRun Updater 7 and CF HotFix 3 which had stability fixes for clustering. This was applied to both servers. Checking logs in IIS I'm not seeing anything abnormal. We've compared the setup of the failing instance to the other server instance and apart from a few unique configuration settings both are identifical in JRun. We are considering the option of rebuilding the instance using the working one but to be honest that drawing at straws. Has anybody else had a similar kind of problem or can think of any other ideas as to what might be causing this. Your help would be appreciated and if there is anymore information you need please let me know. Cheers, James ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300055 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
JRun Clustering problem - Instance keeps "shutting down"
Hi there, We've been having a lot of problems recently with one of our Cluster instances whereby it keeps either shutting itself down or starts to reject threads. There isn't a set pattern to when this happens but it is only happening on one instance (we have four in total separated 50/50 on two servers). When JRun starts rejecting requests we're seeing this kind of thing in the logs: 27/02 10:44:01 metrics Web threads (busy/total): 0/10 Sessions: 4520 Total Memory=65472 Free=8732 27/02 10:45:01 metrics Web threads (busy/total): 0/11 Sessions: 4515 Total Memory=56320 Free=8533 27/02 10:46:01 metrics Web threads (busy/total): 1/10 Sessions: 4512 Total Memory=57600 Free=7505 27/02 10:47:01 metrics Web threads (busy/total): 0/10 Sessions: 4518 Total Memory=57920 Free=6622 27/02 10:48:01 metrics Web threads (busy/total): 1/10 Sessions: 4503 Total Memory=57216 Free=9725 27/02 10:49:01 metrics Web threads (busy/total): 0/10 Sessions: 4501 Total Memory=54976 Free=7224 27/02 10:50:01 metrics Web threads (busy/total): 0/9 Sessions: 4431 Total Memory=61376 Free=12289 27/02 10:50:41 info Clusterable service JRunProxyClusterHelper successfully removed a peer when that peer left the cluster 27/02 10:51:01 metrics Web threads (busy/total): 0/9 Sessions: 4413 Total Memory=56832 Free=11473 27/02 10:52:01 metrics Web threads (busy/total): 0/9 Sessions: 4377 Total Memory=56064 Free=11637 27/02 10:53:01 metrics Web threads (busy/total): 0/9 Sessions: 4341 Total Memory=53504 Free=11657 27/02 10:54:02 metrics Web threads (busy/total): 0/9 Sessions: 4300 Total Memory=53568 Free=11636 27/02 10:55:02 metrics Web threads (busy/total): 0/9 Sessions: 4263 Total Memory=53568 Free=11543 27/02 10:56:02 metrics Web threads (busy/total): 0/1 Sessions: 4213 Total Memory=53504 Free=11598 27/02 10:57:02 metrics Web threads (busy/total): 0/1 Sessions: 4173 Total Memory=52544 Free=11585 27/02 10:58:02 metrics Web threads (busy/total): 0/1 Sessions: 4132 Total Memory=52608 Free=11501 27/02 10:59:02 metrics Web threads (busy/total): 0/1 Sessions: 4089 Total Memory=52608 Free=11370 27/02 11:00:02 metrics Web threads (busy/total): 0/1 Sessions: 4051 Total Memory=52608 Free=11454 27/02 11:01:02 metrics Web threads (busy/total): 0/1 Sessions: 4014 Total Memory=52096 Free=11537 27/02 11:02:02 metrics Web threads (busy/total): 0/1 Sessions: 3967 Total Memory=52096 Free=11190 .so note that JRun rejects the instance from the cluster but the logs carry on. Also note that the Web Threads just carry on as 0/1 until the instance is started up again. The frequency of this has started to increase and we're now getting this at least once a day. The server is a virtual machine, Win Server 2003, CF7.0 with multiserver JRun. We have it setup on Round Robin with sticky sessions. Just to give you a breakdown on what we've tried already The problem started on the 29th of Jan this year and looking at our logs nothing has changed on or around this time apart from an upgrade to our backup software on the other "working" server. So I wouldn't expect this to effect the one that is now faulty. We started to add Hotfixes to the server on the 5th of Feb but this hasn't resolved the problem. These included JRun Updater 7 and CF HotFix 3 which had stability fixes for clustering. This was applied to both servers. Checking logs in IIS I'm not seeing anything abnormal. We've compared the setup of the failing instance to the other server instance and apart from a few unique configuration settings both are identifical in JRun. We are considering the option of rebuilding the instance using the working one but to be honest that drawing at straws. Has anybody else had a similar kind of problem or can think of any other ideas as to what might be causing this. Your help would be appreciated and if there is anymore information you need please let me know. Cheers, James ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;160198600;22374440;w Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:300056 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
