Hello,
I've run into an odd situation where my WebObjects applications
spontaneously restart after running for 16.5 hours regardless of
active sessions or other application activity. I currently have around
18 applications deployed onto 4 different server setups. Not every
application has this problem but I am seeing it on all the different
servers.
When an application restarts, I get the following message in the
application log:
Oct 15 09:29:19 App2[2016] (ERXNSLogLog4jBridge.java:46) DEBUG NSLog
- <com.webobjects.appserver._private.WODefaultAdaptor>: All worker
threads finished processing
Since this message is exactly the same as what I see from a shutdown
through Monitor, I first checked wotaskd's behavior by turning on its
debug logging. Here's the relevant messages from the restart time:
[2010-10-15 09:28:48 EDT] <WorkerThread8> @@@@@ Received Lifebeat:
lifebeat Monitor testweb.local 2001
[2010-10-15 09:28:55 EDT] <WorkerThread3> @@@@@ Received Lifebeat:
lifebeat App1 testweb.local 2017
[2010-10-15 09:29:12 EDT] <WorkerThread0> @@@@@ Received Lifebeat:
lifebeat App2 testweb.local 2016
[2010-10-15 09:29:14 EDT] <main> _checkAutoRecover START
[2010-10-15 09:29:14 EDT] <main> _checkAutoRecover STOP
[2010-10-15 09:29:18 EDT] <WorkerThread8> @@@@@ Received Lifebeat:
lifebeat Monitor testweb.local 2001
[2010-10-15 09:29:19 EDT] <WorkerThread0> @@@@@ Received Lifebeat:
willStop App2 testweb.local 2016
[2010-10-15 09:29:19 EDT] <WorkerThread3> @@@@@ Received Lifebeat:
willStop App1 testweb.local 2017
[2010-10-15 09:29:44 EDT] <main> _checkAutoRecover START
[2010-10-15 09:29:44 EDT] <main> Starting Instance: /System/Library/
WebObjects/JavaApplications/wotaskd.woa/Co
ntents/Resources/SpawnOfWotaskd.sh /Library/WebObjects/Applications/
App2.woa/App2 -WOPort 2016 -WOCach
ingEnabled YES -WODebuggingEnabled NO -WOOutputPath /Library/
WebObjects/Logs/App2-1 -WOAutoOpenInBrows
er NO -WOAutoOpenClientApplication NO -WOLifebeatInterval 30 -
WOLifebeatEnabled YES -WOLifebeatDestinationPort
1085 -WOAdaptor WODefaultAdaptor -WOWorkerThreadCount 8 -
WOListenQueueSize 128 -WOWorkerThreadCountMin 16 -WO
WorkerThreadCountMax 256 -NSProjectSearchPath () -WOSessionTimeOut
3600 -WOApplicationName App2 -WOMonitor
Enabled YES -WONoPause YES -NSDebugLevel 2 -NSDebugGroups 18
[2010-10-15 09:29:44 EDT] <main> Starting Instance: /System/Library/
WebObjects/JavaApplications/wotaskd.woa/Co
ntents/Resources/SpawnOfWotaskd.sh /Library/WebObjects/Applications/
App1.woa/App1 -WOPort 2017 -WOCachingE
nabled YES -WODebuggingEnabled NO -WOOutputPath /Library/WebObjects/
Logs/App1-1 -WOAutoOpenInBrowser NO
-WOAutoOpenClientApplication NO -WOLifebeatInterval 30 -
WOLifebeatEnabled YES -WOLifebeatDestinationPort 1085
-WOAdaptor WODefaultAdaptor -WOWorkerThreadCount 8 -WOListenQueueSize
128 -WOWorkerThreadCountMin 16 -WOWorker
ThreadCountMax 256 -NSProjectSearchPath () -WOSessionTimeOut 3600 -
WOApplicationName App1 -WOMonitorEnabled
YES -WONoPause YES -NSDebugGroups 18
[2010-10-15 09:29:44 EDT] <main> _checkAutoRecover STOP
[2010-10-15 09:29:48 EDT] <WorkerThread8> @@@@@ Received Lifebeat:
lifebeat Monitor testweb.local 2001
[2010-10-15 09:29:52 EDT] <WorkerThread15> @@@@@ Received Lifebeat:
hasStarted App2 testweb.local 2016
[2010-10-15 09:29:52 EDT] <WorkerThread4> @@@@@ Received Lifebeat:
hasStarted App1 testweb.local 2017
My applications do share custom frameworks which points to something
in the code; however, some applications don't have this problem. It
also sometimes comes and goes when I deploy updated versions. There
also seems to be some sort of interaction between the application
restarts; here's a timeline from a test yesterday:
Oct. 14 4:28 pm - App1 restarts
Oct. 14 4:29 pm - App2 restarts
Oct. 14 5:01 pm - I deploy a completely clean rebuild of App2 and
start it. App1 is untouched and continues running.
Oct. 15 8:58 am (16.5 hours after 4:30 pm) - nothing happens
Oct. 15 9:29 am (16.5 hours after 5 pm) - App2 and App1 restart
These applications don't communicate with each other although they do
use the same database.
A couple more details - some of the apps have scheduled restarts on a
daily or weekly basis, all are set to auto-recover. Here's the
development and deployment info:
development: Mac OS X 10.5.8, WebObjects 5.3.3 w/ Project Wonder [this
is a custom install to use WO 5.3 instead of 5.4 on Leopard]
deployment: Mac OS X Server 10.4.10 (1 machine), Mac OS X 10.4.11 (1
machine), Mac OS X Server 10.4.11 (2 machines)
Any ideas?
Thanks,
Catherine
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-deploy mailing list ([email protected])
Help/Unsubscribe/Update your Subscription:
http://lists.apple.com/mailman/options/webobjects-deploy/archive%40mail-archive.com
This email sent to [email protected]
