I'd add Miguel/Paulo's code to your dispatchRequest method in
Application. That would at least isolate whether this is a bug in
your request handling, or a bug in a background thread. If it is a
bug in request handling (component or DA etc), then it will show you
which thread caused this. If you have decent logging, that should
isolate the code at the rood of this. If it is a bug in a background
thread, well you might want to consider goats. Though I think you
could adapt this code to your threads as well.
Chuck
On Oct 8, 2009, at 8:52 AM, Kieran Kelleher wrote:
On Oct 7, 2009, at 7:46 PM, Chuck Hill wrote:
Ah geez, the Irish are at it again... :-P
I guess we must do whatever we have to to engage the Canadians in a
conversation :-)
On Oct 7, 2009, at 1:06 PM, Kieran Kelleher wrote:
Here is an interesting deadlock I got today. I know some of you
like to comment on deadlocks
You looking at me?
Yes, you, Anjo, Mike and all others who like WO challenges :-)
Thread t...@81411: (state = BLOCKED)
- java.lang.Object.wait(long) @bci=0 (Compiled frame; information
may be imprecise)
- java.lang.Object.wait() @bci=2, line=474 (Compiled frame)
- com.webobjects.eoaccess.EODatabaseContext.lock() @bci=56,
line=1973 (Compiled frame)
Obviously affected (blocked). I an wondering why it is doing this
now:
And looking at that via jad makes me none the wiser either....
-
com
.webobjects
.eocontrol
.EOObjectStoreCoordinator
.addCooperatingObjectStore
(com.webobjects.eocontrol.EOCooperatingObjectStore) @bci=5,
line=130 (Compiled frame)
-
com
.webobjects
.eoaccess
.EODatabaseChannel
.setCurrentEditingContext
(com.webobjects.eocontrol.EOEditingContext) @bci=34, line=166
(Compiled frame)
-
com
.webobjects
.eoaccess
.EODatabaseChannel
._selectWithFetchSpecificationEditingContext
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=158, line=788
(Compiled frame)
-
com
.webobjects
.eoaccess
.EODatabaseChannel
.selectObjectsWithFetchSpecification
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=64, line=215
(Compiled frame)
-
com
.webobjects
.eoaccess
.EODatabaseContext
._objectsWithFetchSpecificationEditingContext
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=219, line=3205
(Compiled frame)
-
com
.webobjects
.eoaccess
.EODatabaseContext
.objectsWithFetchSpecification
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=34, line=3346
(Compiled frame)
-
com
.webobjects
.eocontrol
.EOObjectStoreCoordinator
.objectsWithFetchSpecification
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=97, line=539
(Compiled frame)
-
com
.webobjects
.eocontrol
.EOEditingContext
.objectsWithFetchSpecification
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=79, line=4114
(Compiled frame)
-
er
.extensions
.eof
.ERXEC
.objectsWithFetchSpecification
(com.webobjects.eocontrol.EOFetchSpecification,
com.webobjects.eocontrol.EOEditingContext) @bci=68, line=1189
(Compiled frame)
-
com
.webobjects
.eocontrol
.EOEditingContext
.objectsWithFetchSpecification
(com.webobjects.eocontrol.EOFetchSpecification) @bci=3, line=4500
(Compiled frame)
- wk.cheetah.eof.ProgramBehaviour
$
Utilities
.hasAllTemplatesApprovedAndValid(wk.cheetah.eof.CTProgram) @bci=5,
line=130 (Compiled frame)
- wk.cheetah.eof.ProgramBehaviour
$Utilities.doesRequireAttention(wk.cheetah.eof.CTProgram) @bci=15,
line=120 (Compiled frame)
-
wk
.cheetah.eof.JobsiteRadiusProgramBehaviour.doesRequireAttention()
@bci=4, line=148 (Compiled frame)
- wk.cheetah.eof.CTProgram.doesRequireAttention() @bci=4, line=425
(Compiled frame)
-
sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object,
java.lang.Object[]) @bci=6, line=25 (Compiled frame)
- java.lang.reflect.Method.invoke(java.lang.Object,
java.lang.Object[]) @bci=111, line=585 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding$ValueAccessor
$1.methodValue(java.lang.Object, java.lang.reflect.Method) @bci=3,
line=684 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$_MethodBinding.valueInObject(java.lang.Object) @bci=9, line=1160
(Compiled frame)
-
com
.webobjects.eocontrol.EOCustomObject.valueForKey(java.lang.String)
@bci=14, line=1559 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$Utility.valueForKey(java.lang.Object, java.lang.String) @bci=26,
line=498 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$DefaultImplementation.valueForKeyPath(java.lang.Object,
java.lang.String) @bci=19, line=212 (Compiled frame)
-
com
.webobjects
.eocontrol.EOCustomObject.valueForKeyPath(java.lang.String)
@bci=2, line=1675 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$Utility.valueForKeyPath(java.lang.Object, java.lang.String)
@bci=26, line=149 (Compiled frame)
-
com
.webobjects
.eocontrol
.EOKeyValueQualifier.evaluateWithObject(java.lang.Object) @bci=5,
line=131 (Compiled frame)
-
com
.webobjects
.eocontrol
.EOQualifier
.filteredArrayWithQualifier(com.webobjects.foundation.NSArray,
com.webobjects.eocontrol.EOQualifier) @bci=55, line=635 (Compiled
frame)
- wk.cheetah.eof.CTLocation.requiresAttentionPrograms() @bci=22,
line=376 (Compiled frame)
-
sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object,
java.lang.Object[]) @bci=6, line=25 (Compiled frame)
- java.lang.reflect.Method.invoke(java.lang.Object,
java.lang.Object[]) @bci=111, line=585 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding$ValueAccessor
$1.methodValue(java.lang.Object, java.lang.reflect.Method) @bci=3,
line=684 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$_MethodBinding.valueInObject(java.lang.Object) @bci=9, line=1160
(Compiled frame)
-
com
.webobjects.eocontrol.EOCustomObject.valueForKey(java.lang.String)
@bci=14, line=1559 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$Utility.valueForKey(java.lang.Object, java.lang.String) @bci=26,
line=498 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$DefaultImplementation.valueForKeyPath(java.lang.Object,
java.lang.String) @bci=32, line=216 (Compiled frame)
-
com
.webobjects
.eocontrol.EOCustomObject.valueForKeyPath(java.lang.String)
@bci=2, line=1675 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$Utility.valueForKeyPath(java.lang.Object, java.lang.String)
@bci=26, line=149 (Compiled frame)
- com.webobjects.foundation.NSArray
$_Operator._operationValue(java.lang.Object, java.lang.String)
@bci=17, line=79 (Compiled frame)
- com.webobjects.foundation.NSArray
$_SumNumberOperator.compute(com.webobjects.foundation.NSArray,
java.lang.String) @bci=3, line=46 (Compiled frame)
-
com
.webobjects
.foundation.NSArray._valueForKeyPathWithOperator(java.lang.String)
@bci=71, line=744 (Compiled frame)
-
com
.webobjects.foundation.NSArray.valueForKeyPath(java.lang.String)
@bci=16, line=778 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$Utility.valueForKeyPath(java.lang.Object, java.lang.String)
@bci=26, line=149 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$DefaultImplementation.valueForKeyPath(java.lang.Object,
java.lang.String) @bci=52, line=217 (Compiled frame)
-
com
.webobjects
.eocontrol.EOCustomObject.valueForKeyPath(java.lang.String)
@bci=2, line=1675 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$Utility.valueForKeyPath(java.lang.Object, java.lang.String)
@bci=26, line=149 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$DefaultImplementation.valueForKeyPath(java.lang.Object,
java.lang.String) @bci=52, line=217 (Compiled frame)
-
com
.webobjects
.appserver.WOComponent.valueForKeyPath(java.lang.String) @bci=2,
line=1600 (Compiled frame)
-
com
.webobjects
.appserver.WOComponent.valueForBinding(java.lang.String) @bci=22,
line=735 (Compiled frame)
- sun.reflect.GeneratedMethodAccessor261.invoke(java.lang.Object,
java.lang.Object[]) @bci=36 (Compiled frame)
-
sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object,
java.lang.Object[]) @bci=6, line=25 (Compiled frame)
- java.lang.reflect.Method.invoke(java.lang.Object,
java.lang.Object[]) @bci=111, line=585 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding$ValueAccessor
$1.methodValue(java.lang.Object, java.lang.reflect.Method) @bci=3,
line=684 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$_MethodBinding.valueInObject(java.lang.Object) @bci=9, line=1160
(Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$DefaultImplementation.valueForKey(java.lang.Object,
java.lang.String) @bci=34, line=1268 (Compiled frame)
-
com.webobjects.appserver.WOComponent.valueForKey(java.lang.String)
@bci=2, line=1539 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCoding
$Utility.valueForKey(java.lang.Object, java.lang.String) @bci=26,
line=498 (Compiled frame)
- com.webobjects.foundation.NSKeyValueCodingAdditions
$DefaultImplementation.valueForKeyPath(java.lang.Object,
java.lang.String) @bci=19, line=212 (Compiled frame)
-
com
.webobjects
.appserver.WOComponent.valueForKeyPath(java.lang.String) @bci=2,
line=1600 (Compiled frame)
-
com
.webobjects
.appserver
._private
.WOHTMLDynamicElement
._appendAttributesFromAssociationsToResponse
(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext,
com.webobjects.foundation.NSDictionary) @bci=60, line=317
(Compiled frame)
-
com
.webobjects
.appserver
._private
.WOGenericElement
.appendAttributesToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=161, line=158 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WOGenericElement
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=60, line=181 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WOGenericContainer
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=3, line=29 (Compiled frame)
-
com
.webobjects
.appserver
.WOComponent.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=56, line=992 (Compiled
frame)
-
er
.extensions
.components
.ERXComponent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=26, line=107 (Compiled
frame)
-
wk
.webobjects
.appserver
.WKAbstractComponent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=30, line=457 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WOComponentReference
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=11, line=111 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendChildrenToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=46, line=121 (Compiled
frame)
-
er
.extensions
.components
._private
.ERXWORepetition
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=90, line=508 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendChildrenToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=46, line=121 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=3, line=130 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WOComponentContent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=36, line=43 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendChildrenToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=46, line=121 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WOGenericContainer
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=15, line=32 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendChildrenToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=46, line=121 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=3, line=130 (Compiled
frame)
-
com
.webobjects
.appserver
.WOComponent.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=56, line=992 (Compiled
frame)
-
er
.extensions
.components
.ERXComponent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=26, line=107 (Compiled
frame)
-
wk
.webobjects
.appserver
.WKAbstractComponent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=30, line=457 (Compiled
frame)
-
wk
.cheetah
.wocomponents
.PageWrapper.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=505, line=247
(Interpreted frame)
-
com
.webobjects
.appserver
._private
.WOComponentReference
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=11, line=111 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendChildrenToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=46, line=121 (Compiled
frame)
-
com
.webobjects
.appserver
._private
.WODynamicGroup
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=3, line=130 (Compiled
frame)
-
com
.webobjects
.appserver
.WOComponent.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=56, line=992 (Compiled
frame)
-
er
.extensions
.components
.ERXComponent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=26, line=107 (Compiled
frame)
-
wk
.webobjects
.appserver
.WKAbstractComponent
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=30, line=457 (Compiled
frame)
-
wk
.cheetah
.wocomponents
.Customers.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=7, line=349 (Interpreted
frame)
-
com
.webobjects
.appserver
.WOSession.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=30, line=1200
(Interpreted frame)
-
er
.extensions
.appserver
.ERXSession.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=11, line=540 (Interpreted
frame)
-
wk
.webobjects
.appserver
.WKSession.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=33, line=176 (Interpreted
frame)
-
wk
.cheetah
.Session.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=205, line=657
(Interpreted frame)
-
com
.webobjects
.appserver
.WOApplication
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=100, line=1418
(Interpreted frame)
-
er
.extensions
.appserver
.ERXApplication
.appendToResponse(com.webobjects.appserver.WOResponse,
com.webobjects.appserver.WOContext) @bci=3, line=1789 (Interpreted
frame)
-
com
.webobjects
.appserver
._private
.WOComponentRequestHandler
._dispatchWithPreparedPage(com.webobjects.appserver.WOComponent,
com.webobjects.appserver.WOSession,
com.webobjects.appserver.WOContext,
com.webobjects.foundation.NSDictionary) @bci=218, line=230
(Interpreted frame)
-
com
.webobjects
.appserver
._private
.WOComponentRequestHandler
._dispatchWithPreparedSession(com.webobjects.appserver.WOSession,
com.webobjects.appserver.WOContext,
com.webobjects.foundation.NSDictionary) @bci=186, line=287
(Interpreted frame)
-
com
.webobjects
.appserver
._private
.WOComponentRequestHandler
._dispatchWithPreparedApplication
(com.webobjects.appserver.WOApplication,
com.webobjects.appserver.WOContext,
com.webobjects.foundation.NSDictionary) @bci=84, line=322
(Interpreted frame)
-
com
.webobjects
.appserver
._private
.WOComponentRequestHandler
._handleRequest(com.webobjects.appserver.WORequest) @bci=109,
line=358 (Interpreted frame)
-
com
.webobjects
.appserver
._private
.WOComponentRequestHandler
.handleRequest(com.webobjects.appserver.WORequest) @bci=23,
line=432 (Interpreted frame)
-
com
.webobjects
.appserver
.WOApplication.dispatchRequest(com.webobjects.appserver.WORequest)
@bci=41, line=1306 (Compiled frame)
-
er
.extensions
.appserver
.ERXApplication
.dispatchRequestImmediately(com.webobjects.appserver.WORequest)
@bci=74, line=1887 (Compiled frame)
-
er
.extensions
.appserver
.ERXApplication
.dispatchRequest(com.webobjects.appserver.WORequest) @bci=13,
line=1852 (Compiled frame)
- com.webobjects.appserver._private.WOWorkerThread.runOnce()
@bci=729, line=173 (Compiled frame)
- com.webobjects.appserver._private.WOWorkerThread.run() @bci=129,
line=254 (Interpreted frame)
- java.lang.Thread.run() @bci=11, line=613 (Interpreted frame)
Thread t...@85507: (state = BLOCKED)
- java.lang.Object.wait(long) @bci=0 (Compiled frame; information
may be imprecise)
- java.lang.Object.wait() @bci=2, line=474 (Compiled frame)
- com.webobjects.eocontrol.EOObjectStoreCoordinator.lock() @bci=4,
line=466 (Compiled frame)
- com.webobjects.eocontrol.EOEditingContext.lockObjectStore()
@bci=41, line=4735 (Compiled frame)
- er.extensions.eof.ERXEC.lockObjectStore() @bci=7, line=668
(Compiled frame)
- com.webobjects.eocontrol.EOEditingContext._dispose(boolean)
@bci=181, line=1110 (Compiled frame)
- com.webobjects.eocontrol.EOEditingContext.finalize() @bci=9,
line=1178 (Interpreted frame)
- er.extensions.eof.ERXEC.finalize() @bci=62, line=653
(Interpreted frame)
- java.lang.ref.Finalizer.runFinalizer() @bci=45, line=83
(Compiled frame)
- java.lang.ref.Finalizer.access$100(java.lang.ref.Finalizer)
@bci=1, line=14 (Compiled frame)
- java.lang.ref.Finalizer$FinalizerThread.run() @bci=11, line=160
(Interpreted frame)
Also affected, but seems normal otherwise.
Thread t...@85763: (state = BLOCKED)
- java.lang.Object.wait(long) @bci=0 (Compiled frame; information
may be imprecise)
- java.lang.Object.wait() @bci=2, line=474 (Compiled frame)
Is part of this missing?
No, that is the unaltered jstack output.
So you have two threads both waiting on an OSC lock and no threads
with an apparent OSC lock. That suggests that some other thread
has locked the OSC, failed to unlock it, and gone off to do other
things. Turn off your machine. Sell all of your possessions. Buy
goats. Move to Nieue.
LOL :-)
Barring that... it is possible that Anjo's changes are somehow
involved, but I'd want more proof before I started suggesting
that. More likely you are missing a try...finally block. Can you
reproduce this in Eclipse? If so, you can stop it in the debugger
and drill into the OSC to see what is holding the lock. Often that
is enough information to isolate the offending code. If not, there
is always goats on Nieue.
Chuck
--
Chuck Hill Senior Consultant / VP Development
Practical WebObjects - for developers who want to increase their
overall knowledge of WebObjects or who are trying to solve specific
problems.
http://www.global-village.net/products/practical_webobjects
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list ([email protected])
Help/Unsubscribe/Update your Subscription:
http://lists.apple.com/mailman/options/webobjects-dev/archive%40mail-archive.com
This email sent to [email protected]
