Hi,
We are experiencing some problems while using the tomcat jdbc pool. Tomcat version: apache-tomcat-7.0.29 Pool settings: <Resource name="PilDevDS" auth="Container" type="javax.sql.DataSource" factory="org.apache.tomcat.jdbc.pool.DataSourceFactory" testWhileIdle="true" testOnBorrow="true" testOnReturn="false" validationQuery="SELECT 1 FROM PIL_USERS" validationInterval="30000" timeBetweenEvictionRunsMillis="30000" maxActive="100" minIdle="10" maxWait="10000" initialSize="10" removeAbandonedTimeout="60" removeAbandoned="true" logAbandoned="true" minEvictableIdleTimeMillis="30000" jmxEnabled="true" jdbcInterceptors="org.apache.tomcat.jdbc.pool.interceptor.ConnectionStat e;org.apache.tomcat.jdbc.pool.interceptor.StatementFinalizer" username="PCS" password="xxx" driverClassName="oracle.jdbc.driver.OracleDriver" url="jdbc:oracle:thin:@somehost" /> Under heavy load we regularly see a thread waiting for response on a "socketRead". Furthermore we see one or more threads trying to lock the same physical connection as used by the 'hanging thread'. See threaddump excerpt further on for an example. Questions: - How is it possible that a thread tries to get a lock on a physical connection which is part of a pooled connection which is not idle? - The 'poolcleaner' also hangs as it is trying to clean the 'hanging connection'. This would mean that one hanging thread will bring the pool to its knees? Threaddump excerpt: >>> "http-bio-8280-exec-148" - Thread t@265 java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at oracle.net.ns.Packet.receive(Packet.java:300) at oracle.net.ns.DataPacket.receive(DataPacket.java:106) at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:315) at oracle.net.ns.NetInputStream.read(NetInputStream.java:260) at oracle.net.ns.NetInputStream.read(NetInputStream.java:185) at oracle.net.ns.NetInputStream.read(NetInputStream.java:102) at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketI nputStreamWrapper.java:124) at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStream Wrapper.java:80) at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137) at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290) at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192) at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.jav a:207) at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatem ent.java:1044) at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(Ora clePreparedStatement.java:10143) at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedSt atement.java:10249) - locked <14d02b3> (a oracle.jdbc.driver.T4CConnection) at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWr apper.java:230) at org.eclipse.persistence.platform.database.oracle.Oracle10Platform.execut eBatch(Oracle10Platform.java:53) at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.execute JDK12BatchStatement(DatabaseAccessor.java:801) at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWri tingMechanism.executeBatchedStatements(ParameterizedSQLBatchWritingMecha nism.java:138) at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWri tingMechanism.appendCall(ParameterizedSQLBatchWritingMechanism.java:82) at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicEx ecuteCall(DatabaseAccessor.java:546) at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.execute Call(DatabaseAccessor.java:512) at org.eclipse.persistence.internal.sessions.AbstractSession.executeCall(Ab stractSession.java:872) at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.ex ecuteCall(DatasourceCallQueryMechanism.java:205) at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.ex ecuteCall(DatasourceCallQueryMechanism.java:191) at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.in sertObject(DatasourceCallQueryMechanism.java:330) at org.eclipse.persistence.internal.queries.StatementQueryMechanism.insertO bject(StatementQueryMechanism.java:162) at org.eclipse.persistence.internal.queries.StatementQueryMechanism.insertO bject(StatementQueryMechanism.java:177) at org.eclipse.persistence.internal.queries.DatabaseQueryMechanism.insertOb jectForWrite(DatabaseQueryMechanism.java:461) at org.eclipse.persistence.queries.InsertObjectQuery.executeCommit(InsertOb jectQuery.java:80) at org.eclipse.persistence.queries.InsertObjectQuery.executeCommitWithChang eSet(InsertObjectQuery.java:90) at org.eclipse.persistence.internal.queries.DatabaseQueryMechanism.executeW riteWithChangeSet(DatabaseQueryMechanism.java:286) at org.eclipse.persistence.queries.WriteObjectQuery.executeDatabaseQuery(Wr iteObjectQuery.java:58) at org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java :664) at org.eclipse.persistence.queries.DatabaseQuery.executeInUnitOfWork(Databa seQuery.java:583) at org.eclipse.persistence.queries.ObjectLevelModifyQuery.executeInUnitOfWo rkObjectLevelModifyQuery(ObjectLevelModifyQuery.java:109) at org.eclipse.persistence.queries.ObjectLevelModifyQuery.executeInUnitOfWo rk(ObjectLevelModifyQuery.java:86) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecute Query(UnitOfWorkImpl.java:2750) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(A bstractSession.java:1181) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(A bstractSession.java:1165) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(A bstractSession.java:1125) at org.eclipse.persistence.internal.sessions.CommitManager.commitNewObjects ForClassWithChangeSet(CommitManager.java:195) at org.eclipse.persistence.internal.sessions.CommitManager.commitAllObjects ForClassWithChangeSet(CommitManager.java:164) at org.eclipse.persistence.internal.sessions.CommitManager.commitAllObjects WithChangeSet(CommitManager.java:116) at org.eclipse.persistence.internal.sessions.AbstractSession.writeAllObject sWithChangeSet(AbstractSession.java:3176) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitToDatabas e(UnitOfWorkImpl.java:1299) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitToDatabas eWithChangeSet(UnitOfWorkImpl.java:1399) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitRootUnitO fWork(UnitOfWorkImpl.java:1230) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commit(UnitOfWo rkImpl.java:1008) at nl.portinfolink.platform.domain.handler.PilDataObjectHandlerImpl.commitU nitOfWork(PilDataObjectHandlerImpl.java:329) at nl.portinfolink.platform.domain.handler.PilDataObjectHandlerImpl.commitC hanges(PilDataObjectHandlerImpl.java:174) at nl.portinfolink.platform.util.ToplinkUtils.commitChanges(ToplinkUtils.ja va:414) at nl.portinfolink.platform.facade.BaseWebFacade.commitWebTransaction(BaseW ebFacade.java:66) at nl.portinfolink.platform.facade.BaseWebFacade.handleWebTransaction(BaseW ebFacade.java:92) at nl.portbase.road.facade.RoadPlanningWebFacade.save(RoadPlanningWebFacade .java:153) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav a:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor Impl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at nl.portinfolink.portal.actions.ServiceProcessWebFacadeCaller.invokeWebFa cadeMethod(ServiceProcessWebFacadeCaller.java:314) at nl.portinfolink.portal.actions.ServiceProcessWebFacadeCaller.execute(Ser viceProcessWebFacadeCaller.java:268) at nl.portinfolink.portal.actions.PilAction.execute(PilAction.java:71) at oracle.jheadstart.controller.struts.action.JhsAction.execute(JhsAction.j ava:179) at org.apache.struts.action.RequestProcessor.processActionPerform(RequestPr ocessor.java:484) at oracle.jheadstart.controller.struts.JhsRequestProcessor.processActionPer form(JhsRequestProcessor.java:236) at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java: 274) at oracle.jheadstart.controller.struts.JhsRequestProcessor.process(JhsReque stProcessor.java:505) at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482) at oracle.jheadstart.controller.struts.JhsActionServlet.process(JhsActionSe rvlet.java:103) at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:525) at javax.servlet.http.HttpServlet.service(HttpServlet.java:641) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:305) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.ServiceAuthorizationFilter.doFilter(Servic eAuthorizationFilter.java:95) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.TimeOutFilter.doFilter(TimeOutFilter.java: 167) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.HttpDataIntegrityValidatorFilter.doFilter( HttpDataIntegrityValidatorFilter.java:56) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at oracle.jheadstart.controller.CharacterEncodingFilter.doFilter(CharacterE ncodingFilter.java:155) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.PageRetrievalTimeFilter.doFilter(PageRetri evalTimeFilter.java:81) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at com.sun.identity.agents.filter.AmAgentBaseFilter.allowRequestToContinue( AmAgentBaseFilter.java:130) at com.sun.identity.agents.filter.AmAgentBaseFilter.doFilter(AmAgentBaseFil ter.java:80) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValv e.java:225) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValv e.java:123) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authenticator Base.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java :168) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java :98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927 ) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve. java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:4 07) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11P rocessor.java:1001) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abs tractProtocol.java:585) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.j ava:310) - locked <1b59703> (a org.apache.tomcat.util.net.SocketWrapper) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecuto r.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja va:908) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - locked <cd68af> (a java.util.concurrent.locks.ReentrantLock$NonfairSync) "http-bio-8280-exec-206" - Thread t@324 java.lang.Thread.State: BLOCKED at oracle.jdbc.driver.PhysicalConnection.prepareStatement(PhysicalConnectio n.java:3461) - waiting to lock <14d02b3> (a oracle.jdbc.driver.T4CConnection) owned by "http-bio-8280-exec-148" t@265 at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor Impl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.tomcat.jdbc.pool.ProxyConnection.invoke(ProxyConnection.java: 126) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java: 99) at org.apache.tomcat.jdbc.pool.interceptor.AbstractCreateStatementIntercept or.invoke(AbstractCreateStatementInterceptor.java:67) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java: 99) at org.apache.tomcat.jdbc.pool.interceptor.ConnectionState.invoke(Connectio nState.java:153) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java: 99) at org.apache.tomcat.jdbc.pool.TrapException.invoke(TrapException.java:41) at org.apache.tomcat.jdbc.pool.JdbcInterceptor.invoke(JdbcInterceptor.java: 99) at org.apache.tomcat.jdbc.pool.DisposableConnectionFacade.invoke(Disposable ConnectionFacade.java:63) at $Proxy4.prepareStatement(Unknown Source) at org.eclipse.persistence.internal.databaseaccess.DatabasePlatform.wasFail ureCommunicationBased(DatabasePlatform.java:2336) at org.eclipse.persistence.platform.database.OraclePlatform.wasFailureCommu nicationBased(OraclePlatform.java:805) at org.eclipse.persistence.platform.server.ServerPlatformBase.wasFailureCom municationBased(ServerPlatformBase.java:473) at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.process ExceptionForCommError(DatabaseAccessor.java:1383) at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWri tingMechanism.prepareBatchStatements(ParameterizedSQLBatchWritingMechani sm.java:198) at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWri tingMechanism.executeBatchedStatements(ParameterizedSQLBatchWritingMecha nism.java:137) at org.eclipse.persistence.internal.databaseaccess.ParameterizedSQLBatchWri tingMechanism.appendCall(ParameterizedSQLBatchWritingMechanism.java:82) at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicEx ecuteCall(DatabaseAccessor.java:546) at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.execute Call(DatabaseAccessor.java:512) at org.eclipse.persistence.internal.sessions.AbstractSession.executeCall(Ab stractSession.java:872) at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.ex ecuteCall(DatasourceCallQueryMechanism.java:205) at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.ex ecuteCall(DatasourceCallQueryMechanism.java:191) at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.in sertObject(DatasourceCallQueryMechanism.java:330) at org.eclipse.persistence.internal.queries.StatementQueryMechanism.insertO bject(StatementQueryMechanism.java:162) at org.eclipse.persistence.internal.queries.StatementQueryMechanism.insertO bject(StatementQueryMechanism.java:177) at org.eclipse.persistence.internal.queries.DatabaseQueryMechanism.insertOb jectForWrite(DatabaseQueryMechanism.java:461) at org.eclipse.persistence.queries.InsertObjectQuery.executeCommit(InsertOb jectQuery.java:80) at org.eclipse.persistence.queries.InsertObjectQuery.executeCommitWithChang eSet(InsertObjectQuery.java:90) at org.eclipse.persistence.internal.queries.DatabaseQueryMechanism.executeW riteWithChangeSet(DatabaseQueryMechanism.java:286) at org.eclipse.persistence.queries.WriteObjectQuery.executeDatabaseQuery(Wr iteObjectQuery.java:58) at org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java :664) at org.eclipse.persistence.queries.DatabaseQuery.executeInUnitOfWork(Databa seQuery.java:583) at org.eclipse.persistence.queries.ObjectLevelModifyQuery.executeInUnitOfWo rkObjectLevelModifyQuery(ObjectLevelModifyQuery.java:109) at org.eclipse.persistence.queries.ObjectLevelModifyQuery.executeInUnitOfWo rk(ObjectLevelModifyQuery.java:86) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecute Query(UnitOfWorkImpl.java:2750) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(A bstractSession.java:1181) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(A bstractSession.java:1165) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(A bstractSession.java:1125) at org.eclipse.persistence.internal.sessions.CommitManager.commitNewObjects ForClassWithChangeSet(CommitManager.java:195) at org.eclipse.persistence.internal.sessions.CommitManager.commitAllObjects ForClassWithChangeSet(CommitManager.java:164) at org.eclipse.persistence.internal.sessions.CommitManager.commitAllObjects WithChangeSet(CommitManager.java:116) at org.eclipse.persistence.internal.sessions.AbstractSession.writeAllObject sWithChangeSet(AbstractSession.java:3176) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitToDatabas e(UnitOfWorkImpl.java:1299) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitToDatabas eWithChangeSet(UnitOfWorkImpl.java:1399) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commitRootUnitO fWork(UnitOfWorkImpl.java:1230) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.commit(UnitOfWo rkImpl.java:1008) at nl.portinfolink.platform.domain.handler.PilDataObjectHandlerImpl.commitU nitOfWork(PilDataObjectHandlerImpl.java:329) at nl.portinfolink.platform.domain.handler.PilDataObjectHandlerImpl.commitC hanges(PilDataObjectHandlerImpl.java:174) at nl.portinfolink.platform.util.ToplinkUtils.commitChanges(ToplinkUtils.ja va:414) at nl.portinfolink.platform.facade.BaseWebFacade.commitWebTransaction(BaseW ebFacade.java:66) at nl.portinfolink.platform.facade.BaseWebFacade.handleWebTransaction(BaseW ebFacade.java:92) at nl.portbase.road.facade.RoadPlanningWebFacade.save(RoadPlanningWebFacade .java:153) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav a:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor Impl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at nl.portinfolink.portal.actions.ServiceProcessWebFacadeCaller.invokeWebFa cadeMethod(ServiceProcessWebFacadeCaller.java:314) at nl.portinfolink.portal.actions.ServiceProcessWebFacadeCaller.execute(Ser viceProcessWebFacadeCaller.java:268) at nl.portinfolink.portal.actions.PilAction.execute(PilAction.java:71) at oracle.jheadstart.controller.struts.action.JhsAction.execute(JhsAction.j ava:179) at org.apache.struts.action.RequestProcessor.processActionPerform(RequestPr ocessor.java:484) at oracle.jheadstart.controller.struts.JhsRequestProcessor.processActionPer form(JhsRequestProcessor.java:236) at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java: 274) at oracle.jheadstart.controller.struts.JhsRequestProcessor.process(JhsReque stProcessor.java:505) at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482) at oracle.jheadstart.controller.struts.JhsActionServlet.process(JhsActionSe rvlet.java:103) at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:525) at javax.servlet.http.HttpServlet.service(HttpServlet.java:641) at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:305) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.ServiceAuthorizationFilter.doFilter(Servic eAuthorizationFilter.java:95) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.TimeOutFilter.doFilter(TimeOutFilter.java: 167) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.HttpDataIntegrityValidatorFilter.doFilter( HttpDataIntegrityValidatorFilter.java:56) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at oracle.jheadstart.controller.CharacterEncodingFilter.doFilter(CharacterE ncodingFilter.java:155) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at nl.portinfolink.portal.filter.PageRetrievalTimeFilter.doFilter(PageRetri evalTimeFilter.java:81) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at com.sun.identity.agents.filter.AmAgentBaseFilter.allowRequestToContinue( AmAgentBaseFilter.java:130) at com.sun.identity.agents.filter.AmAgentBaseFilter.doFilter(AmAgentBaseFil ter.java:80) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applica tionFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilt erChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValv e.java:225) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValv e.java:123) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authenticator Base.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java :168) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java :98) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927 ) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve. java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:4 07) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11P rocessor.java:1001) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abs tractProtocol.java:585) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.j ava:310) - locked <127d059> (a org.apache.tomcat.util.net.SocketWrapper) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecuto r.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja va:908) at java.lang.Thread.run(Thread.java:619) Locked ownable synchronizers: - locked <dfc239> (a java.util.concurrent.locks.ReentrantLock$NonfairSync) "PoolCleaner[28290629:1368625550375]" - Thread t@19 java.lang.Thread.State: BLOCKED at oracle.jdbc.driver.PhysicalConnection.close(PhysicalConnection.java:3957 ) - waiting to lock <18ed651> (a oracle.jdbc.driver.T4CConnection) owned by "http-bio-8280-exec-83" t@179 at org.apache.tomcat.jdbc.pool.PooledConnection.disconnect(PooledConnection .java:330) at org.apache.tomcat.jdbc.pool.PooledConnection.release(PooledConnection.ja va:489) at org.apache.tomcat.jdbc.pool.ConnectionPool.release(ConnectionPool.java:5 78) at org.apache.tomcat.jdbc.pool.ConnectionPool.abandon(ConnectionPool.java:5 37) at org.apache.tomcat.jdbc.pool.ConnectionPool.checkAbandoned(ConnectionPool .java:955) at org.apache.tomcat.jdbc.pool.ConnectionPool$PoolCleaner.run(ConnectionPoo l.java:1345) at java.util.TimerThread.mainLoop(Timer.java:512) at java.util.TimerThread.run(Timer.java:462) Locked ownable synchronizers: - locked <1a4c4c1> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync) <<<< Greetings, Huub