Re: WOSessionStore$TimeoutEntry

Fred Larken <[email protected]> Fri, 1 Aug 2008 07:09:22 -0700 (PDT)
Newsgroups gmane.comp.web.webobjects.devel
Message-ID <[email protected]>
Hey Chuck, I definitely see that problem. In fact at that time, we took 8
thread dumps (I only posted one) and it was stuck in every one of them. But
what confuses me is that that is the only time when the jvm froze up to
where an EODatabaseContext was locked. 

The jvm locks up once per day, and in the other thread dumps, there isn't
that error. The only thing that is consistent is the threads that are locked
show up with the WOSessionStore$Timeout



Chuck Hill wrote:
> 
> 
> On Jul 31, 2008, at 12:25 PM, Fred Larken wrote:
> 
>>
>> The thread dumps that do not show that trace of the WOSessionStore  
>> look ok to
>> me. I don't see any deadlocks or other problems. I will post a dump  
>> at the
>> bottom of this message.
> 
> I see threads blocked in EOF.
> 
> 
>> So I guess our course of action to locate the problem, whether this  
>> is a
>> symptom or the actual problem, would be to put debuggin info in the  
>> awake,
>> sleep and terminate methods and maybe even stick the code in that  
>> was posted
>> in that link?
> 
> I don't think that will help.
> 
> 
>> Here is a dump, if you see something that could be the prob, let me  
>> know:
> 
>> Dumping JVM state.
>> Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode):
>>
>> "Thread-450" daemon prio=1 tid=0x4a6b8998 nid=0x34fc waiting on  
>> condition
>> [0x518bf000..0x518c0020]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4650)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: 
>> 1270)
> 
> That ya go.  Something in your code has locked the object store  
> (EODatabaseContext), and not unlocked it.  Either a long running  
> thread (did not see this in the stack trace, but there are a lot of  
> threads and I may have missed it) or something threw an exception that  
> left it locked.
> 
> Chuck
> 
> 
> 
>> "http-20226-Processor50" daemon prio=1 tid=0x4ae120a8 nid=0x104d in
>> Object.wait() [0x4db6d000..0x4db6dfa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: 
>> 695)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	
>>
>> "http-20226-Processor49" daemon prio=1 tid=0x4ae11338 nid=0x104c  
>> waiting on
>> condition [0x4dbed000..0x4dbef020]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $WriteLock.lock(ReentrantReadWriteLock.java:637)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: 
>> 736)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4648)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.refaultObject(EOEditingContext.java:3984)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext._refaultObjectWithGlobalID(EOEditingContext.java: 
>> 3243)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> ._refaultLocalObjectWithGlobalID(EOEditingContext.java:3250)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext._refaultObjectsWithGlobalIDs(EOEditingContext.java: 
>> 3275)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext._processObjectStoreChanges(EOEditingContext.java: 
>> 3500)
>> 	at sun.reflect.GeneratedMethodAccessor471.invoke(Unknown Source)
>> 	at
>> sun 
>> .reflect 
>> .DelegatingMethodAccessorImpl 
>> .invoke(DelegatingMethodAccessorImpl.java:25)
>> 	at java.lang.reflect.Method.invoke(Method.java:585)
>> 	at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358)
>> 	at
>> com 
>> .webobjects 
>> .foundation.NSSelector._safeInvokeSelector(NSSelector.java:110)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext._processNotificationQueue(EOEditingContext.java: 
>> 4725)
>> 	at
>> com.webobjects.eocontrol.EOEditingContext.lock(EOEditingContext.java: 
>> 4604)
>> 	at
>> com 
>> .webobjects.eocontrol.EOEditingContext.tryLock(EOEditingContext.java: 
>> 4616)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext._sendOrEnqueueNotification(EOEditingContext.java: 
>> 4689)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext._objectsChangedInStore(EOEditingContext.java:3546)
>> 	at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source)
>> 	at
>> sun 
>> .reflect 
>> .DelegatingMethodAccessorImpl 
>> .invoke(DelegatingMethodAccessorImpl.java:25)
>> 	at java.lang.reflect.Method.invoke(Method.java:585)
>> 	at
>> com 
>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: 
>> 122)
>> 	at
>> com.webobjects.foundation.NSNotificationCenter 
>> $_Entry.invokeMethod(NSNotificationCenter.java:588)
>> 	at
>> com 
>> .webobjects 
>> .foundation 
>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532)
>> 	at
>> com 
>> .webobjects 
>> .foundation 
>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator 
>> ._objectsChangedInSubStore(EOObjectStoreCoordinator.java:693)
>> 	at sun.reflect.GeneratedMethodAccessor712.invoke(Unknown Source)
>> 	at
>> sun 
>> .reflect 
>> .DelegatingMethodAccessorImpl 
>> .invoke(DelegatingMethodAccessorImpl.java:25)
>> 	at java.lang.reflect.Method.invoke(Method.java:585)
>> 	at
>> com 
>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: 
>> 122)
>> 	at
>> com.webobjects.foundation.NSNotificationCenter 
>> $_Entry.invokeMethod(NSNotificationCenter.java:588)
>> 	at
>> com 
>> .webobjects 
>> .foundation 
>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532)
>> 	at
>> com 
>> .webobjects 
>> .foundation 
>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess 
>> .EODatabaseContext 
>> ._snapshotsChangedInDatabase(EODatabaseContext.java:3664)
>> 	at sun.reflect.GeneratedMethodAccessor710.invoke(Unknown Source)
>> 	at
>> sun 
>> .reflect 
>> .DelegatingMethodAccessorImpl 
>> .invoke(DelegatingMethodAccessorImpl.java:25)
>> 	at java.lang.reflect.Method.invoke(Method.java:585)
>> 	at
>> com 
>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: 
>> 122)
>> 	at
>> com.webobjects.foundation.NSNotificationCenter 
>> $_Entry.invokeMethod(NSNotificationCenter.java:588)
>> 	at
>> com 
>> .webobjects 
>> .foundation 
>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532)
>> 	at
>> com 
>> .webobjects 
>> .foundation 
>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess.EODatabaseContext.commitChanges(EODatabaseContext.java:6418)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator 
>> .saveChangesInEditingContext(EOObjectStoreCoordinator.java:386)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.saveChanges(EOEditingContext.java:3176)
>> 	
>> "http-20226-Processor48" daemon prio=1 tid=0x4ae105c8 nid=0x104b in
>> Object.wait() [0x4dc6f000..0x4dc700a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: 
>> 695)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>> "http-20226-Processor47" daemon prio=1 tid=0x4ae0f858 nid=0x104a  
>> runnable
>> [0x4dcf0000..0x4dcf1120]
>> 	at java.net.SocketInputStream.socketRead0(Native Method)
>> 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
>> 	at
>> org 
>> .apache 
>> .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737)
>> 	at
>> org 
>> .apache 
>> .coyote 
>> .http11 
>> .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398)
>> 	at
>> org 
>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: 
>> 827)
>> 	at
>> org.apache.coyote.http11.Http11BaseProtocol 
>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: 
>> 664)
>> 	at
>> org 
>> .apache 
>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: 
>> 527)
>> 	at
>> org 
>> .apache 
>> .tomcat 
>> .util 
>> .net 
>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:684)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor46" daemon prio=1 tid=0x4ae0eae8 nid=0x1049  
>> waiting on
>> condition [0x4dd70000..0x4dd71da0]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4650)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: 
>> 1270)
>> 	at
>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer 
>> $ 
>> _LazyGenericRecordBinding 
>> .valueInObject(_EOMutableKnownKeyDictionary.java:614)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634)
>>
>> "http-20226-Processor45" daemon prio=1 tid=0x4ae0ddb0 nid=0x1048 in
>> Object.wait() [0x4ddf2000..0x4ddf2e20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>> "http-20226-Processor44" daemon prio=1 tid=0x4ae03f58 nid=0x1047 in
>> Object.wait() [0x4de73000..0x4de73ea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>>
>> "http-20226-Processor43" daemon prio=1 tid=0x4ae02390 nid=0x1046 in
>> Object.wait() [0x4def4000..0x4def4f20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6eec6df0> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x6eec6df0> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>>
>> "http-20226-Processor42" daemon prio=1 tid=0x0841e560 nid=0x1045 in
>> Object.wait() [0x4df75000..0x4df75fa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>> "http-20226-Processor41" daemon prio=1 tid=0x088eb1a0 nid=0x1044 in
>> Object.wait() [0x4dff6000..0x4dff7020]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor40" daemon prio=1 tid=0x088e8258 nid=0x1043  
>> waiting on
>> condition [0x4e076000..0x4e0780a0]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4650)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4051)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4428)
>> 	
>> "http-20226-Processor39" daemon prio=1 tid=0x088e7318 nid=0x1042  
>> runnable
>> [0x4e0f8000..0x4e0f9120]
>> 	at java.net.PlainSocketImpl.socketAccept(Native Method)
>> 	at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
>> 	- locked <0x687d18f0> (a java.net.SocksSocketImpl)
>> 	at java.net.ServerSocket.implAccept(ServerSocket.java:450)
>> 	at java.net.ServerSocket.accept(ServerSocket.java:421)
>> 	at
>> org 
>> .apache 
>> .tomcat 
>> .util 
>> .net 
>> .DefaultServerSocketFactory 
>> .acceptSocket(DefaultServerSocketFactory.java:60)
>> 	at
>> org 
>> .apache 
>> .tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java: 
>> 407)
>> 	at
>> org 
>> .apache 
>> .tomcat 
>> .util 
>> .net 
>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:684)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor38" daemon prio=1 tid=0x088ec3e0 nid=0x1041 in
>> Object.wait() [0x4e179000..0x4e179da0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x916494d0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x916494d0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor37" daemon prio=1 tid=0x088eb500 nid=0x1040 in
>> Object.wait() [0x4e1fa000..0x4e1fae20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x916494b0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x916494b0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor36" daemon prio=1 tid=0x091a3938 nid=0x103f in
>> Object.wait() [0x4e27b000..0x4e27bea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649490> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649490> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor35" daemon prio=1 tid=0x091a2b80 nid=0x103e in
>> Object.wait() [0x4e2fc000..0x4e2fcf20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649470> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649470> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor34" daemon prio=1 tid=0x0862cef8 nid=0x103d in
>> Object.wait() [0x4e37d000..0x4e37dfa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649450> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649450> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor33" daemon prio=1 tid=0x0921f260 nid=0x103c in
>> Object.wait() [0x4e3fe000..0x4e3ff020]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649430> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649430> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor32" daemon prio=1 tid=0x0921e380 nid=0x103b in
>> Object.wait() [0x4e5fe000..0x4e5ff0a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649410> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649410> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor31" daemon prio=1 tid=0x086c6b20 nid=0x103a in
>> Object.wait() [0x4e7c0000..0x4e7c1120]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x916493f0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x916493f0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor30" daemon prio=1 tid=0x086c5db8 nid=0x1039 in
>> Object.wait() [0x4e841000..0x4e841da0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x916493d0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x916493d0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor29" daemon prio=1 tid=0x08249350 nid=0x1038 in
>> Object.wait() [0x4e8c2000..0x4e8c2e20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x916493b0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x916493b0> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor28" daemon prio=1 tid=0x082489d8 nid=0x1037 in
>> Object.wait() [0x4f9fe000..0x4f9feea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649390> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649390> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor27" daemon prio=1 tid=0x09420140 nid=0x1036 in
>> Object.wait() [0x519fa000..0x519faf20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649370> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649370> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor26" daemon prio=1 tid=0x0941fd28 nid=0x1035 in
>> Object.wait() [0x51979000..0x51979fa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x91649350> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x91649350> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Monitor" prio=1 tid=0x51c30138 nid=0x595 in Object.wait()
>> [0x51a7b000..0x51a7c020]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6e6b48e8> (a
>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $MonitorRunnable.run(ThreadPool.java:559)
>> 	- locked <0x6e6b48e8> (a
>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor25" daemon prio=1 tid=0x51c2f440 nid=0x594 in
>> Object.wait() [0x51afc000..0x51afd0a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: 
>> 695)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in
>> Object.wait() [0x51b7d000..0x51b7e120]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>> "http-20226-Processor23" daemon prio=1 tid=0x52320b70 nid=0x592 in
>> Object.wait() [0x51bfe000..0x51bfeda0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>>
>> "http-20226-Processor22" daemon prio=1 tid=0x521d5e90 nid=0x591  
>> waiting on
>> condition [0x51ffd000..0x51ffee20]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4650)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4051)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4428)
>>
>> "http-20226-Processor21" daemon prio=1 tid=0x521d52a0 nid=0x590 in
>> Object.wait() [0x524fe000..0x524feea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor20" daemon prio=1 tid=0x52b03bf0 nid=0x58f in
>> Object.wait() [0x52afe000..0x52afef20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor19" daemon prio=1 tid=0x52695fb0 nid=0x58e in
>> Object.wait() [0x52cfe000..0x52cfefa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor18" daemon prio=1 tid=0x52b37c50 nid=0x58d  
>> waiting on
>> condition [0x530fd000..0x530ff020]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess 
>> .EODatabaseContext 
>> .registeredDatabaseContextForModel(EODatabaseContext.java:999)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess 
>> .EODatabaseContext 
>> .registeredDatabaseContextForModel(EODatabaseContext.java:1033)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: 
>> 814)
>> 	at  
>> com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: 
>> 585)
>>
>> "http-20226-Processor17" daemon prio=1 tid=0x526c1980 nid=0x58c in
>> Object.wait() [0x532bb000..0x532bc0a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor16" daemon prio=1 tid=0x4fa0f908 nid=0x58b in
>> Object.wait() [0x538e2000..0x538e3120]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor15" daemon prio=1 tid=0x4fa0f780 nid=0x58a in
>> Object.wait() [0x53963000..0x53963da0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor14" daemon prio=1 tid=0x52b74250 nid=0x589 in
>> Object.wait() [0x539e4000..0x539e4e20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor13" daemon prio=1 tid=0x521be938 nid=0x588 in
>> Object.wait() [0x53a65000..0x53a65ea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6ea04b80> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:656)
>> 	- locked <0x6ea04b80> (a
>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor12" daemon prio=1 tid=0x52b13970 nid=0x587  
>> waiting on
>> condition [0x53ae5000..0x53ae6f20]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $WriteLock.lock(ReentrantReadWriteLock.java:637)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: 
>> 736)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4648)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4051)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4428)
>> 	
>> "http-20226-Processor11" daemon prio=1 tid=0x52b740c8 nid=0x586 in
>> Object.wait() [0x53b67000..0x53b67fa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xcd1b9410> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor10" daemon prio=1 tid=0x52387828 nid=0x585  
>> runnable
>> [0x53be8000..0x53be9020]
>> 	at java.net.SocketInputStream.socketRead0(Native Method)
>> 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
>> 	at
>> org 
>> .apache 
>> .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737)
>> 	at
>> org 
>> .apache 
>> .coyote 
>> .http11 
>> .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398)
>> 	at
>> org 
>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: 
>> 827)
>> 	at
>> org.apache.coyote.http11.Http11BaseProtocol 
>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: 
>> 664)
>> 	at
>> org 
>> .apache 
>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: 
>> 527)
>> 	at
>> org 
>> .apache 
>> .tomcat 
>> .util 
>> .net 
>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
>> 	at
>> org.apache.tomcat.util.threads.ThreadPool 
>> $ControlRunnable.run(ThreadPool.java:684)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "http-20226-Processor9" daemon prio=1 tid=0x523876a0 nid=0x584 in
>> Object.wait() [0x53c69000..0x53c6a0a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: 
>> 695)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor8" daemon prio=1 tid=0x521f67f0 nid=0x583 in
>> Object.wait() [0x53cea000..0x53ceb120]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0xaaede7d8> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>>
>> "http-20226-Processor7" daemon prio=1 tid=0x521f9ed0 nid=0x582  
>> waiting on
>> condition [0x53de7000..0x53de8da0]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4650)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: 
>> 1270)
>> 	at
>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer 
>> $ 
>> _LazyGenericRecordBinding 
>> .valueInObject(_EOMutableKnownKeyDictionary.java:614)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634)
>> 	
>> "http-20226-Processor6" daemon prio=1 tid=0x52356090 nid=0x581 in
>> Object.wait() [0x53e69000..0x53e69e20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x99138c50> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: 
>> 709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "http-20226-Processor5" daemon prio=1 tid=0x52356ff0 nid=0x580  
>> waiting on
>> condition [0x53ee9000..0x53eeaea0]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $WriteLock.lock(ReentrantReadWriteLock.java:637)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: 
>> 736)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4648)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4051)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4428)
>> 	
>> "http-20226-Processor4" daemon prio=1 tid=0x52691360 nid=0x57f  
>> waiting on
>> condition [0x53f6a000..0x53f6bf20]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4650)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4051)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4428)
>> 	
>> "http-20226-Processor3" daemon prio=1 tid=0x5262eba8 nid=0x57e  
>> waiting on
>> condition [0x53feb000..0x53fecfa0]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342)
>> 	at
>> java.util.concurrent.locks.ReentrantReadWriteLock 
>> $WriteLock.lock(ReentrantReadWriteLock.java:637)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: 
>> 736)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: 
>> 4648)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4051)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOEditingContext 
>> .objectsWithFetchSpecification(EOEditingContext.java:4428)
>> 	
>> "http-20226-Processor2" daemon prio=1 tid=0x52b744e0 nid=0x57d  
>> waiting on
>> condition [0x5406c000..0x5406e020]
>> 	at sun.misc.Unsafe.park(Native Method)
>> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer 
>> .acquireQueued(AbstractQueuedSynchronizer.java:746)
>> 	at
>> java 
>> .util 
>> .concurrent 
>> .locks 
>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: 
>> 1076)
>> 	at
>> java.util.concurrent.locks.ReentrantLock 
>> $NonfairSync.lock(ReentrantLock.java:184)
>> 	at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: 
>> 256)
>> 	at
>> com 
>> .webobjects 
>> .eocontrol 
>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess 
>> .EODatabaseContext 
>> .registeredDatabaseContextForModel(EODatabaseContext.java:999)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess 
>> .EODatabaseContext 
>> .registeredDatabaseContextForModel(EODatabaseContext.java:1033)
>> 	at
>> com 
>> .webobjects 
>> .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: 
>> 814)
>> 	at  
>> com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: 
>> 585)
>> 	
>> "http-20226-Processor1" daemon prio=1 tid=0x52ba7b78 nid=0x57c in
>> Object.wait() [0x5333c000..0x5333d0a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: 
>> 191)
>> 	- locked <0x7b93e440> (a
>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> ._handleRequest(WOComponentRequestHandler.java:369)
>> 	at
>> com 
>> .webobjects 
>> .appserver 
>> ._private 
>> .WOComponentRequestHandler 
>> .handleRequest(WOComponentRequestHandler.java:445)
>> 	at
>> com 
>> .webobjects 
>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet 
>> ._WOApplicationWrapper 
>> .servletDispatchRequest(_WOApplicationWrapper.java:131)
>> 	at
>> com 
>> .webobjects 
>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727)
>> 	at
>> com 
>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: 
>> 695)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
>> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core 
>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 
>> 252)
>> 	at
>> org 
>> .apache 
>> .catalina 
>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
>> 	
>> "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1
>> tid=0x52321f80 nid=0x57b waiting on condition [0x54102000..0x54102120]
>> 	at java.lang.Thread.sleep(Native Method)
>> 	at
>> org.apache.catalina.core.ContainerBase 
>> $ContainerBackgroundProcessor.run(ContainerBase.java:1547)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "Timer-2" prio=1 tid=0x52b74a20 nid=0x574 in Object.wait()
>> [0x54182000..0x54182f20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6d201840> (a java.util.TaskQueue)
>> 	at java.util.TimerThread.mainLoop(Timer.java:509)
>> 	- locked <0x6d201840> (a java.util.TaskQueue)
>> 	at java.util.TimerThread.run(Timer.java:462)
>>
>> "Timer-1" prio=1 tid=0x4fa0fb18 nid=0x573 in Object.wait()
>> [0x54203000..0x54203fa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6d2018c8> (a java.util.TaskQueue)
>> 	at java.util.TimerThread.mainLoop(Timer.java:509)
>> 	- locked <0x6d2018c8> (a java.util.TaskQueue)
>> 	at java.util.TimerThread.run(Timer.java:462)
>>
>> "Thread-8" prio=1 tid=0x090e20e0 nid=0x56e waiting on condition
>> [0x54284000..0x54285020]
>> 	at java.lang.Thread.sleep(Native Method)
>> 	at
>> com 
>> .XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 
>> .client.beans.Timer.run(Timer.java:110)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "PoolManagerCleanup-20012302" daemon prio=1 tid=0x52357328 nid=0x560  
>> waiting
>> on condition [0x54dfd000..0x54dfd120]
>> 	at java.lang.Thread.sleep(Native Method)
>> 	at
>> org.apache.cayenne.conn.PoolManager 
>> $PoolMaintenanceThread.run(PoolManager.java:522)
>>
>> "EventDispatchThread-1" daemon prio=1 tid=0x5230da30 nid=0x55f in
>> Object.wait() [0x54e7d000..0x54e7dda0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c18b350> (a java.util.Collections$SynchronizedList)
>>
>> "EventDispatchThread-0" daemon prio=1 tid=0x51c12b20 nid=0x55e in
>> Object.wait() [0x54efe000..0x54efee20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c18b350> (a java.util.Collections$SynchronizedList)
>>
>> "EventDispatchThread-4" daemon prio=1 tid=0x52654e70 nid=0x55d in
>> Object.wait() [0x54305000..0x54305ea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)
>>
>> "EventDispatchThread-3" daemon prio=1 tid=0x52bd8860 nid=0x55c in
>> Object.wait() [0x54386000..0x54386f20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)
>>
>> "EventDispatchThread-2" daemon prio=1 tid=0x526f6880 nid=0x55b in
>> Object.wait() [0x54407000..0x54407fa0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)
>>
>> "EventDispatchThread-1" daemon prio=1 tid=0x52ba5c08 nid=0x55a in
>> Object.wait() [0x54ba3000..0x54ba4020]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)
>>
>> "EventDispatchThread-0" daemon prio=1 tid=0x51c1af80 nid=0x559 in
>> Object.wait() [0x55dc2000..0x55dc30a0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at
>> org.apache.cayenne.event.EventManager 
>> $DispatchThread.run(EventManager.java:450)
>> 	- locked <0x6c133f48> (a java.util.Collections$SynchronizedList)
>>
>> "PoolManagerCleanup-18771651" daemon prio=1 tid=0x52bd8c68 nid=0x558  
>> waiting
>> on condition [0x55ec5000..0x55ec5120]
>> 	at java.lang.Thread.sleep(Native Method)
>> 	at
>> org.apache.cayenne.conn.PoolManager 
>> $PoolMaintenanceThread.run(PoolManager.java:522)
>>
>> "WrapperStartStopAppMain" prio=1 tid=0x0819d920 nid=0x534 runnable
>> [0x55d41000..0x55d41fa0]
>> 	at java.net.PlainSocketImpl.socketAccept(Native Method)
>> 	at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
>> 	- locked <0x6e9a3098> (a java.net.SocksSocketImpl)
>> 	at java.net.ServerSocket.implAccept(ServerSocket.java:450)
>> 	at java.net.ServerSocket.accept(ServerSocket.java:421)
>> 	at  
>> org.apache.catalina.core.StandardServer.await(StandardServer.java:388)
>> 	at org.apache.catalina.startup.Catalina.await(Catalina.java:615)
>> 	at org.apache.catalina.startup.Catalina.start(Catalina.java:575)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at
>> sun 
>> .reflect 
>> .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> 	at
>> sun 
>> .reflect 
>> .DelegatingMethodAccessorImpl 
>> .invoke(DelegatingMethodAccessorImpl.java:25)
>> 	at java.lang.reflect.Method.invoke(Method.java:585)
>> 	at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
>> 	at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432)
>> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 	at
>> sun 
>> .reflect 
>> .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> 	at
>> sun 
>> .reflect 
>> .DelegatingMethodAccessorImpl 
>> .invoke(DelegatingMethodAccessorImpl.java:25)
>> 	at java.lang.reflect.Method.invoke(Method.java:585)
>> 	at
>> org 
>> .tanukisoftware 
>> .wrapper.WrapperStartStopApp.run(WrapperStartStopApp.java:238)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "DestroyJavaVM" prio=1 tid=0x568d5eb8 nid=0x51c waiting on condition
>> [0x00000000..0xffff9190]
>>
>> "Wrapper-Connection" daemon prio=1 tid=0x568ae0e8 nid=0x532 runnable
>> [0x55e43000..0x55e440a0]
>> 	at java.net.SocketInputStream.socketRead0(Native Method)
>> 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
>> 	at java.net.SocketInputStream.read(SocketInputStream.java:182)
>> 	at java.io.DataInputStream.readByte(DataInputStream.java:241)
>> 	at
>> org 
>> .tanukisoftware 
>> .wrapper.WrapperManager.handleSocket(WrapperManager.java:3737)
>> 	at  
>> org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java: 
>> 4084)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "Wrapper-Control-Event-Monitor" daemon prio=1 tid=0x568ac820 nid=0x530
>> sleeping[0x55f45000..0x55f45da0]
>> 	at java.lang.Thread.sleep(Native Method)
>> 	at org.tanukisoftware.wrapper.WrapperManager 
>> $3.run(WrapperManager.java:731)
>>
>> "RMI TCP Accept-0" daemon prio=1 tid=0x5689e660 nid=0x52e runnable
>> [0x5604a000..0x5604aea0]
>> 	at java.net.PlainSocketImpl.socketAccept(Native Method)
>> 	at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
>> 	- locked <0x68888648> (a java.net.SocksSocketImpl)
>> 	at java.net.ServerSocket.implAccept(ServerSocket.java:450)
>> 	at java.net.ServerSocket.accept(ServerSocket.java:421)
>> 	at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340)
>> 	at java.lang.Thread.run(Thread.java:595)
>>
>> "Timer-0" daemon prio=1 tid=0x5689e158 nid=0x52d in Object.wait()
>> [0x560cb000..0x560cbf20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6a979aa8> (a java.util.TaskQueue)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at java.util.TimerThread.mainLoop(Timer.java:483)
>> 	- locked <0x6a979aa8> (a java.util.TaskQueue)
>> 	at java.util.TimerThread.run(Timer.java:462)
>>
>> "Low Memory Detector" daemon prio=1 tid=0x08149ee0 nid=0x52c runnable
>> [0x00000000..0x00000000]
>>
>> "CompilerThread1" daemon prio=1 tid=0x08148a60 nid=0x52b waiting on
>> condition [0x00000000..0x56b01248]
>>
>> "CompilerThread0" daemon prio=1 tid=0x08147a08 nid=0x52a waiting on
>> condition [0x00000000..0x56b822c8]
>>
>> "AdapterThread" daemon prio=1 tid=0x081468d0 nid=0x529 waiting on  
>> condition
>> [0x00000000..0x00000000]
>>
>> "Signal Dispatcher" daemon prio=1 tid=0x08145b00 nid=0x528 waiting on
>> condition [0x00000000..0x00000000]
>>
>> "Finalizer" daemon prio=1 tid=0x0813b348 nid=0x527 in Object.wait()
>> [0x56f05000..0x56f05e20]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock)
>> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120)
>> 	- locked <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock)
>> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136)
>> 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
>>
>> "Reference Handler" daemon prio=1 tid=0x0813ae20 nid=0x526 in  
>> Object.wait()
>> [0x56f86000..0x56f86ea0]
>> 	at java.lang.Object.wait(Native Method)
>> 	- waiting on <0x6a97a128> (a java.lang.ref.Reference$Lock)
>> 	at java.lang.Object.wait(Object.java:474)
>> 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
>> 	- locked <0x6a97a128> (a java.lang.ref.Reference$Lock)
>>
>> "VM Thread" prio=1 tid=0x081388d8 nid=0x525 runnable
>>
>> "GC task thread#0 (ParallelGC)" prio=1 tid=0x0807a548 nid=0x51d  
>> runnable
>>
>> "GC task thread#1 (ParallelGC)" prio=1 tid=0x0807b5a0 nid=0x51e  
>> runnable
>>
>> "GC task thread#2 (ParallelGC)" prio=1 tid=0x0807c1b8 nid=0x51f  
>> runnable
>>
>> "GC task thread#3 (ParallelGC)" prio=1 tid=0x0807cdd8 nid=0x520  
>> runnable
>>
>> "GC task thread#4 (ParallelGC)" prio=1 tid=0x0807da10 nid=0x521  
>> runnable
>>
>> "GC task thread#5 (ParallelGC)" prio=1 tid=0x0807e648 nid=0x522  
>> runnable
>>
>> "GC task thread#6 (ParallelGC)" prio=1 tid=0x0807f280 nid=0x523  
>> runnable
>>
>> "GC task thread#7 (ParallelGC)" prio=1 tid=0x0807feb8 nid=0x524  
>> runnable
>>
>> "VM Periodic Task Thread" prio=1 tid=0x568a7868 nid=0x52f waiting on
>> condition
>>
>> Jul 30, 2008 5:30:24 PM org.apache.catalina.core.ApplicationContext  
>> log
>> INFO: HTMLManager: list: Listing contexts for virtual host 'localhost'
>> [GC 1968661K->1868524K(2111040K), 0.0176210 secs]
>> Dumping JVM state.
>> Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode):
>>
>>
>>
>> Chuck Hill wrote:
>>>
>>>
>>> On Jul 31, 2008, at 10:16 AM, Fred Larken wrote:
>>>
>>>>
>>>> Yes, we are setting this in the code:
>>>> setAllowsConcurrentRequestHandling(true);
>>>
>>> The trace below is probably a symptom then, not the cause.
>>>
>>>> The session timeout is set to 30 minutes.
>>>>
>>>> How do I find out why a session is hung, or how to fix this?
>>>
>>> Check the the thread dumps that don't show this trace.
>>>
>>> Check that session's sleep() and terminate() methods can't throw.
>>> Check awake too for good measure.
>>>
>>>
>>>> I saw one post that said something about adding code to your
>>>> Application.java
>>>> Is this the correct way to fix it, or is this problem just a  
>>>> result of
>>>> something else happening?
>>>> http://www.mail-archive.com/[email protected]/msg09497.html
>>>> http://www.mail-archive.com/[email protected]/msg09497.html
>>>
>>> You could try this if nothing else pans out.
>>>
>>>
>>> Chuck
>>>
>>>
>>>>>
>>>>>
>>>>> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote:
>>>>>
>>>>>>
>>>>>> we have a linux server running our web objects app. After a day,  
>>>>>> the
>>>>>> system
>>>>>> locks up for 30 mins. It will self-recoverbut in the mean time,
>>>>>> nobody can
>>>>>> log in or use the app. I have seen thread dumps during this period
>>>>>> and I
>>>>>> have noticed the following trace:
>>>>>>
>>>>>>
>>>>>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in
>>>>>> Object.wait() [0x51b7d000..0x51b7e120]
>>>>>> 	at java.lang.Object.wait(Native Method)
>>>>>> 	- waiting on <0xaaede7d8> (a
>>>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>>>>>> 	at java.lang.Object.wait(Object.java:474)
>>>>>> 	at
>>>>>> com
>>>>>> .webobjects
>>>>>> .appserver 
>>>>>> .WOSessionStore.checkOutSessionWithID(WOSessionStore.java:
>>>>>> 191)
>>>>>> 	- locked <0xaaede7d8> (a
>>>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry)
>>>>>> 	at
>>>>>> com
>>>>>> .webobjects
>>>>>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:
>>>>>> 1904)
>>>>>>
>>>>>> There are a lot of http threads in this state. There is one lock  
>>>>>> for
>>>>>> every 4
>>>>>> http threads waiting on it.
>>>>>>
>>>>>> Can any one explain what the above means?
>>>>>
>>>>> Are you dispatching requests concurrently? I am guessing the answer
>>>>> is
>>>>> no.  Is your session timeout 30 minutes?  It looks like a session  
>>>>> is
>>>>> getting hung and blocking the app until it expires
>>>>>
>>>>> Chuck
>>>>>
>>>>>
>>>>> -- 
>>>>> Chuck Hill             Senior Consultant / VP Development
>>>>>
>>>>> Practical WebObjects - for developers who want to increase their
>>>>> overall knowledge of WebObjects or who are trying to solve specific
>>>>> problems.
>>>>> http://www.global-village.net/products/practical_webobjects
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> WebObjects-dev mailing list
>>>>> [email protected]
>>>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
>>>>>
>>>>>
>>>>
>>>> -- 
>>>> View this message in context:
>>>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html
>>>> Sent from the WebObjects-Dev mailing list archive at Nabble.com.
>>>>
>>>> _______________________________________________
>>>> WebObjects-dev mailing list
>>>> [email protected]
>>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
>>>>
>>>
>>> -- 
>>> Chuck Hill             Senior Consultant / VP Development
>>>
>>> Practical WebObjects - for developers who want to increase their
>>> overall knowledge of WebObjects or who are trying to solve specific
>>> problems.
>>> http://www.global-village.net/products/practical_webobjects
>>>
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> WebObjects-dev mailing list
>>> [email protected]
>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
>>>
>>>
>>
>> -- 
>> View this message in context:
>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18761699.html
>> Sent from the WebObjects-Dev mailing list archive at Nabble.com.
>>
>> _______________________________________________
>> WebObjects-dev mailing list
>> [email protected]
>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
>>
> 
> -- 
> Chuck Hill             Senior Consultant / VP Development
> 
> Practical WebObjects - for developers who want to increase their  
> overall knowledge of WebObjects or who are trying to solve specific  
> problems.
> http://www.global-village.net/products/practical_webobjects
> 
> 
> 
> 
> 
> 
> _______________________________________________
> WebObjects-dev mailing list
> [email protected]
> http://www.omnigroup.com/mailman/listinfo/webobjects-dev
> 
> 

-- 
View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18775137.html
Sent from the WebObjects-Dev mailing list archive at Nabble.com.