Re: WOSessionStore$TimeoutEntry
"Guido Neitzer" <[email protected]> Fri, 1 Aug 2008 16:02:36 -0600
| Newsgroups | gmane.comp.web.webobjects.devel |
|---|---|
| Message-ID | <[email protected]> |
I've seen things like that when you access the sessions editing context from a different thread and that session is not checked out, but has an autolocking editing context that requires a request-response loop for unlocking. If that autolock triggers, the session will lockup with something that looks like a session store deadlock when it is checked out the next time and finds its editing context being locked. You might see something different, but at least it's worth thinking about it. On Fri, Aug 1, 2008 at 8:09 AM, Fred Larken <[email protected]> wrote: > > Hey Chuck, I definitely see that problem. In fact at that time, we took 8 > thread dumps (I only posted one) and it was stuck in every one of them. But > what confuses me is that that is the only time when the jvm froze up to > where an EODatabaseContext was locked. > > The jvm locks up once per day, and in the other thread dumps, there isn't > that error. The only thing that is consistent is the threads that are locked > show up with the WOSessionStore$Timeout > > > > Chuck Hill wrote: >> >> >> On Jul 31, 2008, at 12:25 PM, Fred Larken wrote: >> >>> >>> The thread dumps that do not show that trace of the WOSessionStore >>> look ok to >>> me. I don't see any deadlocks or other problems. I will post a dump >>> at the >>> bottom of this message. >> >> I see threads blocked in EOF. >> >> >>> So I guess our course of action to locate the problem, whether this >>> is a >>> symptom or the actual problem, would be to put debuggin info in the >>> awake, >>> sleep and terminate methods and maybe even stick the code in that >>> was posted >>> in that link? >> >> I don't think that will help. >> >> >>> Here is a dump, if you see something that could be the prob, let me >>> know: >> >>> Dumping JVM state. >>> Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): >>> >>> "Thread-450" daemon prio=1 tid=0x4a6b8998 nid=0x34fc waiting on >>> condition >>> [0x518bf000..0x518c0020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: >>> 1270) >> >> That ya go. Something in your code has locked the object store >> (EODatabaseContext), and not unlocked it. Either a long running >> thread (did not see this in the stack trace, but there are a lot of >> threads and I may have missed it) or something threw an exception that >> left it locked. >> >> Chuck >> >> >> >>> "http-20226-Processor50" daemon prio=1 tid=0x4ae120a8 nid=0x104d in >>> Object.wait() [0x4db6d000..0x4db6dfa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> >>> >>> "http-20226-Processor49" daemon prio=1 tid=0x4ae11338 nid=0x104c >>> waiting on >>> condition [0x4dbed000..0x4dbef020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.refaultObject(EOEditingContext.java:3984) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._refaultObjectWithGlobalID(EOEditingContext.java: >>> 3243) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> ._refaultLocalObjectWithGlobalID(EOEditingContext.java:3250) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._refaultObjectsWithGlobalIDs(EOEditingContext.java: >>> 3275) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._processObjectStoreChanges(EOEditingContext.java: >>> 3500) >>> at sun.reflect.GeneratedMethodAccessor471.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at com.webobjects.foundation.NSSelector.invoke(NSSelector.java:358) >>> at >>> com >>> .webobjects >>> .foundation.NSSelector._safeInvokeSelector(NSSelector.java:110) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._processNotificationQueue(EOEditingContext.java: >>> 4725) >>> at >>> com.webobjects.eocontrol.EOEditingContext.lock(EOEditingContext.java: >>> 4604) >>> at >>> com >>> .webobjects.eocontrol.EOEditingContext.tryLock(EOEditingContext.java: >>> 4616) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._sendOrEnqueueNotification(EOEditingContext.java: >>> 4689) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext._objectsChangedInStore(EOEditingContext.java:3546) >>> at sun.reflect.GeneratedMethodAccessor470.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> com >>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: >>> 122) >>> at >>> com.webobjects.foundation.NSNotificationCenter >>> $_Entry.invokeMethod(NSNotificationCenter.java:588) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator >>> ._objectsChangedInSubStore(EOObjectStoreCoordinator.java:693) >>> at sun.reflect.GeneratedMethodAccessor712.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> com >>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: >>> 122) >>> at >>> com.webobjects.foundation.NSNotificationCenter >>> $_Entry.invokeMethod(NSNotificationCenter.java:588) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> ._snapshotsChangedInDatabase(EODatabaseContext.java:3664) >>> at sun.reflect.GeneratedMethodAccessor710.invoke(Unknown Source) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> com >>> .webobjects.foundation.NSSelector._safeInvokeMethod(NSSelector.java: >>> 122) >>> at >>> com.webobjects.foundation.NSNotificationCenter >>> $_Entry.invokeMethod(NSNotificationCenter.java:588) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:532) >>> at >>> com >>> .webobjects >>> .foundation >>> .NSNotificationCenter.postNotification(NSNotificationCenter.java:562) >>> at >>> com >>> .webobjects >>> .eoaccess.EODatabaseContext.commitChanges(EODatabaseContext.java:6418) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator >>> .saveChangesInEditingContext(EOObjectStoreCoordinator.java:386) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.saveChanges(EOEditingContext.java:3176) >>> >>> "http-20226-Processor48" daemon prio=1 tid=0x4ae105c8 nid=0x104b in >>> Object.wait() [0x4dc6f000..0x4dc700a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor47" daemon prio=1 tid=0x4ae0f858 nid=0x104a >>> runnable >>> [0x4dcf0000..0x4dcf1120] >>> at java.net.SocketInputStream.socketRead0(Native Method) >>> at java.net.SocketInputStream.read(SocketInputStream.java:129) >>> at >>> org >>> .apache >>> .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) >>> at >>> org >>> .apache >>> .coyote >>> .http11 >>> .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) >>> at >>> org >>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: >>> 827) >>> at >>> org.apache.coyote.http11.Http11BaseProtocol >>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: >>> 664) >>> at >>> org >>> .apache >>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: >>> 527) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:684) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor46" daemon prio=1 tid=0x4ae0eae8 nid=0x1049 >>> waiting on >>> condition [0x4dd70000..0x4dd71da0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: >>> 1270) >>> at >>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer >>> $ >>> _LazyGenericRecordBinding >>> .valueInObject(_EOMutableKnownKeyDictionary.java:614) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) >>> >>> "http-20226-Processor45" daemon prio=1 tid=0x4ae0ddb0 nid=0x1048 in >>> Object.wait() [0x4ddf2000..0x4ddf2e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor44" daemon prio=1 tid=0x4ae03f58 nid=0x1047 in >>> Object.wait() [0x4de73000..0x4de73ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> >>> "http-20226-Processor43" daemon prio=1 tid=0x4ae02390 nid=0x1046 in >>> Object.wait() [0x4def4000..0x4def4f20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6eec6df0> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x6eec6df0> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> >>> "http-20226-Processor42" daemon prio=1 tid=0x0841e560 nid=0x1045 in >>> Object.wait() [0x4df75000..0x4df75fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor41" daemon prio=1 tid=0x088eb1a0 nid=0x1044 in >>> Object.wait() [0x4dff6000..0x4dff7020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor40" daemon prio=1 tid=0x088e8258 nid=0x1043 >>> waiting on >>> condition [0x4e076000..0x4e0780a0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor39" daemon prio=1 tid=0x088e7318 nid=0x1042 >>> runnable >>> [0x4e0f8000..0x4e0f9120] >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> - locked <0x687d18f0> (a java.net.SocksSocketImpl) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:450) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .DefaultServerSocketFactory >>> .acceptSocket(DefaultServerSocketFactory.java:60) >>> at >>> org >>> .apache >>> .tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java: >>> 407) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:684) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor38" daemon prio=1 tid=0x088ec3e0 nid=0x1041 in >>> Object.wait() [0x4e179000..0x4e179da0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916494d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916494d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor37" daemon prio=1 tid=0x088eb500 nid=0x1040 in >>> Object.wait() [0x4e1fa000..0x4e1fae20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916494b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916494b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor36" daemon prio=1 tid=0x091a3938 nid=0x103f in >>> Object.wait() [0x4e27b000..0x4e27bea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649490> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649490> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor35" daemon prio=1 tid=0x091a2b80 nid=0x103e in >>> Object.wait() [0x4e2fc000..0x4e2fcf20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649470> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649470> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor34" daemon prio=1 tid=0x0862cef8 nid=0x103d in >>> Object.wait() [0x4e37d000..0x4e37dfa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649450> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649450> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor33" daemon prio=1 tid=0x0921f260 nid=0x103c in >>> Object.wait() [0x4e3fe000..0x4e3ff020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649430> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649430> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor32" daemon prio=1 tid=0x0921e380 nid=0x103b in >>> Object.wait() [0x4e5fe000..0x4e5ff0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649410> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649410> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor31" daemon prio=1 tid=0x086c6b20 nid=0x103a in >>> Object.wait() [0x4e7c0000..0x4e7c1120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916493f0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916493f0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor30" daemon prio=1 tid=0x086c5db8 nid=0x1039 in >>> Object.wait() [0x4e841000..0x4e841da0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916493d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916493d0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor29" daemon prio=1 tid=0x08249350 nid=0x1038 in >>> Object.wait() [0x4e8c2000..0x4e8c2e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x916493b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x916493b0> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor28" daemon prio=1 tid=0x082489d8 nid=0x1037 in >>> Object.wait() [0x4f9fe000..0x4f9feea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649390> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649390> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor27" daemon prio=1 tid=0x09420140 nid=0x1036 in >>> Object.wait() [0x519fa000..0x519faf20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649370> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649370> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor26" daemon prio=1 tid=0x0941fd28 nid=0x1035 in >>> Object.wait() [0x51979000..0x51979fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x91649350> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x91649350> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Monitor" prio=1 tid=0x51c30138 nid=0x595 in Object.wait() >>> [0x51a7b000..0x51a7c020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6e6b48e8> (a >>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $MonitorRunnable.run(ThreadPool.java:559) >>> - locked <0x6e6b48e8> (a >>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor25" daemon prio=1 tid=0x51c2f440 nid=0x594 in >>> Object.wait() [0x51afc000..0x51afd0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>> Object.wait() [0x51b7d000..0x51b7e120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor23" daemon prio=1 tid=0x52320b70 nid=0x592 in >>> Object.wait() [0x51bfe000..0x51bfeda0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor22" daemon prio=1 tid=0x521d5e90 nid=0x591 >>> waiting on >>> condition [0x51ffd000..0x51ffee20] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor21" daemon prio=1 tid=0x521d52a0 nid=0x590 in >>> Object.wait() [0x524fe000..0x524feea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor20" daemon prio=1 tid=0x52b03bf0 nid=0x58f in >>> Object.wait() [0x52afe000..0x52afef20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor19" daemon prio=1 tid=0x52695fb0 nid=0x58e in >>> Object.wait() [0x52cfe000..0x52cfefa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor18" daemon prio=1 tid=0x52b37c50 nid=0x58d >>> waiting on >>> condition [0x530fd000..0x530ff020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:999) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:1033) >>> at >>> com >>> .webobjects >>> .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: >>> 814) >>> at >>> com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: >>> 585) >>> >>> "http-20226-Processor17" daemon prio=1 tid=0x526c1980 nid=0x58c in >>> Object.wait() [0x532bb000..0x532bc0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor16" daemon prio=1 tid=0x4fa0f908 nid=0x58b in >>> Object.wait() [0x538e2000..0x538e3120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor15" daemon prio=1 tid=0x4fa0f780 nid=0x58a in >>> Object.wait() [0x53963000..0x53963da0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor14" daemon prio=1 tid=0x52b74250 nid=0x589 in >>> Object.wait() [0x539e4000..0x539e4e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor13" daemon prio=1 tid=0x521be938 nid=0x588 in >>> Object.wait() [0x53a65000..0x53a65ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6ea04b80> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:656) >>> - locked <0x6ea04b80> (a >>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor12" daemon prio=1 tid=0x52b13970 nid=0x587 >>> waiting on >>> condition [0x53ae5000..0x53ae6f20] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor11" daemon prio=1 tid=0x52b740c8 nid=0x586 in >>> Object.wait() [0x53b67000..0x53b67fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xcd1b9410> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor10" daemon prio=1 tid=0x52387828 nid=0x585 >>> runnable >>> [0x53be8000..0x53be9020] >>> at java.net.SocketInputStream.socketRead0(Native Method) >>> at java.net.SocketInputStream.read(SocketInputStream.java:129) >>> at >>> org >>> .apache >>> .coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:737) >>> at >>> org >>> .apache >>> .coyote >>> .http11 >>> .InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:398) >>> at >>> org >>> .apache.coyote.http11.Http11Processor.process(Http11Processor.java: >>> 827) >>> at >>> org.apache.coyote.http11.Http11BaseProtocol >>> $Http11ConnectionHandler.processConnection(Http11BaseProtocol.java: >>> 664) >>> at >>> org >>> .apache >>> .tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java: >>> 527) >>> at >>> org >>> .apache >>> .tomcat >>> .util >>> .net >>> .LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) >>> at >>> org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:684) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "http-20226-Processor9" daemon prio=1 tid=0x523876a0 nid=0x584 in >>> Object.wait() [0x53c69000..0x53c6a0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor8" daemon prio=1 tid=0x521f67f0 nid=0x583 in >>> Object.wait() [0x53cea000..0x53ceb120] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0xaaede7d8> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> >>> "http-20226-Processor7" daemon prio=1 tid=0x521f9ed0 nid=0x582 >>> waiting on >>> condition [0x53de7000..0x53de8da0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.willReadRelationship(EOCustomObject.java: >>> 1270) >>> at >>> com.webobjects.eocontrol._EOMutableKnownKeyDictionary$Initializer >>> $ >>> _LazyGenericRecordBinding >>> .valueInObject(_EOMutableKnownKeyDictionary.java:614) >>> at >>> com >>> .webobjects >>> .eocontrol.EOCustomObject.storedValueForKey(EOCustomObject.java:1634) >>> >>> "http-20226-Processor6" daemon prio=1 tid=0x52356090 nid=0x581 in >>> Object.wait() [0x53e69000..0x53e69e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x99138c50> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doGet(WOServletAdaptor.java: >>> 709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "http-20226-Processor5" daemon prio=1 tid=0x52356ff0 nid=0x580 >>> waiting on >>> condition [0x53ee9000..0x53eeaea0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor4" daemon prio=1 tid=0x52691360 nid=0x57f >>> waiting on >>> condition [0x53f6a000..0x53f6bf20] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4650) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor3" daemon prio=1 tid=0x5262eba8 nid=0x57e >>> waiting on >>> condition [0x53feb000..0x53fecfa0] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $NonfairSync.wlock(ReentrantReadWriteLock.java:342) >>> at >>> java.util.concurrent.locks.ReentrantReadWriteLock >>> $WriteLock.lock(ReentrantReadWriteLock.java:637) >>> at >>> com >>> .webobjects >>> .eocontrol.EOSharedEditingContext.lock(EOSharedEditingContext.java: >>> 736) >>> at >>> com >>> .webobjects >>> .eocontrol.EOEditingContext.lockObjectStore(EOEditingContext.java: >>> 4648) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4051) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOEditingContext >>> .objectsWithFetchSpecification(EOEditingContext.java:4428) >>> >>> "http-20226-Processor2" daemon prio=1 tid=0x52b744e0 nid=0x57d >>> waiting on >>> condition [0x5406c000..0x5406e020] >>> at sun.misc.Unsafe.park(Native Method) >>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:716) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer >>> .acquireQueued(AbstractQueuedSynchronizer.java:746) >>> at >>> java >>> .util >>> .concurrent >>> .locks >>> .AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java: >>> 1076) >>> at >>> java.util.concurrent.locks.ReentrantLock >>> $NonfairSync.lock(ReentrantLock.java:184) >>> at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java: >>> 256) >>> at >>> com >>> .webobjects >>> .eocontrol >>> .EOObjectStoreCoordinator.lock(EOObjectStoreCoordinator.java:420) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:999) >>> at >>> com >>> .webobjects >>> .eoaccess >>> .EODatabaseContext >>> .registeredDatabaseContextForModel(EODatabaseContext.java:1033) >>> at >>> com >>> .webobjects >>> .eoaccess.EOUtilities.databaseContextForModelNamed(EOUtilities.java: >>> 814) >>> at >>> com.webobjects.eoaccess.EOUtilities.rawRowsForSQL(EOUtilities.java: >>> 585) >>> >>> "http-20226-Processor1" daemon prio=1 tid=0x52ba7b78 nid=0x57c in >>> Object.wait() [0x5333c000..0x5333d0a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> com >>> .webobjects >>> .appserver.WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>> 191) >>> - locked <0x7b93e440> (a >>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java:1904) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._dispatchWithPreparedApplication(WOComponentRequestHandler.java:324) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> ._handleRequest(WOComponentRequestHandler.java:369) >>> at >>> com >>> .webobjects >>> .appserver >>> ._private >>> .WOComponentRequestHandler >>> .handleRequest(WOComponentRequestHandler.java:445) >>> at >>> com >>> .webobjects >>> .appserver.WOApplication.dispatchRequest(WOApplication.java:1678) >>> at >>> com >>> .webobjects >>> .jspservlet >>> ._WOApplicationWrapper >>> .servletDispatchRequest(_WOApplicationWrapper.java:131) >>> at >>> com >>> .webobjects >>> .jspservlet.WOServletAdaptor._handleRequest(WOServletAdaptor.java:727) >>> at >>> com >>> .webobjects.jspservlet.WOServletAdaptor.doPost(WOServletAdaptor.java: >>> 695) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709) >>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: >>> 252) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) >>> >>> "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1 >>> tid=0x52321f80 nid=0x57b waiting on condition [0x54102000..0x54102120] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> org.apache.catalina.core.ContainerBase >>> $ContainerBackgroundProcessor.run(ContainerBase.java:1547) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "Timer-2" prio=1 tid=0x52b74a20 nid=0x574 in Object.wait() >>> [0x54182000..0x54182f20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6d201840> (a java.util.TaskQueue) >>> at java.util.TimerThread.mainLoop(Timer.java:509) >>> - locked <0x6d201840> (a java.util.TaskQueue) >>> at java.util.TimerThread.run(Timer.java:462) >>> >>> "Timer-1" prio=1 tid=0x4fa0fb18 nid=0x573 in Object.wait() >>> [0x54203000..0x54203fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6d2018c8> (a java.util.TaskQueue) >>> at java.util.TimerThread.mainLoop(Timer.java:509) >>> - locked <0x6d2018c8> (a java.util.TaskQueue) >>> at java.util.TimerThread.run(Timer.java:462) >>> >>> "Thread-8" prio=1 tid=0x090e20e0 nid=0x56e waiting on condition >>> [0x54284000..0x54285020] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> com >>> .XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX >>> .client.beans.Timer.run(Timer.java:110) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "PoolManagerCleanup-20012302" daemon prio=1 tid=0x52357328 nid=0x560 >>> waiting >>> on condition [0x54dfd000..0x54dfd120] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> org.apache.cayenne.conn.PoolManager >>> $PoolMaintenanceThread.run(PoolManager.java:522) >>> >>> "EventDispatchThread-1" daemon prio=1 tid=0x5230da30 nid=0x55f in >>> Object.wait() [0x54e7d000..0x54e7dda0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-0" daemon prio=1 tid=0x51c12b20 nid=0x55e in >>> Object.wait() [0x54efe000..0x54efee20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c18b350> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-4" daemon prio=1 tid=0x52654e70 nid=0x55d in >>> Object.wait() [0x54305000..0x54305ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-3" daemon prio=1 tid=0x52bd8860 nid=0x55c in >>> Object.wait() [0x54386000..0x54386f20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-2" daemon prio=1 tid=0x526f6880 nid=0x55b in >>> Object.wait() [0x54407000..0x54407fa0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-1" daemon prio=1 tid=0x52ba5c08 nid=0x55a in >>> Object.wait() [0x54ba3000..0x54ba4020] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "EventDispatchThread-0" daemon prio=1 tid=0x51c1af80 nid=0x559 in >>> Object.wait() [0x55dc2000..0x55dc30a0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> at java.lang.Object.wait(Object.java:474) >>> at >>> org.apache.cayenne.event.EventManager >>> $DispatchThread.run(EventManager.java:450) >>> - locked <0x6c133f48> (a java.util.Collections$SynchronizedList) >>> >>> "PoolManagerCleanup-18771651" daemon prio=1 tid=0x52bd8c68 nid=0x558 >>> waiting >>> on condition [0x55ec5000..0x55ec5120] >>> at java.lang.Thread.sleep(Native Method) >>> at >>> org.apache.cayenne.conn.PoolManager >>> $PoolMaintenanceThread.run(PoolManager.java:522) >>> >>> "WrapperStartStopAppMain" prio=1 tid=0x0819d920 nid=0x534 runnable >>> [0x55d41000..0x55d41fa0] >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> - locked <0x6e9a3098> (a java.net.SocksSocketImpl) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:450) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at >>> org.apache.catalina.core.StandardServer.await(StandardServer.java:388) >>> at org.apache.catalina.startup.Catalina.await(Catalina.java:615) >>> at org.apache.catalina.startup.Catalina.start(Catalina.java:575) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun >>> .reflect >>> .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294) >>> at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun >>> .reflect >>> .NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >>> at >>> sun >>> .reflect >>> .DelegatingMethodAccessorImpl >>> .invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:585) >>> at >>> org >>> .tanukisoftware >>> .wrapper.WrapperStartStopApp.run(WrapperStartStopApp.java:238) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "DestroyJavaVM" prio=1 tid=0x568d5eb8 nid=0x51c waiting on condition >>> [0x00000000..0xffff9190] >>> >>> "Wrapper-Connection" daemon prio=1 tid=0x568ae0e8 nid=0x532 runnable >>> [0x55e43000..0x55e440a0] >>> at java.net.SocketInputStream.socketRead0(Native Method) >>> at java.net.SocketInputStream.read(SocketInputStream.java:129) >>> at java.net.SocketInputStream.read(SocketInputStream.java:182) >>> at java.io.DataInputStream.readByte(DataInputStream.java:241) >>> at >>> org >>> .tanukisoftware >>> .wrapper.WrapperManager.handleSocket(WrapperManager.java:3737) >>> at >>> org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java: >>> 4084) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "Wrapper-Control-Event-Monitor" daemon prio=1 tid=0x568ac820 nid=0x530 >>> sleeping[0x55f45000..0x55f45da0] >>> at java.lang.Thread.sleep(Native Method) >>> at org.tanukisoftware.wrapper.WrapperManager >>> $3.run(WrapperManager.java:731) >>> >>> "RMI TCP Accept-0" daemon prio=1 tid=0x5689e660 nid=0x52e runnable >>> [0x5604a000..0x5604aea0] >>> at java.net.PlainSocketImpl.socketAccept(Native Method) >>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) >>> - locked <0x68888648> (a java.net.SocksSocketImpl) >>> at java.net.ServerSocket.implAccept(ServerSocket.java:450) >>> at java.net.ServerSocket.accept(ServerSocket.java:421) >>> at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:340) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> "Timer-0" daemon prio=1 tid=0x5689e158 nid=0x52d in Object.wait() >>> [0x560cb000..0x560cbf20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6a979aa8> (a java.util.TaskQueue) >>> at java.lang.Object.wait(Object.java:474) >>> at java.util.TimerThread.mainLoop(Timer.java:483) >>> - locked <0x6a979aa8> (a java.util.TaskQueue) >>> at java.util.TimerThread.run(Timer.java:462) >>> >>> "Low Memory Detector" daemon prio=1 tid=0x08149ee0 nid=0x52c runnable >>> [0x00000000..0x00000000] >>> >>> "CompilerThread1" daemon prio=1 tid=0x08148a60 nid=0x52b waiting on >>> condition [0x00000000..0x56b01248] >>> >>> "CompilerThread0" daemon prio=1 tid=0x08147a08 nid=0x52a waiting on >>> condition [0x00000000..0x56b822c8] >>> >>> "AdapterThread" daemon prio=1 tid=0x081468d0 nid=0x529 waiting on >>> condition >>> [0x00000000..0x00000000] >>> >>> "Signal Dispatcher" daemon prio=1 tid=0x08145b00 nid=0x528 waiting on >>> condition [0x00000000..0x00000000] >>> >>> "Finalizer" daemon prio=1 tid=0x0813b348 nid=0x527 in Object.wait() >>> [0x56f05000..0x56f05e20] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:120) >>> - locked <0x68958b38> (a java.lang.ref.ReferenceQueue$Lock) >>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:136) >>> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) >>> >>> "Reference Handler" daemon prio=1 tid=0x0813ae20 nid=0x526 in >>> Object.wait() >>> [0x56f86000..0x56f86ea0] >>> at java.lang.Object.wait(Native Method) >>> - waiting on <0x6a97a128> (a java.lang.ref.Reference$Lock) >>> at java.lang.Object.wait(Object.java:474) >>> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) >>> - locked <0x6a97a128> (a java.lang.ref.Reference$Lock) >>> >>> "VM Thread" prio=1 tid=0x081388d8 nid=0x525 runnable >>> >>> "GC task thread#0 (ParallelGC)" prio=1 tid=0x0807a548 nid=0x51d >>> runnable >>> >>> "GC task thread#1 (ParallelGC)" prio=1 tid=0x0807b5a0 nid=0x51e >>> runnable >>> >>> "GC task thread#2 (ParallelGC)" prio=1 tid=0x0807c1b8 nid=0x51f >>> runnable >>> >>> "GC task thread#3 (ParallelGC)" prio=1 tid=0x0807cdd8 nid=0x520 >>> runnable >>> >>> "GC task thread#4 (ParallelGC)" prio=1 tid=0x0807da10 nid=0x521 >>> runnable >>> >>> "GC task thread#5 (ParallelGC)" prio=1 tid=0x0807e648 nid=0x522 >>> runnable >>> >>> "GC task thread#6 (ParallelGC)" prio=1 tid=0x0807f280 nid=0x523 >>> runnable >>> >>> "GC task thread#7 (ParallelGC)" prio=1 tid=0x0807feb8 nid=0x524 >>> runnable >>> >>> "VM Periodic Task Thread" prio=1 tid=0x568a7868 nid=0x52f waiting on >>> condition >>> >>> Jul 30, 2008 5:30:24 PM org.apache.catalina.core.ApplicationContext >>> log >>> INFO: HTMLManager: list: Listing contexts for virtual host 'localhost' >>> [GC 1968661K->1868524K(2111040K), 0.0176210 secs] >>> Dumping JVM state. >>> Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode): >>> >>> >>> >>> Chuck Hill wrote: >>>> >>>> >>>> On Jul 31, 2008, at 10:16 AM, Fred Larken wrote: >>>> >>>>> >>>>> Yes, we are setting this in the code: >>>>> setAllowsConcurrentRequestHandling(true); >>>> >>>> The trace below is probably a symptom then, not the cause. >>>> >>>>> The session timeout is set to 30 minutes. >>>>> >>>>> How do I find out why a session is hung, or how to fix this? >>>> >>>> Check the the thread dumps that don't show this trace. >>>> >>>> Check that session's sleep() and terminate() methods can't throw. >>>> Check awake too for good measure. >>>> >>>> >>>>> I saw one post that said something about adding code to your >>>>> Application.java >>>>> Is this the correct way to fix it, or is this problem just a >>>>> result of >>>>> something else happening? >>>>> http://www.mail-archive.com/[email protected]/msg09497.html >>>>> http://www.mail-archive.com/[email protected]/msg09497.html >>>> >>>> You could try this if nothing else pans out. >>>> >>>> >>>> Chuck >>>> >>>> >>>>>> >>>>>> >>>>>> On Jul 31, 2008, at 9:52 AM, Fred Larken wrote: >>>>>> >>>>>>> >>>>>>> we have a linux server running our web objects app. After a day, >>>>>>> the >>>>>>> system >>>>>>> locks up for 30 mins. It will self-recoverbut in the mean time, >>>>>>> nobody can >>>>>>> log in or use the app. I have seen thread dumps during this period >>>>>>> and I >>>>>>> have noticed the following trace: >>>>>>> >>>>>>> >>>>>>> "http-20226-Processor24" daemon prio=1 tid=0x52321880 nid=0x593 in >>>>>>> Object.wait() [0x51b7d000..0x51b7e120] >>>>>>> at java.lang.Object.wait(Native Method) >>>>>>> - waiting on <0xaaede7d8> (a >>>>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>>>> at java.lang.Object.wait(Object.java:474) >>>>>>> at >>>>>>> com >>>>>>> .webobjects >>>>>>> .appserver >>>>>>> .WOSessionStore.checkOutSessionWithID(WOSessionStore.java: >>>>>>> 191) >>>>>>> - locked <0xaaede7d8> (a >>>>>>> com.webobjects.appserver.WOSessionStore$TimeoutEntry) >>>>>>> at >>>>>>> com >>>>>>> .webobjects >>>>>>> .appserver.WOApplication.restoreSessionWithID(WOApplication.java: >>>>>>> 1904) >>>>>>> >>>>>>> There are a lot of http threads in this state. There is one lock >>>>>>> for >>>>>>> every 4 >>>>>>> http threads waiting on it. >>>>>>> >>>>>>> Can any one explain what the above means? >>>>>> >>>>>> Are you dispatching requests concurrently? I am guessing the answer >>>>>> is >>>>>> no. Is your session timeout 30 minutes? It looks like a session >>>>>> is >>>>>> getting hung and blocking the app until it expires >>>>>> >>>>>> Chuck >>>>>> >>>>>> >>>>>> -- >>>>>> Chuck Hill Senior Consultant / VP Development >>>>>> >>>>>> Practical WebObjects - for developers who want to increase their >>>>>> overall knowledge of WebObjects or who are trying to solve specific >>>>>> problems. >>>>>> http://www.global-village.net/products/practical_webobjects >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> WebObjects-dev mailing list >>>>>> [email protected] >>>>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>>>> >>>>>> >>>>> >>>>> -- >>>>> View this message in context: >>>>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18759318.html >>>>> Sent from the WebObjects-Dev mailing list archive at Nabble.com. >>>>> >>>>> _______________________________________________ >>>>> WebObjects-dev mailing list >>>>> [email protected] >>>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>>> >>>> >>>> -- >>>> Chuck Hill Senior Consultant / VP Development >>>> >>>> Practical WebObjects - for developers who want to increase their >>>> overall knowledge of WebObjects or who are trying to solve specific >>>> problems. >>>> http://www.global-village.net/products/practical_webobjects >>>> >>>> >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> WebObjects-dev mailing list >>>> [email protected] >>>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18761699.html >>> Sent from the WebObjects-Dev mailing list archive at Nabble.com. >>> >>> _______________________________________________ >>> WebObjects-dev mailing list >>> [email protected] >>> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >>> >> >> -- >> Chuck Hill Senior Consultant / VP Development >> >> Practical WebObjects - for developers who want to increase their >> overall knowledge of WebObjects or who are trying to solve specific >> problems. >> http://www.global-village.net/products/practical_webobjects >> >> >> >> >> >> >> _______________________________________________ >> WebObjects-dev mailing list >> [email protected] >> http://www.omnigroup.com/mailman/listinfo/webobjects-dev >> >> > > -- > View this message in context: http://www.nabble.com/WOSessionStore%24TimeoutEntry-tp18756956p18775137.html > Sent from the WebObjects-Dev mailing list archive at Nabble.com. > > _______________________________________________ > WebObjects-dev mailing list > [email protected] > http://www.omnigroup.com/mailman/listinfo/webobjects-dev >