Re: Segmentation faults with Mozilla 1.7.3 on Solaris 9

Tom Puckett <[email protected]> Tue, 16 Nov 2004 09:00:23 -0700

Newsgroups	gmane.comp.mozilla.devel.unix
Organization	Another Netscape Collabra Server User
Message-ID	<[email protected]>

OK, after some misadventures I'm set up to get core files on the seg 
faults. pstacks on two of them are attached. Sorry, I have no idea how 
to interpret them, but hopefully someone else can make some sense of them.

Here is something that might or might not be connected. I think I saw a 
situation where a seg fault happened after Mozilla went into some sort 
of loop driving network traffic. It went completely unresponsive and 
started pushing or pulling something like 700 Kb over my 1.5 Mb DSL 
connection, possibly to my home directory which is on an NSF mount. This 
went on for several minutes before the fault happened.  Again, this 
might be a red herring.

Thanks for any help you can give.

Kyle Yuan wrote:
> Can you post the output of 'pstack core' command? Assuming there is a 
> core file left in the directory where you launched mozilla.
> 
> Tom Puckett wrote:
> 
>> I am getting frequent segmentation faults running 1.7.3 on Solaris 9.
>> This is using the Gtk library mentioned in the release notes, and there
>> are no complaints about missing patches when the program starts. The
>> fault never seems to appear on startup, but only after some minutes or
>> some hours of usage. The faults are not tied to any particular user
>> action that I have been able to identify, and often seem to appear
>> spontaneously when the program is otherwise apparently idle. (I
>> typically have both the browser and the mail tool active, and so of
>> course they both can be triggering actions on their own such as checking
>> for new mail.) I have no problems of this sort when running Mozilla 1.6
>>
>> If anyone has any suggestions as to how to deal with this or investigate
>> further I'll appreciate hearing them.
>>
>> Thanks....

pstack.2004.11.16.01:33:00 (text/plain, 8.7 KB)

core 'core.2004.11.16.01:33:00' of 14864:	/ppd/530/mozilla/mozilla/1.7.3/mozilla-bin
-----------------  lwp# 1  --------------------------------
 ff29f7bc _cerror  (b, ffbfde20, 0, fda72a44, 0, 0) + 8
 fda55e94 ???????? (b, fda55d5c, a, e0, 28, fda738c8)
 ff355b0c _thread_setschedparam_main (b, 0, ffbfdff0, fda55d98, 0, 0) + 1ac
 ff34f804 _pthread_setcleanupinit (b, 0, ffbfdff0, 0, 0, 0) + c
 ff34f9b4 _thrp_create (b, 0, ffbfdff0, aa194, fc3c7ca8, 118) + 144
 fbf3f19c ???????? (c771b0, e7d670, 252d388, 80000000, ffbfe328, ffbfe384)
 fe551060 XPTC_InvokeByIndex (c77288, 1a, 2, 10f9560, 0, 1) + 48
 fe53709c ???????? (d3a180, 2320558, 0, 0, 0, 1)
 fe52d158 PL_HandleEvent (2466ca8, fe537070, 1f0254, ff184184, 18098, 2466ca8) + 14
 fe52d084 PL_ProcessPendingEvents (1f0250, 1, 1, 2, 80004000, 90820) + 84
 fe52efc8 __1cQnsEventQdDueueImplUProcessPendingEvents6M_I_ (1ef868, 6, fe52ef9c, fdb8d1d8, 481e8, fe59dbcc) + 2c
 fdb8d1d8 ???????? (426230, 1, 3e0e58, 473350, fdb8d1b4, fdb8d63c)
 febbd08c g_main_dispatch (ffbfe708, febef76c, 23, febb90a8, febef774, 473350) + fc
 febbd900 g_main_iterate (1, 1, febef6e0, 1, 31, 0) + 7ac
 febbdb90 g_main_run (3e0ec8, 3e0ec8, 99e00, fdb8d930, 3588c, f000) + 90
 fed067d8 gtk_main (0, 71a4, 0, 1, 0, 0) + f8
 fdb8da24 ???????? (216710, 1, fdb8d9e4, 1deec, 31a28, 0)
 0001deec ???????? (fd8da2d8, fe4def74, ffbfe9a4, ffbfe9dc, ffbfe9f0, ffbfea08)
 0001eae4 main     (1, ffbfeae4, ffbfeaec, 36a34, 80000000, 20dca8) + 2c8
 0001a978 _start   (0, 0, 0, 0, 0, 0) + 108
-----------------  lwp# 2  --------------------------------
 ff29db48 ptrace   (fbd4fc80, 6, ffffffff, aaaaaaaa, 525850, 525850) + 7bc
 ff1681c8 ???????? (0, 6, ffffffff, 1e3f84, fbd4fc80, 5)
 fdfc15f0 ???????? (1e3c30, e82800, fe09d9ab, 0, fe0c7588, 1e3dec)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (1e420c, 0, fdfc1988, 90820, fbd3ff84, fe0c7620) + 24
 ff1699bc ???????? (1e4a40, 0, ff184184, 0, 2, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 16  --------------------------------
 ff3558f8 pthread_getschedparam (2bf7c8, ff368b48, 0, 0, ff320c00, ff368000) + 124
 ff353114 thr_setstate (0, 2c0dc8, fb9bfd38, 0, 0, 4199b8e3) + b8
 ff3535a4 _clean_thread (2bf7c8, 2c0dc8, fb9bfe70, ff2bc000, 3588c, 0) + 60
 ff3535d8 _clean_thread (2bf7c8, 2c0dc8, fb9bfe70, 186a0, 0, 0) + 94
 ff353618 _clean_thread (2bf7c8, 2c0dc8, fb9bfe70, 0, 0, 0) + d4
 ff1637a8 ???????? (2bf7c8, 2c0dc8, 0, 0, 44b83, 4199b91f)
 ff163a14 PR_WaitCondVar (2bf7c0, 5b8d80, 0, 0, 27df0, 126c6e0) + 84
 fdf97e44 ???????? (2c0d90, 5b8d80, 2c0db0, 69b3b22a, 2c0db0, 1)
 ff1699bc ???????? (126c6e0, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 4  --------------------------------
 ff3558f8 pthread_getschedparam (2bf980, ff368b48, 0, 0, ff320600, ff368000) + 124
 ff353114 thr_setstate (0, 2c3428, fbc6fcd8, 0, 0, 4199b8fd) + b8
 ff3535a4 _clean_thread (2bf980, 2c3428, fbc6fe10, 1e3b78, 0, 1) + 60
 ff3535d8 _clean_thread (2bf980, 2c3428, fbc6fe10, 186a0, e1, 199f0ec0) + 94
 ff353618 _clean_thread (2bf980, 2c3428, fbc6fe10, 1dcd65, 1, 1dcd64) + d4
 ff1637a8 ???????? (2bf980, 2c3428, 7f, 80, 44b83, 4199b903)
 ff163a14 PR_WaitCondVar (2bf978, 892d7, 0, 0, 69e3c913, 2c34e8) + 84
 fe534b24 __1cLTimerThreadDRun6M_I_ (892d7, 2c3360, 69db35b6, 4af2c8, fe531e00, 6) + 1d4
 fe5310dc __1cInsThreadEMain6Fpv_v_ (2bed7c, 0, fe535614, 2c0fd0, fbc5ff84, fe59df44) + 24
 ff1699bc ???????? (2c34e8, 0, ff184184, 0, 2, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 18  --------------------------------
 ff3558f8 pthread_getschedparam (e3ff98, ff368b48, 0, 0, ff320400, ff368000) + 124
 ff353114 thr_setstate (0, b9e2d0, fbc8fbf8, 0, 0, 4199b8fd) + b8
 ff3535a4 _clean_thread (e3ff98, b9e2d0, fbc8fd30, ff2bc000, ff183bcc, 0) + 60
 ff3535d8 _clean_thread (e3ff98, b9e2d0, fbc8fd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (e3ff98, b9e2d0, fbc8fd30, 0, 0, 0) + d4
 ff1637a8 ???????? (e3ff98, b9e2d0, 0, 0, 44b83, 4199b8fe)
 ff163a14 PR_WaitCondVar (e3ff90, 186a0, 0, 0, 128bd90, f978e8) + 84
 ff163d3c PR_Wait  (b9e2c8, 10000, 1, 80223, 80000000, b9e2c8) + 24
 fbf5bcd8 ???????? (128bd90, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (128bd90, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (10197dc, 0, fbf731ec, 1373fa0, fbc7ff84, fbff2c9c) + 24
 ff1699bc ???????? (f978e8, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 19  --------------------------------
 ff3558f8 pthread_getschedparam (1020af0, ff368b48, 0, 0, ff320a00, ff368000) + 124
 ff353114 thr_setstate (0, 119fae0, fb9dfbf8, 0, 0, 4199b8fd) + b8
 ff3535a4 _clean_thread (1020af0, 119fae0, fb9dfd30, fbfda5d9, 1051f9c, 1051aa8) + 60
 ff3535d8 _clean_thread (1020af0, 119fae0, fb9dfd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (1020af0, 119fae0, fb9dfd30, 0, 0, 0) + d4
 ff1637a8 ???????? (1020af0, 119fae0, 0, 0, 44b83, 4199b8fe)
 ff163a14 PR_WaitCondVar (1020ae8, 186a0, 0, 0, 132f6a0, 1162880) + 84
 ff163d3c PR_Wait  (119fad8, 10000, 1, fbf5c95c, 80000000, 119fad8) + 24
 fbf5bcd8 ???????? (132f6a0, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (132f6a0, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (1059524, 0, fbf731ec, f978e8, fb9cff84, fbff2c9c) + 24
 ff1699bc ???????? (1162880, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 9  --------------------------------
 ff3558f8 pthread_getschedparam (df7df0, ff368b48, 0, 0, ff320e00, ff368000) + 124
 ff353114 thr_setstate (0, b44230, fb99fbf8, 0, 0, 4199b8fe) + b8
 ff3535a4 _clean_thread (df7df0, b44230, fb99fd30, fbfda5d9, d18b9c, 137d658) + 60
 ff3535d8 _clean_thread (df7df0, b44230, fb99fd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (df7df0, b44230, fb99fd30, 0, 0, 0) + d4
 ff1637a8 ???????? (df7df0, b44230, 0, 0, 44b83, 4199b8ff)
 ff163a14 PR_WaitCondVar (df7de8, 186a0, 0, 0, dfdb90, e1c968) + 84
 ff163d3c PR_Wait  (b44228, 10000, 1, fbf5c95c, 80000000, b44228) + 24
 fbf5bcd8 ???????? (dfdb90, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (dfdb90, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (df6e4c, 0, fbf731ec, 7b4878, fb98ff84, fbff2c9c) + 24
 ff1699bc ???????? (e1c968, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 10  --------------------------------
 ff3558f8 pthread_getschedparam (d09a40, ff368b48, 0, 0, ff321000, ff368000) + 124
 ff353358 _thread_delete (d09a40, 2545738, 1, 1, 1, 0) + 28
 ff353394 _thread_delete (d09a40, 2545738, ff1634e8, ff184184, 3, 0) + 64
 ff1639f8 PR_WaitCondVar (d09a38, ffffffff, 0, 0, 0, a61550) + 68
 ff163d3c PR_Wait  (2545730, 10000, 1, ff184184, 18098, 2545730) + 24
 fe52d2b4 PL_WaitForEvent (2516940, ffffe897, ffffe800, 3, 65a18, 0) + 44
 fe52f238 __1cQnsEventQdDueueImplMWaitForEvent6MppnHPLEvent__I_ (10b0d50, fb97f688, 0, fe536b88, 80004000, fe52eb8c) + 28
 fe536be8 __1cNnsProxyObjectLPostAndWait6MpnVnsProxyObjectCallInfo__I_ (d3a180, 2320558, fe5309d4, 1, 5, 0) + 13c
 fe536f1c __1cNnsProxyObjectEPost6MIpnPnsXPTMethodInfo_pnRnsXPTCMiniVariant_pnQnsIInterfaceInfo__I_ (d3a180, 1a, e24588, 2320558, 2466ca8, d3a180) + 198
 fe54f874 PrepareAndDispatch (e37e68, 1a, fe59e084, 21, 92, fb97f778) + 1f4
 fe5510a4 SharedStub (e37e68, 1a, fb97f910, fbf633dc, 252d320, 1) + 30
 fe54fae4 __1cOnsXPTCStubBaseGStub266M_I_ (e37e68, e7d670, 252d388, fbf62260, 8bde4, e37e68) + 8
 fbf62260 ???????? (e7d670, 10000004, 252d388, 0, e7d7a0, 10000003)
 fbf5e450 ???????? (e7d670, fffff984, fbf61de4, 10000000, e7d7a0, 80000000)
 fbf5c51c ???????? (e7d670, 0, 80000000, fb97fd78, fb97fdf0, e7d7a0)
 fbf5bd84 ???????? (e7d670, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (e7d670, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (9e9c84, 0, fbf731ec, e1c968, fb96ff84, fbff2c9c) + 24
 ff1699bc ???????? (a61550, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 20  --------------------------------
 ff3558f8 pthread_getschedparam (10203e8, ff368b48, 0, 0, ff321200, ff368000) + 124
 ff353114 thr_setstate (0, 13e9550, fb95fbf8, 0, 0, 4199b8fd) + b8
 ff3535a4 _clean_thread (10203e8, 13e9550, fb95fd30, 0, 0, 0) + 60
 ff3535d8 _clean_thread (10203e8, 13e9550, fb95fd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (10203e8, 13e9550, fb95fd30, 0, 0, 0) + d4
 ff1637a8 ???????? (10203e8, 13e9550, 0, 0, 44b83, 4199b8fe)
 ff163a14 PR_WaitCondVar (10203e0, 186a0, 0, 0, a9fae8, 12a72e0) + 84
 ff163d3c PR_Wait  (13e9548, 10000, 1, fbf5c95c, 80000000, 13e9548) + 24
 fbf5bcd8 ???????? (a9fae8, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (a9fae8, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (1051e34, 0, fbf731ec, 1162880, fb94ff84, fbff2c9c) + 24
 ff1699bc ???????? (12a72e0, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8

pstack.2004.11.16.07:49:00 (text/plain, 10.9 KB)

core 'core.2004.11.16.07:49:00' of 15003:	/ppd/530/mozilla/mozilla/1.7.3/mozilla-bin
-----------------  lwp# 1  --------------------------------
 ff29f7bc _cerror  (b, ffbfde20, 0, fda72a44, 0, 0) + 8
 fda55e94 ???????? (b, fda55d5c, a, e0, 28, fda738c8)
 ff355b0c _thread_setschedparam_main (b, 0, ffbfdff0, fda55d98, 0, 0) + 1ac
 ff34f804 _pthread_setcleanupinit (b, 0, ffbfdff0, 0, 0, 0) + c
 ff34f9b4 _thrp_create (b, 0, ffbfdff0, aa194, fc3c7ca8, 1) + 144
 fbf3f19c ???????? (c04230, c9af88, 22d2ad8, 80000000, ffbfe328, ffbfe384)
 fe551060 XPTC_InvokeByIndex (c04308, 1a, 2, 23452f0, 3, 1) + 48
 fe53709c ???????? (f7a930, 23802c0, 0, ff2bc000, ff183bcc, 1)
 fe52d158 PL_HandleEvent (2346380, fe537070, 21f44c8, fe52d084, 2e4fc, 2346380) + 14
 fe52d084 PL_ProcessPendingEvents (1f0250, 2, 1, 2, 80004000, 90820) + 84
 fe52efc8 __1cQnsEventQdDueueImplUProcessPendingEvents6M_I_ (1ef868, 6, fe52ef9c, fdb8d1d8, 481e8, fe59dbcc) + 2c
 fdb8d1d8 ???????? (422440, 1, 404b20, 47e400, fdb8d1b4, fdb8d63c)
 febbd08c g_main_dispatch (ffbfe708, febef76c, 23, febb90a8, febef774, 47e400) + fc
 febbd900 g_main_iterate (1, 1, febef6e0, 1, 31, 0) + 7ac
 febbdb90 g_main_run (3881a0, 3881a0, 99e00, fdb8d930, 3588c, f000) + 90
 fed067d8 gtk_main (0, 71a4, 0, 1, 0, 0) + f8
 fdb8da24 ???????? (216710, 1, fdb8d9e4, 1deec, 31a28, 0)
 0001deec ???????? (fd8da2d8, fe4def74, ffbfe9a4, ffbfe9dc, ffbfe9f0, ffbfea08)
 0001eae4 main     (1, ffbfeae4, ffbfeaec, 36a34, 80000000, 20dca8) + 2c8
 0001a978 _start   (0, 0, 0, 0, 0, 0) + 108
-----------------  lwp# 2  --------------------------------
 ff29db48 ptrace   (fbd4fc80, 7, ffffffff, aaaaaaaa, 731cb0, 731cb0) + 7bc
 ff1681c8 ???????? (0, 7, ffffffff, 1e3f84, fbd4fc80, 5)
 fdfc15f0 ???????? (1e3c30, b34f20, fe09d9ab, 0, fe0c7588, 1e3dec)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (1e420c, 0, fdfc1988, 90820, fbd3ff84, fe0c7620) + 24
 ff1699bc ???????? (1e4a40, 0, ff184184, 0, 2, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 3  --------------------------------
 ff3558f8 pthread_getschedparam (27f158, ff368b48, 0, 0, ff320400, ff368000) + 124
 ff353114 thr_setstate (0, 28fde8, fbb7fcd8, 0, 0, 419a1118) + b8
 ff3535a4 _clean_thread (27f158, 28fde8, fbb7fe10, 1e3b78, 0, 1) + 60
 ff3535d8 _clean_thread (27f158, 28fde8, fbb7fe10, 186a0, 92, 9cb104c0) + 94
 ff353618 _clean_thread (27f158, 28fde8, fbb7fe10, 0, 0, 0) + d4
 ff1637a8 ???????? (27f158, 28fde8, 0, 0, 44b83, 419a1118)
 ff163a14 PR_WaitCondVar (27f150, 9d6f, 0, 0, f04b22e7, 287d58) + 84
 fe534b24 __1cLTimerThreadDRun6M_I_ (9d6f, 28fd20, f04a7e33, 233ff40, fe531e00, a) + 1d4
 fe5310dc __1cInsThreadEMain6Fpv_v_ (27fdc4, 0, fe535614, 1e4a40, fbb6ff84, fe59df44) + 24
 ff1699bc ???????? (287d58, 0, ff184184, 0, 2, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 4  --------------------------------
 ff3558f8 pthread_getschedparam (2cb6e0, ff368b48, 0, 0, ff320600, ff368000) + 124
 ff353114 thr_setstate (0, 2ccc70, fbb5fd38, 0, 0, 419a1116) + b8
 ff3535a4 _clean_thread (2cb6e0, 2ccc70, fbb5fe70, ff2bc000, 3588c, 0) + 60
 ff3535d8 _clean_thread (2cb6e0, 2ccc70, fbb5fe70, 186a0, 0, 0) + 94
 ff353618 _clean_thread (2cb6e0, 2ccc70, fbb5fe70, 0, 0, 0) + d4
 ff1637a8 ???????? (2cb6e0, 2ccc70, 0, 0, 44b83, 419a1152)
 ff163a14 PR_WaitCondVar (2cb6d8, 5b8d80, 0, 0, 27df0, 2cce78) + 84
 fdf97e44 ???????? (2ccc38, 5b8d80, 2ccc58, f0487b47, 2ccc58, 1)
 ff1699bc ???????? (2cce78, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 12  --------------------------------
 ff3558f8 pthread_getschedparam (23452d0, ff368b48, 0, 0, ff320a00, ff368000) + 124
 ff353358 _thread_delete (23452d0, 20d9c30, 1, 1, 1, 0) + 28
 ff353394 _thread_delete (23452d0, 20d9c30, ff1634e8, ff184184, 3, 0) + 64
 ff1639f8 PR_WaitCondVar (23452c8, ffffffff, 0, 0, 0, b34eb0) + 68
 ff163d3c PR_Wait  (20d9c28, 10000, 1, ff184184, 18098, 20d9c28) + 24
 fe52d2b4 PL_WaitForEvent (1fb8a10, ffffe897, ffffe800, 3, 65a18, 0) + 44
 fe52f238 __1cQnsEventQdDueueImplMWaitForEvent6MppnHPLEvent__I_ (2345278, fb98f628, 0, fe536b88, 80004000, fe52eb8c) + 28
 fe536be8 __1cNnsProxyObjectLPostAndWait6MpnVnsProxyObjectCallInfo__I_ (c15328, 1e6e610, fe5309d4, 1, 5, 0) + 13c
 fe536f1c __1cNnsProxyObjectEPost6MIpnPnsXPTMethodInfo_pnRnsXPTCMiniVariant_pnQnsIInterfaceInfo__I_ (c15328, 1c, c9f010, 1e6e610, 21f44c8, c15328) + 198
 fe54f874 PrepareAndDispatch (f838d0, 1c, fe59e084, 28, 92, fb98f718) + 1f4
 fe5510a4 SharedStub (f838d0, 1c, fb98f8b0, 4, 35940, 1) + 30
 fe54fb14 __1cOnsXPTCStubBaseGStub286M_I_ (f838d0, ed5190, ed545c, fbf633dc, 22d2a10, 1) + 8
 fbf629a4 ???????? (ed5190, 0, 0, 400, 8bcdc, f838d0)
 fbf62318 ???????? (ed5190, 10000004, 7c3118, 0, ed52c0, 10000003)
 fbf5e450 ???????? (ed5190, fffff984, fbf61de4, 10000000, ed52c0, 80000000)
 fbf5c51c ???????? (ed5190, 0, 80000000, fb98fd78, fb98fdf0, ed52c0)
 fbf5bd84 ???????? (ed5190, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (ed5190, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (d20944, 0, fbf731ec, a19138, fb97ff84, fbff2c9c) + 24
 ff1699bc ???????? (b34eb0, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 8  --------------------------------
 ff3558f8 pthread_getschedparam (2cb6e0, ff368b48, 0, 0, ff320c00, ff368000) + 124
 ff353114 thr_setstate (0, 2ccc70, fb96fd38, 0, 0, 419a10e9) + b8
 ff3535a4 _clean_thread (2cb6e0, 2ccc70, fb96fe70, ff2bc000, 3588c, 0) + 60
 ff3535d8 _clean_thread (2cb6e0, 2ccc70, fb96fe70, 186a0, 0, 0) + 94
 ff353618 _clean_thread (2cb6e0, 2ccc70, fb96fe70, 0, 0, 0) + d4
 ff1637a8 ???????? (2cb6e0, 2ccc70, 0, 0, 44b83, 419a1125)
 ff163a14 PR_WaitCondVar (2cb6d8, 5b8d80, 0, 0, 27df0, ab42c8) + 84
 fdf97e44 ???????? (2ccc38, 5b8d80, 2ccc58, f0032c1c, 2ccc58, 1)
 ff1699bc ???????? (ab42c8, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 13  --------------------------------
 ff3558f8 pthread_getschedparam (1ef9d8, ff368b48, 0, 0, ff320e00, ff368000) + 124
 ff353114 thr_setstate (0, 1e49e0, fb94fcd0, 0, 0, 419a1116) + b8
 ff3535a4 _clean_thread (1ef9d8, 1e49e0, fb94fe08, ff2bc000, ff1821fc, 1) + 60
 ff3535d8 _clean_thread (1ef9d8, 1e49e0, fb94fe08, 186a0, 0, 0) + 94
 ff353618 _clean_thread (1ef9d8, 1e49e0, fb94fe08, 0, 0, 0) + d4
 ff1637a8 ???????? (1ef9d8, 1e49e0, 0, 0, 44b83, 419a1152)
 ff163a14 PR_WaitCondVar (1ef9d0, 5b8d80, 0, 0, 27df0, cc0568) + 84
 fdfd2164 ???????? (1e5488, fb94ff3c, 5b8d80, 1e54c4, f047bd59, fdfd2200)
 fdfd24e8 ???????? (1e5488, 2341728, 804b001e, b34eb0, fb93ff84, 804b0000)
 ff1699bc ???????? (cc0568, 0, ff184184, 1, 7, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 10  --------------------------------
 ff3558f8 pthread_getschedparam (c71068, ff368b48, 0, 0, ff321000, ff368000) + 124
 ff353114 thr_setstate (0, afcfb0, fb92fbf8, 0, 0, 419a1117) + b8
 ff3535a4 _clean_thread (c71068, afcfb0, fb92fd30, 0, 0, 0) + 60
 ff3535d8 _clean_thread (c71068, afcfb0, fb92fd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (c71068, afcfb0, fb92fd30, 0, 0, 0) + d4
 ff1637a8 ???????? (c71068, afcfb0, 0, 0, 44b83, 419a1118)
 ff163a14 PR_WaitCondVar (c71060, 186a0, 0, 0, c77f70, c78840) + 84
 ff163d3c PR_Wait  (afcfa8, 10000, 1, fbf5c95c, 80000000, afcfa8) + 24
 fbf5bcd8 ???????? (c77f70, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (c77f70, 1, 93090, 0, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (c718b4, 0, fbf731ec, abf790, fb91ff84, fbff2c9c) + 24
 ff1699bc ???????? (c78840, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 11  --------------------------------
 ff3558f8 pthread_getschedparam (2345258, ff368b48, 0, 0, ff321200, ff368000) + 124
 ff353358 _thread_delete (2345258, 2348e88, 1, 1, 1, 0) + 28
 ff353394 _thread_delete (2345258, 2348e88, ff1634e8, ff184184, 3, 0) + 64
 ff1639f8 PR_WaitCondVar (2345250, ffffffff, 0, 0, 0, a19138) + 68
 ff163d3c PR_Wait  (2348e80, 10000, 1, ff184184, 18098, 2348e80) + 24
 fe52d2b4 PL_WaitForEvent (23418f0, ffffe897, ffffe800, 3, 65a18, 0) + 44
 fe52f238 __1cQnsEventQdDueueImplMWaitForEvent6MppnHPLEvent__I_ (2345318, fb90f688, 0, fe536b88, 80004000, fe52eb8c) + 28
 fe536be8 __1cNnsProxyObjectLPostAndWait6MpnVnsProxyObjectCallInfo__I_ (f7a930, 23802c0, fe5309d4, 1, 5, 0) + 13c
 fe536f1c __1cNnsProxyObjectEPost6MIpnPnsXPTMethodInfo_pnRnsXPTCMiniVariant_pnQnsIInterfaceInfo__I_ (f7a930, 1a, c9eff0, 23802c0, 2346380, f7a930) + 198
 fe54f874 PrepareAndDispatch (1f47230, 1a, fe59e084, 21, 92, fb90f778) + 1f4
 fe5510a4 SharedStub (1f47230, 1a, fb90f910, fbf633dc, f8a250, 1) + 30
 fe54fae4 __1cOnsXPTCStubBaseGStub266M_I_ (1f47230, c9af88, 22d2ad8, fbf62260, 8bde4, 1f47230) + 8
 fbf62260 ???????? (c9af88, 10000004, 22d2ad8, 0, c9b0b8, 10000003)
 fbf5e450 ???????? (c9af88, fffff984, fbf61de4, 10000000, c9b0b8, 80000000)
 fbf5c51c ???????? (c9af88, 0, 80000000, fb90fd78, fb90fdf0, c9b0b8)
 fbf5bd84 ???????? (c9af88, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (c9af88, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (c469dc, 0, fbf731ec, c78840, fb8fff84, fbff2c9c) + 24
 ff1699bc ???????? (a19138, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 14  --------------------------------
 ff3558f8 pthread_getschedparam (d291e0, ff368b48, 0, 0, ff321400, ff368000) + 124
 ff353114 thr_setstate (0, d3a950, fb8dfbf8, 0, 0, 419a1118) + b8
 ff3535a4 _clean_thread (d291e0, d3a950, fb8dfd30, fbfda5d9, cc1ea4, c71928) + 60
 ff3535d8 _clean_thread (d291e0, d3a950, fb8dfd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (d291e0, d3a950, fb8dfd30, 0, 0, 0) + d4
 ff1637a8 ???????? (d291e0, d3a950, 0, 0, 44b83, 419a1119)
 ff163a14 PR_WaitCondVar (d291d8, 186a0, 0, 0, 50c638, aa7938) + 84
 ff163d3c PR_Wait  (d3a948, 10000, 1, fbf5c95c, 80000000, d3a948) + 24
 fbf5bcd8 ???????? (50c638, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (50c638, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (c5e994, 0, fbf731ec, cc0568, fb8cff84, fbff2c9c) + 24
 ff1699bc ???????? (aa7938, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8
-----------------  lwp# 15  --------------------------------
 ff3558f8 pthread_getschedparam (9d0900, ff368b48, 0, 0, ff321600, ff368000) + 124
 ff353114 thr_setstate (0, c4ff38, fb8bfbf8, 0, 0, 419a1117) + b8
 ff3535a4 _clean_thread (9d0900, c4ff38, fb8bfd30, fbfda5d9, 8c40b4, f83870) + 60
 ff3535d8 _clean_thread (9d0900, c4ff38, fb8bfd30, 186a0, 0, 0) + 94
 ff353618 _clean_thread (9d0900, c4ff38, fb8bfd30, 0, 0, 0) + d4
 ff1637a8 ???????? (9d0900, c4ff38, 0, 0, 44b83, 419a1118)
 ff163a14 PR_WaitCondVar (9d08f8, 186a0, 0, 0, d5c980, 9e8360) + 84
 ff163d3c PR_Wait  (c4ff30, 10000, 1, fbf5c95c, 80000000, c4ff30) + 24
 fbf5bcd8 ???????? (d5c980, 1, 186a0, 0, ffffe897, 80000)
 fbf5b2b0 ???????? (d5c980, 1, 93090, fe53183c, 0, 0)
 fe5310dc __1cInsThreadEMain6Fpv_v_ (583e1c, 0, fbf731ec, aa7938, fb8aff84, fbff2c9c) + 24
 ff1699bc ???????? (9e8360, 0, ff184184, 1, 3, ff1821fc)
 ff3557b4 pthread_getspecific (0, 0, 0, 0, 0, 0) + 8