athena eats my cpu
Werner Thie <[email protected]> Tue, 04 Sep 2007 07:47:05 +0200
| Newsgroups | gmane.comp.python.quotient.dev |
|---|---|
| Message-ID | <[email protected]> |
Hi all I implemented a cardgame, which makes approximately one call up to the client per second in autoplay mode. Everything is fine with one client, the server runs for days, no apparent problem. Now, if I move my app from Windows to a hefty OpenBSD V4.1) server class machine, multihomed Internet connection, RAID, ... and connect 9 more clients I see an initial CPU load of say 10%, everything is working seemingly fine, but now things get out of hand: CPU usage is increasing steadily up until where the server disconnects clients. Different type of reactors show the same basic behavior, only the gradient of the increase varies. Linux (Ubuntu server, latest version) shows the same symptoms. Windows comes in first, with barely an increase in CPU usage detectable. gc, cProfile to the rescue, I studied printouts for hours and tried to detect a pattern, but so far no luck, I am out of my wits. Has someone out there experienced such problems and is willing to give me a hint, I am grateful for the smallest straw. Thanks, Werner Jean-Paul Calderone wrote: > On Thu, 26 Jul 2007 08:22:27 +0200, Werner Thie > <[email protected]> wrote: >> I am suffering from the same problem in athena like Michael Graz >> described in his post from the 12.Jan 2007. >> Jean-Paul asked for an example, Michael provided one and silence since >> then. >> >> After having received no answer to my own post regarding this issue I >> bring up this subject again, since it is observable since at least >> nevow 0.7 in the widgets example. (I have no earlier version anymore). >> If somebody could provide some pointers where to hook into I might >> invest time to fix this. >> >> It's very annoying to have to clean the logs for customers from a >> gazillion 'Athena transport duplicate message, discarding...' even >> when their harmless. > > I can think of a few possible courses of action. > > I could remove the log message. The duplicates would still occur, of > course, but no one would know about them. > > Someone else could tackle Twisted ticket #638, allowing you to avoid > actually recording this event in the log file. > > Someone else could work on improving Athena such that duplicates occur > only in the case where they really cannot be avoided. This might result > in a small enough number of messages so that they wouldn't be a bother > to your customers, or it might leave the code in a state where the log > message really isn't conveying _any_ useful information and it could be > removed. > > I probably only have time to address this in the first way myself. Any > contributions towards the other two solutions would be welcome, though. > > Jean-Paul > > _______________________________________________ > Divmod-dev mailing list > [email protected] > http://divmod.org/users/mailman.twistd/listinfo/divmod-dev