Re: Multi server fix?

Doug McLaren <[email protected]> Tue, 5 Apr 2005 08:37:44 -0500
Newsgroups gmane.network.ubh
Message-ID <[email protected]>
On Tue, Apr 05, 2005 at 08:11:24AM -0500, Shalon Wood wrote:

| Ubh3, sorry. (Are people still using ubh2?)

Yes.  I am, at least.  No real need to upgrade.

| It seems to work okay -- at least, I got files last night, and I'd
| activated all my servers.
| 
| One other thing I've noticed -- when running ubh, it hangs for a
| fairly long time at 'Processing Multipart Articles' before it actually
| starts downloading. I assume that at that point it's deciding which
| articles to get, right? (doing some form of select against the DB?)
| 
| Is there any way to move that into a separate action, done ahead of
| time?

You want it to filter the list of articles, to decide what it wants to
download and decode, before it's downloaded the list of articles? :)

There's a lot of processing involved in that step -- grep it against
the $OPT_I (in ubh2 anyways) stuff, then remove the $OPT_X stuff, then
see if you have every part of a given item ... it's slow when a group
has 100,000+ articles.  And the only way I know of to really speed it
up would be to write that part in C, which really isn't practical and
may not help that much anyways (I've looked at the code, and don't see
anything obvious to do in perl anyways.)

-- 
Doug McLaren, [email protected]
Today is the first day of the rest of the mess.


 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/ubh/

<*> To unsubscribe from this group, send an email to:
    [email protected]

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/