Re: Multi server fix?

Shalon Wood <[email protected]> Tue, 05 Apr 2005 08:53:54 -0500
Newsgroups gmane.network.ubh
Message-ID <[email protected]>
Doug McLaren <[email protected]> writes:

> On Tue, Apr 05, 2005 at 08:11:24AM -0500, Shalon Wood wrote:
>
> | Ubh3, sorry. (Are people still using ubh2?)
>
> Yes.  I am, at least.  No real need to upgrade.
>
> | It seems to work okay -- at least, I got files last night, and I'd
> | activated all my servers.
> | 
> | One other thing I've noticed -- when running ubh, it hangs for a
> | fairly long time at 'Processing Multipart Articles' before it actually
> | starts downloading. I assume that at that point it's deciding which
> | articles to get, right? (doing some form of select against the DB?)
> | 
> | Is there any way to move that into a separate action, done ahead of
> | time?
>
> You want it to filter the list of articles, to decide what it wants to
> download and decode, before it's downloaded the list of articles? :)

No, I'd like it to do that after the ubhasm step but before ubh itself
is run. I haven't looked at the code yet to see exactly what it's
doing there, though.

>
> There's a lot of processing involved in that step -- grep it against
> the $OPT_I (in ubh2 anyways) stuff, then remove the $OPT_X stuff, then
> see if you have every part of a given item ... it's slow when a group
> has 100,000+ articles.  And the only way I know of to really speed it
> up would be to write that part in C, which really isn't practical and
> may not help that much anyways (I've looked at the code, and don't see
> anything obvious to do in perl anyways.)

Some of that's done by ubhasm, right? And as I think about it, the
$OPT_I and $OPT_X parts _could_ be done ahead of time for the values
set in .ubhrc (you'd have to redo that step if the user specifies a
value on the command line, of course).

Shalon Wood

-- 
Check out Strange Love -- an ezine of science fiction, fantasy, and
paranormal erotica. Only $2 for more than 20,000 words of fiction!

                 http://strangelove.pele.cx


 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/ubh/

<*> To unsubscribe from this group, send an email to:
    [email protected]

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/