Re: Any way to mitigate slowdown caused by scoring on article headers?
Troy Piggins <[email protected]>
| Newsgroups | gmane.network.slrn.user |
|---|---|
| Message-ID | <[email protected]> |
* Grant Edwards is quoted & my replies are inline below : > On 2008-05-09, Troy Piggins <[email protected]> wrote: > > * Grant Edwards is quoted & my replies are inline below : > > >> I recently started scoring articles on header fields other > >> than subject, and it's causing about a 100X slowdown when I > >> enter a group. Previously (scoring only on subject headers), > >> a single XOVER command grabbed all of the info needed. Now > >> slrn sends commands to fetch headers for each article. I > >> don't suppose there's anything I can do to mitigate the > >> problem? (Without letting in the flood of spam from google > >> groups.) > > > > What header are you scoring on? > > Organization: Try getting rid of the Organization: score. It's not an XOVER header. If you limit scoring rules to just these headers it will be /much/ faster: Subject From Date Message-ID References Bytes Lines Xref:full > Message-ID: > Subject: > > > How many messages in the group? > > Somewere between 0 and 200. > > If I score on Subject: alone, slrn retrives headers for about > 100-200 articles per second using the XOVER command to grab a > bunch of them in one transaction. If I score on Organization: > and Message-ID:, slrn sends an individual command to fetch each > header for each article, and that probably runs at 2-5 articles > per second. After doing some more informal timing, the > slowdown is probably closer to 50X than 100X. Message-ID should be fine. It's Organization causing the problem IMO. -- Troy Piggins | http://piggo.com/~troy/slrn ___ | __ __ |___ | |/ |/ | ___| | | | | ------------------------------------------------------------------------- This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone