Re: Any way to mitigate slowdown caused by scoring on article headers?
Grant Edwards <[email protected]>
| Newsgroups | gmane.network.slrn.user |
|---|---|
| Message-ID | <[email protected]> |
On 2008-05-09, Troy Piggins <[email protected]> wrote: > * Grant Edwards is quoted & my replies are inline below : >> I recently started scoring articles on header fields other >> than subject, and it's causing about a 100X slowdown when I >> enter a group. Previously (scoring only on subject headers), >> a single XOVER command grabbed all of the info needed. Now >> slrn sends commands to fetch headers for each article. I >> don't suppose there's anything I can do to mitigate the >> problem? (Without letting in the flood of spam from google >> groups.) > > What header are you scoring on? Organization: Message-ID: Subject: > How many messages in the group? Somewere between 0 and 200. If I score on Subject: alone, slrn retrives headers for about 100-200 articles per second using the XOVER command to grab a bunch of them in one transaction. If I score on Organization: and Message-ID:, slrn sends an individual command to fetch each header for each article, and that probably runs at 2-5 articles per second. After doing some more informal timing, the slowdown is probably closer to 50X than 100X. -- Grant Edwards grante Yow! I am a jelly donut. at I am a jelly donut. visi.com ------------------------------------------------------------------------- This SF.net email is sponsored by the 2008 JavaOne(SM) Conference Don't miss this year's exciting event. There's still time to save $100. Use priority code J8TL2D2. http://ad.doubleclick.net/clk;198757673;13503038;p?http://java.sun.com/javaone