Re: spamprobe-1.1x7 released

Jem wrote:
> Also, I built spamprobe without either DB or PBL. It works fine :) One 
> question,
> 
> I'm using train mode in procmail and periodic cleanups in crontab. I'm also 
> trying to evaluate how "full" my hash database is. What's a good way to 
> check this? I thought of something like spamprobe export | wc -l, in order 
> to count the number of terms (one per line).

Yes, I use export|wc to count terms also.  spamprobe counts can be used 
to see how many messages you've trained on but there isn't a built in 
command for counting actual terms.


> Then you said the size 
> occupied is approximately the number of terms * 24 bytes? Is that right?

To decide what percentage of your file you are using you can take 
(number of terms * 12) to get roughly the minimum size in bytes required 
to hold your terms.

Since hash tables need free space to minimize the performance hit from 
hash collisions I suggested the (24 * number of terms) formula as a way 
of projecting a comfortable file size for the number of terms you have 
or expect to have.  So if you have 2 million terms in your database a 24 
meg hash file would barely be able to contain them with no free space 
but a 48 meg hash file is recommended to have best performance and some 
growing room.

All the best,
++Brian


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click