Re: consistant failures on a new kind of spam
"David A. Lee" <[email protected]> Wed, 15 Nov 2006 13:21:14 -0600
| Newsgroups | gmane.mail.spam.spamprobe.general |
|---|---|
| Message-ID | <[email protected]> |
"This explains everything !" ha !:) I've been running in hash mode for about a year now ... at a 40MB file which from the discussions in this group I figured was pleanty ... maybe even 2x pleanty ... but NO ... I'm running about 85% full ! I had no clue. Nothing "broke" so I didnt bother looking ... I do run regular cleanups daily 1 14 weekly 3 60 monthly 100000 180 but I really just guessed these numbers. I understand why brian doesnt want to give us "the perfect numbers" to use because there are none ... but ... Honestly I have no clue even after using spamprobe for years how to pick the right numbers ... I just tried now running cleanup 2 14 and it finally dropped the usage down to about 75% ... still not good though. So I'm thinking I should make a bigger DB ... or use different cleanup numbers ? How to choose ! Some simple "dummy mode" script or command would be so very useful ... Most of us dont have the time or even desire to really keep track of this stuff. I'd love some procedure that simple "works prety good without failing badly" ... Right now thats making total blind guesses and then if spamprobe doesnt crash I figure its OK ... thats got to be worse then even the most simplistic code that used internal knowlege about the hash sizes and email volume. > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > David A. Lee wrote: >> How many bytes/slot for hash tables ? >> Or even more direct question. How do I tell how full a hash table is ? >> Would be nice to have a simple command line like >> >> samprobe -how_full_is_it >> ------------ >> 1000 slots of 2000 used 50% full > > I agree that would be incredibly useful. The hash format uses 14 bytes > per slot IIRC so you can roughly divide the size of the file in bytes by > 14 to get the number of slots. The first few are reserved for internal > use. > > Right now you have to dump|wc to get the number of terms in the > database. I agree that's not very good. > > All the best, > ++Brian > > -----BEGIN PGP SIGNATURE----- > Version: PGP Desktop 9.5.1 (Build 1557) > Charset: ISO-8859-1 > > wsBVAwUBRVtiRTxRyEoJfXIFAQi51wf7BlfdNA6D1PDeCIGiBMFFCTSgcQqezQ03 > vSkw2v49eRHWpOQr7ByxeB3A3C0xNSfQFOpn/MFm4OX+Cca8V0jvzfz9VhvfOdXx > +32ukx6oXUsUJ8GIEVS0qkdOcj6yI6DhlYB7YNyFBAtbjMXCUmPfHgVynUQkgQTb > B/dQlTdf3QWS057PJ+Wme62YgBpu+AgJ0ouTAonopYYyWEb2VMvETJQwu4h67SiX > 9XHvT8hVytfl928aMGxSQV87tIssvivVPOWvQpGv94jUrFcd3nEOAbA2NThpThKV > PHzaHBWvL+mC8owhI9IJ38quULHDabNR3NBnFCJOoyxLKTpiwDZ2yw== > =JimH > -----END PGP SIGNATURE----- > > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share > your > opinions on IT & business topics through brief surveys - and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > _______________________________________________ > Spamprobe-users mailing list > Spamprobe-users-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > https://lists.sourceforge.net/lists/listinfo/spamprobe-users > ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV