Re: cleanup

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

k b wrote:
> The readme says this about the cleanup function:
> 
> Scans the database and removes all terms with junk_count or less
>    (default 2) which have not had their counts modified in at least
>    max_age days (default 7).
> 
> What is junk_count defined as?
> is it the spam_count (I assumed this, since spam is junk),
> or is it the token's total count?

Sorry it wasn't more clear in the documentation.  I need to change it to 
something like this:

cleanup [max_count min_age]...
     Scans the database and removes all terms with a total count (good
     plus spam count) of max_count or less (default 2) which have not
     had their counts modified in at least min_age days (default 7).
     You can specify multiple count/age pairs on a single command line
     but must specify both a count and an age for all but the last count.
     This should be run periodically to keep the database from growing
     endlessly.

The default value of 2 is good for catching unique terms (most terms 
found by SP turn out to be unique but SP doesn't know in advance which 
ones will be).  To really scrub your database you might want to use a 
much higher number with a long number of days.  Something like this to 
clean out all terms with total count <= 100,000 not seen in 6 months 
might be a good idea:

   spamprobe cleanup 100000 180

All the best,
++Brian

-----BEGIN PGP SIGNATURE-----
Version: PGP Desktop 9.0.4 (Build 4042)

iQEVAwUBQ95kXDxRyEoJfXIFAQj3RwgAsbfGkh3kIBkhJY86aUWPH62jUQOMsSaW
wT6Fs7QZS555ZG0BZhvacF23GFEKFwAwYelSQSzGZ/vDLIGtrOamcT3iUqfv1iFJ
ETMzBRcVmhGvH2xX5jedw8m0qJ3UJ9jIc8uPjQ/Z4A5Qa9m8aY0xVLDJ/oIVDkWW
/txbhz+qkOm1zZFVWlQ0AXxiZ0sw6fsMcgC10DaCcFLBDndcW23yVNUucXBl36hN
368cAclLtv80mX5O0wf2lx3gtQG5jYkWhkuZs0LWP2cIdRWeP+ofo9C0uPFbnKdw
i6BAS7hfUZAgj3wbsGjfCdxJptx7woXftim1vqDd3/QpdzCXUt1EcQ==
=L9rj
-----END PGP SIGNATURE-----


-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=103432&bid=230486&dat=121642