Re: train-good and train-spam; cron error
Daniel Higgins <[email protected]>
| Newsgroups | gmane.mail.spam.spamprobe.general |
|---|---|
| Message-ID | <1102793417.2908.10.camel@Feyr> |
email deliveries still go through, but they don't get the spamprobe header (that's how i know something is wrong usually, there's a lot of spam in my box :) On Sat, 2004-12-11 at 14:21, David A. Lee wrote: > I think what happens in this case is Sendmail gets blocked. I've had this happen when one account > had an error which held up a dozen spamprobes ... then all email deliver would get blocked up. > > > > > > > just chipping in for the record, > > > > on my server i still have some accounts that uses BDB (~30) and some > > that uses PBL. once in a while one process gets stuck (im assuming on > > the lock) that causes a buildup of processes for that account and > > eventually spamprobe doesn't work for ANY account (including the PBL > > ones) > > > > i can't explain it, but that's just a gotcha to be aware of if you have > > multiple accounts with BDB databases on the same server (i've never seen > > that problem with PBL, and there's a lot more of them) > > > > note that i'm NOT using a shared database (-D) and i'm still using > > spamprobe 0.9b (for BDB) and 0.9e (for PBL) > > > > On Fri, 2004-12-10 at 13:17, Brian Burton wrote: > > > John Chandler wrote: > > > > The documentation still recommends using "good" and "spam" > > > > for the initial training and for later corrrective training. > > > > > > If you use train for incoming email then you should use train-good and > > > train-spam for corrections. Using the good/spam commands would not hurt > > > anything but could increase database size. > > > > > > > > > > Would the use of "train-good" or "train-spam" > > > > in initially training spamprobe > > > > or in later corrective sessions be appropriate, > > > > in order better to control the size of the database? > > > > > > Once 1.1 is finished (needs documentation changes prior to release) the > > > proper way to build an initial database will be the auto-train command. > > > Until then I recomment using the good and spam commands. > > > > > > auto-train will do its best to minimize the database size during > > > training and will train on your saved hams and spams in a balanced way > > > that should improve starting accuracy. > > > > > > > > > > If not, could "train-good" and "train-spam" perhaps be used > > > > for just the latter part of the initial training? > > > > (That is, train on one small "good" file and one small "spam" file, > > > > then switch to "train-good" and "train-spam" and train some more.) > > > > > > As long as you mix up your mail using train-good and train-spam would be > > > fine. By that I mean if you just have two buge files (mail.good and > > > mail.spam) then using train-good and train-spam will give poor accuracy > > > to start but if you have 5 or 6 ham files and 5 or 6 spam files then > > > training with train-good and train-spam should work well if you > > > alternate them (i.e. train one on good file, then one spam file, repeat) > > > > > > > > > > 2) My cron job ran fine for seven months, > > > > but recently it has given the following error in every run. > > > > > > Your sp_words file is corrupt. If you retrain and see the exact same > > > error then maybe you have an email that is crashing SP? If that's the > > > case and it's reproducible then let me know and I can try to fix the bug. > > > > > > > > > > We are running spamprobe 1.0 on Solaris 9. > > > > Any suggestions of things to try? > > > > > > Build a new sp_words file and run db_verify on it to see if it's > > > corrupted immediately after the rebuild. If it is then we'd want to > > > know what's causing that to happen. Note that BDB is vulnerable to > > > problems if you ^C during an update. > > > > > > You might want to give the latest 1.1x release a try. It's very stable > > > and has 1.0's features but a better (I think) parser than 1.0. It also > > > has some improvements that try to clean up the database more cleanly in > > > the event of improper termination of SP during an update. > > > > > > If possible switching to PBL would be a good idea. PBL seems to be much > > > more robust than berkeley db. I'm thinking of adding QDBM support over > > > the holiday to see if it's a reasonable alternative to PBL and BDB. > > > > > > All the best, > > > ++Brian > > > > > > > > > ------------------------------------------------------- > > > SF email is sponsored by - The IT Product Guide > > > Read honest & candid reviews on hundreds of IT Products from real users. > > > Discover which products truly live up to the hype. Start reading now. > > > http://productguide.itmanagersjournal.com/ > > > _______________________________________________ > > > Spamprobe-users mailing list > > > Spamprobe-users-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > > > https://lists.sourceforge.net/lists/listinfo/spamprobe-users > > > > > > > > ------------------------------------------------------- > > SF email is sponsored by - The IT Product Guide > > Read honest & candid reviews on hundreds of IT Products from real users. > > Discover which products truly live up to the hype. Start reading now. > > http://productguide.itmanagersjournal.com/ > > _______________________________________________ > > Spamprobe-users mailing list > > Spamprobe-users-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > > https://lists.sourceforge.net/lists/listinfo/spamprobe-users > > > > > ------------------------------------------------------- > SF email is sponsored by - The IT Product Guide > Read honest & candid reviews on hundreds of IT Products from real users. > Discover which products truly live up to the hype. Start reading now. > http://productguide.itmanagersjournal.com/ > _______________________________________________ > Spamprobe-users mailing list > Spamprobe-users-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > https://lists.sourceforge.net/lists/listinfo/spamprobe-users ------------------------------------------------------- SF email is sponsored by - The IT Product Guide Read honest & candid reviews on hundreds of IT Products from real users. Discover which products truly live up to the hype. Start reading now. http://productguide.itmanagersjournal.com/