Re: Delete headers before training

Ed Blackman <[email protected]>
Newsgroups gmane.mail.bogofilter.general
Message-ID <[email protected]>
On Wed, Sep 29, 2010 at 08:58:28PM +0800, Denny Lin wrote:
>I have a corpus of 10,000 ham and 10,000 spam right now. While running
>some tests, I discovered that the headers SpamAssassin added (X-Spam-*)
>affects the accurary of bogofilter.
>
>Is there a script I can use to delete the headers before training?

Piping a message through "formail -I X-Spam" removes all X-Spam header 
lines.  It's unlikely that those kinds of headers would have 
continuations, but formail will correctly handle them if so.

formail is part of procmail, so it's fairly common for it to already 
be installed on Unix systems.

Ed

_______________________________________________
Bogofilter mailing list
[email protected]
http://www.bogofilter.org/mailman/listinfo/bogofilter
signature.txt (application/pgp-signature, 190 B)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)

iD4DBQFMo1a03nrUNJhVPs4RAjEDAJiiSbX+8/2GM2e2sAW++if+LnU4AJ4qOwtx
b3oOJPpJ9qsRxBLoi7AawA==
=SvgU
-----END PGP SIGNATURE-----
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.