Re: Delete headers before training

RW <[email protected]> Wed, 29 Sep 2010 19:38:58 +0100

Newsgroups	gmane.mail.bogofilter.general
Message-ID	<[email protected]>

On Wed, 29 Sep 2010 20:58:28 +0800
Denny Lin <[email protected]> wrote:

> Hi,
> 
> I have a corpus of 10,000 ham and 10,000 spam right now. While running
> some tests, I discovered that the headers SpamAssassin added
> (X-Spam-*) affects the accurary of bogofilter.
> 
> Is there a script I can use to delete the headers before training?
> Thanks.
> 

I pipe though this bit of awk 

/^[^[:space:]]/  {want=1}
/^$/ {body=1}
!body && /^(X-Bogo|X-DSPAM-|X-Spam-)/ {want=0}
body || want {print}
_______________________________________________
Bogofilter mailing list
[email protected]
http://www.bogofilter.org/mailman/listinfo/bogofilter