Re: BlameThorstenAndJenny: doesn't appear to classify some mails correctly after learning

"Eric S. Johansson" <[email protected]> Wed, 04 Nov 2009 12:48:20 -0500
Newsgroups gmane.mail.spam.crm114
Message-ID <[email protected]>
On 11/3/2009 4:44 PM, Martin Steigerwald wrote:

>
> Maybe its a treshold issue? Those after learning wronly classified mails
> are all above 5 but below 10.
>
> martin@shambhala:~/Mail/.trash.directory/Unsicher/cur>  grep CRM114-Status
> *
> 1257260447.22316.TzOey:2,S:X-CRM114-Status: UNSURE (   8.75  )
> 1257260448.22316.oyQo1:2,S:X-CRM114-Status: UNSURE (   9.35  )
> 1257261491.22316.huxyz:2,S:X-CRM114-Status: UNSURE (   8.84  )
> 1257261491.22316.huxyz:2,S:X-CRM114-Status: UNSURE (   8.14  )
> 1257280958.22316.OnA0L:2,S:X-CRM114-Status: UNSURE (   8.98  )
> 1257280993.22316.Tapxy:2,S:X-CRM114-Status: UNSURE (   7.99  )
> 1257280994.22316.czbwZ:2,S:X-CRM114-Status: UNSURE (   9.18  )
> 1257281001.22316.Xp889:2,S:X-CRM114-Status: UNSURE (   8.63  )
> 1257283921.22316.6uatN:2,S:X-CRM114-Status: UNSURE (   7.12  )
>
> ("Unsicher" is the german word for "unsure")
>

I have been experiencing a similar or common even the same bug for a couple 
years now.  I bet if you look at the statuses and plotted them you'd find that 
there is a pileup of scores near the threshold on the red and a smaller hump on 
the green.  this kind of problem has rendered twopenny blue almost useless 
because you spend your day cleaning out hundreds of messages that should have 
been classified as spam and are not training properly.

I'm more than willing to run experiments on different classifiers but I need a 
simpler interface than even mail Reaver.  I want no cache and an output that 
makes it easier to determine what's going on without schlepping the message in 
both directions.

--- eric

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july