Re: BlameThorstenAndJenny: doesn't appear to classify some mails correctly after learning
"Eric S. Johansson" <[email protected]> Wed, 04 Nov 2009 12:48:20 -0500
| Newsgroups | gmane.mail.spam.crm114 |
|---|---|
| Message-ID | <[email protected]> |
On 11/3/2009 4:44 PM, Martin Steigerwald wrote:
>
> Maybe its a treshold issue? Those after learning wronly classified mails
> are all above 5 but below 10.
>
> martin@shambhala:~/Mail/.trash.directory/Unsicher/cur> grep CRM114-Status
> *
> 1257260447.22316.TzOey:2,S:X-CRM114-Status: UNSURE ( 8.75 )
> 1257260448.22316.oyQo1:2,S:X-CRM114-Status: UNSURE ( 9.35 )
> 1257261491.22316.huxyz:2,S:X-CRM114-Status: UNSURE ( 8.84 )
> 1257261491.22316.huxyz:2,S:X-CRM114-Status: UNSURE ( 8.14 )
> 1257280958.22316.OnA0L:2,S:X-CRM114-Status: UNSURE ( 8.98 )
> 1257280993.22316.Tapxy:2,S:X-CRM114-Status: UNSURE ( 7.99 )
> 1257280994.22316.czbwZ:2,S:X-CRM114-Status: UNSURE ( 9.18 )
> 1257281001.22316.Xp889:2,S:X-CRM114-Status: UNSURE ( 8.63 )
> 1257283921.22316.6uatN:2,S:X-CRM114-Status: UNSURE ( 7.12 )
>
> ("Unsicher" is the german word for "unsure")
>
I have been experiencing a similar or common even the same bug for a couple
years now. I bet if you look at the statuses and plotted them you'd find that
there is a pileup of scores near the threshold on the red and a smaller hump on
the green. this kind of problem has rendered twopenny blue almost useless
because you spend your day cleaning out hundreds of messages that should have
been classified as spam and are not training properly.
I'm more than willing to run experiments on different classifiers but I need a
simpler interface than even mail Reaver. I want no cache and an output that
makes it easier to determine what's going on without schlepping the message in
both directions.
--- eric
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july