Re: CRM-114 customization for chocolate?

Martin Steigerwald <[email protected]> Sat, 15 Oct 2011 12:13:54 +0200
Newsgroups gmane.mail.spam.crm114
Message-ID <[email protected]>
Hi Bill,

Am Freitag, 14. Oktober 2011 schrieben Sie:
> Martin Steigerwald <[email protected]> writes:
> >> What I would like to have is a mailreaver type system that
> >> classifies messages into several categories, eg. personal messages,
> >> work messages, desired commercial messages, etc. and spam.  In this
> >> way I could handle the desired commercial messages at my own
> >> convenience (rather than having them interrupt my thoughts when
> >> they randomly show up).  Also spam/desired commercial errors would
> >> be much less bothersome.  I can think of a couple of different ways
> >> of doing this (including maintaining a whitelist of desired
> >> commercial senders, and flagging all undesired commercial e-mail as
> >> spam, or running a cascade of standard mailreaver filters; first
> >> separating commercial e-mail from everything else, and then
> >> dividing commercial e-mail into good and bad).  However I presume
> >> others have thought about more generalized classification of
> >> messages, and I realize than in the time I could implement this,
> >> someone more directly skilled could do 10x the product at much
> >> higher quality.
> > 
> > as an idea. I thought CRM114 could actually replace manually setting
> > up mail filters that sort mail into folders. I just drag mails in
> > folders and CRM114 learns it.
> 
> Multi-class differentiation is a _much_ harder problem.
> 
> We've tried all sorts of ideas on the 20-newsgroups test-set (which is
> sort of the "world standard" for this kind of problem, thank you Jason
> Rennie) and we get what everyone else gets - about 90% correct
> placement (i.e. 85% lower bound, 90% is a publishable result, and
> 92% is the best reported by anyone anywhere to my knowledge)
> 
> Interestingly, it does not seem to matter what the algorithm is;
> you always get somewhere around 90% accuracy.

Hmmmm... thanks for the information. So its (program-assisted) manually 
creating filters until research comes up with something different then... ;)

Ciao,
-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct