interesting cssdiff output

Jason White <[email protected]> Tue, 15 Jun 2010 12:53:03 +1000
Newsgroups gmane.mail.spam.crm114
Message-ID <[email protected]>
I have just started training CRM114 for spam detection (when last I tried it a
few years ago, I wasn't able to achieve high accuracy and deleted the CSS
files).

This time, I'm running it directly from the Debian package, version 20090807,
x86-64 architecture with an up to date Debian Sid system.

It's too early to judge accuracy, since I haven't received enough spam in the
last day or so to give sufficient training. However, I notice the following
suspect numbers in the cssdiff output:

cssdiff nonspam.css spam.css


Sparse spectra file nonspam.css has 1048577 bins total
Sparse spectra file spam.css has 1048577 bins total

 File 1 total features            :        16547
 File 2 total features            :         7219

 Similarities between files       :          665
 Differences between files        : 14081050284681

 File 1 dominates file 2          :  47244656123
 File 2 dominates file 1          : 734439413993

The difference and dominance lines seem highly suspect to me, either due to a
problem with the calculations or corrupt CSS files. Alternatively, this could
be correct and I'm just making unwarranted assumptions about the numbers.


------------------------------------------------------------------------------
ThinkGeek and WIRED's GeekDad team up for the Ultimate 
GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the 
lucky parental unit.  See the prize list and enter to win: 
http://p.sf.net/sfu/thinkgeek-promo