Re: crm114 on 64 bit SuSE

Thomas Spahni <[email protected]>
Newsgroups gmane.mail.spam.crm114
Message-ID <[email protected]>
On Thu, 14 Aug 2008, Paolo wrote:

> On Wed, Aug 13, 2008 at 06:24:26PM +0200, Thomas Spahni wrote:
> > > > Any ideas why count of messages learned goes up by 2 after learning one 
> > > > message? I never observed this on 32bit systems.
> > > 
> > > which classifier? all? - I suspect a raw bytes count's biting us ...
> > 
> > I observed this with 'osb unique microgroom' (default).
> 
> beside Gerrit's suggestion, try zero setup, basic commands:
> 
> ! crm '-{learn <osb unique microgroom> (s)}' < doc1
> ! cssutil -b -r s
> 
> here 'Documents learned' should say '1'; then redo
> 
> ! crm '-{learn <osb unique microgroom> (s)}' < doc2
> ! cssutil -b -r s
> 
> here 'Documents learned' should say '2'; then redo
> 
> pls post output from both cssutil run, as well as 'ls -l s'.
> 
> if you get 2 and 4 instead, that'd rule out .crm and point right to the 
> crm binary.

Hi Paolo

I added
:goodcss: /s/
to mailfilter.cf and then did:

tsp@host:~/crmtest> crm '-{learn <osb unique microgroom> (s)}' < doc1

tsp@host:~/crmtest> cssutil -b -r s

 Sparse spectra file s statistics:

 Total available buckets          :       524287
 Total buckets in use             :           40
 Total in-use zero-count buckets  :            0
 Total buckets with value >= max  :            0
 Total hashed datums in file      :           40
 Documents learned                :            1
 Features learned                 :           41
 Average datums per bucket        :         1.00
 Maximum length of overflow chain :            1
 Average length of overflow chain :         1.00
 Average packing density          :         0.00

tsp@host:~/crmtest> crm '-{learn <osb unique microgroom> (s)}' < doc2

tsp@host:~/crmtest> cssutil -b -r s

 Sparse spectra file s statistics:

 Total available buckets          :       524287
 Total buckets in use             :           68
 Total in-use zero-count buckets  :            0
 Total buckets with value >= max  :            0
 Total hashed datums in file      :           68
 Documents learned                :            2
 Features learned                 :           69
 Average datums per bucket        :         1.00
 Maximum length of overflow chain :            1
 Average length of overflow chain :         1.00
 Average packing density          :         0.00

tsp@host:~/crmtest> ls -l s
-rw-r--r-- 1 tsp users 12582888 15. Aug 09:32 s

tsp@host:~/crmtest> ./mailreaver.crm < doc3
And this just to test mailreaver action
X-CRM114-Version: 20070810-BlameTheSegfault ( TRE 0.7.5 (LGPL) ) MR-FFFFFFFF
X-CRM114-CacheID: sfid-20080815_093822_101183_0F41B71A
Message-Id: (sfid-20080815_093822_101183_0F41B71A)
X-CRM114-Status: UNSURE (   0.00  )
X-CRM114-Notice: Please train this message.

tsp@host:~/crmtest> echo "X-CRM114-CacheID: 
sfid-20080815_093822_101183_0F41B71A" | ./mailreaver.crm --good
X-CRM114-CacheID: sfid-20080815_093822_101183_0F41B71A
X-CRM114-Action: LEARNED AND CACHED GOOD

tsp@host:~/crmtest> ./cssutil -b -r s

 Sparse spectra file s statistics:

 Total available buckets          :       524287
 Total buckets in use             :          104
 Total in-use zero-count buckets  :            0
 Total buckets with value >= max  :            0
 Total hashed datums in file      :          106
 Documents learned                :            4
 Features learned                 :          107
 Average datums per bucket        :         1.02
 Maximum length of overflow chain :            1
 Average length of overflow chain :         1.00
 Average packing density          :         0.00


Scratching my head. Counts up ONE for each message learned 'low level' and 
then counts up TWO for one message learned by mailreaver/mailtrainer.

Best regards
Thomas Spahni


-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.