Re: crm114 on 64 bit SuSE

On Tue, 12 Aug 2008, Ger Hobbelt wrote:

> On Tue, Aug 12, 2008 at 10:07 AM, Thomas Spahni <[email protected]> wrote:
> >> Don't know where yet, but definitely a screwup in my mail*.crm scripts.
> >
> > Yes, when find is syscalled it gets a -name argument with / at the end.
> 
> What I need to (re-)discover is why I did that. (I seem to recall an
> issue I had with double / slashes in some paths in there a while back,
> but I didn't write it down and other stuff has pushed it out of my
> brain FIFO, so I'll have to pay for that.
> 
> 
> >> make megatest_ng
> >
> > I could not find a target 'megatest_ng' in the Makefile
> > (crm-114-20080502-BlameJason-Ger-2423) but there is /tests/megatest_ng.sh.
> > How do I run that?
> 
> Ah, yeah, quick check revealed that. Erm, answer is 'no' on that one
> (at least: I am not sure megatest_ng will work from the tests
> directory in that release already), so here's the way that _should_
> work, because that's where it all started (as I moved from Bill's
> single source dir to moving tests to a separate tests/ dir later):
> 
> cd src/
> make megatest_ng
> 
> and you should have the ./src/megatest_ng.sh file in the extracted
> contents of the GerH distro /before/ you run the above two lines.

yep, that works. I will mail you the diff off-list.

> > seems to run ok. Some diffs for pid numbers as expected.
> 
> yup.
> 

  <snip>

> > Any ideas why count of messages learned goes up by 2 after learning one
> > message? I never observed this on 32bit systems.
> 
> Hm, that's vanilla/BillY on 32-bit and what classifier?

Default osb unique microgroom

> I wonder what GerH does -- never saw that happen here but then (a) I
> never thought to check for that bit in particular and (b) I don't use
> the mail* scripts, so you /may/ see an artifact of those: depending on
> your mailfilter.cf settings, mailtrainer.crm /can/ train a message
> multiple times -- and each time a message is trained it is counted +1,
> so two rounds of training would show up as '2 documents trained' (even
> while it's the same doc twice: CRM114 itself doesn't know that.
> But that's me guessing from across the field...

mailfilter.cf is the same on 32-bit and 64-bit system (except the path to 
mailtrainer), so there should be no difference.

> On a closing note: if you want to play with the GerH binaries (and
> don't be bothered with those mail*.crm script errors of mine), you
> should be able to use the GerH binary as a 'drop in', i.e. using
> Bill's original crm scripts and a GerH binary. Like Paolo warned
> about: when you do this, you MUST 'rm -f *.css' your CSS files as GerH
> and vanilla/BillY binaries produce different format CSS files on
> 64-bit (I _should_ be able to use Bill's CSS files produced on 32-bit
> boxes, but not the other way around: GerH CSS files can never be used
> by BillY binaries, due to an extra versioning/platform-identification
> header block I added). In short: want to try? delete all CSS files.
> replace binary with a GerH one and it should work. If not, please
> notify me.
> 
> Extra note: older vanilla scripts will report a syntax error when run
> with GerH binaries; AFAIK this has been fixed completely in the latest
> vanilla/BillY scripts.

I tried this:

1. took a copy of Bill Y crm114-20070810-BlameTheSegfault

2. replaced all binaries (crm114, cssutil, cssdiff, cssmerge, osbf-util) 
by the corresponding GerH binaries.

3. did the same in /usr/bin (where my binaries are).

4. created new spam.css and nonspam.css files (using cssutil GerH)

5. tried to classify one message:
   echo "Some text to be classified" | ./mailreaver.crm

This results in:

crm: *ERROR*
Statement 833(./mailreaver.crm) NOT YET IMPLEMENTED !!! Check your source code. Here's the text:
4)
Sorry, but this program is very sick and probably should be killed off.
This happened at line 833 of file ./mailreaver.crm:
    4) :/
(runtime system location: crm_compiler.c(630) in routine: crm_microcompiler)


6. Now changed crm114 in /usr/bin to BlameTheSegfault Bill Y version.
   Try again: echo "Some text to be classified" | ./mailreaver.crm
   Says:

Some text to be classified
X-CRM114-Version: 20070810-BlameTheSegfault ( TRE 0.7.5 (LGPL) ) MR-FFFFFFFF 
X-CRM114-CacheID: sfid-20080814_140315_610340_6251DBB9 
Message-Id: (sfid-20080814_140315_610340_6251DBB9)
X-CRM114-Status: UNSURE (   0.07  )
X-CRM114-Notice: Please train this message. 

What I did:

echo "X-CRM114-CacheID: sfid-20080814_140315_610340_6251DBB9" \
	| ./mailreaver.crm --good

with this result:

X-CRM114-CacheID: sfid-20080814_140315_610340_6251DBB9
X-CRM114-Action: LEARNED AND CACHED GOOD

7. Activating again crm114 GerH trying mailfilter:

   echo "Some text to be classified" | ./mailfilter.crm

crm: *WARNING*
 The statement contains an unidentified operand delimiter ']'(HEX:5D). Only these are currently supported: <>()[]//
 Bug in statement?
 --> call /:mungmail_add:/ [X-CRM114-Version: :*:_crm_version: MF-:*:_pgm_hash: [:*:pr:]]
I'll try to keep working.
This happened at line 1110 of file ./mailfilter.crm:
    call /:mungmail_add:/ [X-CRM114-Version: :*:_crm_version: MF-:*:_pgm_hash: [:*:pr:]]
(runtime system location: crm_stmt_parser.c(917) in routine: crm_generic_parse_line)
Some text to be classified
X-CRM114-Version: 20080502-BlameJason ( TRE 0.7.5 (LGPL) ) MF-451D0E20 [pR: 0.0000
X-CRM114-CacheID: sfid-20080814_142241_402112_672E5FE4 
X-CRM114-Status: UNSURE (0.0000) This message is 'unsure'; please train it! 


Conclusion: Bill Y *.crm scripts no longer work with
GerH binary crm114 20080502-Blame-Jason. :-((

Best regards
Thomas Spahni

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/