Megatest, and other CRM114 topics

"A. Wik" <[email protected]>
Newsgroups gmane.mail.spam.crm114
Message-ID <[email protected]> 
I built CRM114 20070810-BlameTheSegfault this morning, and
ran the "megatest".  There seems to be only one minor issue:

    > OK_IF_LESS_THAN_10: Total growth: 13

I'm presuming that the above is not likely to have any
serious adverse effect on the operation of the software,
especailly considering that the "known good" reference
build was farther (15) from reaching the goal of < 10 -
or would such a conclusion be a misinterpretation of
the results (all included at the end of this message).

    <  This is CRM114, version 20070807-BlameTheInterns (TRE 0.7.5 (LGPL))
    >  This is CRM114, version 20070810-BlameTheSegfault (TRE 0.7.5 (LGPL))

I haven't set up CRM114 from scratch since the 20040327-
BlameStPatrick release.  I know there are significant
news since that point - any documents or other information
that would be of particularly high importance for bringing
one's knowledge of CRM114 up to date?

For reference, this was my old setup:

  :0HB: .crm/msgid.lock
  * ? /usr/bin/crm -u /home/aw/.crm/ mailfilter.crm >/dev/null
  mail/junk/crm

And I'm assuming the current approach will be comparable.

The major problem last time around was that after almost any
--learnspam, it was necessary to verify that all my non-spam
messages were still being recognised as such, which was rarely
the case, and then of course, after a --learnnonspam, the
recognition of known spam needed to be verified.  Attempts at
automation of the process degenerated into a mess of shell
scripts, folders, message-ID caches and procmail recipes.
Hopefully, I will be more successful this time.

-aw

/home/aw/crm114-mkmgtst-20090412.txt:
narpes:~aw/build/crm114-20070810-BlameTheSegfault.src# make megatest
#
#        This runs a moderately interesting set of base tests
#        to exercise much of CRM114 under TRE.  This takes about
#        1 minute to run on a 1.6 GHz Pentium-M laptop.  Please
#        be patient; you (hopefully) won't see anything till the
#        full set of tests complete.  If you didn't use TRE, all
#        bets are off.
#
#       Lines of output that start with OK_IF_mumble are allowed
#       to change values.  No other lines should.  If other lines
#       do change, either your kit isn't quite right or your
#       install is broken (or you've found a bug).
#
./megatest.sh  > megatest_test.log 2>&1
diff megatest_knowngood.log megatest_test.log & sleep 1
1c1
<  This is CRM114, version 20070807-BlameTheInterns (TRE 0.7.5 (LGPL))
---
>  This is CRM114, version 20070810-BlameTheSegfault (TRE 0.7.5 (LGPL))
206,207c206,207
<  OK_IF_PID_CHANGES: one... MINION PROC PID: 1616 from-pipe: 6 to-pipe: 5
<  OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 1616 from-pipe: 6 to-pipe: 5
---
>  OK_IF_PID_CHANGES: one... MINION PROC PID: 12308 from-pipe: 6 to-pipe: 5
>  OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 12308 from-pipe: 6 to-pipe: 5
543,544c543,544
< OK_IF_SIZE_CHANGES: Size of isolation at start: 2099105
< Bytes used per pass: 2097150
---
> OK_IF_SIZE_CHANGES: Size of isolation at start: 354803
> Bytes used per pass: 352846
546,548c546,548
< Total flux through isolation:  419430000
< OK_IF_SIZE_CHANGES: Final isolation size: 2099122
< OK_IF_LESS_THAN_100: Total growth: 17
---
> Total flux through isolation:  70569200
> OK_IF_SIZE_CHANGES: Final isolation size: 354818
> OK_IF_LESS_THAN_100: Total growth: 15
554,555c554,555
< OK_IF_SIZE_CHANGES: Size of isolation at start: 2101593
< Bytes used per pass: 2097150
---
> OK_IF_SIZE_CHANGES: Size of isolation at start: 357291
> Bytes used per pass: 352846
557,560c557,560
< Total flux through isolation:  41943000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101608
< OK_IF_LESS_THAN_10: Total growth: 15
< Bytes used per pass: 2097150
---
> Total flux through isolation:  7056920
> OK_IF_SIZE_CHANGES: Final isolation size: 357304
> OK_IF_LESS_THAN_10: Total growth: 13
> Bytes used per pass: 352846
562,565c562,565
< Total flux through isolation:  83886000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101614
< OK_IF_LESS_THAN_20: Total growth: 21
< Bytes used per pass: 2097150
---
> Total flux through isolation:  14113840
> OK_IF_SIZE_CHANGES: Final isolation size: 357310
> OK_IF_LESS_THAN_20: Total growth: 19
> Bytes used per pass: 352846
567,570c567,570
< Total flux through isolation:  125829000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101615
< OK_IF_LESS_THAN_30: Total growth: 22
< Bytes used per pass: 2097150
---
> Total flux through isolation:  21170760
> OK_IF_SIZE_CHANGES: Final isolation size: 357310
> OK_IF_LESS_THAN_30: Total growth: 19
> Bytes used per pass: 352846
572,574c572,574
< Total flux through isolation:  167772000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101615
< OK_IF_LESS_THAN_40: Total growth: 22
---
> Total flux through isolation:  28227680
> OK_IF_SIZE_CHANGES: Final isolation size: 357310
> OK_IF_LESS_THAN_40: Total growth: 19
660c660
< version: 20070807-BlameTheInterns ( TRE 0.7.5 (LGPL) )
---
> version: 20070810-BlameTheSegfault ( TRE 0.7.5 (LGPL) )
690c690
< #1 (q_test.css): features: 130178, hits: 5010, prob: 1.00e+00, pR:  10.65
---
> #1 (q_test.css): features: 130178, hits: 5010, prob: 1.00e-00, pR:  10.65
696c696
< #0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e+00, pR:  10.40
---
> #0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e-00, pR:  10.40
870c870
< #1 (q_test.css): features: 533520 (6%), entropy: 229.415086, jumps: 7, prob: 1.00e+00, pR:   5.99
---
> #1 (q_test.css): features: 533520 (6%), entropy: 229.415086, jumps: 7, prob: 1.00e-00, pR:   5.99
876c876
< #0 (i_test.css): features: 425488 (6%), entropy: 141.372546, jumps: 4, prob: 1.00e+00, pR:   4.84
---
> #0 (i_test.css): features: 425488 (6%), entropy: 141.372546, jumps: 4, prob: 1.00e-00, pR:   4.84
886c886
< #1 (q_test.css): features: 533520 (100%), entropy: 305.595264, jumps: 9, prob: 1.00e+00, pR:   6.39
---
> #1 (q_test.css): features: 533520 (100%), entropy: 305.595264, jumps: 9, prob: 1.00e-00, pR:   6.39
892c892
< #0 (i_test.css): features: 425488 (100%), entropy: 231.058285, jumps: 7, prob: 1.00e+00, pR:   6.51
---
> #0 (i_test.css): features: 425488 (100%), entropy: 231.058285, jumps: 7, prob: 1.00e-00, pR:   6.51
988c988
< #0 (INTRO.txt): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, l4: 52869796589 prob: 1.00e+00, pR:   4.34
---
> #0 (INTRO.txt): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, l4: 52869796589 prob: 1.00e-00, pR:   4.34
narpes:~aw/build/crm114-20070810-BlameTheSegfault.src#



------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.