crm114 on 64 bit SuSE
Thomas Spahni <[email protected]>
| Newsgroups | gmane.mail.spam.crm114 |
|---|---|
| Message-ID | <[email protected]> |
Hi Bill, Paolo, Ger
After all the discussions on this list about installing crm114 on 64-bit
systems I just want to let you all know that the following setup works
well for me:
Motherboard: ASUS P5KPL-VM
CPU: Intel Pentium Dual E2180 @ 2.00 GHz
Distrib: SuSE 10.2, installed x86_64
Version: crm114-20070810-BlameTheSegfault.src.tar.gz
Patch: replaced original crm_expandvar.c by
Ger's patched version from crm_expandvar.c.gz
using: libtre-0.7.5-patched-i_a.tar
Using: osb unique microgroom, mailreaver.crm
Megatest reports some minor differences (see output at the end of this
mail) but the build works well in production. There is just one glitch I
observed: learning just one message advances the count of messages learned
by TWO. I still could not find the reason for this. Any pointers would be
welcome.
Additional remarks:
I tried to install Ger's crm114-20080502-BlameJason-Ger-2423.src.tar as
well. Compile went well but learning a message with mailreaver results in:
find: paths must precede expression
Usage: find [-H] [-L] [-P] [path...] [expression]
find: warning: Unix filenames usually don't contain slashes (though
pathnames do). That means that '-name 0080810_135257_848598_78B458CD/' will
probably evaluate to false all the time on this system. You might find the
'-wholename' test more useful, or perhaps '-samefile'. Alternatively, if
you are using GNU grep, you could use 'find ... -print0 | grep -FzZ
0080810_135257_848598_78B458CD/'.
find: reaver_cache/known_good/20080810_135257_848598_78B458CD/: Not a
directory
X-CRM114-Version: 20080502-BlameJason ( TRE 0.7.5 (LGPL) ) MR-EEF259D2
X-CRM114-CacheID: sfid-20080810_135257_848598_78B458CD
Message-Id: (sfid-20080810_135257_848598_78B458CD)
X-CRM114-Status: UNSURE ( 0.00 )
X-CRM114-Notice: Please train this message.
I suspect this error happens in mailtrainer.crm on line 397 or 420.
Additionally Ger's version produces a significant list of differences in
megatest (output attached).
Thank you all for your excellent work and I hope this report may be
useful.
Thomas Spahni
------------------------
make megatest (Bill Y crm114-20070810-BlameTheSegfault):
#
# This runs a moderately interesting set of base tests
# to exercise much of CRM114 under TRE. This takes about
# 1 minute to run on a 1.6 GHz Pentium-M laptop. Please
# be patient; you (hopefully) won't see anything till the
# full set of tests complete. If you didn't use TRE, all
# bets are off.
#
# Lines of output that start with OK_IF_mumble are allowed
# to change values. No other lines should. If other lines
# do change, either your kit isn't quite right or your
# install is broken (or you've found a bug).
#
./megatest.sh > megatest_test.log 2>&1
diff megatest_knowngood.log megatest_test.log & sleep 1
1c1
< This is CRM114, version 20070807-BlameTheInterns (TRE 0.7.5 (LGPL))
---
> This is CRM114, version 20070810-BlameTheSegfault (TRE 0.7.5 (LGPL))
206,207c206,207
< OK_IF_PID_CHANGES: one... MINION PROC PID: 1616 from-pipe: 6 to-pipe: 5
< OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 1616 from-pipe: 6 to-pipe: 5
---
> OK_IF_PID_CHANGES: one... MINION PROC PID: 1260 from-pipe: 6 to-pipe: 5
> OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 1260 from-pipe: 6 to-pipe: 5
543,544c543,544
< OK_IF_SIZE_CHANGES: Size of isolation at start: 2099105
< Bytes used per pass: 2097150
---
> OK_IF_SIZE_CHANGES: Size of isolation at start: 2072562
> Bytes used per pass: 2070606
546,547c546,547
< Total flux through isolation: 419430000
< OK_IF_SIZE_CHANGES: Final isolation size: 2099122
---
> Total flux through isolation: 414121200
> OK_IF_SIZE_CHANGES: Final isolation size: 2072579
554,555c554,555
< OK_IF_SIZE_CHANGES: Size of isolation at start: 2101593
< Bytes used per pass: 2097150
---
> OK_IF_SIZE_CHANGES: Size of isolation at start: 2075050
> Bytes used per pass: 2070606
557,558c557,558
< Total flux through isolation: 41943000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101608
---
> Total flux through isolation: 41412120
> OK_IF_SIZE_CHANGES: Final isolation size: 2075065
560c560
< Bytes used per pass: 2097150
---
> Bytes used per pass: 2070606
562,563c562,563
< Total flux through isolation: 83886000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101614
---
> Total flux through isolation: 82824240
> OK_IF_SIZE_CHANGES: Final isolation size: 2075071
565c565
< Bytes used per pass: 2097150
---
> Bytes used per pass: 2070606
567,568c567,568
< Total flux through isolation: 125829000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101615
---
> Total flux through isolation: 124236360
> OK_IF_SIZE_CHANGES: Final isolation size: 2075072
570c570
< Bytes used per pass: 2097150
---
> Bytes used per pass: 2070606
572,573c572,573
< Total flux through isolation: 167772000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101615
---
> Total flux through isolation: 165648480
> OK_IF_SIZE_CHANGES: Final isolation size: 2075072
660c660
< version: 20070807-BlameTheInterns ( TRE 0.7.5 (LGPL) )
---
> version: 20070810-BlameTheSegfault ( TRE 0.7.5 (LGPL) )
690c690
< #1 (q_test.css): features: 130178, hits: 5010, prob: 1.00e+00, pR: 10.65
---
> #1 (q_test.css): features: 130178, hits: 5010, prob: 1.00e-00, pR: 10.65
696c696
< #0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e+00, pR: 10.40
---
> #0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e-00, pR: 10.40
834,835c834,835
< CLASSIFY fails; success probability: 0.0307 pR: -14.9943
< Best match to file #1 (q_test.css) prob: 0.9693 pR: 14.9943
---
> CLASSIFY fails; success probability: 0.0413 pR: -13.6550
> Best match to file #1 (q_test.css) prob: 0.9587 pR: 13.6550
837,838c837,838
< #0 (i_test.css): features: 29641, hits: 6, radiance: 1.21e-03, prob: 3.07e-02, pR: -14.99
< #1 (q_test.css): features: 26746, hits: 32, radiance: 3.83e-02, prob: 9.69e-01, pR: 14.99
---
> #0 (i_test.css): features: 29641, hits: 7, radiance: 1.65e-03, prob: 4.13e-02, pR: -13.66
> #1 (q_test.css): features: 26746, hits: 32, radiance: 3.83e-02, prob: 9.59e-01, pR: 13.66
841,842c841,842
< CLASSIFY succeeds; success probability: 0.9883 pR: 19.2673
< Best match to file #0 (i_test.css) prob: 0.9883 pR: 19.2673
---
> CLASSIFY succeeds; success probability: 0.9944 pR: 22.4844
> Best match to file #0 (i_test.css) prob: 0.9944 pR: 22.4844
844,845c844,845
< #0 (i_test.css): features: 29641, hits: 29, radiance: 2.84e-02, prob: 9.88e-01, pR: 19.27
< #1 (q_test.css): features: 26746, hits: 3, radiance: 3.36e-04, prob: 1.17e-02, pR: -19.27
---
> #0 (i_test.css): features: 29641, hits: 28, radiance: 2.65e-02, prob: 9.94e-01, pR: 22.48
> #1 (q_test.css): features: 26746, hits: 2, radiance: 1.49e-04, prob: 5.61e-03, pR: -22.48
866,867c866,867
< CLASSIFY fails; success probability: 0.0000 pR: -5.9890
< Best match to file #1 (q_test.css) prob: 1.0000 pR: 5.9890
---
> CLASSIFY fails; success probability: 0.0000 pR: -6.0157
> Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.0157
869,870c869,870
< #0 (i_test.css): features: 425488 (6%), entropy: 374.103126, jumps: 20, prob: 1.03e-06, pR: -5.99
< #1 (q_test.css): features: 533520 (6%), entropy: 229.415086, jumps: 7, prob: 1.00e+00, pR: 5.99
---
> #0 (i_test.css): features: 425488 (6%), entropy: 374.085454, jumps: 20, prob: 9.65e-07, pR: -6.02
> #1 (q_test.css): features: 533520 (6%), entropy: 228.753525, jumps: 7, prob: 1.00e-00, pR: 6.02
873,874c873,874
< CLASSIFY succeeds; success probability: 1.0000 pR: 4.8355
< Best match to file #0 (i_test.css) prob: 1.0000 pR: 4.8355
---
> CLASSIFY succeeds; success probability: 1.0000 pR: 4.8441
> Best match to file #0 (i_test.css) prob: 1.0000 pR: 4.8441
876,877c876,877
< #0 (i_test.css): features: 425488 (6%), entropy: 141.372546, jumps: 4, prob: 1.00e+00, pR: 4.84
< #1 (q_test.css): features: 533520 (6%), entropy: 258.192788, jumps: 14, prob: 1.46e-05, pR: -4.84
---
> #0 (i_test.css): features: 425488 (6%), entropy: 141.372546, jumps: 4, prob: 1.00e-00, pR: 4.84
> #1 (q_test.css): features: 533520 (6%), entropy: 258.401520, jumps: 14, prob: 1.43e-05, pR: -4.84
882,883c882,883
< CLASSIFY fails; success probability: 0.0000 pR: -6.3888
< Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.3888
---
> CLASSIFY fails; success probability: 0.0000 pR: -6.3474
> Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.3474
885,886c885,886
< #0 (i_test.css): features: 425488 (100%), entropy: 459.942001, jumps: 26, prob: 4.08e-07, pR: -6.39
< #1 (q_test.css): features: 533520 (100%), entropy: 305.595264, jumps: 9, prob: 1.00e+00, pR: 6.39
---
> #0 (i_test.css): features: 425488 (100%), entropy: 459.942001, jumps: 26, prob: 4.49e-07, pR: -6.35
> #1 (q_test.css): features: 533520 (100%), entropy: 306.595264, jumps: 9, prob: 1.00e-00, pR: 6.35
892c892
< #0 (i_test.css): features: 425488 (100%), entropy: 231.058285, jumps: 7, prob: 1.00e+00, pR: 6.51
---
> #0 (i_test.css): features: 425488 (100%), entropy: 231.058285, jumps: 7, prob: 1.00e-00, pR: 6.51
914,915c914,915
< CLASSIFY succeeds; success probability: 0.8868 pR: 8.9402
< Best match to file #0 (i_test.css) prob: 0.8868 pR: 8.9402
---
> CLASSIFY succeeds; success probability: 0.8842 pR: 8.8301
> Best match to file #0 (i_test.css) prob: 0.8842 pR: 8.8301
917,918c917,918
< #0 (i_test.css): documents: 300, features: 7464, prob: 8.87e-01, pR: 8.94
< #1 (q_test.css): documents: 175, features: 6095, prob: 1.13e-01, pR: -8.94
---
> #0 (i_test.css): documents: 300, features: 7464, prob: 8.84e-01, pR: 8.83
> #1 (q_test.css): documents: 175, features: 6095, prob: 1.16e-01, pR: -8.83
921,922c921,922
< CLASSIFY succeeds; success probability: 0.9951 pR: 23.0417
< Best match to file #0 (i_test.css) prob: 0.9951 pR: 23.0417
---
> CLASSIFY succeeds; success probability: 0.9951 pR: 23.0955
> Best match to file #0 (i_test.css) prob: 0.9951 pR: 23.0955
924,925c924,925
< #0 (i_test.css): documents: 300, features: 7464, prob: 9.95e-01, pR: 23.04
< #1 (q_test.css): documents: 175, features: 6095, prob: 4.94e-03, pR: -23.04
---
> #0 (i_test.css): documents: 300, features: 7464, prob: 9.95e-01, pR: 23.10
> #1 (q_test.css): documents: 175, features: 6095, prob: 4.88e-03, pR: -23.10
930,931c930,931
< CLASSIFY succeeds; success probability: 0.8724 pR: 8.3472
< Best match to file #0 (i_test.css) prob: 0.8724 pR: 8.3472
---
> CLASSIFY succeeds; success probability: 0.8725 pR: 8.3526
> Best match to file #0 (i_test.css) prob: 0.8725 pR: 8.3526
933,934c933,934
< #0 (i_test.css): documents: 300, features: 34780, prob: 8.72e-01, pR: 8.35
< #1 (q_test.css): documents: 175, features: 31487, prob: 1.28e-01, pR: -8.35
---
> #0 (i_test.css): documents: 300, features: 34780, prob: 8.73e-01, pR: 8.35
> #1 (q_test.css): documents: 175, features: 31487, prob: 1.27e-01, pR: -8.35
937,938c937,938
< CLASSIFY succeeds; success probability: 0.9675 pR: 14.7373
< Best match to file #0 (i_test.css) prob: 0.9675 pR: 14.7373
---
> CLASSIFY succeeds; success probability: 0.9675 pR: 14.7366
> Best match to file #0 (i_test.css) prob: 0.9675 pR: 14.7366
962,963c962,963
< CLASSIFY succeeds; success probability: 0.8873 pR: 8.9604
< Best match to file #0 (i_test.css) prob: 0.8873 pR: 8.9604
---
> CLASSIFY succeeds; success probability: 0.8876 pR: 8.9746
> Best match to file #0 (i_test.css) prob: 0.8876 pR: 8.9746
965,966c965,966
< #0 (i_test.css):documents: 300, features: 42397, prob: 8.87e-01, pR: 8.96
< #1 (q_test.css):documents: 175, features: 36769, prob: 1.13e-01, pR: -8.96
---
> #0 (i_test.css):documents: 300, features: 42397, prob: 8.88e-01, pR: 8.97
> #1 (q_test.css):documents: 175, features: 36769, prob: 1.12e-01, pR: -8.97
969,970c969,970
< CLASSIFY succeeds; success probability: 0.9859 pR: 18.4550
< Best match to file #0 (i_test.css) prob: 0.9859 pR: 18.4550
---
> CLASSIFY succeeds; success probability: 0.9859 pR: 18.4489
> Best match to file #0 (i_test.css) prob: 0.9859 pR: 18.4489
972,973c972,973
< #0 (i_test.css):documents: 300, features: 42397, prob: 9.86e-01, pR: 18.46
< #1 (q_test.css):documents: 175, features: 36769, prob: 1.41e-02, pR: -18.46
---
> #0 (i_test.css):documents: 300, features: 42397, prob: 9.86e-01, pR: 18.45
> #1 (q_test.css):documents: 175, features: 36769, prob: 1.41e-02, pR: -18.45
988c988
< #0 (INTRO.txt): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, l4: 52869796589 prob: 1.00e+00, pR: 4.34
---
> #0 (INTRO.txt): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, l4: 52869796589 prob: 1.00e-00, pR: 4.34
----------------------------
make megatest (Ger H crm114-20080502-BlameJason-Ger-2423)
Running the regression test:
(cd src && make megatest);
make[1]: Entering directory `/home/tsp/programs/crm114/crm114-20080502-BlameJason/src'
This runs a moderately interesting set of base tests
to exercise much of CRM114 under TRE. This takes about
1 minute to run on a 1.6 GHz Pentium-M laptop. Please
be patient; you (hopefully) won't see anything till the
full set of tests complete. If you didn't use TRE, all
bets are off.
Lines of output that start with OK_IF_mumble are allowed
to change values. No other lines should. If other lines
do change, either your kit isn't quite right or your
install is broken (or you've found a bug).
( if [ ! -e ./inserttest_a.crm ] ; then cp ./*.crm ./ ; fi )
( if [ ! -e ./rewrites.mfp ] ; then cp ./*.mfp ./ ; fi )
( if [ ! -e ./blacklist.mfp.example ] ; then cp ./*.example ./ ; fi )
./megatest.sh 2 > megatest_test.log 2>&1
==============================================================
=================== MEGATEST DIFF REPORT =====================
=================== (unified) =====================
==============================================================
/usr/bin/diff -u -EbwBd --strip-trailing-cr ./megatest_knowngood.log megatest_test.log & sleep 1
--- ./megatest_knowngood.log 2008-05-02 21:01:40.000000000 +0200
+++ megatest_test.log 2008-08-10 12:39:20.000000000 +0200
@@ -1,7 +1,19 @@
- This is CRM114, version 20080502-BlameJason (TRE 0.7.5 (LGPL))
- Copyright 2001-2006 William S. Yerazunis
+ This is CRM114, version 20080502-BlameJason, rev 2908 (TRE 0.7.5 (LGPL)) (OS: linux-gnu)
+ Copyright 2001-2008 William S. Yerazunis
This software is licensed under the GPL with ABSOLUTELY NO WARRANTY
+Classifiers included in this build:
+ all of 'em
+
+Extra features:
+ Developer Assertions are:
+ - included
+ - UNTRAPPABLE
+ - '-Cdbg' will cause a memory access violation in a last ditch
+ effort to trigger your debugger
+
+***** checking CRM language features
+
CRM114 testing brackets, escapes and #'s
If you don't see any compiler error messages, that means the test passed.
@@ -19,18 +31,20 @@
--- the next thing you see SHOULD be an error "unable to read-open"---
Caught the error - fault text was
-./crm114: *ERROR*
- For some reason, I was unable to read-open the file named zoob.zipulrlfjf
+crm114: *ERROR*
+For some reason, I was unable to read-open the file named 'zoob.zipulrlfjf' (expanded from 'zoob.zipulrlfjf'): error = 2(No such file or directory)
Sorry, but this program is very sick and probably should be killed off.
-This happened at line 19 of file fataltraptest.crm
-(runtime system location: crm_expr_file_io.c(151) in routine: crm_expr_input)
+This happened at line 19 of file fataltraptest.crm:
+ input [zoob.zipulrlfjf] (:hi:)
+(runtime system location: crm_expr_file_io.c(217) in routine: crm_expr_input)
--- and again, the next thing you see SHOULD be an error "unable to write-open"---
Caught the error - fault text was
-./crm114: *ERROR*
+crm114: *ERROR*
For some reason, I was unable to write-open the file named /No/Such/Directory/frotz.mumble
Sorry, but this program is very sick and probably should be killed off.
-This happened at line 29 of file fataltraptest.crm
-(runtime system location: crm_expr_file_io.c(345) in routine: crm_expr_output)
+This happened at line 30 of file fataltraptest.crm:
+ output [/No/Such/Directory/frotz.mumble] /:hi:/ # This is correct code; should give the I/O error as expected
+(runtime system location: crm_expr_file_io.c(593) in routine: crm_expr_output)
Start of insert processor testing
@@ -112,11 +126,12 @@
The next stmt --- SHOULD--- get an error message!
Caught the error, fault text was:
-./crm114: *WARNING*
+crm114: *WARNING*
This program specifies an 'absent' match, and also tries to bind variables that, by the above, aren't matched! We'll ignore these variable bindings for now.
I'll try to keep working.
-This happened at line 292 of file matchtest.crm
-(runtime system location: crm_expr_match.c(479) in routine: crm_expr_match)
+This happened at line 292 of file matchtest.crm:
+ match <absent> (:incognita:) /nothinjkljiejfksn;s94jf94msks/
+(runtime system location: crm_expr_match.c(487) in routine: crm_expr_match)
------------------END OF TESTING----------------------
@@ -205,8 +220,8 @@
----- keeping a process around ----
preparing...
- OK_IF_PID_CHANGES: one... MINION PROC PID: 5834 from-pipe: 6 to-pipe: 5
- OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 5834 from-pipe: 6 to-pipe: 5
+ OK_IF_PID_CHANGES: one... MINION PROC PID: 2021 from-pipe: 5 to-pipe: 4
+ OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 2021 from-pipe: 5 to-pipe: 4
and done ...DEAD MINION, EXIT CODE: 0
exit value test got DEAD MINION, EXIT CODE: 123
CRM114: Testing union and intersection
@@ -458,11 +473,12 @@
with a large string of Z's.
We should get an error here, due to the (intentional!) loop
-./crm114: *WARNING*
+crm114: *WARNING*
The variable you're attempting to EVAL seems to eval infinitely, and hence I cannot compute it. I did try a lot, though. I got this far before I gave up: :*:a:ZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZ!
ZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZZ(...truncated)
I'll try to keep working.
-This happened at line 15 of file eval_infiniteloop.crm
-(runtime system location: crm_expr_alter.c(141) function crm_expr_eval)
+This happened at line 15 of file eval_infiniteloop.crm:
+ eval (:b:) /:*:a:/
+(runtime system location: crm_expr_alter.c(136) in routine: crm_expr_eval)
Original: The quick brown fox jumped over the lazy dog's back
delete file then append: alpha bravo charlie
prior file, no append: The quick brown fox jumped over the lazy dog's back
@@ -543,37 +559,37 @@
error out, the test is passed. (we allocate about 80 megs,
well past the window size, but in small (400K) chunks that
alternately are allocated and become reclaimable)
-OK_IF_SIZE_CHANGES: Size of isolation at start: 2099029
-Bytes used per pass: 2097150
+OK_IF_SIZE_CHANGES: Size of isolation at start: 2072508
+Bytes used per pass: 2070606
Passes done: 100
-Total flux through isolation: 419430000
-OK_IF_SIZE_CHANGES: Final isolation size: 2099046
+Total flux through isolation: 414121200
+OK_IF_SIZE_CHANGES: Final isolation size: 2072525
OK_IF_LESS_THAN_100: Total growth: 17
Match-Isolate reclamation test. If this program doesn't
error out, the test is passed. (we allocate about 80 megs,
well past the window size, but in small (400K) chunks that
alternately are allocated and become reclaimable)
-OK_IF_SIZE_CHANGES: Size of isolation at start: 2101511
-Bytes used per pass: 2097150
+OK_IF_SIZE_CHANGES: Size of isolation at start: 2074990
+Bytes used per pass: 2070606
Passes done: 10
-Total flux through isolation: 41943000
-OK_IF_SIZE_CHANGES: Final isolation size: 2101526
+Total flux through isolation: 41412120
+OK_IF_SIZE_CHANGES: Final isolation size: 2075005
OK_IF_LESS_THAN_10: Total growth: 15
-Bytes used per pass: 2097150
+Bytes used per pass: 2070606
Passes done: 20
-Total flux through isolation: 83886000
-OK_IF_SIZE_CHANGES: Final isolation size: 2101532
+Total flux through isolation: 82824240
+OK_IF_SIZE_CHANGES: Final isolation size: 2075011
OK_IF_LESS_THAN_20: Total growth: 21
-Bytes used per pass: 2097150
+Bytes used per pass: 2070606
Passes done: 30
-Total flux through isolation: 125829000
-OK_IF_SIZE_CHANGES: Final isolation size: 2101533
+Total flux through isolation: 124236360
+OK_IF_SIZE_CHANGES: Final isolation size: 2075012
OK_IF_LESS_THAN_30: Total growth: 22
-Bytes used per pass: 2097150
+Bytes used per pass: 2070606
Passes done: 40
-Total flux through isolation: 167772000
-OK_IF_SIZE_CHANGES: Final isolation size: 2101533
+Total flux through isolation: 165648480
+OK_IF_SIZE_CHANGES: Final isolation size: 2075012
OK_IF_LESS_THAN_40: Total growth: 22
Starting
@@ -679,29 +695,37 @@
one two three
***** checking return and exit codes
+
+***** checking return and exit codes
Status: DEAD MINION, EXIT CODE: 123
***** check that failed syscalls will code right
+
+***** check that failed syscalls will code right
Status: DEAD MINION, EXIT CODE: 127
result -->you hit the jackpot<--->and that's good<--->:frobotz:<---
**** Default (SBPH Markovian) classifier
+
+ **** Default (SBPH Markovian) classifier
type Q
CLASSIFY fails; success probability: 0.0000 pR: -10.6507
Best match to file #1 (q_test.css) prob: 1.0000 pR: 10.6507
Total features in input file: 176
#0 (i_test.css): features: 140946, hits: 693, prob: 2.24e-11, pR: -10.65
-#1 (q_test.css): features: 133586, hits: 5022, prob: 1.00e+00, pR: 10.65
+#1 (q_test.css): features: 133586, hits: 5022, prob: 1.00e-00, pR: 10.65
type I
CLASSIFY succeeds; success probability: 1.0000 pR: 10.2820
Best match to file #0 (i_test.css) prob: 1.0000 pR: 10.2820
Total features in input file: 160
-#0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e+00, pR: 10.28
+#0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e-00, pR: 10.28
#1 (q_test.css): features: 133586, hits: 552, prob: 5.22e-11, pR: -10.28
**** OSB Markovian classifier
+
+**** OSB Markovian classifier
type Q
CLASSIFY fails; success probability: 0.0023 pR: -2.6334
Best match to file #1 (q_test.css) prob: 0.9977 pR: 2.6334
@@ -718,6 +742,8 @@
**** OSB Markov Unique classifier
+
+**** OSB Markov Unique classifier
type Q
CLASSIFY fails; success probability: 0.0021 pR: -2.6697
Best match to file #1 (q_test.css) prob: 0.9979 pR: 2.6697
@@ -734,6 +760,8 @@
**** OSB Markov Chisquared Unique classifier
+
+**** OSB Markov Chisquared Unique classifier
type Q
CLASSIFY fails; success probability: 0.0000 pR: -5.7886
Best match to file #1 (q_test.css) prob: 1.0000 pR: 5.7886
@@ -750,6 +778,8 @@
**** OSBF Local Confidence (Fidelis) classifier
+
+**** OSBF Local Confidence (Fidelis) classifier
type Q
CLASSIFY fails; success probability: 0.0752 pR: -1.0897
Best match to file #1 (q_test.css) prob: 0.9248 pR: 1.0897
@@ -766,6 +796,8 @@
**** OSB Winnow classifier
+
+**** OSB Winnow classifier
type Q
CLASSIFY fails; success probability: 0.4401 pR: -1.0456
Best match to file #1 (q_test.css) weight: 50.4736 pR: 1.3486
@@ -783,6 +815,9 @@
**** Now verify that winnow learns affect only the named file (i_test.css)
+
+
+**** Now verify that winnow learns affect only the named file (i_test.css)
type I
CLASSIFY succeeds; success probability: 0.5636 pR: 1.1113
Best match to file #0 (i_test.css) weight: 46.0636 pR: 1.8624
@@ -798,8 +833,10 @@
Best match to file #0 (i_test.css) weight: 46.0636 pR: 1.8624
Total features in input file: 40
#0 (i_test.css): features: 58464.95, unseen: 1.00e+01, weight: 4.61e+01, pR: 1.86
-#1 (q_test.css): features: 69806.15, unseen: 1.00e+01, weight: 3.53e+01, pR: 0.71
+#1 (q_test.css): features: 69806.71, unseen: 1.00e+01, weight: 3.53e+01, pR: 0.71
+
+**** Unigram Bayesian classifier
**** Unigram Bayesian classifier
type Q
@@ -818,6 +855,8 @@
**** unigram Winnow classifier
+
+**** unigram Winnow classifier
type Q
CLASSIFY fails; success probability: 0.4734 pR: -0.4634
Best match to file #1 (q_test.css) weight: 11.8572 pR: 0.3259
@@ -834,6 +873,8 @@
**** OSB Hyperspace classifier
+
+**** OSB Hyperspace classifier
type Q
CLASSIFY fails; success probability: 0.0315 pR: -14.8787
Best match to file #1 (q_test.css) prob: 0.9685 pR: 14.8787
@@ -850,6 +891,8 @@
**** OSB three-letter Hyperspace classifier
+
+**** OSB three-letter Hyperspace classifier
type Q
CLASSIFY fails; success probability: 0.1569 pR: -7.3023
Best match to file #1 (q_test.css) prob: 0.8431 pR: 7.3023
@@ -866,6 +909,8 @@
**** Unigram Hyperspace classifier
+
+**** Unigram Hyperspace classifier
type Q
CLASSIFY fails; success probability: 0.3065 pR: -3.5468
Best match to file #1 (q_test.css) prob: 0.6935 pR: 3.5468
@@ -882,6 +927,8 @@
**** String Hyperspace classifier
+
+**** String Hyperspace classifier
type Q
CLASSIFY fails; success probability: 0.0000 pR: -216.3477
Best match to file #1 (q_test.css) prob: 1.0000 pR: 216.3477
@@ -898,6 +945,8 @@
**** String Unigram Hyperspace classifier
+
+**** String Unigram Hyperspace classifier
type Q
CLASSIFY fails; success probability: 0.2962 pR: -3.7579
Best match to file #1 (q_test.css) prob: 0.7038 pR: 3.7579
@@ -914,54 +963,118 @@
**** Vector 3-word-bag Hyperspace classifier
+
+**** Vector 3-word-bag Hyperspace classifier
+
+crm114: *WARNING*
+We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
+I'll try to keep working.
+This happened at line 2 of file (from command line):
+ learn < hyperspace > (q_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
+(runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
+
+crm114: *WARNING*
+ There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
+I'll try to keep working.
+This happened at line 2 of file (from command line):
+ learn < hyperspace > (q_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
+(runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
+
+crm114: *WARNING*
+We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
+I'll try to keep working.
+This happened at line 2 of file (from command line):
+ learn < hyperspace > (i_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1/
+(runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
+
+crm114: *WARNING*
+ There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
+I'll try to keep working.
+This happened at line 2 of file (from command line):
+ learn < hyperspace > (i_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1/
+(runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
+
+crm114: *WARNING*
+We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
+I'll try to keep working.
+This happened at line 4 of file (from command line):
+ classify < hyperspace > ( i_test.css | q_test.css ) (:s:)/[[:graph:]]+/ /vector: 3 1 1 1 1 /
+(runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
+
+crm114: *WARNING*
+ There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
+I'll try to keep working.
+This happened at line 4 of file (from command line):
+ classify < hyperspace > ( i_test.css | q_test.css ) (:s:)/[[:graph:]]+/ /vector: 3 1 1 1 1 /
+(runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
type Q
-CLASSIFY fails; success probability: 0.0000 pR: -217.6877
-Best match to file #1 (q_test.css) prob: 1.0000 pR: 217.6877
-Total features in input file: 10
-#0 (i_test.css): features: 8809, hits: 0, radiance: 0.00e+00, prob: 1.70e-22, pR: -217.69
-#1 (q_test.css): features: 8349, hits: 7, radiance: 5.87e-03, prob: 1.00e+00, pR: 217.69
+CLASSIFY fails; success probability: 0.5000 pR: 0.0000
+Best match to file #0 (i_test.css) prob: 0.5000 pR: 0.0000
+Total features in input file: -1
+#0 (i_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
+#1 (q_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
- type I
-CLASSIFY succeeds; success probability: 1.0000 pR: 217.4552
-Best match to file #0 (i_test.css) prob: 1.0000 pR: 217.4552
-Total features in input file: 9
-#0 (i_test.css): features: 8809, hits: 7, radiance: 5.57e-03, prob: 1.00e+00, pR: 217.46
-#1 (q_test.css): features: 8349, hits: 0, radiance: 0.00e+00, prob: 1.80e-22, pR: -217.46
+
+crm114: *WARNING*
+We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
+I'll try to keep working.
+This happened at line 4 of file (from command line):
+ classify <hyperspace > ( i_test.css | q_test.css ) (:s:) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
+(runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
+
+crm114: *WARNING*
+ There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
+I'll try to keep working.
+This happened at line 4 of file (from command line):
+ classify <hyperspace > ( i_test.css | q_test.css ) (:s:) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
+(runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
+ type Q
+CLASSIFY fails; success probability: 0.5000 pR: 0.0000
+Best match to file #0 (i_test.css) prob: 0.5000 pR: 0.0000
+Total features in input file: -1
+#0 (i_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
+#1 (q_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
**** Bit-Entropy classifier
+
+**** Bit-Entropy classifier
type Q
-CLASSIFY fails; success probability: 0.0000 pR: -6.5985
-Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.5985
+CLASSIFY fails; success probability: 0.0000 pR: -5.3784
+Best match to file #1 (q_test.css) prob: 1.0000 pR: 5.3784
Total features in input file: 552
-#0 (i_test.css): features: 425488 (5%), entropy: 384.969632, jumps: 23, prob: 2.52e-07, pR: -6.60
-#1 (q_test.css): features: 552504 (5%), entropy: 225.556532, jumps: 7, prob: 1.00e+00, pR: 6.60
+#0 (i_test.css): features: 425488 (5%), entropy: 365.245113, jumps: 21, prob: 4.18e-06, pR: -5.38
+#1 (q_test.css): features: 552504 (5%), entropy: 235.307962, jumps: 8, prob: 1.00e-00, pR: 5.38
type I
-CLASSIFY succeeds; success probability: 1.0000 pR: 5.3230
-Best match to file #0 (i_test.css) prob: 1.0000 pR: 5.3230
+CLASSIFY succeeds; success probability: 1.0000 pR: 4.9105
+Best match to file #0 (i_test.css) prob: 1.0000 pR: 4.9105
Total features in input file: 408
-#0 (i_test.css): features: 425488 (5%), entropy: 138.295562, jumps: 4, prob: 1.00e+00, pR: 5.32
-#1 (q_test.css): features: 552504 (5%), entropy: 266.892513, jumps: 17, prob: 4.75e-06, pR: -5.32
+#0 (i_test.css): features: 425488 (5%), entropy: 138.295563, jumps: 4, prob: 1.00e-00, pR: 4.91
+#1 (q_test.css): features: 552504 (5%), entropy: 256.926733, jumps: 16, prob: 1.23e-05, pR: -4.91
**** Bit-Entropy Toroid classifier
+
+**** Bit-Entropy Toroid classifier
type Q
-CLASSIFY fails; success probability: 0.0000 pR: -6.5308
-Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.5308
+CLASSIFY fails; success probability: 0.0000 pR: -8.6215
+Best match to file #1 (q_test.css) prob: 1.0000 pR: 8.6215
Total features in input file: 552
-#0 (i_test.css): features: 425488 (100%), entropy: 459.942001, jumps: 26, prob: 2.95e-07, pR: -6.53
-#1 (q_test.css): features: 552504 (100%), entropy: 302.166313, jumps: 10, prob: 1.00e+00, pR: 6.53
+#0 (i_test.css): features: 425488 (100%), entropy: 519.417393, jumps: 33, prob: 2.39e-09, pR: -8.62
+#1 (q_test.css): features: 552504 (100%), entropy: 311.132100, jumps: 11, prob: 1.00e-00, pR: 8.62
type I
-CLASSIFY succeeds; success probability: 1.0000 pR: 6.0927
-Best match to file #0 (i_test.css) prob: 1.0000 pR: 6.0927
+CLASSIFY succeeds; success probability: 1.0000 pR: 5.6187
+Best match to file #0 (i_test.css) prob: 1.0000 pR: 5.6187
Total features in input file: 408
-#0 (i_test.css): features: 425488 (100%), entropy: 231.058285, jumps: 7, prob: 1.00e+00, pR: 6.09
-#1 (q_test.css): features: 552504 (100%), entropy: 378.250899, jumps: 21, prob: 8.08e-07, pR: -6.09
+#0 (i_test.css): features: 425488 (100%), entropy: 231.058286, jumps: 7, prob: 1.00e-00, pR: 5.62
+#1 (q_test.css): features: 552504 (100%), entropy: 366.798873, jumps: 20, prob: 2.41e-06, pR: -5.62
**** Fast Substring Compression Match Classifier
+
+**** Fast Substring Compression Match Classifier
type Q
CLASSIFY fails; success probability: 0.049565 pR: -147.9304
Best match to file #1 (q_test.css) prob: 0.9504 pR: 147.9304
@@ -978,209 +1091,164 @@
**** Neural Network Classifier
+
+**** Neural Network Classifier
type Q
-CLASSIFY fails; success probability: 0.241661 pR: -62.5048
-Best match to file #1 (q_test.css) prob: 0.7583 pR: 62.5048
+CLASSIFY fails; success probability: 0.338256 pR: -6.5569
+Best match to file #1 (q_test.css) prob: 0.6617 pR: 6.5569
Total features in input file: 268
-#0 (i_test.css): prob: 2.42e-01, pR: -62.50
-#1 (q_test.css): prob: 7.58e-01, pR: 62.50
+#0 (i_test.css): prob: 3.38e-01, pR: -6.56
+#1 (q_test.css): prob: 6.62e-01, pR: 6.56
type I
-CLASSIFY succeeds; success probability: 0.889200 pR: 189.2001
-Best match to file #0 (i_test.css) prob: 0.8892 pR: 189.2001
+CLASSIFY succeeds; success probability: 0.941100 pR: 241.0995
+Best match to file #0 (i_test.css) prob: 0.9411 pR: 241.0995
Total features in input file: 372
-#0 (i_test.css): prob: 8.89e-01, pR: 189.20
-#1 (q_test.css): prob: 1.11e-01, pR: -189.20
+#0 (i_test.css): prob: 9.41e-01, pR: 241.10
+#1 (q_test.css): prob: 5.89e-02, pR: -241.10
+
+**** Alternate Neural Network Classifier test script
Alternating Example Neural Network Classifier TRAINING
**** Alternating Example Neural Network Classifier RUNNING TEST
type Q
-CLASSIFY fails; success probability: 0.017262 pR: -282.7380
-Best match to file #1 (q_test.css) prob: 0.9827 pR: 282.7380
+CLASSIFY fails; success probability: 0.018972 pR: -281.0282
+Best match to file #1 (q_test.css) prob: 0.9810 pR: 281.0282
Total features in input file: 195
-#0 (i_test.css): prob: 1.73e-02, pR: -282.74
-#1 (q_test.css): prob: 9.83e-01, pR: 282.74
+#0 (i_test.css): prob: 1.90e-02, pR: -281.03
+#1 (q_test.css): prob: 9.81e-01, pR: 281.03
type I
-CLASSIFY succeeds; success probability: 0.971915 pR: 271.9152
-Best match to file #0 (i_test.css) prob: 0.9719 pR: 271.9152
+CLASSIFY succeeds; success probability: 0.965700 pR: 265.7001
+Best match to file #0 (i_test.css) prob: 0.9657 pR: 265.7001
Total features in input file: 177
-#0 (i_test.css): prob: 9.72e-01, pR: 271.92
-#1 (q_test.css): prob: 2.81e-02, pR: -271.92
+#0 (i_test.css): prob: 9.66e-01, pR: 265.70
+#1 (q_test.css): prob: 3.43e-02, pR: -265.70
**** Support Vector Machine (SVM) unigram classifier
+
+**** Support Vector Machine (SVM) unigram classifier
type I
-CLASSIFY succeeds; success probability: 0.8901 pR: 9.0850
-Best match to file #0 (i_test.css) prob: 0.8901 pR: 9.0850
+CLASSIFY succeeds; success probability: 0.8872 pR: 8.9571
+Best match to file #0 (i_test.css) prob: 0.8872 pR: 8.9571
Total features in input file: 11
-#0 (i_test.css): documents: 300, features: 7464, prob: 8.90e-01, pR: 9.09
-#1 (q_test.css): documents: 175, features: 6223, prob: 1.10e-01, pR: -9.09
+#0 (i_test.css): documents: 300, features: 7464, prob: 8.87e-01, pR: 8.96
+#1 (q_test.css): documents: 175, features: 6223, prob: 1.13e-01, pR: -8.96
type I
-CLASSIFY succeeds; success probability: 0.9947 pR: 22.7433
-Best match to file #0 (i_test.css) prob: 0.9947 pR: 22.7433
+CLASSIFY succeeds; success probability: 0.9947 pR: 22.7512
+Best match to file #0 (i_test.css) prob: 0.9947 pR: 22.7512
Total features in input file: 10
-#0 (i_test.css): documents: 300, features: 7464, prob: 9.95e-01, pR: 22.74
-#1 (q_test.css): documents: 175, features: 6223, prob: 5.29e-03, pR: -22.74
+#0 (i_test.css): documents: 300, features: 7464, prob: 9.95e-01, pR: 22.75
+#1 (q_test.css): documents: 175, features: 6223, prob: 5.28e-03, pR: -22.75
+
+**** Support Vector Machine (SVM) classifier
**** Support Vector Machine (SVM) classifier
type I
-CLASSIFY succeeds; success probability: 0.8723 pR: 8.3442
-Best match to file #0 (i_test.css) prob: 0.8723 pR: 8.3442
+CLASSIFY succeeds; success probability: 0.8726 pR: 8.3572
+Best match to file #0 (i_test.css) prob: 0.8726 pR: 8.3572
Total features in input file: 44
-#0 (i_test.css): documents: 300, features: 34780, prob: 8.72e-01, pR: 8.34
-#1 (q_test.css): documents: 175, features: 32300, prob: 1.28e-01, pR: -8.34
+#0 (i_test.css): documents: 300, features: 34780, prob: 8.73e-01, pR: 8.36
+#1 (q_test.css): documents: 175, features: 32300, prob: 1.27e-01, pR: -8.36
type I
-CLASSIFY succeeds; success probability: 0.9678 pR: 14.7738
-Best match to file #0 (i_test.css) prob: 0.9678 pR: 14.7738
+CLASSIFY succeeds; success probability: 0.9678 pR: 14.7820
+Best match to file #0 (i_test.css) prob: 0.9678 pR: 14.7820
Total features in input file: 40
-#0 (i_test.css): documents: 300, features: 34780, prob: 9.68e-01, pR: 14.77
-#1 (q_test.css): documents: 175, features: 32300, prob: 3.22e-02, pR: -14.77
+#0 (i_test.css): documents: 300, features: 34780, prob: 9.68e-01, pR: 14.78
+#1 (q_test.css): documents: 175, features: 32300, prob: 3.22e-02, pR: -14.78
**** String Kernel SVM (SKS) classifier
+
+**** String Kernel SVM (SKS) classifier
type I
-CLASSIFY succeeds; success probability: 0.8755 pR: 8.4725
-Best match to file #0 (i_test.css) prob: 0.8755 pR: 8.4725
+CLASSIFY succeeds; success probability: 0.8756 pR: 8.4734
+Best match to file #0 (i_test.css) prob: 0.8756 pR: 8.4734
Total features in input file: 69
#0 (i_test.css):documents: 300, features: 52237, prob: 8.76e-01, pR: 8.47
#1 (q_test.css):documents: 175, features: 68204, prob: 1.24e-01, pR: -8.47
type I
-CLASSIFY succeeds; success probability: 0.9834 pR: 17.7226
-Best match to file #0 (i_test.css) prob: 0.9834 pR: 17.7226
+CLASSIFY succeeds; success probability: 0.9834 pR: 17.7222
+Best match to file #0 (i_test.css) prob: 0.9834 pR: 17.7222
Total features in input file: 51
#0 (i_test.css):documents: 300, features: 52237, prob: 9.83e-01, pR: 17.72
#1 (q_test.css):documents: 175, features: 68204, prob: 1.66e-02, pR: -17.72
**** String Kernel SVM (SKS) Unique classifier
+
+**** String Kernel SVM (SKS) Unique classifier
type I
-CLASSIFY succeeds; success probability: 0.8890 pR: 9.0370
-Best match to file #0 (i_test.css) prob: 0.8890 pR: 9.0370
+CLASSIFY succeeds; success probability: 0.8889 pR: 9.0317
+Best match to file #0 (i_test.css) prob: 0.8889 pR: 9.0317
Total features in input file: 68
-#0 (i_test.css):documents: 300, features: 42397, prob: 8.89e-01, pR: 9.04
-#1 (q_test.css):documents: 175, features: 37599, prob: 1.11e-01, pR: -9.04
+#0 (i_test.css): documents: 300, features: 42397, prob: 8.89e-01, pR: 9.03
+#1 (q_test.css): documents: 175, features: 37599, prob: 1.11e-01, pR: -9.03
type I
-CLASSIFY succeeds; success probability: 0.9848 pR: 18.1080
-Best match to file #0 (i_test.css) prob: 0.9848 pR: 18.1080
+CLASSIFY succeeds; success probability: 0.9848 pR: 18.1012
+Best match to file #0 (i_test.css) prob: 0.9848 pR: 18.1012
Total features in input file: 49
-#0 (i_test.css):documents: 300, features: 42397, prob: 9.85e-01, pR: 18.11
-#1 (q_test.css):documents: 175, features: 37599, prob: 1.52e-02, pR: -18.11
+#0 (i_test.css): documents: 300, features: 42397, prob: 9.85e-01, pR: 18.10
+#1 (q_test.css): documents: 175, features: 37599, prob: 1.52e-02, pR: -18.10
**** Bytewise Correlation classifier
+
+**** Bytewise Correlation classifier
type Q
CLASSIFY fails; success probability: 0.0093 pR: -2.0254
-Best match to file #1 (QUICKREF.txt) prob: 0.9907 pR: 2.0254
+Best match to file #1 (QUICKREF_mt_ng_reference_1.input) prob: 0.9907 pR: 2.0254
Total features in input file: 69063
-#0 (INTRO.txt): features: 53186, L1: 219063 L2: 325594 L3: 585264, l4: 1747198 prob: 9.34e-03, pR: -2.03
-#1 (QUICKREF.txt): features: 69063, L1: 385852 L2: 599956 L3: 6579582, l4: 326320000 prob: 9.91e-01, pR: 2.03
+#0 (INTRO_mt_ng_reference_2.input): features: 53186, L1: 219063 L2: 325594 L3: 585264, L4: 1747198 prob: 9.34e-03, pR: -2.03
+#1 (QUICKREF_mt_ng_reference_1.input): features: 69063, L1: 385852 L2: 599956 L3: 6579582, L4: 326320000 prob: 9.91e-01, pR: 2.03
type I
CLASSIFY succeeds; success probability: 1.0000 pR: 4.3436
-Best match to file #0 (INTRO.txt) prob: 1.0000 pR: 4.3436
+Best match to file #0 (INTRO_mt_ng_reference_2.input) prob: 1.0000 pR: 4.3436
Total features in input file: 53186
-#0 (INTRO.txt): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, l4: 52869796589 prob: 1.00e+00, pR: 4.34
-#1 (QUICKREF.txt): features: 69063, L1: 1060543 L2: 1359260 L3: 1991862, l4: 4285688 prob: 4.53e-05, pR: -4.34
+#0 (INTRO_mt_ng_reference_2.input): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, L4: 52869796589 prob: 1.00e-00, pR: 4.34
+#1 (QUICKREF_mt_ng_reference_1.input): features: 69063, L1: 1060543 L2: 1359260 L3: 1991862, L4: 4285688 prob: 4.53e-05, pR: -4.34
**** Clump / Pmulc Test
-...............................................................Likely result:
-PMULC succeeds; success probabilty: 1.0000 pR: 61.5681
-Best match to clump #8 (clump_#8) prob: 1.0000 pR: 61.5681
-Closest document: #46 (document_#46) affinity: 0.8233
+
+**** Clump / Pmulc Test
+
+crm114: *UNTRAPPABLE ERROR*
+ Cannot allocate distance matrix M[] (C) Stick a fork in us; we're _done_.
+Sorry, but this program is very sick and probably should be killed off.
+This happened at line 3 of file (from command line):
+ clump <bychunk> [:one_paragraph:] (i_test.css) /[[:graph:]]+/
+(runtime system location: crm_expr_clump.c(782) in routine: thresholding_average_cluster)
+
+crm114: *UNTRAPPABLE ERROR*
+
+Better start screaming, guv', since the software's just gone critical:
+assertion '!(scale <= 1.19209290e-7F && scale >= -1.19209290e-7F)' failed!
+Sorry, but this program is very sick and probably should be killed off.
+This happened at line 3 of file (from command line):
+ clump [:one_paragraph:] <bychunk> (i_test.css) /[[:graph:]]+/
+(runtime system location: crm_expr_clump.c(841) in routine: thresholding_average_cluster)
+ Unsure result
+PMULC fails; success probability: 0.0000 pR: 0.0000
+Best match to clump #1 (clump_#1) prob: 0.0000 pR: 0.0000
+Closest document: #-1 (document_#-1) affinity: -1.0000
Total features in input file: 259
-1: (clump_#1): documents: 4 affinity: 0.1529 prob: 0.0000 pR: -70.0000
-2: (clump_#2): documents: 2 affinity: 0.0942 prob: 0.0000 pR: -70.0000
-3: (clump_#3): documents: 49 affinity: 0.1234 prob: 0.0000 pR: -70.0000
-4: (clump_#4): documents: 3 affinity: 0.1136 prob: 0.0000 pR: -70.0000
-5: (clump_#5): documents: 1 affinity: 0.1408 prob: 0.0000 pR: -70.0000
-6: (clump_#6): documents: 1 affinity: 0.1379 prob: 0.0000 pR: -70.0000
-7: (clump_#7): documents: 1 affinity: 0.0991 prob: 0.0000 pR: -70.0000
-8: (clump_#8): documents: 2 affinity: 0.5186 prob: 1.0000 pR: 61.5681
-Likely result:
-PMULC succeeds; success probabilty: 1.0000 pR: 59.1777
-Best match to clump #2 (clump_#2) prob: 1.0000 pR: 59.1777
-Closest document: #1 (document_#1) affinity: 0.7596
+ Unsure result
+PMULC fails; success probability: 0.0000 pR: 0.0000
+Best match to clump #1 (clump_#1) prob: 0.0000 pR: 0.0000
+Closest document: #-1 (document_#-1) affinity: -1.0000
Total features in input file: 223
-1: (clump_#1): documents: 4 affinity: 0.1356 prob: 0.0000 pR: -70.0000
-2: (clump_#2): documents: 2 affinity: 0.4753 prob: 1.0000 pR: 59.1777
-3: (clump_#3): documents: 49 affinity: 0.1422 prob: 0.0000 pR: -70.0000
-4: (clump_#4): documents: 3 affinity: 0.1230 prob: 0.0000 pR: -70.0000
-5: (clump_#5): documents: 1 affinity: 0.1208 prob: 0.0000 pR: -70.0000
-6: (clump_#6): documents: 1 affinity: 0.1421 prob: 0.0000 pR: -70.0000
-7: (clump_#7): documents: 1 affinity: 0.1173 prob: 0.0000 pR: -70.0000
-8: (clump_#8): documents: 2 affinity: 0.0928 prob: 0.0000 pR: -70.0000
Likely result:
-0 (document_#0) clump: 1 (clump_#1) affinity: 0.1439
-1 (document_#1) clump: 2 (clump_#2) affinity: 0.0887
-2 (document_#2) clump: 3 (clump_#3) affinity: 0.1784
-3 (document_#3) clump: 4 (clump_#4) affinity: 0.1651
-4 (document_#4) clump: 4 (clump_#4) affinity: 0.1949
-5 (document_#5) clump: 4 (clump_#4) affinity: 0.2162
-6 (document_#6) clump: 3 (clump_#3) affinity: 0.1953
-7 (document_#7) clump: 1 (clump_#1) affinity: 0.1418
-8 (document_#8) clump: 1 (clump_#1) affinity: 0.1535
-9 (document_#9) clump: 1 (clump_#1) affinity: 0.1432
-10 (document_#10) clump: 3 (clump_#3) affinity: 0.1790
-11 (document_#11) clump: 3 (clump_#3) affinity: 0.1883
-12 (document_#12) clump: 3 (clump_#3) affinity: 0.2052
-13 (document_#13) clump: 3 (clump_#3) affinity: 0.1841
-14 (document_#14) clump: 3 (clump_#3) affinity: 0.2289
-15 (document_#15) clump: 3 (clump_#3) affinity: 0.1805
-16 (document_#16) clump: 3 (clump_#3) affinity: 0.1776
-17 (document_#17) clump: 3 (clump_#3) affinity: 0.1966
-18 (document_#18) clump: 2 (clump_#2) affinity: 0.0887
-19 (document_#19) clump: 3 (clump_#3) affinity: 0.1803
-20 (document_#20) clump: 3 (clump_#3) affinity: 0.2188
-21 (document_#21) clump: 3 (clump_#3) affinity: 0.2216
-22 (document_#22) clump: 3 (clump_#3) affinity: 0.2264
-23 (document_#23) clump: 3 (clump_#3) affinity: 0.1826
-24 (document_#24) clump: 3 (clump_#3) affinity: 0.2031
-25 (document_#25) clump: 3 (clump_#3) affinity: 0.1978
-26 (document_#26) clump: 3 (clump_#3) affinity: 0.1834
-27 (document_#27) clump: 3 (clump_#3) affinity: 0.2121
-28 (document_#28) clump: 3 (clump_#3) affinity: 0.1853
-29 (document_#29) clump: 3 (clump_#3) affinity: 0.1602
-30 (document_#30) clump: 3 (clump_#3) affinity: 0.1999
-31 (document_#31) clump: 3 (clump_#3) affinity: 0.2193
-32 (document_#32) clump: 3 (clump_#3) affinity: 0.2209
-33 (document_#33) clump: 3 (clump_#3) affinity: 0.1977
-34 (document_#34) clump: 5 (clump_#5) affinity: 0.0000
-35 (document_#35) clump: 6 (clump_#6) affinity: 0.0000
-36 (document_#36) clump: 3 (clump_#3) affinity: 0.1724
-37 (document_#37) clump: 3 (clump_#3) affinity: 0.1824
-38 (document_#38) clump: 3 (clump_#3) affinity: 0.1955
-39 (document_#39) clump: 3 (clump_#3) affinity: 0.1970
-40 (document_#40) clump: 3 (clump_#3) affinity: 0.1906
-41 (document_#41) clump: 3 (clump_#3) affinity: 0.1979
-42 (document_#42) clump: 3 (clump_#3) affinity: 0.1926
-43 (document_#43) clump: 3 (clump_#3) affinity: 0.1717
-44 (document_#44) clump: 7 (clump_#7) affinity: 0.0000
-45 (document_#45) clump: 3 (clump_#3) affinity: 0.1876
-46 (document_#46) clump: 8 (clump_#8) affinity: 0.1011
-47 (document_#47) clump: 8 (clump_#8) affinity: 0.1011
-48 (document_#48) clump: 3 (clump_#3) affinity: 0.1751
-49 (document_#49) clump: 3 (clump_#3) affinity: 0.1998
-50 (document_#50) clump: 3 (clump_#3) affinity: 0.1896
-51 (document_#51) clump: 3 (clump_#3) affinity: 0.1863
-52 (document_#52) clump: 3 (clump_#3) affinity: 0.2194
-53 (document_#53) clump: 3 (clump_#3) affinity: 0.2076
-54 (document_#54) clump: 3 (clump_#3) affinity: 0.2291
-55 (document_#55) clump: 3 (clump_#3) affinity: 0.2257
-56 (document_#56) clump: 3 (clump_#3) affinity: 0.2070
-57 (document_#57) clump: 3 (clump_#3) affinity: 0.1970
-58 (document_#58) clump: 3 (clump_#3) affinity: 0.2020
-59 (document_#59) clump: 3 (clump_#3) affinity: 0.2016
-60 (document_#60) clump: 3 (clump_#3) affinity: 0.1767
-61 (document_#61) clump: 3 (clump_#3) affinity: 0.1724
-62 (document_#62) clump: 3 (clump_#3) affinity: 0.1727
+0 (document_#0) clump: 0 (unassigned) affinity: 0.0822
+1 (document_#1) clump: 0 (unassigned) affinity: 0.0822
==============================================================
=================== MEGATEST DIFF REPORT =====================
=================== (regular) ====================
==============================================================
/usr/bin/diff -EbwBd --strip-trailing-cr ./megatest_knowngood.log megatest_test.log & sleep 1
1,2c1,2
< This is CRM114, version 20080502-BlameJason (TRE 0.7.5 (LGPL))
< Copyright 2001-2006 William S. Yerazunis
---
> This is CRM114, version 20080502-BlameJason, rev 2908 (TRE 0.7.5 (LGPL)) (OS: linux-gnu)
> Copyright 2001-2008 William S. Yerazunis
4a5,16
> Classifiers included in this build:
> all of 'em
>
> Extra features:
> Developer Assertions are:
> - included
> - UNTRAPPABLE
> - '-Cdbg' will cause a memory access violation in a last ditch
> effort to trigger your debugger
>
> ***** checking CRM language features
>
22,23c34,35
< ./crm114: *ERROR*
< For some reason, I was unable to read-open the file named zoob.zipulrlfjf
---
> crm114: *ERROR*
> For some reason, I was unable to read-open the file named 'zoob.zipulrlfjf' (expanded from 'zoob.zipulrlfjf'): error = 2(No such file or directory)
25,26c37,39
< This happened at line 19 of file fataltraptest.crm
< (runtime system location: crm_expr_file_io.c(151) in routine: crm_expr_input)
---
> This happened at line 19 of file fataltraptest.crm:
> input [zoob.zipulrlfjf] (:hi:)
> (runtime system location: crm_expr_file_io.c(217) in routine: crm_expr_input)
29c42
< ./crm114: *ERROR*
---
> crm114: *ERROR*
32,33c45,47
< This happened at line 29 of file fataltraptest.crm
< (runtime system location: crm_expr_file_io.c(345) in routine: crm_expr_output)
---
> This happened at line 30 of file fataltraptest.crm:
> output [/No/Such/Directory/frotz.mumble] /:hi:/ # This is correct code; should give the I/O error as expected
> (runtime system location: crm_expr_file_io.c(593) in routine: crm_expr_output)
115c129
< ./crm114: *WARNING*
---
> crm114: *WARNING*
118,119c132,134
< This happened at line 292 of file matchtest.crm
< (runtime system location: crm_expr_match.c(479) in routine: crm_expr_match)
---
> This happened at line 292 of file matchtest.crm:
> match <absent> (:incognita:) /nothinjkljiejfksn;s94jf94msks/
> (runtime system location: crm_expr_match.c(487) in routine: crm_expr_match)
208,209c223,224
< OK_IF_PID_CHANGES: one... MINION PROC PID: 5834 from-pipe: 6 to-pipe: 5
< OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 5834 from-pipe: 6 to-pipe: 5
---
> OK_IF_PID_CHANGES: one... MINION PROC PID: 2021 from-pipe: 5 to-pipe: 4
> OK_IF_PID_SAME_AS_ABOVE: again... MINION PROC PID: 2021 from-pipe: 5 to-pipe: 4
461c476
< ./crm114: *WARNING*
---
> crm114: *WARNING*
464,465c479,481
< This happened at line 15 of file eval_infiniteloop.crm
< (runtime system location: crm_expr_alter.c(141) function crm_expr_eval)
---
> This happened at line 15 of file eval_infiniteloop.crm:
> eval (:b:) /:*:a:/
> (runtime system location: crm_expr_alter.c(136) in routine: crm_expr_eval)
546,547c562,563
< OK_IF_SIZE_CHANGES: Size of isolation at start: 2099029
< Bytes used per pass: 2097150
---
> OK_IF_SIZE_CHANGES: Size of isolation at start: 2072508
> Bytes used per pass: 2070606
549,550c565,566
< Total flux through isolation: 419430000
< OK_IF_SIZE_CHANGES: Final isolation size: 2099046
---
> Total flux through isolation: 414121200
> OK_IF_SIZE_CHANGES: Final isolation size: 2072525
557,558c573,574
< OK_IF_SIZE_CHANGES: Size of isolation at start: 2101511
< Bytes used per pass: 2097150
---
> OK_IF_SIZE_CHANGES: Size of isolation at start: 2074990
> Bytes used per pass: 2070606
560,561c576,577
< Total flux through isolation: 41943000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101526
---
> Total flux through isolation: 41412120
> OK_IF_SIZE_CHANGES: Final isolation size: 2075005
563c579
< Bytes used per pass: 2097150
---
> Bytes used per pass: 2070606
565,566c581,582
< Total flux through isolation: 83886000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101532
---
> Total flux through isolation: 82824240
> OK_IF_SIZE_CHANGES: Final isolation size: 2075011
568c584
< Bytes used per pass: 2097150
---
> Bytes used per pass: 2070606
570,571c586,587
< Total flux through isolation: 125829000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101533
---
> Total flux through isolation: 124236360
> OK_IF_SIZE_CHANGES: Final isolation size: 2075012
573c589
< Bytes used per pass: 2097150
---
> Bytes used per pass: 2070606
575,576c591,592
< Total flux through isolation: 167772000
< OK_IF_SIZE_CHANGES: Final isolation size: 2101533
---
> Total flux through isolation: 165648480
> OK_IF_SIZE_CHANGES: Final isolation size: 2075012
681a698,699
>
> ***** checking return and exit codes
684a703,704
>
> ***** check that failed syscalls will code right
688a709,710
>
> **** Default (SBPH Markovian) classifier
694c716
< #1 (q_test.css): features: 133586, hits: 5022, prob: 1.00e+00, pR: 10.65
---
> #1 (q_test.css): features: 133586, hits: 5022, prob: 1.00e-00, pR: 10.65
700c722
< #0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e+00, pR: 10.28
---
> #0 (i_test.css): features: 140946, hits: 4571, prob: 1.00e-00, pR: 10.28
704a727,728
>
> **** OSB Markovian classifier
720a745,746
>
> **** OSB Markov Unique classifier
736a763,764
>
> **** OSB Markov Chisquared Unique classifier
752a781,782
>
> **** OSBF Local Confidence (Fidelis) classifier
768a799,800
>
> **** OSB Winnow classifier
785a818,820
>
>
> **** Now verify that winnow learns affect only the named file (i_test.css)
801c836,837
< #1 (q_test.css): features: 69806.15, unseen: 1.00e+01, weight: 3.53e+01, pR: 0.71
---
> #1 (q_test.css): features: 69806.71, unseen: 1.00e+01, weight: 3.53e+01, pR: 0.71
>
802a839
> **** Unigram Bayesian classifier
820a858,859
>
> **** unigram Winnow classifier
836a876,877
>
> **** OSB Hyperspace classifier
852a894,895
>
> **** OSB three-letter Hyperspace classifier
868a912,913
>
> **** Unigram Hyperspace classifier
884a930,931
>
> **** String Hyperspace classifier
900a948,949
>
> **** String Unigram Hyperspace classifier
916a966,1009
>
> **** Vector 3-word-bag Hyperspace classifier
>
> crm114: *WARNING*
> We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
> I'll try to keep working.
> This happened at line 2 of file (from command line):
> learn < hyperspace > (q_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
> (runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
>
> crm114: *WARNING*
> There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
> I'll try to keep working.
> This happened at line 2 of file (from command line):
> learn < hyperspace > (q_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
> (runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
>
> crm114: *WARNING*
> We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
> I'll try to keep working.
> This happened at line 2 of file (from command line):
> learn < hyperspace > (i_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1/
> (runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
>
> crm114: *WARNING*
> There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
> I'll try to keep working.
> This happened at line 2 of file (from command line):
> learn < hyperspace > (i_test.css) /[[:graph:]]+/ /vector: 3 1 1 1 1/
> (runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
>
> crm114: *WARNING*
> We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
> I'll try to keep working.
> This happened at line 4 of file (from command line):
> classify < hyperspace > ( i_test.css | q_test.css ) (:s:)/[[:graph:]]+/ /vector: 3 1 1 1 1 /
> (runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
>
> crm114: *WARNING*
> There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
> I'll try to keep working.
> This happened at line 4 of file (from command line):
> classify < hyperspace > ( i_test.css | q_test.css ) (:s:)/[[:graph:]]+/ /vector: 3 1 1 1 1 /
> (runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
918,922c1011,1015
< CLASSIFY fails; success probability: 0.0000 pR: -217.6877
< Best match to file #1 (q_test.css) prob: 1.0000 pR: 217.6877
< Total features in input file: 10
< #0 (i_test.css): features: 8809, hits: 0, radiance: 0.00e+00, prob: 1.70e-22, pR: -217.69
< #1 (q_test.css): features: 8349, hits: 7, radiance: 5.87e-03, prob: 1.00e+00, pR: 217.69
---
> CLASSIFY fails; success probability: 0.5000 pR: 0.0000
> Best match to file #0 (i_test.css) prob: 0.5000 pR: 0.0000
> Total features in input file: -1
> #0 (i_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
> #1 (q_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
924,929c1017,1036
< type I
< CLASSIFY succeeds; success probability: 1.0000 pR: 217.4552
< Best match to file #0 (i_test.css) prob: 1.0000 pR: 217.4552
< Total features in input file: 9
< #0 (i_test.css): features: 8809, hits: 7, radiance: 5.57e-03, prob: 1.00e+00, pR: 217.46
< #1 (q_test.css): features: 8349, hits: 0, radiance: 0.00e+00, prob: 1.80e-22, pR: -217.46
---
>
> crm114: *WARNING*
> We'd expected to see another value specified for the VT coefficient matrix value but alas, the script apparently didn't deliver enough for that. Next time, make sure you've got a full custom vector!
> I'll try to keep working.
> This happened at line 4 of file (from command line):
> classify <hyperspace > ( i_test.css | q_test.css ) (:s:) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
> (runtime system location: crm_vector_tokenize.c(1387) in routine: fetch_value)
>
> crm114: *WARNING*
> There's a boo-boo in the 2nd slash argument where we try to look for the 'vector:...' coefficient matrix collection while configuring VT (Vector Tokenizer) default coefficient matrix and tokenizer setup.
> I'll try to keep working.
> This happened at line 4 of file (from command line):
> classify <hyperspace > ( i_test.css | q_test.css ) (:s:) /[[:graph:]]+/ /vector: 3 1 1 1 1 /
> (runtime system location: crm_vector_tokenize.c(1728) in routine: config_vt_coeff_matrix_and_tokenizer)
> type Q
> CLASSIFY fails; success probability: 0.5000 pR: 0.0000
> Best match to file #0 (i_test.css) prob: 0.5000 pR: 0.0000
> Total features in input file: -1
> #0 (i_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
> #1 (q_test.css): features: 0, hits: 0, radiance: 0.00e+00, prob: 5.00e-01, pR: 0.00
932a1040,1041
>
> **** Bit-Entropy classifier
934,935c1043,1044
< CLASSIFY fails; success probability: 0.0000 pR: -6.5985
< Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.5985
---
> CLASSIFY fails; success probability: 0.0000 pR: -5.3784
> Best match to file #1 (q_test.css) prob: 1.0000 pR: 5.3784
937,938c1046,1047
< #0 (i_test.css): features: 425488 (5%), entropy: 384.969632, jumps: 23, prob: 2.52e-07, pR: -6.60
< #1 (q_test.css): features: 552504 (5%), entropy: 225.556532, jumps: 7, prob: 1.00e+00, pR: 6.60
---
> #0 (i_test.css): features: 425488 (5%), entropy: 365.245113, jumps: 21, prob: 4.18e-06, pR: -5.38
> #1 (q_test.css): features: 552504 (5%), entropy: 235.307962, jumps: 8, prob: 1.00e-00, pR: 5.38
941,942c1050,1051
< CLASSIFY succeeds; success probability: 1.0000 pR: 5.3230
< Best match to file #0 (i_test.css) prob: 1.0000 pR: 5.3230
---
> CLASSIFY succeeds; success probability: 1.0000 pR: 4.9105
> Best match to file #0 (i_test.css) prob: 1.0000 pR: 4.9105
944,945c1053,1054
< #0 (i_test.css): features: 425488 (5%), entropy: 138.295562, jumps: 4, prob: 1.00e+00, pR: 5.32
< #1 (q_test.css): features: 552504 (5%), entropy: 266.892513, jumps: 17, prob: 4.75e-06, pR: -5.32
---
> #0 (i_test.css): features: 425488 (5%), entropy: 138.295563, jumps: 4, prob: 1.00e-00, pR: 4.91
> #1 (q_test.css): features: 552504 (5%), entropy: 256.926733, jumps: 16, prob: 1.23e-05, pR: -4.91
948a1058,1059
>
> **** Bit-Entropy Toroid classifier
950,951c1061,1062
< CLASSIFY fails; success probability: 0.0000 pR: -6.5308
< Best match to file #1 (q_test.css) prob: 1.0000 pR: 6.5308
---
> CLASSIFY fails; success probability: 0.0000 pR: -8.6215
> Best match to file #1 (q_test.css) prob: 1.0000 pR: 8.6215
953,954c1064,1065
< #0 (i_test.css): features: 425488 (100%), entropy: 459.942001, jumps: 26, prob: 2.95e-07, pR: -6.53
< #1 (q_test.css): features: 552504 (100%), entropy: 302.166313, jumps: 10, prob: 1.00e+00, pR: 6.53
---
> #0 (i_test.css): features: 425488 (100%), entropy: 519.417393, jumps: 33, prob: 2.39e-09, pR: -8.62
> #1 (q_test.css): features: 552504 (100%), entropy: 311.132100, jumps: 11, prob: 1.00e-00, pR: 8.62
957,958c1068,1069
< CLASSIFY succeeds; success probability: 1.0000 pR: 6.0927
< Best match to file #0 (i_test.css) prob: 1.0000 pR: 6.0927
---
> CLASSIFY succeeds; success probability: 1.0000 pR: 5.6187
> Best match to file #0 (i_test.css) prob: 1.0000 pR: 5.6187
960,961c1071,1072
< #0 (i_test.css): features: 425488 (100%), entropy: 231.058285, jumps: 7, prob: 1.00e+00, pR: 6.09
< #1 (q_test.css): features: 552504 (100%), entropy: 378.250899, jumps: 21, prob: 8.08e-07, pR: -6.09
---
> #0 (i_test.css): features: 425488 (100%), entropy: 231.058286, jumps: 7, prob: 1.00e-00, pR: 5.62
> #1 (q_test.css): features: 552504 (100%), entropy: 366.798873, jumps: 20, prob: 2.41e-06, pR: -5.62
964a1076,1077
>
> **** Fast Substring Compression Match Classifier
980a1094,1095
>
> **** Neural Network Classifier
982,983c1097,1098
< CLASSIFY fails; success probability: 0.241661 pR: -62.5048
< Best match to file #1 (q_test.css) prob: 0.7583 pR: 62.5048
---
> CLASSIFY fails; success probability: 0.338256 pR: -6.5569
> Best match to file #1 (q_test.css) prob: 0.6617 pR: 6.5569
985,986c1100,1101
< #0 (i_test.css): prob: 2.42e-01, pR: -62.50
< #1 (q_test.css): prob: 7.58e-01, pR: 62.50
---
> #0 (i_test.css): prob: 3.38e-01, pR: -6.56
> #1 (q_test.css): prob: 6.62e-01, pR: 6.56
989,990c1104,1105
< CLASSIFY succeeds; success probability: 0.889200 pR: 189.2001
< Best match to file #0 (i_test.css) prob: 0.8892 pR: 189.2001
---
> CLASSIFY succeeds; success probability: 0.941100 pR: 241.0995
> Best match to file #0 (i_test.css) prob: 0.9411 pR: 241.0995
992,993c1107,1109
< #0 (i_test.css): prob: 8.89e-01, pR: 189.20
< #1 (q_test.css): prob: 1.11e-01, pR: -189.20
---
> #0 (i_test.css): prob: 9.41e-01, pR: 241.10
> #1 (q_test.css): prob: 5.89e-02, pR: -241.10
>
994a1111
> **** Alternate Neural Network Classifier test script
999,1000c1116,1117
< CLASSIFY fails; success probability: 0.017262 pR: -282.7380
< Best match to file #1 (q_test.css) prob: 0.9827 pR: 282.7380
---
> CLASSIFY fails; success probability: 0.018972 pR: -281.0282
> Best match to file #1 (q_test.css) prob: 0.9810 pR: 281.0282
1002,1003c1119,1120
< #0 (i_test.css): prob: 1.73e-02, pR: -282.74
< #1 (q_test.css): prob: 9.83e-01, pR: 282.74
---
> #0 (i_test.css): prob: 1.90e-02, pR: -281.03
> #1 (q_test.css): prob: 9.81e-01, pR: 281.03
1006,1007c1123,1124
< CLASSIFY succeeds; success probability: 0.971915 pR: 271.9152
< Best match to file #0 (i_test.css) prob: 0.9719 pR: 271.9152
---
> CLASSIFY succeeds; success probability: 0.965700 pR: 265.7001
> Best match to file #0 (i_test.css) prob: 0.9657 pR: 265.7001
1009,1010c1126,1127
< #0 (i_test.css): prob: 9.72e-01, pR: 271.92
< #1 (q_test.css): prob: 2.81e-02, pR: -271.92
---
> #0 (i_test.css): prob: 9.66e-01, pR: 265.70
> #1 (q_test.css): prob: 3.43e-02, pR: -265.70
1013a1131,1132
>
> **** Support Vector Machine (SVM) unigram classifier
1015,1016c1134,1135
< CLASSIFY succeeds; success probability: 0.8901 pR: 9.0850
< Best match to file #0 (i_test.css) prob: 0.8901 pR: 9.0850
---
> CLASSIFY succeeds; success probability: 0.8872 pR: 8.9571
> Best match to file #0 (i_test.css) prob: 0.8872 pR: 8.9571
1018,1019c1137,1138
< #0 (i_test.css): documents: 300, features: 7464, prob: 8.90e-01, pR: 9.09
< #1 (q_test.css): documents: 175, features: 6223, prob: 1.10e-01, pR: -9.09
---
> #0 (i_test.css): documents: 300, features: 7464, prob: 8.87e-01, pR: 8.96
> #1 (q_test.css): documents: 175, features: 6223, prob: 1.13e-01, pR: -8.96
1022,1023c1141,1142
< CLASSIFY succeeds; success probability: 0.9947 pR: 22.7433
< Best match to file #0 (i_test.css) prob: 0.9947 pR: 22.7433
---
> CLASSIFY succeeds; success probability: 0.9947 pR: 22.7512
> Best match to file #0 (i_test.css) prob: 0.9947 pR: 22.7512
1025,1026c1144,1146
< #0 (i_test.css): documents: 300, features: 7464, prob: 9.95e-01, pR: 22.74
< #1 (q_test.css): documents: 175, features: 6223, prob: 5.29e-03, pR: -22.74
---
> #0 (i_test.css): documents: 300, features: 7464, prob: 9.95e-01, pR: 22.75
> #1 (q_test.css): documents: 175, features: 6223, prob: 5.28e-03, pR: -22.75
>
1027a1148
> **** Support Vector Machine (SVM) classifier
1031,1032c1152,1153
< CLASSIFY succeeds; success probability: 0.8723 pR: 8.3442
< Best match to file #0 (i_test.css) prob: 0.8723 pR: 8.3442
---
> CLASSIFY succeeds; success probability: 0.8726 pR: 8.3572
> Best match to file #0 (i_test.css) prob: 0.8726 pR: 8.3572
1034,1035c1155,1156
< #0 (i_test.css): documents: 300, features: 34780, prob: 8.72e-01, pR: 8.34
< #1 (q_test.css): documents: 175, features: 32300, prob: 1.28e-01, pR: -8.34
---
> #0 (i_test.css): documents: 300, features: 34780, prob: 8.73e-01, pR: 8.36
> #1 (q_test.css): documents: 175, features: 32300, prob: 1.27e-01, pR: -8.36
1038,1039c1159,1160
< CLASSIFY succeeds; success probability: 0.9678 pR: 14.7738
< Best match to file #0 (i_test.css) prob: 0.9678 pR: 14.7738
---
> CLASSIFY succeeds; success probability: 0.9678 pR: 14.7820
> Best match to file #0 (i_test.css) prob: 0.9678 pR: 14.7820
1041,1042c1162,1163
< #0 (i_test.css): documents: 300, features: 34780, prob: 9.68e-01, pR: 14.77
< #1 (q_test.css): documents: 175, features: 32300, prob: 3.22e-02, pR: -14.77
---
> #0 (i_test.css): documents: 300, features: 34780, prob: 9.68e-01, pR: 14.78
> #1 (q_test.css): documents: 175, features: 32300, prob: 3.22e-02, pR: -14.78
1045a1167,1168
>
> **** String Kernel SVM (SKS) classifier
1047,1048c1170,1171
< CLASSIFY succeeds; success probability: 0.8755 pR: 8.4725
< Best match to file #0 (i_test.css) prob: 0.8755 pR: 8.4725
---
> CLASSIFY succeeds; success probability: 0.8756 pR: 8.4734
> Best match to file #0 (i_test.css) prob: 0.8756 pR: 8.4734
1054,1055c1177,1178
< CLASSIFY succeeds; success probability: 0.9834 pR: 17.7226
< Best match to file #0 (i_test.css) prob: 0.9834 pR: 17.7226
---
> CLASSIFY succeeds; success probability: 0.9834 pR: 17.7222
> Best match to file #0 (i_test.css) prob: 0.9834 pR: 17.7222
1061a1185,1186
>
> **** String Kernel SVM (SKS) Unique classifier
1063,1064c1188,1189
< CLASSIFY succeeds; success probability: 0.8890 pR: 9.0370
< Best match to file #0 (i_test.css) prob: 0.8890 pR: 9.0370
---
> CLASSIFY succeeds; success probability: 0.8889 pR: 9.0317
> Best match to file #0 (i_test.css) prob: 0.8889 pR: 9.0317
1066,1067c1191,1192
< #0 (i_test.css):documents: 300, features: 42397, prob: 8.89e-01, pR: 9.04
< #1 (q_test.css):documents: 175, features: 37599, prob: 1.11e-01, pR: -9.04
---
> #0 (i_test.css): documents: 300, features: 42397, prob: 8.89e-01, pR: 9.03
> #1 (q_test.css): documents: 175, features: 37599, prob: 1.11e-01, pR: -9.03
1070,1071c1195,1196
< CLASSIFY succeeds; success probability: 0.9848 pR: 18.1080
< Best match to file #0 (i_test.css) prob: 0.9848 pR: 18.1080
---
> CLASSIFY succeeds; success probability: 0.9848 pR: 18.1012
> Best match to file #0 (i_test.css) prob: 0.9848 pR: 18.1012
1073,1074c1198,1199
< #0 (i_test.css):documents: 300, features: 42397, prob: 9.85e-01, pR: 18.11
< #1 (q_test.css):documents: 175, features: 37599, prob: 1.52e-02, pR: -18.11
---
> #0 (i_test.css): documents: 300, features: 42397, prob: 9.85e-01, pR: 18.10
> #1 (q_test.css): documents: 175, features: 37599, prob: 1.52e-02, pR: -18.10
1077a1203,1204
>
> **** Bytewise Correlation classifier
1080c1207
< Best match to file #1 (QUICKREF.txt) prob: 0.9907 pR: 2.0254
---
> Best match to file #1 (QUICKREF_mt_ng_reference_1.input) prob: 0.9907 pR: 2.0254
1082,1083c1209,1210
< #0 (INTRO.txt): features: 53186, L1: 219063 L2: 325594 L3: 585264, l4: 1747198 prob: 9.34e-03, pR: -2.03
< #1 (QUICKREF.txt): features: 69063, L1: 385852 L2: 599956 L3: 6579582, l4: 326320000 prob: 9.91e-01, pR: 2.03
---
> #0 (INTRO_mt_ng_reference_2.input): features: 53186, L1: 219063 L2: 325594 L3: 585264, L4: 1747198 prob: 9.34e-03, pR: -2.03
> #1 (QUICKREF_mt_ng_reference_1.input): features: 69063, L1: 385852 L2: 599956 L3: 6579582, L4: 326320000 prob: 9.91e-01, pR: 2.03
1087c1214
< Best match to file #0 (INTRO.txt) prob: 1.0000 pR: 4.3436
---
> Best match to file #0 (INTRO_mt_ng_reference_2.input) prob: 1.0000 pR: 4.3436
1089,1090c1216,1217
< #0 (INTRO.txt): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, l4: 52869796589 prob: 1.00e+00, pR: 4.34
< #1 (QUICKREF.txt): features: 69063, L1: 1060543 L2: 1359260 L3: 1991862, l4: 4285688 prob: 4.53e-05, pR: -4.34
---
> #0 (INTRO_mt_ng_reference_2.input): features: 53186, L1: 593131 L2: 3238253 L3: 344785845, L4: 52869796589 prob: 1.00e-00, pR: 4.34
> #1 (QUICKREF_mt_ng_reference_1.input): features: 69063, L1: 1060543 L2: 1359260 L3: 1991862, L4: 4285688 prob: 4.53e-05, pR: -4.34
1094,1097c1221,1242
< ...............................................................Likely result:
< PMULC succeeds; success probabilty: 1.0000 pR: 61.5681
< Best match to clump #8 (clump_#8) prob: 1.0000 pR: 61.5681
< Closest document: #46 (document_#46) affinity: 0.8233
---
>
> **** Clump / Pmulc Test
>
> crm114: *UNTRAPPABLE ERROR*
> Cannot allocate distance matrix M[] (C) Stick a fork in us; we're _done_.
> Sorry, but this program is very sick and probably should be killed off.
> This happened at line 3 of file (from command line):
> clump <bychunk> [:one_paragraph:] (i_test.css) /[[:graph:]]+/
> (runtime system location: crm_expr_clump.c(782) in routine: thresholding_average_cluster)
>
> crm114: *UNTRAPPABLE ERROR*
>
> Better start screaming, guv', since the software's just gone critical:
> assertion '!(scale <= 1.19209290e-7F && scale >= -1.19209290e-7F)' failed!
> Sorry, but this program is very sick and probably should be killed off.
> This happened at line 3 of file (from command line):
> clump [:one_paragraph:] <bychunk> (i_test.css) /[[:graph:]]+/
> (runtime system location: crm_expr_clump.c(841) in routine: thresholding_average_cluster)
> Unsure result
> PMULC fails; success probability: 0.0000 pR: 0.0000
> Best match to clump #1 (clump_#1) prob: 0.0000 pR: 0.0000
> Closest document: #-1 (document_#-1) affinity: -1.0000
1099,1106d1243
< 1: (clump_#1): documents: 4 affinity: 0.1529 prob: 0.0000 pR: -70.0000
< 2: (clump_#2): documents: 2 affinity: 0.0942 prob: 0.0000 pR: -70.0000
< 3: (clump_#3): documents: 49 affinity: 0.1234 prob: 0.0000 pR: -70.0000
< 4: (clump_#4): documents: 3 affinity: 0.1136 prob: 0.0000 pR: -70.0000
< 5: (clump_#5): documents: 1 affinity: 0.1408 prob: 0.0000 pR: -70.0000
< 6: (clump_#6): documents: 1 affinity: 0.1379 prob: 0.0000 pR: -70.0000
< 7: (clump_#7): documents: 1 affinity: 0.0991 prob: 0.0000 pR: -70.0000
< 8: (clump_#8): documents: 2 affinity: 0.5186 prob: 1.0000 pR: 61.5681
1108,1111c1245,1248
< Likely result:
< PMULC succeeds; success probabilty: 1.0000 pR: 59.1777
< Best match to clump #2 (clump_#2) prob: 1.0000 pR: 59.1777
< Closest document: #1 (document_#1) affinity: 0.7596
---
> Unsure result
> PMULC fails; success probability: 0.0000 pR: 0.0000
> Best match to clump #1 (clump_#1) prob: 0.0000 pR: 0.0000
> Closest document: #-1 (document_#-1) affinity: -1.0000
1113,1120d1249
< 1: (clump_#1): documents: 4 affinity: 0.1356 prob: 0.0000 pR: -70.0000
< 2: (clump_#2): documents: 2 affinity: 0.4753 prob: 1.0000 pR: 59.1777
< 3: (clump_#3): documents: 49 affinity: 0.1422 prob: 0.0000 pR: -70.0000
< 4: (clump_#4): documents: 3 affinity: 0.1230 prob: 0.0000 pR: -70.0000
< 5: (clump_#5): documents: 1 affinity: 0.1208 prob: 0.0000 pR: -70.0000
< 6: (clump_#6): documents: 1 affinity: 0.1421 prob: 0.0000 pR: -70.0000
< 7: (clump_#7): documents: 1 affinity: 0.1173 prob: 0.0000 pR: -70.0000
< 8: (clump_#8): documents: 2 affinity: 0.0928 prob: 0.0000 pR: -70.0000
1123,1185c1252,1253
< 0 (document_#0) clump: 1 (clump_#1) affinity: 0.1439
< 1 (document_#1) clump: 2 (clump_#2) affinity: 0.0887
< 2 (document_#2) clump: 3 (clump_#3) affinity: 0.1784
< 3 (document_#3) clump: 4 (clump_#4) affinity: 0.1651
< 4 (document_#4) clump: 4 (clump_#4) affinity: 0.1949
< 5 (document_#5) clump: 4 (clump_#4) affinity: 0.2162
< 6 (document_#6) clump: 3 (clump_#3) affinity: 0.1953
< 7 (document_#7) clump: 1 (clump_#1) affinity: 0.1418
< 8 (document_#8) clump: 1 (clump_#1) affinity: 0.1535
< 9 (document_#9) clump: 1 (clump_#1) affinity: 0.1432
< 10 (document_#10) clump: 3 (clump_#3) affinity: 0.1790
< 11 (document_#11) clump: 3 (clump_#3) affinity: 0.1883
< 12 (document_#12) clump: 3 (clump_#3) affinity: 0.2052
< 13 (document_#13) clump: 3 (clump_#3) affinity: 0.1841
< 14 (document_#14) clump: 3 (clump_#3) affinity: 0.2289
< 15 (document_#15) clump: 3 (clump_#3) affinity: 0.1805
< 16 (document_#16) clump: 3 (clump_#3) affinity: 0.1776
< 17 (document_#17) clump: 3 (clump_#3) affinity: 0.1966
< 18 (document_#18) clump: 2 (clump_#2) affinity: 0.0887
< 19 (document_#19) clump: 3 (clump_#3) affinity: 0.1803
< 20 (document_#20) clump: 3 (clump_#3) affinity: 0.2188
< 21 (document_#21) clump: 3 (clump_#3) affinity: 0.2216
< 22 (document_#22) clump: 3 (clump_#3) affinity: 0.2264
< 23 (document_#23) clump: 3 (clump_#3) affinity: 0.1826
< 24 (document_#24) clump: 3 (clump_#3) affinity: 0.2031
< 25 (document_#25) clump: 3 (clump_#3) affinity: 0.1978
< 26 (document_#26) clump: 3 (clump_#3) affinity: 0.1834
< 27 (document_#27) clump: 3 (clump_#3) affinity: 0.2121
< 28 (document_#28) clump: 3 (clump_#3) affinity: 0.1853
< 29 (document_#29) clump: 3 (clump_#3) affinity: 0.1602
< 30 (document_#30) clump: 3 (clump_#3) affinity: 0.1999
< 31 (document_#31) clump: 3 (clump_#3) affinity: 0.2193
< 32 (document_#32) clump: 3 (clump_#3) affinity: 0.2209
< 33 (document_#33) clump: 3 (clump_#3) affinity: 0.1977
< 34 (document_#34) clump: 5 (clump_#5) affinity: 0.0000
< 35 (document_#35) clump: 6 (clump_#6) affinity: 0.0000
< 36 (document_#36) clump: 3 (clump_#3) affinity: 0.1724
< 37 (document_#37) clump: 3 (clump_#3) affinity: 0.1824
< 38 (document_#38) clump: 3 (clump_#3) affinity: 0.1955
< 39 (document_#39) clump: 3 (clump_#3) affinity: 0.1970
< 40 (document_#40) clump: 3 (clump_#3) affinity: 0.1906
< 41 (document_#41) clump: 3 (clump_#3) affinity: 0.1979
< 42 (document_#42) clump: 3 (clump_#3) affinity: 0.1926
< 43 (document_#43) clump: 3 (clump_#3) affinity: 0.1717
< 44 (document_#44) clump: 7 (clump_#7) affinity: 0.0000
< 45 (document_#45) clump: 3 (clump_#3) affinity: 0.1876
< 46 (document_#46) clump: 8 (clump_#8) affinity: 0.1011
< 47 (document_#47) clump: 8 (clump_#8) affinity: 0.1011
< 48 (document_#48) clump: 3 (clump_#3) affinity: 0.1751
< 49 (document_#49) clump: 3 (clump_#3) affinity: 0.1998
< 50 (document_#50) clump: 3 (clump_#3) affinity: 0.1896
< 51 (document_#51) clump: 3 (clump_#3) affinity: 0.1863
< 52 (document_#52) clump: 3 (clump_#3) affinity: 0.2194
< 53 (document_#53) clump: 3 (clump_#3) affinity: 0.2076
< 54 (document_#54) clump: 3 (clump_#3) affinity: 0.2291
< 55 (document_#55) clump: 3 (clump_#3) affinity: 0.2257
< 56 (document_#56) clump: 3 (clump_#3) affinity: 0.2070
< 57 (document_#57) clump: 3 (clump_#3) affinity: 0.1970
< 58 (document_#58) clump: 3 (clump_#3) affinity: 0.2020
< 59 (document_#59) clump: 3 (clump_#3) affinity: 0.2016
< 60 (document_#60) clump: 3 (clump_#3) affinity: 0.1767
< 61 (document_#61) clump: 3 (clump_#3) affinity: 0.1724
< 62 (document_#62) clump: 3 (clump_#3) affinity: 0.1727
---
> 0 (document_#0) clump: 0 (unassigned) affinity: 0.0822
> 1 (document_#1) clump: 0 (unassigned) affinity: 0.0822
make[1]: Leaving directory `/home/tsp/programs/crm114/crm114-20080502-BlameJason/src'
-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Crm114-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/crm114-general