.cfc-files make program hang
Thomas Michael Hagen <[email protected]> Tue, 12 May 2009 14:26:01 +0200
| Newsgroups | gmane.mail.spam.crm114 |
|---|---|
| Message-ID | <[email protected]> |
in my multi-category classifier, i have a weird problem; after a
period of inactivity, i have to re-create the .cfc-files from scratch
to make the classifier program run properly.
example: i help train my classifier for a while, and then leave the
program open and go home from work. when i come back in the morning
and continue, the program hangs for several minutes, or even longer
(sometimes for more than an hour, in which case i shut down and start
over).
this also happens if i go for lunch, or even if i take a few minutes
off from classifying. the program is always slow after the break.
i have also seen the program hang like this on 'virgin' .cfc-files
that were created the day before, but not used.
it seems that somehow, my .cfc-files magically 'rot' or go stale. how
on earth is this possible?
i use nineteen categories. could this have something to do with it?
the program i have created is text-based, and runs in the terminal. it
tries to classify an article, and presents the user with a suggestion
(along with an excerpt from the article). the user then answers 'y' or
the right category.
this is the output of crm114 -v:
This is CRM114, version 20081111-BlameBarack, rev 4797 (TRE 0.7.5
(LGPL, APPROX, WCHAR, MULTIBYTE)) (OS: linux-gnu)
Copyright 2001-2009 William S. Yerazunis
This software is licensed under the GPL with ABSOLUTELY NO WARRANTY
Classifiers included in this build:
all of 'em
Extra features:
Developer Assertions are:
- included
- UNTRAPPABLE
- '-Cdbg' will cause a memory access violation in a last ditch
effort to trigger your debugger
Script language:
Reserved words (instructions) + attributes / format:
accept
alius
alter (...) /.../
call (optional) [optional] /.../
cssmerge <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace ...> (...) (optional)
[optional] /optional/
cssdiff <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace ...> (...) (optional)
[optional] /optional/
cssbackup <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace ...> (...) (optional)
[optional] /optional/
cssrestore <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace ...> (...) (optional)
[optional] /optional/
cssinfo <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace ...> (...) (optional)
[optional] /optional/
cssanalyze <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace ...> (...) (optional)
[optional] /optional/
csscreate <nocase basic literal nomultiline byline bychar string bychunk
microgroom markovian markov osb correlate winnow chi2 unique entropy
entropic osbf hyperspace unigram crosslink default sks svm fscm neural
alt.markovian alt.markov alt.osb alt.winnow alt.osbf alt.hyperspace
...> (...) (optional) [optional] /optional/
cssmigrate <basic bychar string microgroom markovian markov osb correlate
winnow chi2 unique entropy entropic osbf hyperspace unigram crosslink
default sks svm fscm neural auto autodetect alt.markovian alt.markov
alt.osb alt.winnow alt.osbf alt.hyperspace> (...) [...] /optional/
eval (optional) /.../
exit /optional/
fail
fault /optional/
hash (...) /.../
input <nomultiline byline lineedit> (optional) [optional]
intersect (...) [...]
isolate <default> (...) /optional/
lazy <default> (...) /optional/
learn <fromstart nocase basic literal nomultiline byline bychar string
bychunk append refute microgroom markovian markov osb correlate winnow
chi2 unique entropy entropic osbf hyperspace unigram crosslink sks svm
fscm neural alt.markovian alt.markov alt.osb alt.winnow alt.osbf
alt.hyperspace> (...) [optional] /optional/ /optional/
classify <nocase basic literal nomultiline byline bychar string bychunk
microgroom markovian markov osb correlate winnow chi2 unique entropy
entropic osbf hyperspace unigram crosslink sks svm fscm neural
alt.markovian alt.markov alt.osb alt.winnow alt.osbf alt.hyperspace>
(...) (optional) [optional] /optional/ /optional/
liaf
match <fromstart fromnext fromend newend fromcurrent nocase absent basic
backwards literal nomultiline byline> (optional) [optional] /.../
mutate <nocase absent basic nomultiline byline bychar string bychunk
unique default ...> (optional) [optional] /.../
output <append> [optional] /optional/
clump <bychunk refute unique unigram> (...) (optional) [...] /optional/
/optional/
pmulc <bychunk refute unique unigram> (...) (optional) [...] /optional/
return /optional/
routine
sort <nocase basic backwards nomultiline byline bychar string bychunk
unique default> (optional) [optional] /optional/
syscall <keep async> (optional) (optional) (optional) [optional] /optional/
translate <literal unique> (optional) [optional] /optional/ /optional/
trap (optional) /.../
union (...) [...]
window <nocase literal bychar string bychunk byeof eofaccepts eofretry>
(optional) (optional) /optional/ /optional/
------------------------------------------------------------------------------
The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
production scanning environment may not be a perfect world - but thanks to
Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
Series Scanner you'll get full speed at 300 dpi even with all image
processing features enabled. http://p.sf.net/sfu/kodak-com