how to do feature selection

[email protected] ("Jianmin WU") Sat, 19 May 2007 20:42:58 +0800
Newsgroups perl.ai
Message-ID <[email protected]>
------=_Part_70944_10390491.1179578578449
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

hi, buddies,

I am not sure if i am in the right place. :-)

I am a fresh man to the perl and perl AI module.

I am trying to do the NaiveBayes experiments with the help of code demo.pl in
example of the module of AI::Categorizer.
Now I am confused about how to do the feature selection.

The documents say that KnowledgeSet::load( ) will do feature selection and
read the corpus at the same time. So, I change the construction of
KnowledgeSet in
demo.pl from
my $k = AI::Categorizer::KnowledgeSet->new( verbose => 1 );
$k->load( collection => $training )
to
my $k = AI::Categorizer::KnowledgeSet->new( verbose => 1 , features_kept =
5000 );
$k->load( collection => $training )

Then I re-run the code with expection to keep the top 5000 features with
high Document Frequency.
But it seems that there is no difference as before.  do i misunderstand any
point ?

And also,  is there any smoothing method implemented in
AI::Categorizer::Learner::NaiveBayes ?

Thanks for your attention

Jianmin

------=_Part_70944_10390491.1179578578449--