Re: Information-theoretic functions (David Bateman)

> Date: Mon, 20 Nov 2006 14:07:56 +0100
> From: David Bateman <[email protected]>
> Subject: Re: Information-theoretic functions
> To: Joseph Wakeling <[email protected]>
> Cc: octave-forge list <[email protected]>,
> 	[email protected]
> Message-ID: <[email protected]>
> Content-Type: text/plain; charset=UTF-8
> 
> Joseph Wakeling wrote:
> > Hello all,
> >
> > For my own private work with Octave I have prepared a set of
> > information-theoretic functions which I thought I would offer to the
> > community.
> >
> > >From browsing the archives I recognise that another user recently
> > contributed a similar set of functions, but the .tar.gz attachment was
> > not available, so I could not compare.  I would very much like to see
> > those if possible.
> >
> > My own functions include one which I think was not in the earlier
> > bundle, to calculate the information gain ratio or uncertainty coefficient.
> >
> > One problem, which I'm not sure how to get round, is in the main
> > information entropy function: it requires vectors at input, but at
> > present only works with row or column vectors, i.e. not with vectors
> > where the active dimension is > 2.
> >   
> You should check with Muthu Annamalai for the overlap with his info
> theory functions in octave-forge, if any, and get these committed to
> octave-forge. Perhaps Muthu can do the commit for you..
> 
> D.
> 

I think you can look at the CVS online via source-forge's
website. The link to the information theory toolbox is at:
http://octave.cvs.sourceforge.net/octave/octave-forge/main/info-theory/inst/

I think of the functions you have presented, infogain.m is something
that is not in the toolbox. I suggest to you to please look through the
source files already in info-theory toolbox, and see if you can rework
the infogain.m. 

Also I would suggest to folks who like to see the info-theory toolbox
grow, to try and rebuild a set of functions starting from the ones in
Dr Kieffer's page http://www.ee.umn.edu/users/kieffer/programs.html . It
is quite disappointing that the code is not available anymore. If we 
work toward this objective it would be really nice to have a 'complete'
info-theory toolbox.

All, any suggestions welcome.
Regards,
Muthu Annamalai