Information-Theory functions.

Muthiah Annamalai <[email protected]> Thu, 28 Sep 2006 18:55:11 -0500
Newsgroups gmane.comp.gnu.octave.sources
Message-ID <1159487712.3646.25.camel@localhost>
--=-VyoAi2c9Yoz6cE0qypyv
Content-Type: text/plain
Content-Transfer-Encoding: 7bit

Hi there,
I have my first cut functions on basic functions in
Information Theory; the package is a nice candidate
for inclusion into Octave-forge. If Paul or David
can approve it, I can gohead and fix it according
to Octave-forge specifications.

Functions present:
./info-theory/
./info-theory/mutualinformation.m
./info-theory/marginalr.m
./info-theory/relativeentropy.m
./info-theory/laverage.m
./info-theory/marginalc.m
./info-theory/jointentropy.m
./info-theory/bscchannel.m
./info-theory/conditionalentropy_YX.m
./info-theory/entropy.m
./info-theory/conditionalentropy_XY.m

Test case
./info-theory/test-info-theory.m

Extra original unoptimized code bundle.
./info-theory/info-theory.m

I also have a set of source coding techniques implemented in 
Octave, and will be posting it soon.

Thanks,
Muthiah Annamalai


--=-VyoAi2c9Yoz6cE0qypyv
Content-Disposition: attachment; filename=info-theory.tar.gz
Content-Type: application/x-compressed-tar; name=info-theory.tar.gz
Content-Transfer-Encoding: base64

H4sIADBgHEUAA+0ca3PbNjJfq1+xdUYT0qElktajZ5edc3JJ47vE8dhOK03b8VAUbDGhSJmkbKmv
3367IMCXXmniKH0QHtHkElgAu8C+ALDRdP2rYC8esSCcNx98kqRj6rbb9N/otvX8f5keGHpb7+rt
btc0H+iG2W4bD6D9aZpTTNMotkOAB+NpPJquybfp/V80NQr8x05ObY8g4diO3cBvjO+hDmJwp9Va
xf99s2tI/ndapoH877R18wHo91D3xvQP5//Dh6A8VcHU9bYG/2EOGw9YqMEr7K1rj+DI9+2x7dmu
Bl+PE1jDlrB/T2O7wYbTb2qIhX4XIzeCSRhch/YY8PYqZAyi4Cq+s0N2CPNgCo7tQ8iGbhSH7mAa
M3BjsP1hMwhhHAzdqznhQdjUH7IQcFhCzMJxBMEVf/j25A18y3wW2h6cTgee68BL12F+xMDGqgkS
jdgQBhwPlXhObTgXbYDnASLmI/sQmIvvQ7hlYYTPYMo6BEINgpCQKHZMLQ8hmFA5FZs7B8+Os6IN
zLas+1kvh+D6HPcomGCPRogS+3jneh4MGEwjdjX1NEKBmeH744sXr99cwNFJH74/Ojs7OrnoH2Lm
eBTgW3bLElTueOK5iBn7Fdp+PMfmE4ZXz86evsAiR0+OXx5f9LET8Pz44uTZ+Tk8f30GR3B6dHZx
/PTNy6MzOH1zdvr6/FkD4JxRsxghWEPiK84lJOOQxbbrRbLjfWRshK3zhjCybxky2GHuLbbNBieY
zDczj5DYXuBf825i5oyQh+BegR/EGtyFLo6XOFhkKxXPOKvBse80NGj/Cy4YEonBqWc7yM/zKSHY
39c1eBJEMeV8dQSgm4Zh7Bn7ehfgzfmR6NM0sq/ZASxIRKXXV7FX4wmyNeJNodxJNsjlk52+dolh
zghnDfMgRlZFLn+P2UJ3RiSEJ3Ok6JXrJy/uWELFY6WnYV0JAjuijAg6QJAF529eKXCqzLS5Cl5w
bYICk+SpSTfqRMFb+rOQGThYEccl8+MQuaGcJnh//RUR9FTtVOmrKh85SR+Osz5oNIrtMVI2pu64
+TeBz+DWDl174HH6j+xIA3tAQ5S6HdDcasBxTCgIgJN+6kjCTH2HhTiEsMfzRjp1qDKI5uMxQ8o4
cIW5uA6qUY4I+W17UXAAoh8acsEfcpLZnoAR72QxbJ1nLWVfDfiYssNrnJVfg0Gk+N2NEoaIDAAs
DINQefRm3Ti4w04y6PVlJxfY+0g9RGTMH9bwHzVIb+gE6VljXr3tOYSIQP0UFCYghDmBF1mR+zMj
iGLwfGFwl4OZSUaama5lHNBL3nrs4nB2GfrXCCQshwIaf4eN6PUVVxPv1UZT6SnyYRffqKrM/BCl
NU495K0/xGmEvedjlEUaiqxQTnmUYJOQTXAeDkU5/+dLRGgpVBl8A3qKkCiAv8cQTccKb0WSVW3s
0ijmBRQBks0g4slryOJp6Nfo4XMrzr9JKtl/cgTei90n0wb7z+jut1P7n2xB3Wh1Db2y/7aRKvuv
sv8q+2+N/ZfXyQQXKbUAZQagBg/sgetxDSm6Q/pYUmmNmVCycFLbgEqWDJpCe4RKTbRpYmv8QR1Z
lP/SVhTm1D1pgQ3y30S5L+W/abQ65P8bncr/30qq5H8l/yv5v1r+lySiMtFulrj/Mpf0TZGr8R0T
jDK5Cw+T4dWjlGJDZUJeJ+Ky6PF/U88b2M67vZfMxfnHR46NPnKKx8xplzkfKengwh5H3FEvN6IB
J+i72QhHeo+ZHU0TSuFEceOIaJo5243ElcUBLb28OXAesAixIe1Z0k304fmURS78zMIg+gjXfBll
S565STTiru5E/T3xeW9U4a3fMidG/3xSer4pOO/rmIiDkt1QwANbeB2PUk8dQLjqvIOKoY3tmSIa
kfikk8vB/PLGmjSaN9mjkvwDyyIKqhZ38/3AJyyJNywyoD8MHM0t+bpZBtWCSeFZ+MQCff5NEge4
F1+4qP89nL0hkuxe3b9N6z9m2zRT/6/V2Sf/r23uV/p/G0no/6PptUZGQKfS/JXm/8dq/pzet2+v
B6QlLZAyUXGCIRsEwTuNVDGOthjFMPlnWOhpYhDw9onscBeEQ6FbeLiewrMn6ku3cepSkSR0LHGK
2HccTh0eaqfh41+jXk+yMdsZcU3LwUhloZgTC4SQUG0NOBUtk44mlckZDqRypowzj79iM5uodAAz
65cdfUfbQXIkV33nt0OYWD/oDQP0Rht/rZ+otxk1Zhqq3odjFJ/cvOF89IlesN9AQaJnyv4l0tJa
Q8UkNlzQ+zXpZuf1+DpOPJIh5iROjInXKqLtIALkcYg8SFiS4lBlXbwAXR6XcvyC5X5Td2VdCj4u
1PaXDUwX9T/atPFeDnA/dsAm/7/V7qT6f9/Uuf/fruK/W0m1eq2OwjJCUUJTJLf4h0qNhgAK6kFo
41DAnDWUCGi96o1um08AlA5mW1xRPNRqbwPXj1MrW63NcstcE5w08tVMrc1zoaz8q7mKeJImATZi
cVGyVuv1sRlG8yv8GR287Jv8IuakAH5VfiHg+Yt80cKu8LJ6cqG+LF85rKXtLKzfqbAHS3yey16f
lyqXCdeV6fd4mQIpk6ozqpxJV++ZcK56JKqJFab4GdiHPgHNHJBkeK3sDNFi8AKwr/WoxlyVT7OW
ZrVugxF1mJWinnWYF5dPazXHsFaS/7DmmMveJoQ+rL21yrQ+rCH6mbWc1fzlfOFlKF6+laoLHsIL
viTPkcFjcMwCaE4gIwPlif1fatB2ybxkvG3gfv69gKVr9jUSJieWeWDqvE5SnlbgM/KnT9RdxWie
CB2akZnyCOAEzZz4StmRaNEiql+TUVO//tHf4WpfMVRtxuXGEFvC8f9gNE0Ne4e/r+j3U42vuNfk
4rjQ67yeWn45muNzVeFvJw9qgrnQuL+Ybn+fVNT/9676eVrv/xt6J4v/d/f30U4w2ka3U+n/baSH
X0JzGoXNges3AycmH27vhk9tnPIOm8Soeods1uB2wjMZ3kOPm80mDPPzDTrwLHvgnoyIIiVYyoJD
Q3BBwBGgrNGo7KLub9RKy2G+MwqCiL1TfC0Ulvyt5QvJSBmMvP1v6QfhnpE6F3L+7yr+nps36ZM7
nPLDUnnjIMxK8/d02XUXygrMTXp9uOAiFPuQSh3qQF3QEl3o78hZaw4YOtZuMA0bSXCUSzpLT+WX
cHAEdumSCLyGniBuJvemlJdrlxRlV+UeI1kVCkUr3bdzoKY7m9Z0rail3wv1geauQl3ELSSzp0Tz
saQe0ofQSAh8aYFg99CNJrBzmvOFpZ9McXDbBwpGjAcea4a2PwzG6d62nXx5CndwlzcZdhSSmOK/
H3dEY37cAdePYmYPk8gHRcJEmzUZHPd28uMBZNBZRp2lwpF9yEK9sITA5dzFXWYlxZfLlA3RPQFN
9V/2nLKB11tfsbEOmaZxG7KeouXV1xOAaHvC3aSGXr/Za+zSrkORp9zQXootbSYayzTuVIkBb/m+
NbFjDZtaT6dgPT/f6kuGzoKtU2w5fzpP99gdpgEK5RytDssy0phBngUpHuZFTGYIgzvrnM87AXAC
zzoXO/mKgiW4q33Bn94mW/bwKWMSn3Nvc73HB8TxRRaByAUjlkUlSKK/UHrN/O7RPlKPw1zaKSpj
TRIisu2dKr13BMCqFXmP+VMGrUoSnyyDCOlWw9smrxsx9PpiA0QyqyiEqEE/t3eC8ohHJMl07HOI
Kxv39PVLF5uOsH4KO3v9vUvNK7J8tXO2dMbk9ldyUnL0ZeHHSyKcro8xy242FHimZr7AKplGbMH5
kGNLj7MFYcSWjCsJIONK/x0BEq4k9wlXPjdZhf+6nqxiCvVyZE0Ff5GsvQJZKVMzX2AFWUmw5NZY
qSt/dI21/qFLrPXlK6zvtfpZdlUKGhImeJWrgiQAb5SVupKPg0+3XXyZcfbeu8XrH7NZnMerxG7x
VcRdtet7mxuwc5Jc7shOdz8vk+akzd5m2iyT45kC5mYysXjFLjJepw1PsAvhHM4lccgKF8cP+BoL
j6kXxjpMGvmJzREjSmsQiXMLyUBM4T+AsTeBySFM6Oanw7JMq/05o4pVWLEKK0IVVqzCilVYMU3L
z384Wz7/0cqd/+jS/p9OFf/bTqr2/1a7gKpdQJvPfzgfdv5DeNcffgQkXDzSWoqpZgdAPmRbaFH+
57X1/amATfs/2q10/+e+2WrT+k+rW53/2Eqq5H8l/yv5v1r+l/2XxbMfPEd68OOjv/rwYvGrDy9y
YbyZQtf5imhe8id68GHHMpavjbzH9xKg/MmEBdK959cSoLyQ+rkXZaQ/VwrvZ9nXrrx8bgm/PhX1
/yByxJi9Twdwo//XSb//pHfaXP/r+5X+30qq9H+l/yv9v1r/ZxKRjhrSiw9agqEzIpvXYMRpkgXF
XVDSH7k6U5r/Rfm/NJz90apgk/9nttL4H/8WAL6lz8BU8n8LqZL/lfyv5P9q+b9y+W/REbzXfTxi
Rm3eyUOZSlt5CLSwl4fYVN7MU/b9/qS7eT63jPw7p6L+v/fQL0+bzv93O93U/zNbdP6v1ar8v+2k
TP93UBrac9g3Ku1faf9K+3Ptn9tePwi8y8xfY5H2y8CO2G9cUxdMgYicssDPR4RtGgwOajSaD9PQ
YWgMBEm/S4uGoQwd44i5ckNU+XZ4PR3zb/DgRBGj0Pa8OZ9y1AQ+qXAcRRPmuFc4JhrwhMBYLxoV
NpJtNKZAsz316HsBAZia+P5AMpJkOwUaGmfXI76D06ZvEohdrfRMH0Sgoj5jQ2Qvoko/RMCnxZhF
/Jy+YHjS1dSrTT82IIlKu8j43rLc5SdVfEXAzK21wvoiWksWMhYsmtL5CI0ItvD932L4emcT7+eX
yccfMrZLEiI6qmDP3EkMGS9iSz9rQJksM7N1UtsK7x8yzx27PkqY5AtLKEaDMczo9M/MkmczxH/x
bV2BYY8sqeSgD308aCZP/fA+r4oCbPT/e/1P7v/TN/+l/99pdxP/v1Xp/22kyv+vLIDKArgn//8+
j1fl1d/StPl81TbiBx++0PwnPZH1uQVylapUpSpVqUpVqlKVqlSlKlWpSp8g/R84EIQkAHgAAA==


--=-VyoAi2c9Yoz6cE0qypyv
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Octave-sources mailing list
[email protected]
https://www.cae.wisc.edu/mailman/listinfo/octave-sources

--=-VyoAi2c9Yoz6cE0qypyv--