Re: charset question (Greek)

Richard Braakman <[email protected]>
Newsgroups gmane.comp.mobile.kannel.devel
Message-ID <[email protected]>
On Wed, Mar 13, 2002 at 03:14:33PM +0100, Andreas Fink wrote:
> well in theory this should be the case and it probably is for non 
> european languages but for historical reasons there are some 
> duplications.
> 
> examples:     		ä (German umlaut "a")
> 
> iso8859-1:	E4
> unicode:	00E4   or 0061 + 0308 (a + ¨)

Unicode defines normalizations for this.  You can convert Unicode strings
to "canonical forms" for comparisons.  There are several levels of canonical
forms, for example there's one that ignores case distinctions.  Unfortunately
doing this correctly requires the use of large tables, so we might be better
off linking to a unicode-support library.  There are a few out there.
libunicode, for example :-)

Richard Braakman
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.