Re: Wide character support enabling

Leon Bottou <[email protected]> Sat, 18 Feb 2006 11:49:24 -0500
Newsgroups gmane.lisp.lush.devel
Message-ID <[email protected]>
On Friday 17 February 2006 09:06 pm, Raymond Martin wrote:
> So a nice bunch of glue code is needed for portable string implementation.
Yes.

Another option is to use the facilities of the c library
without reference to unicode. Basically it means that
you get as good i18n support as the os offers.
By default one writes text files using the locale encoding, whatever it is.
For portability reasons, one might also want to write text files in UTF8,
but this problem is slowly disappearing because everybody 
is slowly transitionning to UTF-8 locales anyway.

So I believe that we only would have to write a small string
library that does the basic string operations using
the wide character interface from the c library.
There are some little performance issues (counting character positions)
that might benefit from a reasonable caching scheme.

> One implementation is ICU (http://icu.sf.net), by IBM...

Too big to my taste.

- L.




-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=103432&bid=230486&dat=121642