Re: Dangerous locale patch to 1.1.3

Jason Rennie <[email protected]> Thu, 10 Oct 2002 09:56:49 -0400
Newsgroups gmane.mail.ifile.general
Message-ID <[email protected]>
[email protected] said:
> There has previously (before I started using ifile) been discussion
> about the  tokenization of non-ascii messages.  Currently, ifile uses
> the "C" locale for  tokenization, which means that tokens are
> basically ascii alpha characters.  But  they are that *consistently*. 

If I understand correctly, setlocale(LC_CTYPE, "") will look to the 
environment variable LC_CTYPE for the character encoding instead of the 
default, "C".  Is this right?  What happens if you don't have LC_CTYPE 
set?

[email protected] said:
> As you can see, this patch should not be taken lightly.  I am
> considering trying  it out for my own email (which contains quite a
> lot of 8bit-encoded characters  in non-spam email) using the locale
> "sv".  If the email uses a 7-bit encoding,  ifile reverts to its
> ordinary behavior [under the "sv" locale]. 

Let us know how it goes.  I think we should understand what's going to 
happen before applying the patch.

Jason D. M. Rennie
MIT AI Lab
[email protected]
(617) 253-5339
http://www.ai.mit.edu/~jrennie/