[Fwd]: Aspell and Unicode

"Mahesh T. Pai" <[email protected]> Sat, 14 Feb 2004 19:49:03 +0530
Newsgroups gmane.org.region.india.gnu-malayalam
Message-ID <20040214141903.GA899@localhost>
----- Forwarded message from Kevin Atkinson <kevina-mXXj517/[email protected]> -----

 > Date: Sat, 14 Feb 2004 05:16:43 -0500 (EST)
 > From: Kevin Atkinson <kevina-mXXj517/[email protected]>
 > Subject: Aspell and Unicode
 > To: [email protected]
 > Cc: gnu-malayalam-discuss-sT238yk/[email protected]
 > 
 > 
 > Lets try this again.....
 > 
 > The Aspell LIBRARY supports Unicode fairly well.  All one has to do is set 
 > the encoding and everything is converted on the fly.
 > 
 > The Aspell UTILITY doesn't really support Unicode at this time.  Although
 > if you set the encoding to UTF-8 the 'PIPE' mode will probably work and
 > the 'CHECK' mode will sort of work.  The issue with the 'check' mode is
 > using Unicode with the curses library correctly.
 > 
 > The REST of the Aspell utility does not support Unicode.  The encoding 
 > used is whatever the dictionary is encoded in.
 > 
 > INTERNALLY the core Aspell library (everything in modules/speller/default) 
 > is 8-bit and is very likely to stay that way.
 > 
 > However, that DOESN'T mean that the end user has to know this.  
 > Everything read in by Aspell and everything printed out can be in UTF-8 or
 > some other encoding.  The only person that REALLY has to be aware of the
 > 8-bit issue is the dictionary maintainers as they must chose an 8-bit
 > character set for Aspell to use.  Even the word list can be in Unicode as
 > Aspell can convert it when creating the dictionary.
 > 
 > But, Aspell is not there yet.  There are several issues in supporting 
 > Unicode.  The main issue is converting everything read in and printed out 
 > from the internal 8-bit encoding to Unicode.  But an other issue is 
 > knowing what encoding the various data files are in.  There is no 
 > reason they can't be in Unicode but Aspell has to know to convert it.  
 > Thus they need to be tagged in someway.  By data files I mean any human 
 > readable files that Aspell uses.
 > 
 > Ideally the Aspell utility use the LC_CTYPE for the encoding, however 
 > using LC_CTYPE to figure out how the data files are encoded will lead to 
 > nothing but trouble.
 > 
 > So, I HOPE to get all this done by Aspell 0.51 but I don't know if I will.  
 > If someone would like to assist me in this task I would really appreciate 
 > it.
 > 
 > I hope this makes everything clear, as I was not very clear before.  If 
 > you still have questions fell free to ask.
 > 
 > PS: Please fell free to forward this to others.
 > 
 > --- 
 > http://kevin.atkinson.dhs.org
 > 

----- End forwarded message -----

-- 
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~+
                                          
  Mahesh T. Pai, LL.M.,                   
  'NANDINI', S. R. M. Road,               
  Ernakulam, Cochin-682018,               
  Kerala, India.                          
                                          
  http://paivakil.port5.com         
                                          
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~+