UTF-8-problems; more tolerance for invalid charsets

Hi all,

thanks to some excellent help I finally managed to compile slrn for linux and Mac.

Now I feel that some utf problems where fixed, while others are even worse than before

- subject lines are cut at 8bit chars:

  Some subjects just got truncated at the first 8bit char (linux, S-Lang 1)

- text is cut at 8bit chars:

  Sometimes it's even the end of each text line which is cut (linux, S-Lang 1)

- non-ASCII is written as <XY> hex codes

  ... which is even worse since this may corrupt columns widths
  This may be somehow related to S-Lang? On the Mac I got
  S-Lang Library Version: 2.1.1 which causes

  1  [Ale Ölerss] Subject
  2  [B<FC>rbel Blu] Other thread

  On linux I got the old S-Lang Library Version: 1.4.9
  Which results in
  1  [Ale Ölerss] Subject
  2  [Bärbel Bl] Other thread

- other S-Lang fragments

  When closing one of the postings there may remain fragments of the text
  within the display of the headers (both Mac/S-Lang 2 and linux/S-Lang 1)


My wish: slrn would offer a choice for fallback solutions - especially to use utf-8 or latin-1/15/... whenever the text shows a mismatch to the (un-)declared charset. Some people would not like these fallback solutions (Greek? Russian? Asian?), while most of the 8-bit-countries should profit here.

BTW: what are the valid charsets? The current slrn.rc names charset isolatin, ibm850, ibm852, next, koi8, but no choices for mime_charset. UTF-8/16/32 is not mentionned here.

I just do the upgrade to S-Lang 2.1.1 {which now shows hex codes instead of truncated text}- but I feel that the problems are not just S-Lang, but parts of it are within slrn!?

There's a very good chance that some of my configuration is wrong - but concerning a slrn  v1.0 I'd wish there should not be that many things which a user can do wrong on his own.

BTW: the configure script did not check PREFIX for slang paths - I had to use --with-slang-library + --with-slang-includes. 

Thanks,
Martin
-- 
Psssst! Schon vom neuen GMX MultiMessenger gehört?
Der kanns mit allen: http://www.gmx.net/de/go/multimessenger

-------------------------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now >>  http://get.splunk.com/