Re: Invalid UTF-8 for Arabic
"Yoann Roman" <[email protected]> Tue, 10 Mar 2009 09:20:58 -0400
| Newsgroups | gmane.comp.internationalization.fribidi |
|---|---|
| Message-ID | <[email protected]> |
>> Behdad, Thanks for the response. > > No problam at all, but please note that I'm behNaM, behDaD's brother. Sorry for the name mishap. I was looking at Behdad's message while replying to yours. >> Your output is what I get from fribidi 0.10.9, but that doesn't do >> Arabic joining. Other than that BOM mark, the Windows output from >> 0.19.1 is correct and matches what other non-Fribidi-based, bidi >> programs do. > > I didn't notice you have get the shaping on the string too. So the > windows output is correct, except the BOM mark. > > Seems the BOM mark appears in the place of the first character of the > LAM+ALEF ligature. This might be a but in the ligature replacement of > the shaping function. > > Yep, it's in the CVS HEAD, lib/fribidi-arabic.c > fribidi_shape_arabic_ligature(), which replaces the first char of > ligature with FRIBIDI_CHAR_FILL, which is ZWNBSP/BOM. > > Behdad, why don't you use U+FFFF for this purpose? and why > fribidi_shape_arabic() or fribidi_shape_arabic_ligature() doesn't > clean this CHAR_FILLs? > > Behdad, I can fix the problem in CVS if you tell me what's the best > way to fix this. Glad to know it's not a problem just on my end. Thanks for the research. -- Yoann Roman