Re: UTF-8 (strict) appears borken

[email protected] (Chris Hall) Sat, 15 Mar 2008 11:56:02 +0000
Newsgroups perl.unicode
Message-ID <[email protected]>
I have prepared a bug report, as below.

I don't want to waste everybody's time if this is thought to be a 
feature...

...so if anyone thinks this is not a bug, please shout (soon).

Thanks,

Chris

-----------------------------------------------------------------
[Please enter your report here]


Encode::encode('UTF-8', $foo) and Encode::decode('UTF-8', $bar) detect 
the
Unicode 'non-character' U+FFFF and treat it as an error.

There are 65 other Unicode non-characters:

   U+FFFE
   U+01FFFE, U+02FFFE, U+03FFFE, ... U+10FFFE
   U+01FFFF, U+02FFFF, U+03FFFF, ... U+10FFFF
   U+FDD0..U+FDEF

which one would expect to be treated the same as U+FFFF.

They aren't.  They are accepted as normal characters.

This appears to be a bug.


[Please do not change anything below this line]
-----------------------------------------------------------------



-- 
Chris Hall               highwayman.com
signature.asc (application/pgp-signature, 470 B)
-----BEGIN PGP SIGNATURE-----
Version: PGP SDK 3.8.3

iQEVAwUAR9u5UOg9H9B04S2cAQIoMwf/R9ckm/fxJ0hM+yc1BBloMaGPw2g50FFf
MB2zbOOyhYLtyGRZBkf3AxbQ9o2MmuPHbfEVPhOlHfD9BCbwzXGT8rG+F7RssbJW
ENgP44Evz/585bBJpX0B0W8mTP12xiD6r+SOvwJ2OlcOdvFxwK0DRJb6F5kaZnkh
koX9q4XTjXD1/xj66ee/d5oc3noWS/2+c8b/cMeBjRQmpvEUehzhhLgX4K+jDjp2
eE9lgdYcX73//wE3C4nDTwyyegFU2U8TzijmYTj5rybSPx684UiLJISLRz5gMnyH
N3oA7IqOkbSiOaYmViKfha1I/xTozVvhoLmWUf9lYJJzzP/JB9BjAw==
=UUX1
-----END PGP SIGNATURE-----