Re: List of unsupported unicode characters?

On Wed, 10 Jan 2007, Paul Bijnens wrote:
> On 2007-01-10 08:10, John Costello wrote:
> > Is there a list of utf8 characters that perl cannot map, for example 
> > "\xA0"?  This is with Perl 5.8.3.
> 
> AFAIK there is no problem with "\xA0" if you mean the "\xA0" in
> latin1 (iso8819-1) or similar encodings.  That is just the "no-break
> space".

Yes, that is the character I mean, though it is ISO-8859 (I seem to recall 
that one is a subset of the other).

> What exactly is your problem with that character?

perl 5.8.3 complains 

	utf8 "\xA0" does not map to Unicode

when the file is read.  I'm specifying open(INFILE, 
"<:encoding($this->{'encoding'})", $this->{filename}), where 
$this->{'encoding'} is set to utf8 (confirmed that).
 
The file originally was generated by perl 5.6.1 with utf encoding
specified via binmode.  The file then was tarred, gzipped, scp'd, and
ungzipped and untarred and fed to perl 5.8.3.

Thanks to Darren for the pointer to perldelta and the Unicode versions.  I 
see that Unicode 4.0.0 does support \xA0, as well as the 110 other 
characters that perl 5.8.3 complains about.

If I drop the encoding statement and change the open command to
	open(INFILE, "<$this->{'filename'}"

the errors disappear.

...

This leads me to think that perl 5.6.1 isn't encoding the output into 
utf8, but that's a bit of a wild guess.