Re: Variation In Decoding Between Encode and XML::LibXML
[email protected] ("David E. Wheeler") Fri, 18 Jun 2010 13:41:01 -0700
| Newsgroups | perl.unicode |
|---|---|
| Message-ID | <[email protected]> |
On Jun 18, 2010, at 12:05 AM, John Delacour wrote:
> In this case all talk of iso-8859-1 and cp1252 is a red herring. I read several Italian websites where this same problem is manifest in external material such as ads. The news page proper is encoded properly and declared as utf-8 but I imagine the web designers have reckoned that the stuff they receive from the advertisers is most likely to be received as windows-1252 and convert accordingly rather than bother to verify the encoding. As a result material that is received as utf-8 will undergo a superfluous encoding.
>
> Here's a way to get the file in question properly encoded:
Yep, that works for me, too. I guess XML::LibXML isn't using Encode in the same way to decode content, as it returns the string with the characters as \x{c4}\x{8d}.
Thanks for the help, everyone. I've got my code parsing all my feeds and emitting a valid UTF-8 feed of its own now.
Best,
David