character encoding wrong for some pages

Matthew Pocock <[email protected]>
Newsgroups gmane.org.wikimedia.wiktionary
Message-ID <CAHQS_ewCN_W=DVuKJCdPYWo026ZrKt3DCMeyOEN4d-i1ncXO3w@mail.gmail.com>
Hi,

I've been pulling down pages from wiktionary in a Java application. The
majority of pages seem to work fine (e.g. http://en.wiktionary.org//wiki/-a).
I can load them in Java, and if I wget them, I end up with a file containing
what I'd expect.

However, some pages seem not to work (e.g.
http://en.wiktionary.org/wiki/absolute_instrument). In Java, I get a codec
exception and when using wget, the resulting downloaded file is garbled. I
think this is because although they claim to be UTF-8 encoded, they are not.
These pages show up fine in my browser, but it isn't telling me what charset
it uses to decode the text.

Is this a known issue? Is there any workaround for this? Can it be fixed
server-side?

Thanks,

Matthew

-- 
Dr Matthew Pocock
Visitor, School of Computing Science, Newcastle University
mailto: [email protected]
gchat: [email protected]
msn: matthew_pocock-/[email protected]
irc.freenode.net: drdozer
tel: (0191) 2566550
mob: +447535664143
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.