Re: charset question (Tajikistan iw-links)

Pablo Saratxaga <pablo-7Aj/b8uzpy6AmYF/[email protected]> Sun, 22 Feb 2004 13:54:49 +0100
Newsgroups gmane.science.linguistics.wikipedia.international
Message-ID <[email protected]>
--===============82289550144580925==
Content-Type: multipart/signed; micalg=pgp-sha1;
	protocol="application/pgp-signature"; boundary="6J7GEvtanOfV9oXA"
Content-Disposition: inline


--6J7GEvtanOfV9oXA
Content-Type: text/plain; charset=iso-8859-15
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Kaixo!

On Sun, Feb 22, 2004 at 01:17:00PM +0100, Roman Maurer wrote:
> Andre Engels pravi:
>=20
> >Looking at the source of the page, I see [[et:Tad=B8ikistan]] with the =
=B8
> >explicitly in the page code, and [[sl:Tad%C5%BEikistan]]. To me that is
> >not "the same".
>=20
> This is my work-around, of course.  Now I reverted this back to=20
> [[sl:Tad=B8ikistan]] and it does not work anymore, as you can clearly see=
:=20
>  http://en.wikipedia.org/wiki/Tajikistan

I tested it...

And the bug is in the en: site, I'm positive about it.

The bug is that, despite the fact the pages announce they are
in "iso-8859-1", the conversion routines use "cp1252"!

So:
* either correct the charset that is announced to correctly announe
  "charset=3Dwindows-1252"
* either switch en: to utf-8, whihc will salve a lot of problems, and
  will make a lot of text lisible (non-latin strings are horrendous
  and incomprehensible with all those #2136;#5464;#4564;

Now, why it works in et: and not in sl: ?
Probably et: is configured to interpret non-utf-8 chars as being in
cp1252 (which makes sense, as it is enough for estonian), while
sl: interpret non-utf-8 chars as being in iso-8859-2

Note that while it makes sense to be large in interpretating
non-utf-8 used *in the URL*, it is completly wrong to interpret anything
*in the data itself* in anything else than the charset declared.

--=20
Ki =E7a vos v=E5ye b=E9n,
Pablo Saratxaga

http://chanae.walon.org/pablo/		PGP Key available, key ID: 0xD9B85466
[you can write me in Walloon, Spanish, French, English, Catalan or Esperant=
o]
[min povas skribi en valona, esperanta, angla aux latinidaj lingvoj]

--6J7GEvtanOfV9oXA
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.3 (GNU/Linux)

iD8DBQFAOKaZpSX1mtm4VGYRArPpAJ9aLpfqBf8aj43tCK/85ZRmRzIIygCdFXeX
uXgEG0PjxAcCeGWXkkYaS04=
=3jxc
-----END PGP SIGNATURE-----

--6J7GEvtanOfV9oXA--

--===============82289550144580925==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Intlwiki-l mailing list
[email protected]
http://mail.wikipedia.org/mailman/listinfo/intlwiki-l
--===============82289550144580925==--