Re: Re: [Wikipedia-l] Switching everything to UTF-8

Ralesk Ne'vennoyx <[email protected]> Tue, 18 Nov 2003 15:56:14 +0100
Newsgroups gmane.science.linguistics.wikipedia.international
Message-ID <[email protected]>
Sorry, Mav, for continuing it here, but there was a line of what you 
said that surprised me a little.

Daniel Mayer wrote:
 > So this is not a simple technical matter due to the fact that going with
 > UTF-8 on many of the Latin-dominated wikis will result in article damage.

How?

In the Latin-x Wikis all the nonlatin characters are HTML entities 
(&#xNNNN;, for one), and those wouldn't make a difference.

Most article titles are Latin-whatevertheeditionuses, with the very 
small amount of exceptions where the article is literally named 
something like Vlad_&scaron;omeorother -- those tricks need to be looked 
up and converted... though the best is a simple entity2uchar conversion, 
and in the database a Latin-xToUTF-8 convo for the titles (with 
attention to what latin-x it uses, if there are some non-1 editions).  I 
don't see the problem this could cause.

-- 
"Your job is being a professor and researcher: That's one hell of a good
excuse for some of the brain-damages of minix." (Torvalds to Tanenbaum)
--
Ralesk Ne'vennoyx
[ICQ:37046326]