Re: Switching everything to UTF-8
Tomasz Wegrzanowski <[email protected]> Tue, 18 Nov 2003 00:57:02 +0100
| Newsgroups | gmane.science.linguistics.wikipedia.misc,gmane.science.linguistics.wikipedia.technical,gmane.science.linguistics.wikipedia.international |
|---|---|
| Message-ID | <20031117235702.GA2116@tavaiah> |
On Mon, Nov 17, 2003 at 03:28:46PM -0800, Brion Vibber wrote: > On Nov 17, 2003, at 15:02, Tomasz Wegrzanowski wrote: > >Staying so long with ISO 8859 was a mistake. > > > >So I propose converting all Wikipedias that aren't using UTF-8 yet to > >UTF-8. > >Procedure should be like that: > [...] > > How about we do the conversion when installing the new big database > server? (Tentatively next week if they actually ship the machine on > time.) > > We'll have to go down to read-only mode while copying stuff over > anyway, so this consolidates downtime. The conversion itself can be > done by simply piping the database dump through iconv as it's being > copied into the new db. > > Easy as pie! It would be better if numeric entities were converted too. The code is somewhere in Phase1->Phase2 conversion script, and in konwert program too.