Re: non-western character sets and object ids

Jean Jordaan <[email protected]>
Newsgroups gmane.comp.web.zope.plone.devel
Message-ID <CAJqnznAGsvKy-RRQ6=z097VjXk_ojPD=iAPMqQOwTCwdcicTgA@mail.gmail.com>
On Thu, Mar 13, 2014 at 6:59 PM, Kees Hink <[email protected]> wrote:
> I've learned this week
> that most German people (are trained to) expect 'ü' to show up as 'ue'
> in a url.

Dating from the days of typewriters :)

Some languages, like Chinese (pinyin), have official romanizations
which could be usable in a normalizer.
  https://pypi.python.org/pypi/pinyin

Fallback:
  https://pypi.python.org/pypi/Unidecode

>>> I noticed that Wikipedia has readable URLs even for languages with
>>> non-western character sets (like Thai, [1]).

Readable in some contexts (location bar), in others pretty ugly:

http://th.wikipedia.org/wiki/%E0%B8%A7%E0%B8%B4%E0%B8%81%E0%B8%B4%E0%B8%9E%E0%B8%B5%E0%B9%80%E0%B8%94%E0%B8%B5%E0%B8%A2:%E0%B8%96%E0%B8%B2%E0%B8%A1%E0%B8%84%E0%B8%B3%E0%B8%96%E0%B8%B2%E0%B8%A1

-- 
jean                                              . .. .... //\\\oo///\\

------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/13534_NeoTech
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.