Re: PLIP suggestion : accents normalization in plone lexicon

Yiorgis Gozadinos <[email protected]> Mon, 6 Jun 2011 15:46:40 +0200
Newsgroups gmane.comp.web.zope.plone.devel,gmane.comp.web.zope.plone.internationalization
Message-ID <[email protected]>
On Jun 6, 2011, at 3:08 PM, thomas desvenain wrote:

> Hi,
> 
> Most users want the search to ignore accents
> 
> where "économétrie"
> finds "econometrie", "Econométrie", "Économétrie".
> 
> What do you think about a PLIP to give Plone lexicon a casenormalizer
> that would use plone.i18n stuff to normalize ZCTextIndex lexical
> values ?
> 
> (as lucene latin normalizer does)
> 
> that would be the occasion to fix a bug, that "économétrie" does'nt
> find "Économétrie" (plone.i18n stuff manages that, plone lexicon, not)
> 
> (I can write the PLIP and implement it... but i know it is a major issue)
> 
> Thanks
> 
> Thomas


I had used this approach for Greek as it was the only sane thing to do. I was going a bit further latinizing the alphabet which worked wonders as it took care of (common) spelling mistakes and the madness that is declining in Greek. Have a look at http://svn.plone.org/svn/collective/qi.GRSplitter/trunk/qi/GRSplitter/GRSplitter.py it's ancient but should work ;)

-- 
Yiorgis Gozadinos
www.jarn.com/ggozad


------------------------------------------------------------------------------
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Discover what all the cheering's about.
Get your free trial download today. 
http://p.sf.net/sfu/quest-dev2dev2