basic question about collation strategies
kirby urner <[email protected]> Sun, 10 May 2015 10:29:06 -0700
| Newsgroups | gmane.comp.python.internationalization |
|---|---|
| Message-ID | <CAPJgG3QV=PcJFQsjufLcCfs-vREad0BiJr9n2vhqSuR6LNULfA@mail.gmail.com> |
--===============0697461899== Content-Type: multipart/alternative; boundary=001a1147efce2783680515bd99bf --001a1147efce2783680515bd99bf Content-Type: text/plain; charset=UTF-8 My nonprofit is only beginning to address non-Latin-1 characters in full names in corporate listings. My current plan is to allow a Full_name field in any script e.g. Devanagari, but then insist on at least single letters A-Z in Last and First name fields. Some examples: https://flic.kr/p/sqV14G (using religious types from Wikipedia for pseudo-records) Although I've worked in libraries which have alphabetization worked out across multiple languages (I could return Arabic titles to their proper place in my hey day), I am less sure of how Unicode handles collations across all language boundaries. It seemed easier to use the Roman alphabet to force a simple last, first collation, whereas Full_name is not used for collation at all and may be in any character set supported by Unicode. Given Roman letters have phonetic value, one looks for the Full_name based on how you'd sound it out in "Romanji" (the Nipponese name for Roman letter scripts, such as Python's keywords and Standard Library). Is there an industry standard I should know about and is my simplification of alpha searching an accepted strategy? Kirby --001a1147efce2783680515bd99bf Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><br><div>My nonprofit is only beginning to address</div><d= iv>non-Latin-1 characters in full names in=C2=A0</div><div>corporate listin= gs.=C2=A0 My current plan is to</div><div>allow a Full_name field in any sc= ript e.g.</div><div>Devanagari, but then insist on at least=C2=A0</div><div= >single letters A-Z in Last and First name</div><div>fields.=C2=A0 Some exa= mples:</div><div><br></div><div><a href=3D"https://flic.kr/p/sqV14G">https:= //flic.kr/p/sqV14G</a><br></div><div>(using religious types from Wikipedia= =C2=A0</div><div>for pseudo-records)</div><div><br></div><div>Although I= 9;ve worked in libraries which=C2=A0</div><div>have alphabetization worked = out across</div><div>multiple languages (I could return Arabic</div><div>ti= tles to their proper place in my hey day),=C2=A0</div><div>I am less sure o= f how Unicode handles=C2=A0</div><div>collations across all language bounda= ries. =C2=A0</div><div><br></div><div>It seemed easier to use the Roman alp= habet=C2=A0</div><div>to force a simple last, first collation, whereas=C2= =A0</div><div>Full_name is not used for collation at all and=C2=A0</div><di= v>may be in any character set supported by=C2=A0</div><div>Unicode.=C2=A0 G= iven Roman letters have phonetic</div><div>value, one looks for the Full_na= me based=C2=A0</div><div>on how you'd sound it out in "Romanji&quo= t; (the</div><div>Nipponese name for Roman letter scripts,</div><div>such a= s Python's keywords and Standard</div><div>Library).</div><div><br></di= v><div>Is there an industry standard I should know</div><div>about and is m= y simplification of alpha=C2=A0</div><div>searching an accepted strategy?</= div><div><br></div><div>Kirby</div><div><br></div><div><br></div></div> --001a1147efce2783680515bd99bf-- --===============0697461899== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ I18n-sig mailing list [email protected] https://mail.python.org/mailman/listinfo/i18n-sig --===============0697461899==--