Stripping out Unicode combining characters (diacritics)
[email protected] ("Doran, Michael D") Mon, 5 May 2008 19:26:57 -0500
| Newsgroups | perl.perl4lib,perl.i18n |
|---|---|
| Message-ID | <[email protected]> |
SSdtIHRyeWluZyB0byBzdHJpcCBvdXQgY29tYmluaW5nIGRpYWNyaXRpY3MgZnJvbSBzb21lIGZv cm0gaW5wdXQgdXNpbmcgdGhpcyBjb2RlOg0KDQo8aGVhZD4NCiAgICA8TUVUQSBodHRwLWVxdWl2 PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD1VVEYtOCI+DQo8L2hl YWQ+DQo8Ym9keT4NCiAgPGZvcm0gYWN0aW9uPSJ0ZXN0LmNnaSIgYWNjZXB0LWNoYXJzZXQ9IlVU Ri04IiBtZXRob2Q9ImdldCI+DQogICAgPGlucHV0IHR5cGU9InRleHQiIG5hbWU9InRleHQiIHZh bHVlPSIiIHNpemU9IjEwIj4NCiAgICA8aW5wdXQgdHlwZT0ic3VibWl0IiB2YWx1ZT0ic3VibWl0 Ij4NCiAgPC9mb3JtPg0KPC9ib2R5Pg0KPC9odG1sPg0KDQojIS91c3IvbG9jYWwvYmluL3BlcmwN CnVzZSBDR0k7DQokcXVlcnkgPSBDR0k6Om5ldygpOw0KJHNlYXJjaF90ZXJtID0gJHF1ZXJ5LT5w YXJhbSgndGV4dCcpOw0KJHNhbnNfZGlhY3JpdGljcyAgPSAkc2VhcmNoX3Rlcm07DQokc2Fuc19k aWFjcml0aWNzICA9fiBzL1xwe019Ki8vZzsNCiMkc2Fuc19kaWFjcml0aWNzICA9fiBzL28vL2c7 DQpwcmludCBxcShDb250ZW50LXR5cGU6IHRleHQvcGxhaW47IGNoYXJzZXQ9dXRmLTgNCg0KJHNh bnNfZGlhY3JpdGljcw0KKTsNCmV4aXQoMCk7DQoNCg0KSW4gdGhlIGZvcm0sIEknbSBpbnB1dHRp bmcgdGhlIHN0cmluZyAiQmFydG/MgWsiIHdpdGggdGhlIGFjY2VudGVkIGNoYXJhY3RlciBiZWlu ZyBhIGJhc2UgY2hhcmFjdGVyIChzbWFsbCBMYXRpbiBsZXR0ZXIgIm8iKSBmb2xsb3dlZCBieSBh IGNvbWJpbmluZyBhY3V0ZSBhY2NlbnQuICBIb3dldmVyLCB3aGVuIEkgcHJpbnQgKHRvIHRoZSB3 ZWIpICRzYW5zX2RpYWNyaXRpY3MsIEkgZ2V0IG15IGlucHV0IHdpdGggbm8gY2hhbmdlIC0tIHRo ZSBjb21iaW5pbmcgZGlhY3JpdGljIGlzIHN0aWxsIHRoZXJlLiAgSSBrbm93IHRoYXQgbXkgaW5w dXQgaXMgbm90IGEgcHJlY29tcG9zZWQgYWNjZW50ZWQgY2hhcmFjdGVyLCBiZWNhdXNlIEkgY2Fu IHN0cmlwIG91dCB0aGUgYmFzZSAibyIgYW5kIHRoZSBjb21iaW5pbmcgYWNjZW50IGVpdGhlciBz dGFuZHMgYWxvbmUgb3IganVtcHMgdG8gYW5vdGhlciBjaGFyYWN0ZXIgWzJdLg0KDQpUaGUgIlxw e019IiBpcyBhIFVuaWNvZGUgY2xhc3MgbmFtZSBmb3IgdGhlIGNoYXJhY3RlciBjbGFzcyBvZiBV bmljb2RlICdtYXJrcycsIGZvciBleGFtcGxlIGFjY2VudCBtYXJrcyBbMV0uICBJJ3ZlIHRyaWVk IHRoZXNlIHZhcmlhdGlvbnMgKGFuZCBtYW55IG90aGVycykgYW5kIG5vbmUgc2VlbSB0byBiZSBk b2luZyB3aGF0IEkgd2FudDoNCg0KICAgICAgICRzYW5zX2RpYWNyaXRpY3MgPX4gcyNbXHB7TWFy a31dKiMjZzsNCiAgICAgICAkc2Fuc19kaWFjcml0aWNzID1+IHRyI1tccHtJbkNvbWJpbmluZ0Rp YWNyaXRpY2FsTWFya3N9XSMjOw0KICAgICAgICRzYW5zX2RpYWNyaXRpY3MgPX4gdHIjW1xwe019 XSMjOw0KICAgICAgICRzYW5zX2RpYWNyaXRpY3MgPX4gcy9ccHtNfSovL2c7DQogICAgICAgJHNh bnNfZGlhY3JpdGljcyA9fiBzI1tccHtNfV0jI2c7DQogICAgICAgJHNhbnNfZGlhY3JpdGljcyA9 fiBzI1x4ezAzMDF9IyNnOw0KICAgICAgICRzYW5zX2RpYWNyaXRpY3MgPX4gcyNceHswMDZGfVx4 ezAzMDF9IyNnOw0KICAgICAgICRzYW5zX2RpYWNyaXRpY3MgPX4gcyNbXHh7MDMwMH0tXHh7MDM2 Rn1dKiMjZzsNCg0KSSdtIHB1bGxpbmcgbXkgaGFpciBvdXQgb24gdGhpcy4uLiBzbyBhbnkgaGVs cCB3b3VsZCBiZSBhcHByZWNpYXRlZC4gIElmIHRoZXJlJ3MgYW55IG90aGVyIGluZm8gSSBjYW4g cHJvdmlkZSwgbGV0IG1lIGtub3cuDQoNCk15IFBlcmwgdmVyc2lvbiBpcyA1LjguOCBhbmQgdGhl IHNjcmlwdCBpcyBydW5uaW5nIG9uIGEgc2VydmVyIHJ1bm5pbmcgU29sYXJpcyA5Lg0KDQotLSBN aWNoYWVsDQoNClsxXSBwZXIgaHR0cDovL3Blcmxkb2MucGVybC5vcmcvcGVybHJldHV0Lmh0bWwg YW5kIG90aGVyIGRvY3VtZW50YXRpb24NCg0KWzJdIHVzaW5nICRzYW5zX2RpYWNyaXRpY3MgID1+ IHMvby8vZzsNCg0KIyBNaWNoYWVsIERvcmFuLCBTeXN0ZW1zIExpYnJhcmlhbg0KIyBVbml2ZXJz aXR5IG9mIFRleGFzIGF0IEFybGluZ3Rvbg0KIyA4MTctMjcyLTUzMjYgb2ZmaWNlDQojIDgxNy02 ODgtMTkyNiBtb2JpbGUNCiMgZG9yYW5AdXRhLmVkdQ0KIyBodHRwOi8vcm9ja3kudXRhLmVkdS9k b3Jhbi8NCg==