Re: Matching encoded strings and file names

At 7:24 pm +0000 23/12/05, John Delacour wrote:

>Others may have some magic solution but to me it seems you have to 
>convert the escaped original text to the utf-8 bytes it intends, 
>convert these to UTF-16BE and then produce one file with the 
>contents in precomposed form and another in decomposed form.  Which 
>of these you use will depend on the normalisation used in the file 
>system.

Here's another way, which is still probably overkill.  This script 
takes your 'R\xC3\xA9union', creates a file in the home directory 
named "Réunion-junk.txt" using the converted string in the decomposed 
form and then checks for matches.


#!/usr/bin/perl
no warnings 'utf8';
use Unicode::Normalize;
$dir = $ENV{HOME};
$ascii = 'R\xC3\xA9union';
$utf8 = pack "U0C*", unpack "C*", eval qq("$ascii");
$decomposed = pack "U0C*", unpack "C*", NFD($utf8);
$precomposed = pack "U0C*", unpack "C*", NFC($utf8);
open F, ">$dir/$decomposed-junk.txt" or die $!;
opendir DIR, $dir or die $!;
for (readdir DIR) {
   $_ = pack "U0C*", unpack "C*", $_;
   print "Found: $_$/" if /$decomposed/;
}


JD