MARC::Record and importing broken UTF8

Nice,

But what is the best way to deal with all those broken UTF8 encodings we encounter over and over again when importing MARC records from outer space?

As it is now the application dies with something like
'utf8 "\xXX" does not map to Unicode at C:/Perl/lib/Encode.pm line 166.'

The problem seems to lie in MARC::File::Encode

sub marc_to_utf8 {
    # if there is invalid utf8 date then this will through an exception
    # let's just hope it's valid :-)
    return decode( 'UTF-8', $_[0], 1 );
}

Is it possible to introduce a "sloppy mode" switch?

Leif

======================================
Leif Andersson, Systems Librarian
Stockholm University Library
SE-106 91 Stockholm
SWEDEN
Phone : +46 8 162769
Mobile: +46 70 6904281

-----Ursprungligt meddelande-----
Från: Mike Rylander [mailto:[email protected]] 
Skickat: den 26 januari 2007 02:35
Till: Public Open-ILS tech discussion; perl4lib
Ämne: Re: Fwd: Module update for MARC::Record

OK, folks, MARC::Record 2.0.0 is officially out.

  http://search.cpan.org/~mikery/MARC-Record-2.0.0/lib/MARC/Record.pm

Give it a go, and let me know if you see anything broken.  Sorry for the delay!

-miker