Hi,
I try to process some records obtained frommy ILS system (Millennium) in
UTF-8 characterset and I obtain this error:
utf8 "\xF9" does not map to Unicode at
/usr/lib/perl5/5.10.0/i386-linux-thread-multi/Encode.pm line 162.
I use a Unix Machine with FEDORA CORE 10 and perl 5 installed. I
Hi Jordi
On Mon, Jul 13, 2009 at 4:34 AM, Jordi Pallares wrote:
> I try to process some records obtained frommy ILS system (Millennium) in
> UTF-8 characterset and I obtain this error:
>
> utf8 "\xF9" does not map to Unicode at
> /usr/lib/perl5/5.10.0/i386-linux-thread-multi/Encode.pm line 162.
S
Hello Jordi,
> my $setting = MARC::Charset->assume_unicode(1);
> my $ignore = MARC::Charset->ignore_errors(1);
Are you sure these lines are necessary for your script ?
Perhaps you could try it without these and see what happens ?
Also, if you can put some small file with just a few records so
Hi,
I test without his lines and I have the same results.
I attach a file with 1 record with error:
"utf8 "\xF9" does not map to Unicode at
/usr/lib/perl5/5.10.0/i386-linux-thread-multi/Encode.pm line 162."
I try to convert to marcXML record with yaz-marcdump and I works perfectly.
I see the
Hi Jordi,
Did III convert your database to Unicode? If so, they encoded it into 'raw'
Unicode, not utf8. Also, how frequently is the error happening?
Mark
Mark Jordan
Head of Library Systems
W.A.C. Bennett Library, Simon Fraser University
Burnaby, British Columbia, V5A 1S6, Canada
Voice: 778.7
Yes they convert to Unicode. I pass them the records in CP1252.
In some cases I found It each 6000 records but in other more often...
It's not a regular patron... The bad notice Is i have 4million records.
Thanks MarK
En/na Mark Jordan ha escrit:
Hi Jordi,
Did III convert your database to
Whoops, meant to send this to the list, not just Jordi.
-- Forwarded message --
From: Jon Gorman
Date: Mon, Jul 13, 2009 at 9:07 AM
Subject: Re: ERROR : "\xF9" does not map to Unicode
To: Jordi Pallares
> I try to convert to marcXML record with yaz-marcdump and I works perfect
Again, meant to send to the list...the caffeine hasn't hit my brain yet.
On Mon, Jul 13, 2009 at 9:18 AM, Jon Gorman wrote:
> On Mon, Jul 13, 2009 at 9:07 AM, Jon Gorman wrote
>> It doesn't look like valid utf-8. Utf-8 doesn't have a single f9
>> character. (It will end being a two byte code, b
