ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Jordi Pallares
Hi, I try to process some records obtained frommy ILS system (Millennium) in UTF-8 characterset and I obtain this error: utf8 \xF9 does not map to Unicode at /usr/lib/perl5/5.10.0/i386-linux-thread-multi/Encode.pm line 162. I use a Unix Machine with FEDORA CORE 10 and perl 5 installed. I

Re: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Galen Charlton
Hi Jordi On Mon, Jul 13, 2009 at 4:34 AM, Jordi Pallaresjpalla...@cbuc.es wrote: I try to process some records obtained frommy ILS system (Millennium) in UTF-8 characterset and I obtain this error: utf8 \xF9 does not map to Unicode at /usr/lib/perl5/5.10.0/i386-linux-thread-multi/Encode.pm

Re: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Sébastien Hinderer
Hello Jordi, my $setting = MARC::Charset-assume_unicode(1); my $ignore = MARC::Charset-ignore_errors(1); Are you sure these lines are necessary for your script ? Perhaps you could try it without these and see what happens ? Also, if you can put some small file with just a few records

Re: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Jordi Pallares
Hi, I test without his lines and I have the same results. I attach a file with 1 record with error: utf8 \xF9 does not map to Unicode at /usr/lib/perl5/5.10.0/i386-linux-thread-multi/Encode.pm line 162. I try to convert to marcXML record with yaz-marcdump and I works perfectly. I see the

Re: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Mark Jordan
Hi Jordi, Did III convert your database to Unicode? If so, they encoded it into 'raw' Unicode, not utf8. Also, how frequently is the error happening? Mark Mark Jordan Head of Library Systems W.A.C. Bennett Library, Simon Fraser University Burnaby, British Columbia, V5A 1S6, Canada Voice:

Re: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Jordi Pallares
Yes they convert to Unicode. I pass them the records in CP1252. In some cases I found It each 6000 records but in other more often... It's not a regular patron... The bad notice Is i have 4million records. Thanks MarK En/na Mark Jordan ha escrit: Hi Jordi, Did III convert your database

Fwd: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Jon Gorman
Whoops, meant to send this to the list, not just Jordi. -- Forwarded message -- From: Jon Gorman jonathan.gor...@gmail.com Date: Mon, Jul 13, 2009 at 9:07 AM Subject: Re: ERROR : \xF9 does not map to Unicode To: Jordi Pallares jpalla...@cbuc.es I try to convert to marcXML

Re: ERROR : \xF9 does not map to Unicode

2009-07-13 Thread Jon Gorman
Again, meant to send to the list...the caffeine hasn't hit my brain yet. On Mon, Jul 13, 2009 at 9:18 AM, Jon Gormanjonathan.gor...@gmail.com wrote: On Mon, Jul 13, 2009 at 9:07 AM, Jon Gormanjonathan.gor...@gmail.com wrote It doesn't look like valid utf-8.  Utf-8 doesn't have a single f9