On Jun 2, 2007, at 8:22 AM, Matt Culbreth wrote:
>
> Howdy All,
>
> I've got some existing code that I'm trying on a new server. The code
> was formerly running with Python 2.4 and SA 0.36, but this new server
> is running Python 2.5 and SA 0.37.
>
> Anyway, I've got a small program which is loading a PostgreSQL 8.2 db
> from a CSV file, and I'm getting this exception:
>
> sqlalchemy.exceptions.SQLError: (ProgrammingError) invalid byte
> sequence for encoding "UTF8": 0xe16e69
> HINT: This error can also happen if the byte sequence does not match
> the encoding expected by the server, which is controlled by
> "client_encoding".
>
> The particular (fake, generated) set of data doing this is shown
> here. It looks like that first element (city) is encoded as something
> other than latin1:
>
> {'city': 'Gu\xe1nica', 'first_name': 'Patricia', 'last_name':
> 'Wagner', 'zip': '25756', 'phone': '490.749.6157', 'state': 'KS',
> 'annual_salary': '72333', 'broker_id': 452L, 'date_hired':
> datetime.date(2004, 1, 1), 'address': 'P.O. Box 815, 6723 Eget, Ave',
> 'commission_percentage': 0.080120064101811897}
>
> Has anybody seen this? Do I need to do a convert_unicode or anything
> like that?
if youre parsing from the CSV file, your best bet is to parse the
data into python unicode objects using the expected encoding of the
file....that will detect any text in the file thats not in the
expected encoding. then just use the DB with convert_unicode=True
either on create_engine() or within the individual String() types
(String(convert_unicode=True) is now equivalent to Unicode()).
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"sqlalchemy" group.
To post to this group, send email to sqlalchemy@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at
http://groups.google.com/group/sqlalchemy?hl=en
-~----------~----~----~----~------~----~------~--~---
