Re: Unicode Problem [solved]

2004-09-03 Thread Jochem van Dieten
Jillian Koskie wrote: > I'm moving an application from CF 5 to CFMX... and I'm having a problem > with some of my data. > > The database is PostgreSQL. For posterity: The database was originally using the encoding SQL-ASCII. With CF 5 this results in characters with accents being treated as op

Re: Unicode Problem

2004-09-01 Thread Jochem van Dieten
Paul Hastings wrote: >> characters in your database). You could also use another >> supported charset like ISO-8859-15, but once you are converting >> it is probably best to go all the way and switch to unicode. > > ah, there's a man who knows a thing or two Well, to quote a famous CF I18N

Re: Unicode Problem

2004-09-01 Thread Jochem van Dieten
Jillian Koskie wrote: >   > Is there any way to search my database for the offending records? Perhaps the following would work: SELECT ID FROM table WHERE octet_length(field) <> octet_length(convert(field, 'UNICODE')) But don't continue with a hodgepodge. Bite the bullet, convert your system to

RE: Unicode Problem

2004-09-01 Thread Jillian Koskie
Jochem, Is there any way to search my database for the offending records? -- Jillian -Original Message- From: Jochem van Dieten [mailto:[EMAIL PROTECTED] Sent: September 1, 2004 10:25 AM To: CF-Talk Subject: Re: Unicode Problem Jillian Koskie wrote: > I have a database

Re: Unicode Problem

2004-09-01 Thread Paul Hastings
> characters in your database). You could also use another > supported charset like ISO-8859-15, but once you are converting > it is probably best to go all the way and switch to unicode. ah, there's a man who knows a thing or two [Todays Threads] [This Message] [Subscription] [Fast U

Re: Unicode Problem

2004-09-01 Thread Jochem van Dieten
Jillian Koskie wrote: > I have a database in sql_ascii. (though we've tried unicode as well) That will only be able to correctly store characters from 7-bit ASCII (so no accented characters). You need to convert your database to unicode in order to be able to use unicode. For that, pg_dump it,

RE: Unicode Problem

2004-09-01 Thread Jillian Koskie
I have a database in sql_ascii. (though we've tried unicode as well) -Original Message- From: Jochem van Dieten [mailto:[EMAIL PROTECTED] Sent: September 1, 2004 9:52 AM To: CF-Talk Subject: Re: Unicode Problem Jillian Koskie wrote: >   > We are not forcing a charset at all

Re: Unicode Problem

2004-09-01 Thread Jochem van Dieten
Jillian Koskie wrote: >   > We are not forcing a charset at all --whatever the default is.  We are > not using cfprocessingdirective, setencoding or cfsetting. Then you are probably using UTF-8 now. > My problem isn't so much 'how will I insert data now'... so much as > there is data in my databa

RE: Unicode Problem

2004-09-01 Thread Jillian Koskie
o about locating the offending characters in PostgreSQL itself? -- Jillian -Original Message- From: Jochem van Dieten [mailto:[EMAIL PROTECTED] Sent: September 1, 2004 6:01 AM To: CF-Talk Subject: Re: Unicode Problem Jillian Koskie wrote: > I'm moving an application from CF 5

Re: Unicode Problem

2004-09-01 Thread Jochem van Dieten
Jillian Koskie wrote: > I'm moving an application from CF 5 to CFMX... and I'm having a problem > with some of my data. > > The database is PostgreSQL. > > How do I start tracking down the problem / fix it?  Any tips? What charset is your website using? What charset was your website using in CF