Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-19 Thread Clint Byrum
Excerpts from Doug Hellmann's message of 2014-03-18 15:08:36 -0700: > On Mon, Mar 10, 2014 at 4:02 PM, Ben Nemec wrote: > > > On 2014-03-10 12:24, Chris Friesen wrote: > > > >> Hi, > >> > >> I'm using havana and recent we ran into an issue with heat related to > >> character sets. > >> > >> In he

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-18 Thread Zhi Yan Liu
Hi Doug, On Wed, Mar 19, 2014 at 6:08 AM, Doug Hellmann wrote: > > > > On Mon, Mar 10, 2014 at 4:02 PM, Ben Nemec wrote: >> >> On 2014-03-10 12:24, Chris Friesen wrote: >>> >>> Hi, >>> >>> I'm using havana and recent we ran into an issue with heat related to >>> character sets. >>> >>> In heat/d

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-18 Thread Doug Hellmann
On Mon, Mar 10, 2014 at 4:02 PM, Ben Nemec wrote: > On 2014-03-10 12:24, Chris Friesen wrote: > >> Hi, >> >> I'm using havana and recent we ran into an issue with heat related to >> character sets. >> >> In heat/db/sqlalchemy/api.py in user_creds_get() we call >> _decrypt() on an encrypted passwo

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-11 Thread Chris Friesen
On 03/11/2014 05:50 PM, Clint Byrum wrote: But MySQL can't possibly know what you _meant_ when you were inserting data. So, if you _assumed_ that the database was UTF-8, and inserted UTF-8 with all of those things accidentally set for latin1, then you will have UTF-8 in your db, but MySQL will t

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-11 Thread Clint Byrum
Excerpts from Ben Nemec's message of 2014-03-10 13:02:47 -0700: > On 2014-03-10 12:24, Chris Friesen wrote: > > Hi, > > > > I'm using havana and recent we ran into an issue with heat related to > > character sets. > > > > In heat/db/sqlalchemy/api.py in user_creds_get() we call > > _decrypt() on

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-10 Thread Roman Podoliaka
Hi all, >>> It sounds like for the near future my best bet would be to just set the >>> install scripts to configure postgres (which is used only for openstack) to >>> default to utf-8. Is that a fair summation? Yes. UTF-8 is a reasonable default value. Thanks, Roman On Mon, Mar 10, 2014 at

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-10 Thread Chris Friesen
On 03/10/2014 02:02 PM, Ben Nemec wrote: We just had a discussion about this in #openstack-oslo too. See the discussion starting at 2014-03-10T16:32:26 http://eavesdrop.openstack.org/irclogs/%23openstack-oslo/%23openstack-oslo.2014-03-10.log In that discussion dhellmann said, "I wonder if we

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-10 Thread Ben Nemec
On 2014-03-10 12:24, Chris Friesen wrote: Hi, I'm using havana and recent we ran into an issue with heat related to character sets. In heat/db/sqlalchemy/api.py in user_creds_get() we call _decrypt() on an encrypted password stored in the database and then try to convert the result to unicode.

Re: [openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-10 Thread Roman Podoliaka
Hi Chris, AFAIK, most OpenStack projects enforce tables to be created with the encoding set to UTF-8 because MySQL has horrible defaults and would use latin1 otherwise. PostgreSQL must default to the locale of a system on which it's running. And, I think, most systems default to UTF-8 nowadays. A

[openstack-dev] UTF-8 required charset/encoding for openstack database?

2014-03-10 Thread Chris Friesen
Hi, I'm using havana and recent we ran into an issue with heat related to character sets. In heat/db/sqlalchemy/api.py in user_creds_get() we call _decrypt() on an encrypted password stored in the database and then try to convert the result to unicode. Today we hit a case where this errore