Re: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

2011-06-17 Thread Albe Laurenz
BRUSSER Michael wrote: >>> Is there a way to find the records with the text field containing Unicode bytes "0xedbebf"? >>> Unfortunately this is a very old version 7.3.10 >> >> This should work on 7.3 (according to the documentation): >> SELECT id FROM nlsdata WHERE position('\360\235\204\236'::byt

Re: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

2011-06-16 Thread BRUSSER Michael
-Original Message- From: Albe Laurenz [mailto:laurenz.a...@wien.gv.at] Sent: Thursday, June 16, 2011 5:16 AM To: BRUSSER Michael; pgsql-general@postgresql.org Subject: RE: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf BRUSSER Michael wrote: > Is there a wa

Re: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

2011-06-16 Thread Albe Laurenz
BRUSSER Michael wrote: > Is there a way to find the records with the text field containing Unicode bytes "0xedbebf"? > > Unfortunately this is a very old version 7.3.10 This should work on 7.3 (according to the documentation): SELECT id FROM nlsdata WHERE position('\360\235\204\236'::bytea IN val

Re: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

2011-06-15 Thread BRUSSER Michael
-Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Alan Hodgson Sent: Wednesday, June 15, 2011 5:37 PM To: pgsql-general@postgresql.org Subject: Re: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

Re: [GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

2011-06-15 Thread Alan Hodgson
On June 15, 2011 01:18:27 PM BRUSSER Michael wrote: > Unless there's no other options I don't want to use sed or break file into > pieces, if possible, iconv loads everything into RAM. You can use "split", convert the pieces, and then recombine, I did that when converting a large database to utf-

[GENERAL] Invalid byte sequence for encoding "UTF8": 0xedbebf

2011-06-15 Thread BRUSSER Michael
This is a follow-up on my previous message http://archives.postgresql.org/pgsql-general/2011-06/msg00054.php I think I have now some understanding of what's causing the problem, but I don't have a good solution, instead more questions. The release notes for v8.1 at http://www.postgresql.org/doc