Re: [SQL] UTF characters compromising data import.

2011-02-13 Thread Gavin Beau Baumanis
Hi and thanks for the replies, I have had some luck. I did find the encoding used originally to create the text files I am trying to import. I have managed to use the client_encoding environmental variable and then successfully did manage to import the data. Gavin. On 12/02/2011, at 8:15 P

Re: [SQL] UTF characters compromising data import.

2011-02-12 Thread Jasen Betts
On 2011-02-08, Gavin Beau Baumanis wrote: > I understand the error message - but what I don't know is what I > need to set the encoding to - in order to import / use the data. if you run it through iconv --from-code=ASCII -to-code=UTF8 -c it'll strip out all the non-ascii symbols, wi

Re: [SQL] UTF characters compromising data import.

2011-02-08 Thread Pavel Stehule
Hello 2011/2/8 Gavin Beau Baumanis : > Hi Everyone, > > I am trying to import some data (provided to us from an external source) from > a CSV file using "\copy " > > But I get the following error message; > invalid byte sequence for encoding "UTF8": 0xfd > HINT:  This error can also happen if

[SQL] UTF characters compromising data import.

2011-02-08 Thread Gavin Beau Baumanis
Hi Everyone, I am trying to import some data (provided to us from an external source) from a CSV file using "\copy " But I get the following error message; invalid byte sequence for encoding "UTF8": 0xfd HINT: This error can also happen if the byte sequence does not match the encoding expe