Re: Need Help Converting Character Sets

2012-10-01 Thread hsv
2012/09/30 11:07 -0700, Mark Phillips The data for this table comes from a web page (charet utf8). I copy/paste word files into gedit (on linux) and then copy/paste from gedit to a text boxes on the web page input form. I had thought I was stripping out all the funky characters by usin

RE: Need Help Converting Character Sets

2012-10-01 Thread Rick James
f8/other. > > * The problem is on ingestion / on retrieval. > > > > The thing mentioned involved 2 steps: > > ALTER TABLE ... MODIFY COLUMN BINARY (or BLOB); -- to forget any > > charset knowledge ALTER TABLE ... MODIFY COLUMN CHARACTER SET ...; > > -- com

Re: Need Help Converting Character Sets

2012-09-30 Thread Mark Phillips
COLUMN BINARY (or BLOB); -- to forget any charset > knowledge > ALTER TABLE ... MODIFY COLUMN CHARACTER SET ...; -- coming from BINARY, > this does not check the encoding. > (sorry, don't have the link handy) > > > -Original Message----- > > From: h...@tb

RE: Need Help Converting Character Sets

2012-09-28 Thread Rick James
the encoding. (sorry, don't have the link handy) > -Original Message- > From: h...@tbbs.net [mailto:h...@tbbs.net] > Sent: Thursday, September 27, 2012 2:24 PM > To: Mark Phillips > Cc: Mysql List > Subject: Re: Need Help Converting Character Sets > > >>&

Re: Need Help Converting Character Sets

2012-09-27 Thread Derek Downey
To go along with what Rick is saying, this link might help you: http://dba.stackexchange.com/questions/10467/how-to-convert-control-characters-in-mysql-from-latin1-to-utf-8 I remember doing a bunch of converting HEX() control characters (such as an apostrophe copied from a Word document) before

Re: Need Help Converting Character Sets

2012-09-27 Thread hsv
2012/09/24 16:28 -0700, Mark Phillips I have a table, Articles, of news articles (in English) with three text columns for the intro, body, and caption. The data came from a web page, and the content was cut and pasted from other sources. I am finding that there are some non utf-8 characte

RE: Need Help Converting Character Sets

2012-09-24 Thread Rick James
If you have a mixture of encodings, you are in deep doodoo. This page describes some debugging techniques and some issues: http://mysql.rjweb.org/doc.php/charcoll That apostrophe might be MicroSquish's "smart quote". Can you provide SELECT HEX(the_field) FROM... ? We (or the above page) migh