Not a unicode one that I know of, converting it to latin1 for the grouping
works for that particular use case, but I can't make any promises how it'd
work on your entire set which may hold any unicode character, a lot of
which cannot be converted to latin1:
mysql SET NAMES utf8;
Query OK, 0 rows
Thanks for that answer. It squares with my solution: have an additional
column that has the lower case values of the case sensitive unicode
setting.
Martin Mueller
Professor emeritus of English and Classics
Northwestern University
On 11/25/14 6:48 AM, Rik r...@grib.nl wrote:
Not a unicode
On 06.03.2008 15:15 CE(S)T, Paul DuBois wrote:
Here's some advice from Alexander Barkov:
You might be able to use a particular collation to achieve what you want.
For example, latin1_general_ci.
You can take a look at its collation chart here:
Yves!
This is a complicated matter alright, but it is a complicated
problem to solve here also. Your statement about characters being the
same isn't really correct. To take an example: Let's assume you were
doing a phonebook, in print, of all people in the world. How would you
sort that?
On 03.03.2008 10:27 CE(S)T, Anders Karlsson wrote:
[a lot about why sorting unicode is complicated]
If you want to
accknowledge exact matching, and say any character, accented / unlauted
etc, is different from any other character, specifiy a binary comparison:
SELECT * FROM phonebook WHERE
yves
when creating a varchar field in table creation, use the binary.
that way, selection is exact. always.
david
-Original Message-
From: Yves Goergen [mailto:[EMAIL PROTECTED]
Sent: Monday, March 03, 2008 1:44 PM
To: Anders Karlsson
Cc: MySQL
Subject: Re: Unicode sorting and binary
Yves!
OK. I agree I don't like this much myself, but we have to live with
the multi-lingual aspect of UNICODE. Or rather, we have to agree to be
either multi-lingual, and have the cons and pros of that (using
UNICODE), or ignore UNICODE and have binary collations etc. And
collation also
On 03.03.2008 23:17 CE(S)T, Anders Karlsson wrote:
And you are right of course, you may use the COLLATE keyword also,
to enforce a certain collation, although if you want BINARY, I think
using BINARY might be slightly more effective.
I was also considering compatibility with other DBMS.
Pardon me if my meager German caused me to misunderstand your question.
We have a French website in UTF-8, and in my experimentation it appeared
that UTF-8 (not binary) fields can be searched without using accents. For
example, doing a full-text search for etudes found études. I do not know
how
Hi Charlie,
The performance problem may be due to using UTF-8 instead of unicode.
Try declaring your text column as:
my_text VARCHAR(...) UNICODE
I am guessing, but it may be that the search is slow because MySQL
has to convert UTF-8 to UNICODE before doing the comparison.
BTW, don't
- Original Message -
From: Daniel Levy [EMAIL PROTECTED]
To: 古雷 [EMAIL PROTECTED]
Sent: Thursday, March 23, 2006 3:26 PM
Subject: Re: Unicode (UTF-8) question
Dear Gu Lei,
Again, thank you very much for your reply and your help.
I'm working with MySQL 5.0.18-nt via TCP/IP, MyODBC
At 20:15 -0700 11/2/05, Steve Johnson wrote:
The documentation notes that BLOBS must escape certain characters ( NULL, etc
.
What documentation are you referring to?
Also, NULL is not a character. Do you mean NUL (byte with value of 00)?
I suspect the escaping that you're referring to is
Hi,
I've read the whole
chapter 10 but I
haven't found any
instructions on how
to setup a UTF-8
database...
Is there any guide
on how to setup this
?
Thanks for any help
Regards
Roberto
Gleb Paharenko
[EMAIL PROTECTED]
wrote:
Hello.
First read:
Hello.
If you want to setup such kind of database you could put
all necessary variables to your configuration file, then restart
the server and create a new database. For example:
[mysqld]
default_character_set=utf8
[client]
default_character_set=utf8
Check with
Hello.
First read:
http://dev.mysql.com/doc/mysql/en/charset.html
Roberto Jobet [EMAIL PROTECTED] wrote:
Hi,
I'm using MySQL
4.1.11
I need to setup a
multilingual
databa=
se to support
a lot of foreign
languages.
Do I have to setup a
UTF-=
8 unicode
Patrice Serrand wrote:
mysql_query (mysql, INSERT INTO db_unicode.unicode_tbl VALUES (6, _utf8
'atüpedâ' COLLATE utf8_general_ci));
I'm no Unicode expert, but I've never seen that _utf8 bit before. What
is it? Or more accurately, what do you expect it to do? I ask because
that
one has to encode extend string or any unicode to utf-8 first and then insert
it to MySQL database 4.1
Most likely you did not encode them to utf-8.
zhi peng
Steve Quezadas [EMAIL PROTECTED] wrote:
Hey guys,
I just upgraded to mysql 4.1 and I'm trying to get damn unicode to work in
my
Hello.
Use MySQL Query Browser instead of MySQL CC. What output does the
following statement produce:
show variables like '%char%';
Steve Quezadas [EMAIL PROTECTED] wrote:
Hey guys,
I just upgraded to mysql 4.1 and I'm trying to get damn unicode to work in
my database. I
Hello.
You may use _utf8 0xXX form of input, where is 0x - hexademical
representation of your japanese string (each unicode character has it's own
hexademical value). For an example see:
http://dev.mysql.com/doc/mysql/en/Charset-literal.html
hi
i want to do a insert query
- Original Message -
From: angie ahl [EMAIL PROTECTED]
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Sent: Wednesday, December 01, 2004 9:26 AM
Subject: Unicode (utf8) and MySQL (with Perl)
Hi List.
Please excuse the cross posting but I've been scouring the archives
and no joy as yet.
On Wed, 1 Dec 2004, Rhino wrote:
I'm using mysql 4.1.7 and perl 5.8.1 on OS X 10.3
It also wouldn't hurt you to upgrade past all the minor updates of your
other components. That means 4.1.7 (check), 5.8.6, and 10.3.6. I'm sure
Perl had a lot of bug fixes or improvements after 5.8.1,
Could someone who has experience with handling the Unicode character
set in a MySQL database please write to me? In particular, I am
trying
to discover how in an ASCII-limited environment one can specify
non-ASCII characters; I do know their Unicode encodings, just not how
to write an
Are you characters being escaped before being stored?
\ucharacter-code?
-Original Message-
From: Silvio Lopes de Oliveira
To: Victor Pendleton; James Huang ; [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: 6/2/04 6:24 PM
Subject: RE: Unicode characters become question marks
You know, now
();
}
println;
}
From: James Huang [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
CC: [EMAIL PROTECTED], [EMAIL PROTECTED]
Subject: Re: Unicode characters become question marks
Date: Wed, 02 Jun 2004 22:11:31 -0700
This test code works, with both mysql-connector-j 3.0.14 and 3.0.11,
against mysql 5.0-alpha
I saw the same problem with 5.0 alpha and Java/JDBC. The text was Chinese
characters in Java; the tables were created with default character set UTF8.
Seems only questions marks are stored.
Wondering if far-east characters in UTF8 are support by MySQL's UTF8
support?
-James
From: Silvio Lopes
Can you display properly handle the Chinese characters? I would try to
verify that the correct unicode code is being stored.
-Original Message-
From: James Huang
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Sent: 6/2/04 11:45 AM
Subject: RE: Unicode characters become question marks
I saw
PROTECTED],'[EMAIL PROTECTED] ' [EMAIL PROTECTED]
Subject: RE: Unicode characters become question marks
Date: Wed, 2 Jun 2004 11:51:22 -0500
Can you display properly handle the Chinese characters? I would try to
verify that the correct unicode code is being stored.
-Original Message-
From
: Wednesday, June 02, 2004 9:51 AM
To: 'James Huang '; Silvio Lopes de Oliveira; '[EMAIL PROTECTED] '
Subject: RE: Unicode characters become question marks
Can you display properly handle the Chinese characters? I would try to
verify that the correct unicode code is being stored.
-Original
Lopes de Oliveira
To: Victor Pendleton; James Huang ; [EMAIL PROTECTED]
Sent: 6/2/04 11:59 AM
Subject: RE: Unicode characters become question marks
Yes, my display can handle the Chinese characters. I have also changed
the application font of MySQL Control Center to SimSun, which supports
all
Oliveira ' [EMAIL PROTECTED],Victor Pendleton
[EMAIL PROTECTED],'James Huang '
[EMAIL PROTECTED],'[EMAIL PROTECTED] ' [EMAIL PROTECTED]
Subject: RE: Unicode characters become question marks
Date: Wed, 2 Jun 2004 12:09:02 -0500
If you can type the character into the keyboard try this.
SELECT
:09 AM
To: Silvio Lopes de Oliveira; Victor Pendleton; 'James Huang ';
'[EMAIL PROTECTED] '
Subject: RE: Unicode characters become question marks
If you can type the character into the keyboard try this.
SELECT IF(col1=chinese-character, 1, 0)
Else try this from a java program
if (rset.getString
Lopes
-Original Message-
From: James Huang [mailto:[EMAIL PROTECTED]
Sent: Wednesday, June 02, 2004 10:18 AM
To: [EMAIL PROTECTED]; Silvio Lopes de Oliveira;
[EMAIL PROTECTED]
Subject: RE: Unicode characters become question marks
Victor,
I'm positive the database is storing ?'s. You
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
James Huang wrote:
Victor,
I'm positive the database is storing ?'s. You may test with these steps:
1) insert \u7247\u4EEE\u540D into a UTF8 table;
James,
Have you set your JDBC driver's character set to be UTF-8 using the
characterEncoding
a standard JDBC method.
-James
From: Mark Matthews [EMAIL PROTECTED]
To: James Huang [EMAIL PROTECTED]
CC: [EMAIL PROTECTED], [EMAIL PROTECTED], [EMAIL PROTECTED]
Subject: Re: Unicode characters become question marks
Date: Wed, 02 Jun 2004 13:04:38 -0500
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
]
Subject: Re: Unicode characters become question marks
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
James Huang wrote:
Victor,
I'm positive the database is storing ?'s. You may test with these steps:
1) insert \u7247\u4EEE\u540D into a UTF8 table;
James,
Have you set your JDBC driver's
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
James Huang wrote:
Thanks, Mark. This instills great confidence in me.
I used this URL:
jdbc:mysql://localhost/mydb?useUnicode=truecharacterEncoding=utf8
(should I use utf-8 perhaps?) Would this work, too?
James,
Either should work, if you're
To: Silvio Lopes de Oliveira; Victor Pendleton; 'James Huang ';
'[EMAIL PROTECTED] '
Subject: RE: Unicode characters become question marks
If you can type the character into the keyboard try this.
SELECT IF(col1=chinese-character, 1, 0)
Else try this from a java program
if (rset.getString(col1
You know, now I'm sure that the chars are getting stored as '?' as
well. I tried the test
you suggested again, but with a small modification. I typed:
SELECT IF(networkname='?', 1, 0) from networktable;
and it returned 1. Because I used '?' instead of the chinese char and
it
-
From: Jeremy March [mailto:[EMAIL PROTECTED]
Sent: Wednesday, June 02, 2004 2:53 PM
To: [EMAIL PROTECTED]
Cc: Silvio Lopes de Oliveira
Subject: RE: Unicode characters become question marks
You know, now I'm sure that the chars are getting stored as '?' as
well. I tried the test
you suggested
]
Subject: Re: Unicode characters become question marks
Date: Wed, 02 Jun 2004 13:04:38 -0500
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
James Huang wrote:
Victor,
I'm positive the database is storing ?'s. You may test with these steps:
1) insert \u7247\u4EEE\u540D into a UTF8 table;
James,
Have
Unicode and multiple character sets are not supported until version 4.10.
See section 9 of the manual. 4.1.1 is still alpha but its quite stable if
your server isn't in a production environment.
_
Tired of slow downloads? Compare
It seems to be working, but I am facing a glitch with
display.
I tried
select convert(_ucs2 0x0400 using utf8);
+--+
| convert(_ucs2 0x0400 using utf8) |
+--+
| ?|
+--+
You need to be sure you are using a Unicode font. Are you using xterm? If
so you can go to the edit tab and click Current Profile to change the font.
Also note that most Unicode fonts only cover subsets of Unicode not the
whole thing so use a font that supports the language you are using. I
Oops--the Unicode character must have gotten lost in the email, but it does
show up in MySQL. Its an O with a line above it.
_
MSN Messenger with backgrounds, emoticons and more.
Remember that utf8 is not the same as the Unicode codepoints. If you want
to enter utf8 like that you need to convert it from ucs2 first. Try this:
SELECT convert(_ucs2 0x00d4 using utf8);
and to insert:
INSERT INTO your_table values (convert(_ucs2 0x00d4 using utf8));
You can compare the
Hi Nils,
I have no ucs2.xml in the /usr/local/share/mysql/charsets/ .
but I was looking for about ucs2 in the
/usr/local/share/mysql/charsets/Index.xml .
charset name=ucs2
familyUnicode/family
descriptionUCS-2 Unicode/description
collation name=ucs2id=35 flag=primary/
/charset
Hi Yuji,
I have never heard of a character set thats named ucs2
This are the character sets which came with 4.1 alpha:
baby-bumble-bee:/usr/share/mysql/charsets # ls
. READMEcp1250.xml cp1257.xml cp866.xml hebrew.xml
koi8r.xml latin2.xml macce.xml
..
I'd like to use ucs2 character set for MySQL.
You do understand that Unicode support is not yet complete in MySQL,
including the current alpha?
Also, I would expect UTF-8 to be in better condition that UTF-16.
--
Joel Rees [EMAIL PROTECTED]
--
MySQL General Mailing List
For list archives:
Hi Nils,
I have to test to unicode(utf8 ucs2).
but It was frontend client enviroment matter(native supported by
Unicode-16).
I was compiled by my self.
Then I tried uft8 and it was successful.
but ucs2 was doesn't work by the same step.
Thank you.
Yujis
--
MySQL General Mailing List
For list
to the list?
I am making a trilingual web site (spanish, japanese and english) and I
really need UTF-8.
Thanks.
- Original Message -
From: Yuji Sato [EMAIL PROTECTED]
To: Nils Valentin [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: Wednesday, June 11, 2003 8:40 AM
Subject: Re: Unicode
Message -
From: Yuji Sato [EMAIL PROTECTED]
To: Nils Valentin [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: Wednesday, June 11, 2003 8:40 AM
Subject: Re: Unicode(ucs2) setup question
Hi Nils,
I have to test to unicode(utf8 ucs2).
but It was frontend client enviroment matter(native
Hi List,
This is my first mail in this list and thanks in advance.
Does anyone know what version of Mysql has Unicode support for full text
searching? I have a database with information in four languages
(english, german, greek and spanish) in unicode and I would like to do
full text searching.
At 11:00 +0200 6/10/03, rich johnson wrote:
Hi List,
This is my first mail in this list and thanks in advance.
Does anyone know what version of Mysql has Unicode support for full text
searching? I have a database with information in four languages
(english, german, greek and spanish) in unicode
Hi Yuji
Error 2 means the file doesnt exist. (here:
'/usr/local/share/mysql/charsets/ucs2.xml').
Please make sure the file is in the foldr specified and not misspelled.
Best regards
Nils Valentin
Tokyo/Japan
Japanese:
2003 6 11 14:44Yuji Sato :
I'd like to use ucs2 character set for
hay rob
i used unicode with mysql 3.23.39
i never activated any support for my unicode data
true dos will convert it into alian characters .
so what u do is
inzert ur unicode data into longtext fields if u want to make them full text
if not keep it in blob fields
i ve been workin with the
On Wednesday 02 April 2003 16:17, Tariq Murtaza wrote:
Hope you are all fine and doing well.
I would like to know the status of unicode support for mysql.
I will appreciate if someone share his/her experience regarding data
manipulation in unicode on mysql.
Unicode is supported since 4.1
Michelle de Beer wrote:
3) I read some of the things on unicode.org, but this
is only the pros. Is there any cons for using unicode?
When should I use it?
If you do primarily english but want other language support, UTF-8 is
_exactly_ the same as ASCII for the first 127 characters. If you
On Wednesday 11 December 2002 12:14, Bruno Batarelo wrote:
I was wandering whether MySQL (4.0.4 or higher) in combination with InnoDB
support UNICODE. If I store central European characters using MyODBC from
VB, am I sure that they are stored in UNICODE in InnoDB table file and that
they can
Steve,
Monday, December 02, 2002, 8:55:05 PM, you wrote:
SV Have you got a rough timescale as to when 4.1 will come out?
Before this year ends.
SV If not then is there a way to simulate Unicode in MySQL?
You can store unicode data in the MySQL database in the 3.23 and 4.0
as well.
ali,
Monday, December 02, 2002, 2:09:19 PM, you wrote:
af i want to know does mysql support unicode encoding ?
af if yes ( i wish ) how can i set this ? are this support automatic or i must
af do something ?
Unicode support will come in 4.1
--
For technical support contracts, goto
Hiya,
Have you got a rough timescale as to when 4.1 will come out?
If not then is there a way to simulate Unicode in MySQL?
THanks,
Steve
XX
-
Before posting, please check:
..
From: Dean Harding [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Subject: RE: Unicode Support with MySQL
Date: Mon, 7 Oct 2002 17:44:08 +1000
According to the website, it'll be in version 4.1.
You can already use Unicode now, though, you just can't sort on it or
stuff like that...
Dean Harding
pm
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: RE: Unicode Support with MySQL
schmid n dean .
fellaz .
i AM using mysql for UNICODE data
all my database is unicode
its all stored there i retieve all my unicode data n play round with it
all
the time
n so far i ve had NO problemx
awww jeeez.
tell me bout dat
i still ve to work on the indexing n sortin
toby
From: Dean Harding [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Subject: RE: Unicode Support with MySQL
Date: Tue, 8 Oct 2002 20:47:17 +1000
Yeah, I've used Unicode with MySQL as well. All I was saying is that
you
According to the website, it'll be in version 4.1.
You can already use Unicode now, though, you just can't sort on it or
stuff like that...
Dean Harding.
-Original Message-
From: Schmid Manfred [mailto:[EMAIL PROTECTED]]
Sent: Monday, 7 October 2002 5:24 pm
To: [EMAIL PROTECTED]
Schmid,
Monday, October 07, 2002, 10:23:52 AM, you wrote:
SM we are very interested in using MySQL with our machines, but we need a full
SM Unicode-support with the database.
SM Can you give us information's about the time, when MySQL will com with a
SM full Unicode Support?
Unicode support
i asked the same very question just yesterday
heres the reply i got for it ... i hope it helps u too
good luck ...
toby
Not natively (i.e. you can't sort on a Unicode field, for example), but
you can
On Tue, 2002-03-19 at 10:02, David Ayliffe wrote:
Hello,
I need some details on the EXACT type of Unicode that MySQL will use
4.1.
Ideally I'm looking for information on which type of Unicode MySQL will
use internally, and which type it will return data to the user in; and
is the MySQL
So how (forgive me if this is a simpleton's question), how will UTF-8
and UCS2 be used? Can you elaborate a bit.
DA
Hi,
Unicode in 4.1 will use UTF-8 and UCS2 with a possibility to recode
between them (as well as between any supported character sets).
Some (VERY) technical documentation
When you say:
Unicode will be supported in 4.0.3 version of MySQL.
What do you mean - UTF-8 encoding or UTF-16 or what?
Can you clarify
-Original Message-
From: Victoria Reznichenko [mailto:[EMAIL PROTECTED]]
Sent: 11 March 2002 09:24
To: [EMAIL PROTECTED]
Subject: Unicode support
.
To: 'Victoria Reznichenko'; [EMAIL PROTECTED]
Subject: RE: Unicode support for MySQL
When you say:
Unicode will be supported in 4.0.3 version of MySQL.
What do you mean - UTF-8 encoding or UTF-16 or what?
Can you clarify
-Original Message-
From: Victoria Reznichenko [mailto:[EMAIL
On Friday 25 January 2002 10:35, Hery Yulianto wrote:
Hi Brothers or Sisters,
I need to know, how to configure MySQL can be support unicode like Chinese
(simplified and Traditional), Croation,Chezh or whatever.
I using PHP programming and needed can transaction with Chinese character.
Hi all,
I have written to this mailing lists twice before, but nobody seems
responds. Please help, this charset problem is very disturbing.
In my case I need to import text files with MacRoman encoding into mysql.
I am working on Mac OS X. How do we get support for this encoding?
Regards,
Hi
You can store Unicode text in a binary column (BLOB) and convert it to/from
native Unicode format in your application. The most efficient form is likely
to be UTF-8 format, which has a variable character length (the lower 128
characters are the same as ASCII).
I have such a database that is
You can *STORE* Unicode (UTF-8) in MySQL just fine. Just don't expect
text-search (LIKE, =, etc) to do anything useful with it.
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]] On Behalf Of md
Sent: 1 June 2001 15:22
To: [EMAIL PROTECTED]
Subject: Unicode
My mysql server is English but I have a chinese/english front end and users
type in both Chinese English.
- Original Message -
From: md [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Sent: Friday, June 01, 2001 21:22
Subject: Unicode
Does anybody use mysql with Chinese or other Unicode
76 matches
Mail list logo