Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 8:20 PM, Govinda wrote: They are getting converted in those functions I posted. They display correctly when in the text field, but when inserted to the DB by that functions, they get converted. Then when I echo them out of the DB they are the converted chars. I think it may be the table or table cell, but I read somewhere on php.net that hemlentities doesn't always convert correctly. Hence my asking of this question. notice that htmlentities() has several params... incl. one for the charset: http://us.php.net/manual/en/function.htmlentities.php But now that I re-read your OP, I am thinking, WHY are you saving the data entity-ized at all? My understanding has always been to save the data just *as it is*.. and if you LATER need to entity-ize it (for example: for display on a webpage), then do that at the time you pull the data out of the db for display. Of course this would require your db/table/connection are all of a charset that can handle the characters you are asking it to save into the db. I have a UTF-8 db that saves content in dozens of languages... and it works fine.. and none of the data has been messed with at all from what the language-specific user input. -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php That is a good point. I will try that and see. Karl DeSaulniers Design Drumm http://designdrumm.com -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
> They are getting converted in those functions I posted. > They display correctly when in the text field, but when inserted to the DB by > that functions, they get converted. > Then when I echo them out of the DB they are the converted chars. > I think it may be the table or table cell, but I read somewhere on php.net > that hemlentities doesn't always convert correctly. > Hence my asking of this question. notice that htmlentities() has several params... incl. one for the charset: http://us.php.net/manual/en/function.htmlentities.php But now that I re-read your OP, I am thinking, WHY are you saving the data entity-ized at all? My understanding has always been to save the data just *as it is*.. and if you LATER need to entity-ize it (for example: for display on a webpage), then do that at the time you pull the data out of the db for display. Of course this would require your db/table/connection are all of a charset that can handle the characters you are asking it to save into the db. I have a UTF-8 db that saves content in dozens of languages... and it works fine.. and none of the data has been messed with at all from what the language-specific user input. -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 6:33 PM, Govinda wrote: notice there are also these if you end up needing them: iconv_set_encoding() iconv() http://us.php.net/manual/en/function.iconv-set-encoding.php http://us.php.net/manual/en/function.iconv.php -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php Hmm. So would this be the quick and easy way to set everything to UTF-8? well... those functions will not "to set everything to UTF-8". They merely do what they say they will do... e.g. for iconv, "Performs a character set conversion on the string str from in_charset to out_charset." <--- That (iconv's function) does not have anything to do with the charset *of the db* (or table, or what Apache is set to serve, or the file's charset, etc.). I always feel that the best thing is to learn and understand, so you know, ...exactly where your strings are becoming what/where/why... and figure out how to control all those places of possible transformation and where you might not have control, appreciate that is the situation, and figure out how to workaround it. I am not so expert either. I *assume* that if one did have control of all the places where encoding config-settings can factor in, then one would never need such a thing as iconv(). But PHP is so full of tools.. to give you power just when/where you need it. My coder spirit always wants to understand exactly what is going on. So if I were you I would want to figure out exactly where your strings are getting transformed into something other than what you expected.. and correct the issue at that spot. -Govinda They are getting converted in those functions I posted. They display correctly when in the text field, but when inserted to the DB by that functions, they get converted. Then when I echo them out of the DB they are the converted chars. I think it may be the table or table cell, but I read somewhere on php.net that hemlentities doesn't always convert correctly. Hence my asking of this question. Good point to check everything though! Thanks, Karl DeSaulniers Design Drumm http://designdrumm.com -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
>> notice there are also these if you end up needing them: >> >> iconv_set_encoding() >> iconv() >> >> http://us.php.net/manual/en/function.iconv-set-encoding.php >> http://us.php.net/manual/en/function.iconv.php >> >> -Govinda >> >> -- >> PHP Database Mailing List (http://www.php.net/) >> To unsubscribe, visit: http://www.php.net/unsub.php >> > > > Hmm. So would this be the quick and easy way to set everything to UTF-8? well... those functions will not "to set everything to UTF-8". They merely do what they say they will do... e.g. for iconv, "Performs a character set conversion on the string str from in_charset to out_charset." <--- That (iconv's function) does not have anything to do with the charset *of the db* (or table, or what Apache is set to serve, or the file's charset, etc.). I always feel that the best thing is to learn and understand, so you know, ...exactly where your strings are becoming what/where/why... and figure out how to control all those places of possible transformation and where you might not have control, appreciate that is the situation, and figure out how to workaround it. I am not so expert either. I *assume* that if one did have control of all the places where encoding config-settings can factor in, then one would never need such a thing as iconv(). But PHP is so full of tools.. to give you power just when/where you need it. My coder spirit always wants to understand exactly what is going on. So if I were you I would want to figure out exactly where your strings are getting transformed into something other than what you expected.. and correct the issue at that spot. -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 6:14 PM, Govinda wrote: I believe when the table was set up. This was handed off from others. I will ask. Thanks for the heads up on the difference. notice there are also these if you end up needing them: iconv_set_encoding() iconv() http://us.php.net/manual/en/function.iconv-set-encoding.php http://us.php.net/manual/en/function.iconv.php -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php Hmm. So would this be the quick and easy way to set everything to UTF-8? Best, Karl DeSaulniers Design Drumm http://designdrumm.com -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
> > I believe when the table was set up. > This was handed off from others. > I will ask. Thanks for the heads up on the difference. notice there are also these if you end up needing them: iconv_set_encoding() iconv() http://us.php.net/manual/en/function.iconv-set-encoding.php http://us.php.net/manual/en/function.iconv.php -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 5:08 PM, Toby Hart Dyke wrote:
-Original Message-
From: Karl DeSaulniers [mailto:k...@designdrumm.com]
Sent: Thursday, August 09, 2012 10:19 PM
To: php-db@lists.php.net
Subject: Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 5:41 AM, Karl DeSaulniers wrote:
On Aug 9, 2012, at 5:37 AM, Karl DeSaulniers wrote:
Help!
How do I get special characters to convert correctly when inserting
and reading from my database.
For example.
é => é
ë => ë
I keep getting
ë and é
using htmlentities, htmlspecialchars, etc...
Any pointers? Please!
Going bald over here.
here is my funcitons
function stringToMysqlFormat($original_input) {
//for inserting the data with special characters INTO
mysql
$html_encoded =
htmlentities(mysql_real_escape_string($original_input));
return $html_encoded;
}
function mysqlToHTMLFormat($encoded) {
//for displaying the data FROM mysql
$html_decoded =
html_entity_decode(stripslashes($encoded));
return $html_decoded;
}
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
using UTF-8
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/) To unsubscribe,
visit:
http://www.php.net/unsub.php
No one?
Not even a link I can go look this up myself with?
I have successfuly converted before, but this time the company is
in the
netherlands and their special characters are doing this.
Also, I have the database set to UTF-8, but when I check the charset:
$charset = mysql_client_encoding($con);
it returns latin1?
Can someone tell me what I am doing wrong here?
Not looking for someone to do it for me.
Just some help figuring out which way to look.
Why is htmlentities() converting wrong?
Hope someone out there can help.
You probably aren't setting your database connection to UTF-8. Try
doing
this before you do anything with the database, after you have
connected:
mysql_query("SET character_set_results=utf8", $dbcnx);
mb_language('uni'); mb_internal_encoding('UTF-8');
mysql_query("SET character_set_results=utf8", $dbcnx);
Toby
No, I hadn't done that! Ok, this is a good point to start from.
Do I set mysql_query("SET character_set_results=utf8", $dbcnx); twice?
Thank you guys for your quick responses!
Best,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 5:02 PM, Govinda wrote: No one? Not even a link I can go look this up myself with? I have successfuly converted before, but this time the company is in the netherlands and their special characters are doing this. Also, I have the database set to UTF-8, but when I check the charset: $charset = mysql_client_encoding($con); it returns latin1? Can someone tell me what I am doing wrong here? Not looking for someone to do it for me. Just some help figuring out which way to look. Why is htmlentities() converting wrong? How are you determining that you are using UTF-8 charset? I think you want to set everything to UTF-8.. the database, the table (or even finer in case any setting has e.g. a column set to another charset), the script files, the HTML output, the browser, *everything*. Just because e.g. one sets the charset in the browser does not mean that Apache (or whatever webserver you are using) is set to serve that charset. -Govinda I believe when the table was set up. This was handed off from others. I will ask. Thanks for the heads up on the difference. Best, Karl DeSaulniers Design Drumm http://designdrumm.com -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
Hey anything is better than nothing. Thanks for the effort.
I will investigate this further. Did not know mysql_real_escape_string
was depreciated.
Good to know.
Thank you!
Best,
Karl
On Aug 9, 2012, at 4:30 PM, Graham H. wrote:
Not sure if this will work any better, but have you tried using
htmlspecialchars instead of htmlentities? http://www.php.net/manual/en/function.htmlspecialchars.php
You should also use mysqli_real_escape_string instead of the older
(and deprecated) mysql_real_escape_string. When you use the mysqli
you'll need to pass in a link to your database as the first
parameter, with the string to be escaped as the second. This will
also require you to use mysqli objects I'm pretty sure (which are
better to be using in the first place). See more about it here: http://ca3.php.net/manual/en/mysqli.real-escape-string.php
Better than nothing? Sorry!
On Thu, Aug 9, 2012 at 3:19 PM, Karl DeSaulniers
wrote:
On Aug 9, 2012, at 5:41 AM, Karl DeSaulniers wrote:
On Aug 9, 2012, at 5:37 AM, Karl DeSaulniers wrote:
Help!
How do I get special characters to convert correctly when inserting
and reading from my database.
For example.
é => é
ë => ë
I keep getting
ë and é
using htmlentities, htmlspecialchars, etc...
Any pointers? Please!
Going bald over here.
here is my funcitons
function stringToMysqlFormat($original_input) {
//for inserting the data with special characters INTO
mysql
$html_encoded =
htmlentities(mysql_real_escape_string($original_input));
return $html_encoded;
}
function mysqlToHTMLFormat($encoded) {
//for displaying the data FROM mysql
$html_decoded =
html_entity_decode(stripslashes($encoded));
return $html_decoded;
}
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
using UTF-8
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
No one?
Not even a link I can go look this up myself with?
I have successfuly converted before, but this time the company
is in the netherlands and their special characters are doing this.
Also, I have the database set to UTF-8, but when I check the charset:
$charset = mysql_client_encoding($con);
it returns latin1?
Can someone tell me what I am doing wrong here?
Not looking for someone to do it for me.
Just some help figuring out which way to look.
Why is htmlentities() converting wrong?
Hope someone out there can help.
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
--
Graham Holtslander
Computer Systems Technologist
www.graham.holtslander.com
mene...@gmail.com
Karl DeSaulniers
Design Drumm
http://designdrumm.com
RE: [PHP-DB] convert special characters.
> -Original Message-
> From: Karl DeSaulniers [mailto:k...@designdrumm.com]
> Sent: Thursday, August 09, 2012 10:19 PM
> To: php-db@lists.php.net
> Subject: Re: [PHP-DB] convert special characters.
>
>
> On Aug 9, 2012, at 5:41 AM, Karl DeSaulniers wrote:
>
> >
> > On Aug 9, 2012, at 5:37 AM, Karl DeSaulniers wrote:
> >
> >> Help!
> >>
> >> How do I get special characters to convert correctly when inserting
> >> and reading from my database.
> >> For example.
> >>
> >> é => é
> >> ë => ë
> >>
> >> I keep getting
> >>
> >> ë and é
> >>
> >> using htmlentities, htmlspecialchars, etc...
> >>
> >> Any pointers? Please!
> >> Going bald over here.
> >>
> >> here is my funcitons
> >>
> >> function stringToMysqlFormat($original_input) {
> >> //for inserting the data with special characters INTO
> >> mysql
> >> $html_encoded =
> >> htmlentities(mysql_real_escape_string($original_input));
> >> return $html_encoded;
> >> }
> >> function mysqlToHTMLFormat($encoded) {
> >> //for displaying the data FROM mysql
> >> $html_decoded =
> >> html_entity_decode(stripslashes($encoded));
> >> return $html_decoded;
> >> }
> >>
> >> TIA,
> >>
> >> Karl DeSaulniers
> >> Design Drumm
> >> http://designdrumm.com
> >>
> >
> >
> > using UTF-8
> >
> >
> > Karl DeSaulniers
> > Design Drumm
> > http://designdrumm.com
> >
> >
> > --
> > PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit:
> > http://www.php.net/unsub.php
> >
>
>
> No one?
> Not even a link I can go look this up myself with?
>
> I have successfuly converted before, but this time the company is in the
> netherlands and their special characters are doing this.
> Also, I have the database set to UTF-8, but when I check the charset:
>
> $charset = mysql_client_encoding($con);
>
> it returns latin1?
>
> Can someone tell me what I am doing wrong here?
> Not looking for someone to do it for me.
> Just some help figuring out which way to look.
>
> Why is htmlentities() converting wrong?
>
> Hope someone out there can help.
You probably aren't setting your database connection to UTF-8. Try doing
this before you do anything with the database, after you have connected:
mysql_query("SET character_set_results=utf8", $dbcnx);
mb_language('uni'); mb_internal_encoding('UTF-8');
mysql_query("SET character_set_results=utf8", $dbcnx);
Toby
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
> > No one? > Not even a link I can go look this up myself with? > > I have successfuly converted before, but this time the company > is in the netherlands and their special characters are doing this. > Also, I have the database set to UTF-8, but when I check the charset: > > $charset = mysql_client_encoding($con); > > it returns latin1? > > Can someone tell me what I am doing wrong here? > Not looking for someone to do it for me. > Just some help figuring out which way to look. > > Why is htmlentities() converting wrong? How are you determining that you are using UTF-8 charset? I think you want to set everything to UTF-8.. the database, the table (or even finer in case any setting has e.g. a column set to another charset), the script files, the HTML output, the browser, *everything*. Just because e.g. one sets the charset in the browser does not mean that Apache (or whatever webserver you are using) is set to serve that charset. -Govinda -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
Not sure if this will work any better, but have you tried using
htmlspecialchars instead of htmlentities?
http://www.php.net/manual/en/function.htmlspecialchars.php
You should also use mysql*i*_real_escape_string instead of the older (and
deprecated) mysql_real_escape_string. When you use the mysqli you'll need
to pass in a link to your database as the first parameter, with the string
to be escaped as the second. This will also require you to use mysqli
objects I'm pretty sure (which are better to be using in the first place).
See more about it here:
http://ca3.php.net/manual/en/mysqli.real-escape-string.php
Better than nothing? Sorry!
On Thu, Aug 9, 2012 at 3:19 PM, Karl DeSaulniers wrote:
>
> On Aug 9, 2012, at 5:41 AM, Karl DeSaulniers wrote:
>
>
>> On Aug 9, 2012, at 5:37 AM, Karl DeSaulniers wrote:
>>
>> Help!
>>>
>>> How do I get special characters to convert correctly when inserting and
>>> reading from my database.
>>> For example.
>>>
>>> é => é
>>> ë => ë
>>>
>>> I keep getting
>>>
>>> ë and é
>>>
>>> using htmlentities, htmlspecialchars, etc...
>>>
>>> Any pointers? Please!
>>> Going bald over here.
>>>
>>> here is my funcitons
>>>
>>> function stringToMysqlFormat($original_**input) {
>>> //for inserting the data with special characters INTO mysql
>>> $html_encoded = htmlentities(mysql_real_**
>>> escape_string($original_input)**);
>>> return $html_encoded;
>>> }
>>> function mysqlToHTMLFormat($encoded) {
>>> //for displaying the data FROM mysql
>>> $html_decoded = html_entity_decode(**
>>> stripslashes($encoded));
>>> return $html_decoded;
>>> }
>>>
>>> TIA,
>>>
>>> Karl DeSaulniers
>>> Design Drumm
>>> http://designdrumm.com
>>>
>>>
>>
>> using UTF-8
>>
>>
>> Karl DeSaulniers
>> Design Drumm
>> http://designdrumm.com
>>
>>
>> --
>> PHP Database Mailing List (http://www.php.net/)
>> To unsubscribe, visit: http://www.php.net/unsub.php
>>
>>
>
> No one?
> Not even a link I can go look this up myself with?
>
> I have successfuly converted before, but this time the company
> is in the netherlands and their special characters are doing this.
> Also, I have the database set to UTF-8, but when I check the charset:
>
> $charset = mysql_client_encoding($con);
>
> it returns latin1?
>
> Can someone tell me what I am doing wrong here?
> Not looking for someone to do it for me.
> Just some help figuring out which way to look.
>
> Why is htmlentities() converting wrong?
>
> Hope someone out there can help.
>
>
> TIA,
>
> Karl DeSaulniers
> Design Drumm
> http://designdrumm.com
>
>
> --
> PHP Database Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>
--
Graham Holtslander
Computer Systems Technologist
www.graham.holtslander.com
mene...@gmail.com
Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 5:41 AM, Karl DeSaulniers wrote:
On Aug 9, 2012, at 5:37 AM, Karl DeSaulniers wrote:
Help!
How do I get special characters to convert correctly when inserting
and reading from my database.
For example.
é => é
ë => ë
I keep getting
ë and é
using htmlentities, htmlspecialchars, etc...
Any pointers? Please!
Going bald over here.
here is my funcitons
function stringToMysqlFormat($original_input) {
//for inserting the data with special characters INTO
mysql
$html_encoded =
htmlentities(mysql_real_escape_string($original_input));
return $html_encoded;
}
function mysqlToHTMLFormat($encoded) {
//for displaying the data FROM mysql
$html_decoded =
html_entity_decode(stripslashes($encoded));
return $html_decoded;
}
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
using UTF-8
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
No one?
Not even a link I can go look this up myself with?
I have successfuly converted before, but this time the company
is in the netherlands and their special characters are doing this.
Also, I have the database set to UTF-8, but when I check the charset:
$charset = mysql_client_encoding($con);
it returns latin1?
Can someone tell me what I am doing wrong here?
Not looking for someone to do it for me.
Just some help figuring out which way to look.
Why is htmlentities() converting wrong?
Hope someone out there can help.
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP-DB] convert special characters.
On Aug 9, 2012, at 5:37 AM, Karl DeSaulniers wrote:
Help!
How do I get special characters to convert correctly when inserting
and reading from my database.
For example.
é => é
ë => ë
I keep getting
ë and é
using htmlentities, htmlspecialchars, etc...
Any pointers? Please!
Going bald over here.
here is my funcitons
function stringToMysqlFormat($original_input) {
//for inserting the data with special characters INTO
mysql
$html_encoded =
htmlentities(mysql_real_escape_string($original_input));
return $html_encoded;
}
function mysqlToHTMLFormat($encoded) {
//for displaying the data FROM mysql
$html_decoded =
html_entity_decode(stripslashes($encoded));
return $html_decoded;
}
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
using UTF-8
Karl DeSaulniers
Design Drumm
http://designdrumm.com
--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
[PHP-DB] convert special characters.
Help!
How do I get special characters to convert correctly when inserting
and reading from my database.
For example.
é => é
ë => ë
I keep getting
ë and é
using htmlentities, htmlspecialchars, etc...
Any pointers? Please!
Going bald over here.
here is my funcitons
function stringToMysqlFormat($original_input) {
//for inserting the data with special characters INTO
mysql
$html_encoded =
htmlentities(mysql_real_escape_string($original_input));
return $html_encoded;
}
function mysqlToHTMLFormat($encoded) {
//for displaying the data FROM mysql
$html_decoded =
html_entity_decode(stripslashes($encoded));
return $html_decoded;
}
TIA,
Karl DeSaulniers
Design Drumm
http://designdrumm.com
