A NOTE has been added to this issue. 
====================================================================== 
http://www.dbmail.org/mantis/view.php?id=401 
====================================================================== 
Reported By:                yuen
Assigned To:                
====================================================================== 
Project:                    DBMail
Issue ID:                   401
Category:                   Database layer
Reproducibility:            sometimes
Severity:                   minor
Priority:                   normal
Status:                     new
target:                      
====================================================================== 
Date Submitted:             23-Aug-06 06:05 CEST
Last Modified:              30-Sep-06 19:03 CEST
====================================================================== 
Summary:                    invalid byte sequence for dbmail_headervalue when
database is utf-8 encoded
Description: 
In 2.1.7 there are bytea type for messageblk, so I hope that I can finally
use unicode based database, but dbmail-util -by throws errors on some
headers, that contain non latin charakters:
.......................................................................Error
dbpgsql.c, db_query: Error executing query [INSERT INTO
mail.dbmail_headervalue (headername_id, physmessage_id, headervalue)
VALUES
(2,4638,'&http://www.dbmail.org/mantis/view.php?id=272;Ç&http://www.dbmail.org/mantis/view.php?id=262;Ú&http://www.dbmail.org/mantis/view.php?id=268;&http://www.dbmail.org/mantis/view.php?id=336;,
15
&http://www.dbmail.org/mantis/view.php?id=327;&http://www.dbmail.org/mantis/view.php?id=357;ÔÂ
2006
23:33:59 +0100')] : [ERROR:  invalid byte sequence for encoding "UTF8":
0xd0c7

======================================================================
Relationships       ID      Summary
----------------------------------------------------------------------
related to          0000338 The header indication is broken in some...
====================================================================== 

---------------------------------------------------------------------- 
 paul - 03-Sep-06 14:34  
---------------------------------------------------------------------- 
This is most likely caused by incorrect truncation of these headervalues.
Please test revision 2250. 

---------------------------------------------------------------------- 
 yuen - 18-Sep-06 01:59  
---------------------------------------------------------------------- 
header values are ok in 2270, but there are exactly same problems with
cached envelopes :( 

---------------------------------------------------------------------- 
 paul - 18-Sep-06 09:14  
---------------------------------------------------------------------- 
Yuen,

The envelope cache uses the same setup as the headervalues cache. Please
provide more details. 

---------------------------------------------------------------------- 
 yuen - 18-Sep-06 12:07  
---------------------------------------------------------------------- 
Error dbpgsql.c, db_query: Error executing query [INSERT INTO
mail.dbmail_envelope (physmessage_id, envelope) VALUES (210,'("Fri, 30 Sep
2005 15:59:10 +0200" {49}
Fwd: FW: Když se ti šprajcne, tak ho
postr&http://www.dbmail.org/mantis/view.php?id=269; myší. ((NIL NIL
"mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL
"mjesensky" "centrum.sk")) ((NIL NIL "randol" "post.sk")(NIL NIL
"martin.fafalak" "centrum.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL
"jesensky.milan" "post.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL
"mranostaj" "vub.sk")(NIL NIL "turkotka" "seznam.cz")(NIL NIL "mia04"
"orangemail.sk")(NIL NIL "jhrkutova" "zoznam.sk")(NIL NIL "Majka55"
"post.sk")) NIL NIL NIL
"<S51790421AbVI3N7K/[EMAIL PROTECTED]>")')] : [ERROR:
 invalid byte sequence for encoding "UTF8": 0xbe
]

Error dbmail-message.c,dbmail_message_cache_envelope: insert envelope
failed [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES
(210,'("Fri, 30 Sep 2005 15:59:10 +0200" {49}
Fwd: FW: Když se ti šprajcne, tak ho
postr&http://www.dbmail.org/mantis/view.php?id=269; myší. ((NIL NIL
"mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL
"mjesensky" "centrum.sk")) ((NIL NIL "randol" "post.sk")(NIL NIL
"martin.fafalak" "centrum.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL
"jesensky.milan" "post.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL
"mranostaj" "vub.sk")(NIL NIL "turkotka" "seznam.cz")(NIL NIL "mia04"
"orangemail.sk")(NIL NIL "jhrkutova" "zoznam.sk")(NIL NIL "Majka55"
"post.sk")) NIL NIL NIL
"<S51790421AbVI3N7K/[EMAIL PROTECTED]>")')]
...Error dbpgsql.c, db_query: Error executing query [INSERT INTO
mail.dbmail_envelope (physmessage_id, envelope) VALUES (213,'("Fri, 30 Sep
2005 16:21:42 +0200" {41}
Fwd: FW: Ako prinúti&http://www.dbmail.org/mantis/view.php?id=357; kravu, aby
žiarlila ((NIL NIL "mjesensky"
"centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky"
"centrum.sk")) ((NIL NIL "mranostaj" "vub.sk")(NIL NIL "bajzicek"
"centrum.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL
"jesensky.milan" "post.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "randol"
"post.sk")) NIL NIL NIL
"<S51789888AbVI3OVn/[EMAIL PROTECTED]>")')] : [ERROR:
 invalid byte sequence for encoding "UTF8": 0xfa7469bb20
]

Error dbmail-message.c,dbmail_message_cache_envelope: insert envelope
failed [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES
(213,'("Fri, 30 Sep 2005 16:21:42 +0200" {41}
Fwd: FW: Ako prinúti&http://www.dbmail.org/mantis/view.php?id=357; kravu, aby
žiarlila ((NIL NIL "mjesensky"
"centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky"
"centrum.sk")) ((NIL NIL "mranostaj" "vub.sk")(NIL NIL "bajzicek"
"centrum.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL
"jesensky.milan" "post.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "randol"
"post.sk")) NIL NIL NIL
"<S51789888AbVI3OVn/[EMAIL PROTECTED]>")')]
.Error dbpgsql.c, db_query: Error executing query [INSERT INTO
mail.dbmail_envelope (physmessage_id, envelope) VALUES (214,'("Fri, 30 Sep
2005 16:25:28 +0200" {85}
Fwd: FW: Ako
prin&http://www.dbmail.org/mantis/view.php?id=258;&quot;âšÄ&http://www.dbmail.org/mantis/view.php?id=261;&http://www.dbmail.org/mantis/view.php?id=313;&http://www.dbmail.org/mantis/view.php?id=351;ti&http://www.dbmail.org/mantis/view.php?id=258;&quot;Ä&http://www.dbmail.org/mantis/view.php?id=258;&quot;âž
kravu,
aby
&http://www.dbmail.org/mantis/view.php?id=258;&quot;Ä&http://www.dbmail.org/mantis/view.php?id=258;&quot;Ä&http://www.dbmail.org/mantis/view.php?id=318;iarlila
((NIL NIL "mjesensky"
"centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky"
"centrum.sk")) ((NIL NIL "mranostaj" "vub.sk")(NIL NIL "bajzicek"
"centrum.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL
"jesensky.milan" "post.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "randol"
"post.sk")) NIL NIL NIL
"<S51791281AbVI3OZ2/[EMAIL PROTECTED]>")')] : [ERROR:
 invalid byte sequence for encoding "UTF8": 0xc326
] 

---------------------------------------------------------------------- 
 paul - 30-Sep-06 19:03  
---------------------------------------------------------------------- 
Yuen,

Please test svn 2283. I think this was fixed last week. The subject part
wasn't encoded correctly. 

Issue History 
Date Modified   Username       Field                    Change               
====================================================================== 
23-Aug-06 06:05 yuen           New Issue                                    
24-Aug-06 02:20 yuen           Issue Monitored: yuen                        
03-Sep-06 14:32 paul           Relationship added       related to 0000338  
03-Sep-06 14:34 paul           Note Added: 0001388                          
18-Sep-06 01:59 yuen           Note Added: 0001405                          
18-Sep-06 09:14 paul           Note Added: 0001406                          
18-Sep-06 12:07 yuen           Note Added: 0001407                          
18-Sep-06 12:09 yuen           File Added: error_message.txt                    
30-Sep-06 19:03 paul           Note Added: 0001427                          
======================================================================

Reply via email to