A NOTE has been added to this issue. ====================================================================== http://www.dbmail.org/mantis/view.php?id=401 ====================================================================== Reported By: yuen Assigned To: ====================================================================== Project: DBMail Issue ID: 401 Category: Database layer Reproducibility: sometimes Severity: minor Priority: normal Status: new target: ====================================================================== Date Submitted: 23-Aug-06 06:05 CEST Last Modified: 30-Sep-06 19:03 CEST ====================================================================== Summary: invalid byte sequence for dbmail_headervalue when database is utf-8 encoded Description: In 2.1.7 there are bytea type for messageblk, so I hope that I can finally use unicode based database, but dbmail-util -by throws errors on some headers, that contain non latin charakters: .......................................................................Error dbpgsql.c, db_query: Error executing query [INSERT INTO mail.dbmail_headervalue (headername_id, physmessage_id, headervalue) VALUES (2,4638,'&http://www.dbmail.org/mantis/view.php?id=272;Ç&http://www.dbmail.org/mantis/view.php?id=262;Ú&http://www.dbmail.org/mantis/view.php?id=268;&http://www.dbmail.org/mantis/view.php?id=336;, 15 &http://www.dbmail.org/mantis/view.php?id=327;&http://www.dbmail.org/mantis/view.php?id=357;ÔÂ 2006 23:33:59 +0100')] : [ERROR: invalid byte sequence for encoding "UTF8": 0xd0c7
====================================================================== Relationships ID Summary ---------------------------------------------------------------------- related to 0000338 The header indication is broken in some... ====================================================================== ---------------------------------------------------------------------- paul - 03-Sep-06 14:34 ---------------------------------------------------------------------- This is most likely caused by incorrect truncation of these headervalues. Please test revision 2250. ---------------------------------------------------------------------- yuen - 18-Sep-06 01:59 ---------------------------------------------------------------------- header values are ok in 2270, but there are exactly same problems with cached envelopes :( ---------------------------------------------------------------------- paul - 18-Sep-06 09:14 ---------------------------------------------------------------------- Yuen, The envelope cache uses the same setup as the headervalues cache. Please provide more details. ---------------------------------------------------------------------- yuen - 18-Sep-06 12:07 ---------------------------------------------------------------------- Error dbpgsql.c, db_query: Error executing query [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES (210,'("Fri, 30 Sep 2005 15:59:10 +0200" {49} Fwd: FW: Když se ti šprajcne, tak ho postr&http://www.dbmail.org/mantis/view.php?id=269; myší. ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "randol" "post.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "jesensky.milan" "post.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL "mranostaj" "vub.sk")(NIL NIL "turkotka" "seznam.cz")(NIL NIL "mia04" "orangemail.sk")(NIL NIL "jhrkutova" "zoznam.sk")(NIL NIL "Majka55" "post.sk")) NIL NIL NIL "<S51790421AbVI3N7K/[EMAIL PROTECTED]>")')] : [ERROR: invalid byte sequence for encoding "UTF8": 0xbe ] Error dbmail-message.c,dbmail_message_cache_envelope: insert envelope failed [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES (210,'("Fri, 30 Sep 2005 15:59:10 +0200" {49} Fwd: FW: Když se ti šprajcne, tak ho postr&http://www.dbmail.org/mantis/view.php?id=269; myší. ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "randol" "post.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "jesensky.milan" "post.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL "mranostaj" "vub.sk")(NIL NIL "turkotka" "seznam.cz")(NIL NIL "mia04" "orangemail.sk")(NIL NIL "jhrkutova" "zoznam.sk")(NIL NIL "Majka55" "post.sk")) NIL NIL NIL "<S51790421AbVI3N7K/[EMAIL PROTECTED]>")')] ...Error dbpgsql.c, db_query: Error executing query [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES (213,'("Fri, 30 Sep 2005 16:21:42 +0200" {41} Fwd: FW: Ako prinúti&http://www.dbmail.org/mantis/view.php?id=357; kravu, aby žiarlila ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mranostaj" "vub.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL "jesensky.milan" "post.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "randol" "post.sk")) NIL NIL NIL "<S51789888AbVI3OVn/[EMAIL PROTECTED]>")')] : [ERROR: invalid byte sequence for encoding "UTF8": 0xfa7469bb20 ] Error dbmail-message.c,dbmail_message_cache_envelope: insert envelope failed [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES (213,'("Fri, 30 Sep 2005 16:21:42 +0200" {41} Fwd: FW: Ako prinúti&http://www.dbmail.org/mantis/view.php?id=357; kravu, aby žiarlila ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mranostaj" "vub.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL "jesensky.milan" "post.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "randol" "post.sk")) NIL NIL NIL "<S51789888AbVI3OVn/[EMAIL PROTECTED]>")')] .Error dbpgsql.c, db_query: Error executing query [INSERT INTO mail.dbmail_envelope (physmessage_id, envelope) VALUES (214,'("Fri, 30 Sep 2005 16:25:28 +0200" {85} Fwd: FW: Ako prin&http://www.dbmail.org/mantis/view.php?id=258;"âšÄ&http://www.dbmail.org/mantis/view.php?id=261;&http://www.dbmail.org/mantis/view.php?id=313;&http://www.dbmail.org/mantis/view.php?id=351;ti&http://www.dbmail.org/mantis/view.php?id=258;"Ä&http://www.dbmail.org/mantis/view.php?id=258;"âž kravu, aby &http://www.dbmail.org/mantis/view.php?id=258;"Ä&http://www.dbmail.org/mantis/view.php?id=258;"Ä&http://www.dbmail.org/mantis/view.php?id=318;iarlila ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mjesensky" "centrum.sk")) ((NIL NIL "mranostaj" "vub.sk")(NIL NIL "bajzicek" "centrum.sk")(NIL NIL "martin.fafalak" "centrum.sk")(NIL NIL "jesensky.milan" "post.sk")(NIL NIL "adamm" "inMail.sk")(NIL NIL "randol" "post.sk")) NIL NIL NIL "<S51791281AbVI3OZ2/[EMAIL PROTECTED]>")')] : [ERROR: invalid byte sequence for encoding "UTF8": 0xc326 ] ---------------------------------------------------------------------- paul - 30-Sep-06 19:03 ---------------------------------------------------------------------- Yuen, Please test svn 2283. I think this was fixed last week. The subject part wasn't encoded correctly. Issue History Date Modified Username Field Change ====================================================================== 23-Aug-06 06:05 yuen New Issue 24-Aug-06 02:20 yuen Issue Monitored: yuen 03-Sep-06 14:32 paul Relationship added related to 0000338 03-Sep-06 14:34 paul Note Added: 0001388 18-Sep-06 01:59 yuen Note Added: 0001405 18-Sep-06 09:14 paul Note Added: 0001406 18-Sep-06 12:07 yuen Note Added: 0001407 18-Sep-06 12:09 yuen File Added: error_message.txt 30-Sep-06 19:03 paul Note Added: 0001427 ======================================================================