Hi.

so I got around to look this up now finally. here's what I found in the
attachment.

Please let me know if you need anything else.

Regards

<quote who="Paul J Stevens">
> Thomas,
>
> Please provide if you can:
>
> - the raw Message-ID for the message involved.
> - your dbmail and gmime versions.
>
> DBMail already tries very hard to always provide the database with a
> correct encoded string. It does rely on GMime however to provide UTF8
> encoded representations of any message fed. Maybe a bug in GMime is
> exposed here.
>
>
> On 05/05/2013 10:39 PM, Thomas Raschbacher wrote:
>> hi.
>>
>> I just ran dbmail-util to check for errors/header stuff and I keep
>> getting the following errors:
>>
>> Error when running dbmail-util -tbvy:
>>
>> Repairing DBMAIL for cached envelopes...
>> Ok. Found [1] missing envelope values.
>> May 05 22:33:11 lordvan.com dbmail-util[20498]: [0xb0b6c0]
>> Error:[message] dbmail_message_cache_envelope(+1840): SQLException:
>> ERROR:  invalid byte sequence for encoding "UTF8": 0xbd
>>
>> May 05 22:33:11 lordvan.com dbmail-util[20498]: [0xb0b6c0]
>> Error:[message] dbmail_message_cache_envelope(+1842): insert envelope
>> failed [("Mon, 29 Apr 2013 14:25:21 +0900" "You have a new PRIVATE
>> MESSAGE!" (("Notification" NIL "B58CD62FB" "ando-sayaka.net"))
>> (("Notification" NIL "B58CD62FB" "ando-sayaka.net")) ((NIL NIL
>> "64A208281" "amcustomersupport.com")) (("User python" NIL "python"
>> "gentoo.org")) NIL NIL NIL {44}
>> <DDB21ED5-3852-1239-87AE-1FD5471AFC18@½Ã
>> ÃÃ3>)]
>> ..--- checking envelope cache took 0 seconds
>>
>>
>> The message is junk mail anyway, but what bothers me is the error
>> itself
>> and how an invalid byte sequence did get this far - and if dbmail-util
>> shouldn't somehow be able to fix this as I think this means I do not
>> see
>> this in my message lists since there is no header cache correct?
>>
>> I think it might be good if at least dbmail-util could fix these
>> automatically by replacing them with something valid instead ?
>>
>> Regards
>> _______________________________________________
>> DBmail mailing list
>> [email protected]
>> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>
>
> --
> ________________________________________________________________
> Paul J Stevens        pjstevns @ gmail, twitter, skype, linkedin
>
>   * Premium Hosting Services and Web Application Consultancy *
>
>            www.nfg.nl/[email protected]/+31.85.877.99.97
> ________________________________________________________________
> _______________________________________________
> DBmail mailing list
> [email protected]
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>


-- 
I don't suffer from insanity - I enjoy every minute of it
physmessage_id |    id    |                                                     
                                                                                
                envelope                                                        
                                                                                
             
----------------+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
       26422599 | 26439149 | ("Mon, 29 Apr 2013 03:36:07 +0300" "You have a new 
PRIVATE MESSAGE!" (("Notification" NIL "AD2B166" "aoireland.ie")) 
(("Notification" NIL "AD2B166" "aoireland.ie")) ((NIL NIL "1012B87" 
"alvida.ru")) (("User lordvan" NIL "lordvan" "gentoo.org")) NIL NIL NIL 
"<61580CEF-ED37-3454-9F37-A95E702331C9@PC-PC>")
(1 Zeile)

dbmail=# select * from dbmail_partlists where physmessage_id=26422599;
 physmessage_id | is_header | part_key | part_depth | part_order | part_id 
----------------+-----------+----------+------------+------------+---------
       26422599 |         0 |        3 |          0 |          2 |       7
       26422599 |         0 |        3 |          1 |          1 |  731538
       26422599 |         1 |        3 |          1 |          0 |    1898
       26422599 |         0 |        2 |          1 |          1 |  731537
       26422599 |         1 |        2 |          1 |          0 |    1896
       26422599 |         1 |        1 |          0 |          0 |  731536

and since I am lazy:

 select dm.* from dbmail_mimeparts as dm INNER JOIN (select part_id from 
dbmail_partlists where physmessage_id = 26422599) dp on (dm.id = dp.part_id);
 
    id   |                                                                      
                                                         hash                   
                                                                                
                            |                                                   
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                     data       
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                  | size 
--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------
      7 | da39a3ee5e6b4b0d3255bfef95601890afd80709                              
                                                                                
                                                                                
                           |                                                    
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                 |    0
 731538 | 95be20cc32369990abbf1f12cea59be48c7b958b                              
                                                                                
                                                                                
                           | <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 
Transitional//EN" 
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";>\015\012<html 
xmlns="http://www.w3.org/1999/xhtml";>\015\012\015\012<head>\015\012<meta 
content="en-us" http-equiv="Content-Language" />\015\012<meta 
content="text/html; charset=utf-8" http-equiv="Content-Type" 
/>\015\012<title>PRIVATE 
MESSAGE</title>\015\012</head>\015\012\015\012<body>\015\012\015\012<p>\015\012<span
 style="font-family: Cambria, Cochin, Georgia, Times, 'Times New Roman', 
serif">\015\012<strong>lordvan, you have a new PRIVATE 
MESSAGE!</strong></span><br style="font-family: Cambria, Cochin, Georgia, 
Times, 'Times New Roman', serif" />\015\012</p>\015\012<p>\015\012<span 
style="font-family: Cambria, Cochin, Georgia, Times, 'Times New Roman', serif; 
text-decoration: underline">\015\012<strong>Alina</strong></span><br 
style="font-family: Cambria, Cochin, Georgia, Times, 'Times New Roman', serif" 
/>\015\012<span style="font-family: Cambria, Cochin, Georgia, Times, 'Times New 
Roman', serif">\015\012PROFILE HEADLINE:</span><br style="font-family: Cambria, 
Cochin, Georgia, Times, 'Times New Roman', serif" />\015\012<span 
style="font-family: Cambria, Cochin, Georgia, Times, 'Times New Roman', 
serif">\015\012<em>Damsel in distress seeking hero </em></span><em>\015\012<br 
style="font-family: Cambria, Cochin, Georgia, Times, 'Times New Roman', serif" 
/>\015\012</em>\015\012<span style="font-family: Cambria, Cochin, Georgia, 
Times, 'Times New Roman', serif">\015\012<em>turtlehero has authorized you to 
view private photos &amp; videos.</em></span><br style="font-family: Cambria, 
Cochin, Georgia, Times, 'Times New Roman', serif" />\015\012<br 
style="font-family: Cambria, Cochin, Georgia, Times, 'Times New Roman', serif" 
/>\015\012<span style="font-family: Cambria, Cochin, Georgia, Times, 'Times New 
Roman', serif">\015\012<a title="Read message" 
href="http://www.awbdating.ru/?E4ACFC5=638AE757C1C68242B"; target="_blank">VIEW 
MEGGAGE</a></span></p>\015\012\015\012</body>\015\012\015\012</html>\015\012
   1898 | c169ed4434d16e0636db3e10a2f081552aa97218                              
                                                                                
                                                                                
                           | Content-Type: text/html; 
charset=utf-8\015\012Content-Transfer-Encoding: 7bit\015\012                    
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                           |   73
 731537 | 38273595c6dff375810675e0770dcafa98fbe798                              
                                                                                
                                                                                
                           | lordvan, you have a new PRIVATE 
MESSAGE!\015\012\015\012Alina\015\012PROFILE HEADLINE:\015\012Damsel in 
distress seeking hero\015\012turtlehero has authorized you to view private 
photos & videos.\015\012\015\012VIEW 
MEGGAGE\015\012http://www.awodating.ru/?C82CFE=53CA74CE88264AA\015\012          
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                            |  232
   1896 | e67a16b5793237e42a24ad949ef4dcc76b35dce9                              
                                                                                
                                                                                
                           | Content-Type: text/plain; 
charset=utf-8\015\012Content-Transfer-Encoding: 7bit\015\012                    
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                          |   74
 731536 | 52ee89912a0f2ae2fe13f8b4b8bf65d6b21da71d                              
                                                                                
                                                                                
                           | Received: from smtp.gentoo.org (smtp.gentoo.org 
[140.211.166.183])\011(using TLSv1\012\011with cipher ADH-AES256-SHA (256/256 
bits))\011(No client certificate requested)\012\011by mail.lordvan.com 
(Postfix) with ESMTPS id 74F8A20076\012\011for <[email protected]>; Mon, 29 
Apr 2013 02:38:14 +0200 (CEST)\012Received: by smtp.gentoo.org (Postfix)\011id 
1BD7333DF8A;\012\011Mon, 29 Apr 2013 00:36:25 +0000 (UTC)\012Delivered-To: 
[email protected]\012Received: from localhost (localhost 
[127.0.0.1])\012\011by smtp.gentoo.org (Postfix) with ESMTP id 
15A8133DF89\012\011for <[email protected]>; Mon, 29 Apr 2013 00:36:25 +0000 
(UTC)\012X-Virus-Scanned: by amavisd-new using ClamAV at 
gentoo.org\012X-Spam-Flag: YES\012X-Spam-Score: 11.11\012X-Spam-Level: 
***********\012X-Spam-Status: Yes, score=11.11 tagged_above=-999 
required=5.5\012\011tests=[DCC_CHECK=1.1, DIGEST_MULTIPLE=0.001, 
HTML_MESSAGE=0.001,\012\011RAZOR2_CF_RANGE_51_100=0.365, 
RAZOR2_CF_RANGE_E8_51_100=2.43,\012\011RAZOR2_CHECK=1.729, RCVD_IN_PBL=3.558, 
RDNS_NONE=1.274,\012\011SPF_NEUTRAL=0.652] autolearn=no\012Received: from 
smtp.gentoo.org ([IPv6:::ffff:127.0.0.1])\012\011by localhost (smtp.gentoo.org 
[IPv6:::ffff:127.0.0.1]) (amavisd-new, port 10024)\012\011with ESMTP id 
MmClXh5qYieq for <[email protected]>;\012\011Mon, 29 Apr 2013 00:36:19 +0000 
(UTC)\012Received: from [109.83.161.72] (unknown [31.167.211.207])\012\011by 
smtp.gentoo.org (Postfix) with ESMTP id C3BB833DF85\012\011for 
<[email protected]>; Mon, 29 Apr 2013 00:36:13 +0000 (UTC)\012From: 
Notification <[email protected]>\012Reply-To: [email protected]\012To: User 
lordvan <[email protected]>\012Subject: You have a new PRIVATE 
MESSAGE!\012Date: Mon, 29 Apr 2013 03:36:07 +0300\012X-Mailer: BM23 
Mail\012List-Unsubscribe: <mailto:[email protected]>\012X-campaignID: 
bm23_8E0779C49BC6F904EC4A198DE13DA\012x-pviq: 
000330-000347-000657-000165-868254\012Message-ID: 
<61580CEF-ED37-3454-9F37-A95E702331C9@PC-PC>\012MIME-Version: 
1.0\012Return-Path: [email protected]\012Content-Type: 
multipart/alternative;\012\011boundary="==Multipart_Boundary_133029320722152898092340"\012Content-Transfer-Encoding:
 7BIT\012 | 1983
(6 Zeilen)


Here's the error again:

Repairing DBMAIL for cached envelopes...
Ok. Found [1] missing envelope values.
May 16 18:42:51 lordvan.com dbmail-util[25088]: [0x106d2d0] Error:[message] 
dbmail_message_cache_envelope(+1840): SQLException: ERROR:  invalid byte 
sequence for encoding "UTF8": 0xbd

May 16 18:42:51 lordvan.com dbmail-util[25088]: [0x106d2d0] Error:[message] 
dbmail_message_cache_envelope(+1842): insert envelope failed [("Mon, 29 Apr 
2013 14:25:21 +0900" "You have a new PRIVATE MESSAGE!" (("Notification" NIL 
"B58CD62FB" "ando-sayaka.net")) (("Notification" NIL "B58CD62FB" 
"ando-sayaka.net")) ((NIL NIL "64A208281" "amcustomersupport.com")) (("User 
python" NIL "python" "gentoo.org")) NIL NIL NIL {44}
<DDB21ED5-3852-1239-87AE-1FD5471AFC18@½ÅÀÔ3>)]
.--- checking envelope cache took 0 seconds


dev-db/libzdb-2.10.5  USE="-mysql postgres sqlite sqliteunlock ssl -debug -doc 
-static-libs" 
net-mail/dbmail-3.0.2  USE="python sieve sqlite ssl -ldap -static"
app-crypt/gpgme-1.3.2:1  USE="-common-lisp -static-libs"
dev-libs/gmime-2.4.32:2.4 USE="-doc -mono -static-libs"
_______________________________________________
DBmail mailing list
[email protected]
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Reply via email to