Re: [Dbmail] Reply for IMAP Mail shows no e-mail address, only real name
Am 01.05.2013 14:49, schrieb Paul J Stevens: On 05/01/2013 01:43 PM, Michael Monnerie wrote: Sorry for the long delay, I had to wait to get a customer report, now I have it. This time, the mail has an attachment, which show correctly in squirrelmail, but in Apple Mail, the user sees the attachment as characters, like this: I don't understand. Did the customer forward the 'broken' message as an attachment? If so, that doesn't help. No, I directly logged in to their webmail, moved that message to a test folder, and did what you wanted. Also, I don't see how incorrect displaying of the email address relates to the behavior you describe: incorrect display of an attachment. Both errors only appear since we changed the mailserver from cyrus to dbmail. Before that, there have been no such problems, and the former server was in production for 5+ years. So at least there's some ... incompatibility between Apple Mail and dbmail 3.0.2, but it happens rather seldom. They are about 35 heavy mail users, and only sometimes is a mail damaged. Customer has a 2nd PC at home (also Mac), and he said it happens he can't read a mail at home but it works in the office... and that's puzzling. [snipped the beginning of the mail] Diese e-mail wurde über den Zarafa Server der Protéger.at gesendet. http://proteger.at/ Facebook: http://facebook.com/protegerat --=_WtFvmGI2rTzutjLsHAtaeo9sz4Tyl3bIP+ma6GbtGdrwCgva Content-Type: application/pdf; name 13_606.pdf;name*=iso-8859-1''%32%30%31%33%5F%36%30%36%2E%70%64%66 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename 13_606.pdf; filename*=iso-8859-1''%32%30%31%33%5F%36%30%36%2E%70%64%66 JVBERi0xLjMNCjEgMCBvYmoNCjw8IA0KL0xlbmd0aCA0NjkwDQovRmlsdGVyIC9GbGF0ZURl So I guess there's a problem between mail content and attachment beginning? What makes you think so? Because the mail client displays the whole mail content, while it should recognize the end of mail text, and recognize the rest as an attachment and display it correctly. Currently it shows the attachment inline, which doesn't help too much if you want to read the PDF as a human ;-) I'm sorry for the formatting - Thunderbird is new to me. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Reply for IMAP Mail shows no e-mail address, only real name
Am 28.02.2013 12:53, schrieb Paul J Stevens: On 02/28/2013 09:47 AM, Michael Monnerie wrote: Hello, we still see this bug occuring frequently. Users cannot reply to an address, as only the users real name is written there instead the e-mail address. Is this a dbmail problem or in some library? Any hint would be good so I can solve it. As I asked before in this thread: help make it reproducible by obtaining the IMAP-envelope and full headers of the original message, since my only hypothesis is that the envelope is incorrect. copy the broken message to a 'test' mailfolder, then: nc imapserver imapserver x login username password x select test x fetch * envelope x fetch * rfc822.header x logout Sorry for the long delay, I had to wait to get a customer report, now I have it. This time, the mail has an attachment, which show correctly in squirrelmail, but in Apple Mail, the user sees the attachment as characters, like this: [snipped the beginning of the mail] Diese e-mail wurde über den Zarafa Server der Protéger.at gesendet. http://proteger.at/ Facebook: http://facebook.com/protegerat --=_WtFvmGI2rTzutjLsHAtaeo9sz4Tyl3bIP+ma6GbtGdrwCgva Content-Type: application/pdf; name 13_606.pdf;name*=iso-8859-1''%32%30%31%33%5F%36%30%36%2E%70%64%66 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename 13_606.pdf; filename*=iso-8859-1''%32%30%31%33%5F%36%30%36%2E%70%64%66 JVBERi0xLjMNCjEgMCBvYmoNCjw8IA0KL0xlbmd0aCA0NjkwDQovRmlsdGVyIC9GbGF0ZURl So I guess there's a problem between mail content and attachment beginning? Here the part that you wanted, I'm not sure its interesting in this case: x fetch * envelope x fetch * rfc822.header * 8546 EXISTS * 0 RECENT * FLAGS (\Seen \Answered \Deleted \Flagged \Draft $Forwarded $Junk $NotJunk Forwarded Junk JunkRecorded NotJunk) * OK [PERMANENTFLAGS (\Seen \Answered \Deleted \Flagged \Draft $Forwarded $Junk $NotJunk Forwarded Junk JunkRecorded NotJunk \*)] Flags allowed. * OK [UIDNEXT 499203] Predicted next UID * OK [UIDVALIDITY 85] UID value * OK [UNSEEN 1] first unseen message x OK [READ-WRITE] SELECT completed * 8546 FETCH (ENVELOPE ("Wed, 01 May 2013 13:30:37 +0200" "=?iso-8859-1?Q?AW=3A_Rechnung_2013-606?=" (("=?iso-8859-1?Q?Buchhaltung_Prot=E9ger=2Eat?=" NIL "buchhaltung" "is.it-management.at")) (("=?iso-8859-1?Q?Michael_Monnerie?=" NIL "michael.monnerie" "is.it-management.at")) (("=?iso-8859-1?Q?Buchhaltung_Prot=E9ger=2Eat?=" NIL "buchhaltung" "is.it-management.at")) (("=?iso-8859-1?Q?Michael_Braunstorfer?=" NIL "mib" "viennapaint.com")) NIL NIL "" "")) x OK FETCH completed * 8546 FETCH (RFC822.HEADER {2148} Received: from protegate54.zmi.at (protegate54.zmi.at [212.69.164.56]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "protegate5.zmi.at", Issuer "power4u.zmi.at" (not verified)) by mail.viennapaint.com (Postfix) with ESMTPS id 45C4F1800099 for ; Wed, 1 May 2013 13:30:37 +0200 (CEST) X-Envelope-From: buchhalt...@is.it-management.at Received: from localhost (localhost [127.0.0.1]) by protegate54.zmi.at (Postfix) with ESMTP id A5A27145E2 for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) X-Virus-Scanned: amavisd-new at zmi.at Received: from protegate54.zmi.at ([127.0.0.1]) by localhost (protegate54.zmi.at [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 8CieKmD8TV4c for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) X-Envelope-From: buchhalt...@is.it-management.at Received: from zarafa16.zmi.at (zarafa16.zmi.at [212.69.164.59]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "zarafa1.zmi.at", Issuer "PositiveSSL CA 2" (verified OK)) by protegate54.zmi.at (Postfix) with ESMTPS id 6DAF2145E1 for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) Received: from zarafa16.zmi.at (localhost [127.0.0.1]) by zarafa16.zmi.at (Postfix) with ESMTP id 563C118A03A5 for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) Subject: =?iso-8859-1?Q?AW=3A_Rechnung_2013-606?= From: Buchhaltung =?iso-8859-1?q?Prot=E9ger=2Eat?= To: Michael Braunstorfer Date: Wed, 1 May 2013 13:30:37 +0200 In-Reply-To: References: X-Priority: 3 (Normal) X-Mailer: Zarafa 7.1.4-41394 Thread-Index: Ac5GX0fCT0/rBV9YR+CeaMHxt3bvGw== Sender: Michael Monnerie Message-Id: Return-Path: buchhalt...@is.it-management.at MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable ) x OK FETCH completed x logout * BYE x OK LOGOUT completed ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Reply for IMAP Mail shows no e-mail address, only real name
Am 28.02.2013 12:53, schrieb Paul J Stevens: On 02/28/2013 09:47 AM, Michael Monnerie wrote: Hello, we still see this bug occuring frequently. Users cannot reply to an address, as only the users real name is written there instead the e-mail address. Is this a dbmail problem or in some library? Any hint would be good so I can solve it. As I asked before in this thread: help make it reproducible by obtaining the IMAP-envelope and full headers of the original message, since my only hypothesis is that the envelope is incorrect. copy the broken message to a 'test' mailfolder, then: nc imapserver imapserver x login username password x select test x fetch * envelope x fetch * rfc822.header x logout Sorry for the long delay, I had to wait to get a customer report, now I have it. This time, the mail has an attachment, which show correctly in squirrelmail, but in Apple Mail, the user sees the attachment as characters, like this: > [snipped the beginning of the mail] > Diese e-mail wurde über den Zarafa Server der Protéger.at gesendet. > http://proteger.at/ Facebook: http://facebook.com/protegerat > > > --=_WtFvmGI2rTzutjLsHAtaeo9sz4Tyl3bIP+ma6GbtGdrwCgva > Content-Type: application/pdf; name 13_606.pdf;name*=iso-8859-1''%32%30%31%33%5F%36%30%36%2E%70%64%66 > Content-Transfer-Encoding: base64 > Content-Disposition: attachment; filename 13_606.pdf; > filename*=iso-8859-1''%32%30%31%33%5F%36%30%36%2E%70%64%66 > > JVBERi0xLjMNCjEgMCBvYmoNCjw8IA0KL0xlbmd0aCA0NjkwDQovRmlsdGVyIC9GbGF0ZURl So I guess there's a problem between mail content and attachment beginning? Here the part that you wanted, I'm not sure its interesting in this case: x fetch * envelope x fetch * rfc822.header * 8546 EXISTS * 0 RECENT * FLAGS (\Seen \Answered \Deleted \Flagged \Draft $Forwarded $Junk $NotJunk Forwarded Junk JunkRecorded NotJunk) * OK [PERMANENTFLAGS (\Seen \Answered \Deleted \Flagged \Draft $Forwarded $Junk $NotJunk Forwarded Junk JunkRecorded NotJunk \*)] Flags allowed. * OK [UIDNEXT 499203] Predicted next UID * OK [UIDVALIDITY 85] UID value * OK [UNSEEN 1] first unseen message x OK [READ-WRITE] SELECT completed * 8546 FETCH (ENVELOPE ("Wed, 01 May 2013 13:30:37 +0200" "=?iso-8859-1?Q?AW=3A_Rechnung_2013-606?=" (("=?iso-8859-1?Q?Buchhaltung_Prot=E9ger=2Eat?=" NIL "buchhaltung" "is.it-management.at")) (("=?iso-8859-1?Q?Michael_Monnerie?=" NIL "michael.monnerie" "is.it-management.at")) (("=?iso-8859-1?Q?Buchhaltung_Prot=E9ger=2Eat?=" NIL "buchhaltung" "is.it-management.at")) (("=?iso-8859-1?Q?Michael_Braunstorfer?=" NIL "mib" "viennapaint.com")) NIL NIL "" "")) x OK FETCH completed * 8546 FETCH (RFC822.HEADER {2148} Received: from protegate54.zmi.at (protegate54.zmi.at [212.69.164.56]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "protegate5.zmi.at", Issuer "power4u.zmi.at" (not verified)) by mail.viennapaint.com (Postfix) with ESMTPS id 45C4F1800099 for ; Wed, 1 May 2013 13:30:37 +0200 (CEST) X-Envelope-From: buchhalt...@is.it-management.at Received: from localhost (localhost [127.0.0.1]) by protegate54.zmi.at (Postfix) with ESMTP id A5A27145E2 for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) X-Virus-Scanned: amavisd-new at zmi.at Received: from protegate54.zmi.at ([127.0.0.1]) by localhost (protegate54.zmi.at [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 8CieKmD8TV4c for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) X-Envelope-From: buchhalt...@is.it-management.at Received: from zarafa16.zmi.at (zarafa16.zmi.at [212.69.164.59]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "zarafa1.zmi.at", Issuer "PositiveSSL CA 2" (verified OK)) by protegate54.zmi.at (Postfix) with ESMTPS id 6DAF2145E1 for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) Received: from zarafa16.zmi.at (localhost [127.0.0.1]) by zarafa16.zmi.at (Postfix) with ESMTP id 563C118A03A5 for ; Wed, 1 May 2013 13:30:42 +0200 (CEST) Subject: =?iso-8859-1?Q?AW=3A_Rechnung_2013-606?= From: Buchhaltung =?iso-8859-1?q?Prot=E9ger=2Eat?= To: Michael Braunstorfer Date: Wed, 1 May 2013 13:30:37 +0200 In-Reply-To: References: X-Priority: 3 (Normal) X-Mailer: Zarafa 7.1.4-41394 Thread-Index: Ac5GX0fCT0/rBV9YR+CeaMHxt3bvGw== Sender: Michael Monnerie Message-Id: Return-Path: buchhalt...@is.it-management.at MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable ) x OK FETCH completed x logout * BYE x OK LOGOUT completed ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Reply for IMAP Mail shows no e-mail address, only real name
Am Mittwoch, 13. Februar 2013, 14:43:13 schrieb Michael Monnerie: > User has dbmail 3.0.2 on SLES11 SP2, clients are Apple Mac, access via IMAP. > > When receiving mails, only the real name part of the sender is displayed, > example: > Michael Monnerie > instead Michael Monnerie > > when the user presses reply, the mail can't be sent because "Michael > Monnerie" is not a valid e-mail address. > > Any ideas how to fix? Hello, we still see this bug occuring frequently. Users cannot reply to an address, as only the users real name is written there instead the e-mail address. Is this a dbmail problem or in some library? Any hint would be good so I can solve it. -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc | Tel: +43 660 415 6531 XING: https://www.xing.com/profile/Michael_Monnerie Facebook: https://www.facebook.com/michael.monnerie Twitter: @MichaelMonnerie https://twitter.com/MichaelMonnerie LinkedIn: http://lnkd.in/uGx6ug Google+: https://plus.google.com/u/0/100598203632716687928/ Protéger.at Internet Services Austria [gesprochen: Prot-e-schee] http://protéger.at | http://proteger.at Facebook: https://www.facebook.com/protegerat Mitglied im it-management Netzwerk http://it-management.at signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Reply for IMAP Mail shows no e-mail address, only real name
Am Mittwoch, 13. Februar 2013, 14:43:13 schrieb Michael Monnerie: > User has dbmail 3.0.2 on SLES11 SP2, clients are Apple Mac, access via IMAP. > > When receiving mails, only the real name part of the sender is displayed, > example: > Michael Monnerie > instead Michael Monnerie > > when the user presses reply, the mail can't be sent because "Michael > Monnerie" is not a valid e-mail address. > > Any ideas how to fix? Hello, we still see this bug occuring frequently. Users cannot reply to an address, as only the users real name is written there instead the e-mail address. Is this a dbmail problem or in some library? Any hint would be good so I can solve it. -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc | Tel: +43 660 415 6531 XING: https://www.xing.com/profile/Michael_Monnerie Facebook: https://www.facebook.com/michael.monnerie Twitter: @MichaelMonnerie https://twitter.com/MichaelMonnerie LinkedIn: http://lnkd.in/uGx6ug Google+: https://plus.google.com/u/0/100598203632716687928/ Protéger.at Internet Services Austria [gesprochen: Prot-e-schee] http://protéger.at | http://proteger.at Facebook: https://www.facebook.com/protegerat Mitglied im it-management Netzwerk http://it-management.at signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Reply for IMAP Mail shows no e-mail address, only real name
User has dbmail 3.0.2 on SLES11 SP2, clients are Apple Mac, access via IMAP. When receiving mails, only the real name part of the sender is displayed, example: Michael Monnerie instead Michael Monnerie when the user presses reply, the mail can't be sent because "Michael Monnerie" is not a valid e-mail address. Any ideas how to fix? -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc | Tel: +43 660 415 6531 XING: https://www.xing.com/profile/Michael_Monnerie Facebook: https://www.facebook.com/michael.monnerie Twitter: @MichaelMonnerie https://twitter.com/MichaelMonnerie LinkedIn: http://lnkd.in/uGx6ug Google+: https://plus.google.com/u/0/100598203632716687928/ Protéger.at Internet Services Austria [gesprochen: Prot-e-schee] http://protéger.at | http://proteger.at Facebook: https://www.facebook.com/protegerat Mitglied im it-management Netzwerk http://it-management.at signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] imapd crashed v3.0.2
User reported "can't connect via imap", and the imapd process was gone. dmesg shows this: [4403546.139853] dbmail-imapd[3447]: segfault at 7fff73fad8e0 ip 0041015a sp 7fff73fad8d0 error 6 in dbmail-imapd[40+19000] [6381633.250846] dbmail-imapd[26457]: segfault at 7fff75222fe0 ip 0041015a sp 7fff75222fd0 error 6 in dbmail-imapd[40+19000] [6793855.397886] udev: starting version 147 [8714984.381743] hrtimer: interrupt took 11272256 ns [8828457.899639] dbmail-imapd[6919]: segfault at 7fffcb940550 ip 0041015a sp 7fffcb940540 error 6 in dbmail-imapd[40+19000] [8840173.973974] dbmail-imapd[11437]: segfault at 7fffa35e8bb0 ip 0041015a sp 7fffa35e8ba0 error 6 in dbmail-imapd[40+19000] [9143977.728901] dbmail-imapd[28073]: segfault at 0 ip 7f56900e09a0 sp 7fffafe2fcc8 error 4 in libdbmail.so.0.0.0[7f56900ab000+58000] Any ideas? -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc | Tel: +43 660 415 6531 XING: https://www.xing.com/profile/Michael_Monnerie Facebook: https://www.facebook.com/michael.monnerie Twitter: @MichaelMonnerie https://twitter.com/MichaelMonnerie LinkedIn: http://lnkd.in/uGx6ug Google+: https://plus.google.com/u/0/100598203632716687928/ Protéger.at Internet Services Austria [gesprochen: Prot-e-schee] http://protéger.at | http://proteger.at Facebook: https://www.facebook.com/protegerat Mitglied im it-management Netzwerk http://it-management.at signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] IPv6 on dbmail 2.2.x?
Am Freitag, 25. Januar 2013, 09:30:17 schrieb Paul J Stevens: > Anyway, for now use the work-around suggested in the 3.0 man-page, > which is use '::' if you are on linux. Perfect - worked! -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc | Tel: +43 660 415 6531 XING: https://www.xing.com/profile/Michael_Monnerie Facebook: https://www.facebook.com/michael.monnerie Twitter: @MichaelMonnerie https://twitter.com/MichaelMonnerie LinkedIn: http://lnkd.in/uGx6ug Google+: https://plus.google.com/u/0/100598203632716687928/ Protéger.at Internet Services Austria [gesprochen: Prot-e-schee] http://protéger.at | http://proteger.at Facebook: https://www.facebook.com/protegerat Mitglied im it-management Netzwerk http://it-management.at signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] IPv6 on dbmail 2.2.x?
Hi, we've enabled IPv6 on our servers, but dbmail-pop3d/imapd don't answer when contacted over IPv6. Is that a matter of recompile, or do we need a higher version? We are on 2.2.15. Our "bindip = *", so it should listen everywhere. -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc it-management Internet Services: Protéger http://proteger.at [gesprochen: Prot-e-schee] Tel: +43 660 / 415 6531 XING: https://www.xing.com/profile/Michael_Monnerie Twitter: @MichaelMonnerie https://twitter.com/MichaelMonnerie FaceBook: https://www.facebook.com/michael.monnerie LinkedIn: http://lnkd.in/uGx6ug Google+: https://plus.google.com/u/0/100598203632716687928/ signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Sieve "redirect" or workaround
On Dienstag, 14. September 2010 Jorge Bastos wrote: > Are you sure? I always used it, with 2.2x or 2.3x Oh, I found I used redirect 'othermailaddress'; while it should really be redirect "othermailaddress"; Now it works, thanks for your feedback, and sorry for the noise :-) -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc it-management Internet Services http://proteger.at [gesprochen: Prot-e-schee] Tel: 0660 / 415 65 31 ** Aktuelles Radiointerview! ** http://www.it-podcast.at/aktuelle-sendung.html // Wir haben im Moment zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://zmi.at/haus2009/ signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Sieve "redirect" or workaround
It seems sieve "redirect" to another e-mail address is not supported in dbmail 2.2. I guess it won't be, so has someone got an idea how to implement a rule like if header :contains "From" ["@important" ] { redirect 'ot...@address'; keep; } in postfix for a single recipient? So I want the mail to be delivered locally, plus sent to another address, based on sender, but just for a single mailbox. Would be easy with sieve "redirect" support. -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc it-management Internet Services http://proteger.at [gesprochen: Prot-e-schee] Tel: 0660 / 415 65 31 ** Aktuelles Radiointerview! ** http://www.it-podcast.at/aktuelle-sendung.html // Wir haben im Moment zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://zmi.at/haus2009/ signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail_headervalue
On Samstag, 13. Februar 2010 Paul J Stevens wrote: > I've blogged about a better approach on blog.dbmail.eu. There's an error, at least for postgresql 8.4: CREATE VIEW header_count AS SELECT count(1) AS count, n.id, n.headername FROM dbmail_headervalue v LEFT JOIN dbmail_headername n ON v.headername_id=n.id GROUP BY n.id; ERROR: column "n.headername" must appear in the GROUP BY clause or be used in an aggregate function just change the last line to GROUP BY n.id, n.headername; and it works. Also, this delete finds zero records: DELETE FROM dbmail_headername WHERE headername = 'Received'; but this one works (again postgresql 8.4): DELETE FROM dbmail_headername WHERE headername = 'received'; To make it a simple copy, here are the most often appearing entries which probably won't be IMAP SEARCHed: DELETE FROM dbmail_headername WHERE headername = 'received' or headername = 'x-virus-scanned' or headername like 'x-spam%'; This deleted more than half of our headervalue entries. Afterwards, running CLUSTER, REINDEX and VACUUM ANALYZE on the two tables is a good way to gain performance immediately. For CLUSTER to work, you'd need to have applied the CLUSTER commands once that I described on http://dbmail.org/dokuwiki/doku.php/performance I've also put the information from Paul on that page, to keep the "performance" tips on one page. -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc it-management Internet Services http://proteger.at [gesprochen: Prot-e-schee] Tel: 0660 / 415 65 31 // Wir haben im Moment zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://zmi.at/haus2009/ signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] IMAP connections piling up - Outlook related?
On Donnerstag, 28. Januar 2010 tabris wrote: > MAXCONNECTS = 2 MAXCONNECTS = 100 # IMAP prefers a longer timeout than other services. TIMEOUT = 912 IDLE_TIMEOUT = 112 We have a server with some hundred users, mostly Outlook, and no problem. It could be your MAXCONNECTS and TIMEOUT is too low, I remember there was some discussion about this once. -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc it-management Internet Services http://it-management.at Tel: 0660 / 415 65 31 // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15923011 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Large delay with email attachments when using dbmail with PostgreSQL
On Montag, 21. Dezember 2009 Werner Stoop wrote: > dbmail starts to consume 99% of the CPU And what does "iostats -kx 5 555" say during that time? Is there heavy I/O going on? What does vmstat say? -- mit freundlichen Grüssen, Michael Monnerie, Ing. BSc it-management Internet Services http://it-management.at Tel: 0660 / 415 65 31 // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Found [16] un-cached physmessages
On Mittwoch, 16. Dezember 2009 Reindl Harald wrote: > Nearly since migration to dbmail i get "Found [16] un-cached > physmessages." At the begin there was 10 increased now to 16 > That's a bug. Skip -b and ignore it. I wanted to do a fixup but didn't have time so far. IIRC it's about dbmail-util -b inserting headers that already exist and it breaks in the middle. See the thread about it on march 17, 2009. It doesn't affect anything, so it's not important. Some indices should be cleaned up. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] OPTIMIZE TABLE dbmail_messageblks in MySQL
On Mittwoch, 16. Dezember 2009 Daniel Mejia wrote: > db.c,db_icheck_isheader(+1788): could not access messageblks table > Failed. An error occured. Please check log. > > > what should i do? Did you check the log, as the error message suggested? we run this command daily: dbmail-util -ubdsy and this once a week: dbmail-util -tpubdsy -r 168h ; dbmail-util -py and for use those commands take about 30-40 seconds (the daily ones) and 20 minutes (the weekly stuff). mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] OPTIMIZE TABLE dbmail_messageblks in MySQL
On Montag, 14. Dezember 2009 Daniel Mejia wrote: > still, the database size is increasing average 2GB per day Just put a max quota on your users accounts, then they *must* delete some old e-mails. If you don't use quota, people will never delete, as they just don't realize they need some space. For POP accounts, I allow 100MB. IMAP gets 500MB per default. Those who want more pay more. Simple as that. How many users do you have, and how much space do they use on average? Maybe you have some "top 5" users who need a lot of space, and the rest is small anyway? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Tomas Kuliavas wrote: > Are you sure that syntax of your select query is correct? No, that was pseudo code to demonstrate you can search for variations within one query. > how complex select call you will make in order to cover all > variations? flowed format, quoted-printable, headers and body that > might have text in n different charsets. Just exactly the same amount a server with flat files would have to. There's no difference. > SQL is not designed to decode MIME on the fly. It all reduces to search for a certain byte combination. You just have to encode your search string to all variations you need, and put all those in a single SELECT. That was my point. In case you have to decode the mail, you need to retrieve,decode,search, and still this is the same work a flat file mailserver would do. All this discussion is about the speed of searching, and I didn't see an example where a flat file server could search faster than the DB so far. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Tomas Kuliavas wrote: > Emails are not raw text. There are at least two ways to write "test" > in email and if you go to 8bit text, number of same text variations > multiplies. SQL can't search emails stored in DB, because SQL does > not know about encodings, mime formats and character sets So where's the difference? You can SELECT * ... WHERE mailtext LIKE 'test'::utf8 OR mailtext LIKE 'test'::base64 etc. and a flat file server would do the same anyway. The e-mail is stored in original format, so it would also search for test in all encodings. The question is anyway: Does an IMAP SEARCH search in several variations of "test"? What if it's base64 encoded? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Paul J Stevens wrote: > Currently, a full body text search will do a full table scan of the > mimeparts table and pull in all mimeparts part of the messages in the > mailbox being searched. If we want to skip all non text/* mimeparts > (as allowed by the imap rfc), we'd have to add some knowledge of the > mimetype contained in the mimepart. Doing so would be trivial. And > so would fixing the query be that does the search. > Sounds like a nice-to-have feature :-) That would be a great reason to upgrade to 2.3. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Michael Monnerie wrote: > LVM snapshots > Another thing to remember: You can only do a snapshot of a single filesystem at a time. So if you have your DB and attachments in different volumes, snapshots are not transactions anymore. Some people may be happy to live with that, though. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Daniel Urstöger wrote: > Well, one can also do that with a filesystem based storage, you > just need something similar to the MySQL replication for flat > files. DRDB for example. > DRBD puts a burden on the server all the time. For a secure replication you need to wait until the I/O on the remote server is on disk too. Only if you relax that, and allow buffered I/O to the remote, the impact is negligible. But then you risk a munged DB in case your first machine brutally crashes during high I/O, and suddenly you loose some parts of your transactions which the DB does not expect. It's not nice, because the DB claims everything went OK, while some data in some tables is wrong... mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Josh Marshall wrote: > I have found that since linux kernel 2.6 series, LVM snapshots have > caused system lockups. I used it happily in the 2.4 series. That's why LVM snapshots are not used in XenServer 5.x. They also said it's unstable, especially under high load. > Besides > that, I did mention *impact-free*. Adding a snapshot and reading from > a snapshot severely impacts the speed of the running system. I totally agree with your arguing. Having all together is much easier to administer. Once it's too slow, I'll throw in more hardware. It's cheaper to throw in a new server than to have the extra burden with redundancy, backup/restore, etc... So far, I haven't seen a limit on dbmail, while we had limits with older POP-only systems before, where users had the setting "leave mail on server". The server had to copy the flat file all over again for each user, I/O stalled... BTW: we upgraded from PostgreSQL 8.1 to 8.3, which exactly *doubled* the speed of our nightly backups and vacuum/cluster runs. So that was a nice step which I can recommend to everybody. I wonder if 8.4 will bring another improvement. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Freitag, 11. Dezember 2009 Daniel Urstöger wrote: > the Full Text Index ( FTI ) is quite bad for searches > dbmail doesn't use FTI. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Optimizing Dbmail Database
On Donnerstag, 10. Dezember 2009 Tomas Kuliavas wrote: > DBMail might find its niche in some setups, but large mailboxes are > not in that niche. 750 GB DB proves it. You can't do text search raw > email sources. There is no point of storing them in DB. And you believe doing a raw text search on a 750GB flat file mailserver would be fast? dbmail 2.3 is different in that it stores mimeparts separately. Maybe a full text search skips binary attachments there. Paul? What I'd like to know from Daniel: Do you have 750G of real data, or is that just your DB size. It seems your setup is not optimized at all, a lost connection shows your server can't keep up with the load. Maybe all mysql Parameters need tuning anyway. dbmail heavily depends on a good DBA to give good performance. Once you have more than 10GB and 100+ users you see the difference. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 6531 .network.your.ideas. // // Wir haben zwei Häuser zu verkaufen: // http://zmi.at/langegg/ // http://willhaben.at/iad/realestate/object?adId=15306857 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] :/
On Mittwoch 11 November 2009 Paul Stevens wrote: > I'm not aware of any showstoppers. You may need to tweak the pg > config to silence spurious warnings about slash-escaping strings - > not an issue. escape_string_warning = off Yes, that needs to be in, starting from 8.3 already. Good, openSUSE 11.2 is due tomorrow, so we can start testing soon. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] :/
On Dienstag 10 November 2009 Piotr Wadas wrote: > - there are still some problems on vacuuming/cleaning up the > database, at least with postgresql 8.4+ Paul, is PostgreSQL 8.4 supported in dbmail-2.2 ? I'd be happy and would like to switch. Some time ago we switched from 8.1 to 8.3, and database performance *doubled*. It was a nicemove :-) Piotr, if you have problems with vacuum, you should ask on the postgresql-admin list: The rest is really generic, you should explain what you *want*, not what is not supported. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] pop3d segfaulting
I've had this yesterday: /var/log/messages: Nov 9 13:53:26 mailsrv1.zmi.at kernel: dbmail-pop3d[12215]: segfault at c ip f7cec943 sp ff8a66d0 error 4 in libc-2.5.so[f7c87000+128000] /var/log/dbmail: Nov 9 13:53:07 mailsrv1.zmi.at dbmail/lmtpd[14330]: Error:[message] dbmail-message.c,_set_content_from_stream(+388): Failed to flush, is your /tmp filesystem full? Nov 9 13:53:07 mailsrv1.zmi.at dbmail/lmtpd[14330]: Error:[lmtp] lmtp.c,lmtp(+578): dbmail_message_new_from_stream() failed I don't believe /tmp was full, there are 2,3GB free now. Could something else be the problem? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] invalid byte sequence for UTF8
Yesterday I saw this error again: Error:[sql] dbpgsql.c,db_query(+287): query failed [INSERT INTO dbmail_tofield (physmessage_id, toname, toaddr) VALUES (2283941,'','"مهند??335?UTF-8?q?ح376tf-8?QD9=85?=اد ')] : [ERROR: invalid byte sequence for encoding "UTF8": 0xdd3f HINT: This error can also... Seems dbmail is to blame here, it really must encode the headers correctly before trying to insert them. Or did I miss something? This is v2.2.11 mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail-lmtp: conversation with 127.0.0.1[127.0.0.1] timed out
On Montag 09 November 2009 Paul J Stevens wrote: > Reindl, Hihi, that's what comes when writing the surename first. :-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBmail and Django
> My question is : can I add columns to DBmail tables without breaking > something in DBmail ? Yes, I did so for my extensions to have domains and customers in it’s own tables. I also modified the aliases table without problems. mfg zmi ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Standard for encoded headers (Offtopic)
On Dienstag 29 September 2009 Shane Kerr wrote: > I have been getting familiar with the IMAP RFC lately, and it says > this: > > Note that headers (part specifiers HEADER or MIME, or the > header portion of a MESSAGE/RFC822 part), MUST be 7-bit; > 8-bit characters are not permitted in headers. > > http://www.faqs.org/rfcs/rfc3501.html A bit off-topic, but: Nice, but there are programs with bugs that generate 8bit headers, namely that Outlook extension that gives the users fancy backgrounds and funny pics to add... what's it's name? Erhmmm... Incredimail. That stupid program, for german setups, creates a time header like this: 10:37 Mitteleuropäische Sommerzeit meaning mid-european summer time - see the umlaut-a (ä) there. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail-util physmessage integrity
On Sonntag 27 September 2009 Casper Langemeijer wrote: > dbmysql.c,db_query(+290): [The total number of locks exceeds the lock > table size] [DELETE FROM dbmail_physmessage WHERE id NOT IN (SELECT > physmessage_id FROM dbmail_messages)] > Warning: could not delete orphaned physmessages. Check log. > > I'm using dbmail 2.2.10 > > I think this happens because dbmail-util tries to remove all 156629 > physmessages in a single statement, therefore all other threads have > to wait until this query is finished. Also I'm guessing that this > http://www.mail-archive.com/dbmail@dbmail.org/msg15575.html bug > report by Michael Monnerie led to the current situation. > > Because I needed to fix this I built my own php script. It basically > works like this: > > SELECT id FROM dbmail_physmessage WHERE id NOT IN (SELECT > physmessage_id FROM dbmail_messages) > > per 100 id's (per id would be way too slow. I found 100 to be a good > number of records): That was the behaviour from earlier releases (or was it a single delete per ID?). The change was done because a single transaction normally is much faster in the db server. But I think you're going the wrong way: It should not happen that you get this message: The total number of locks exceeds the lock table size I've googled, and found this: http://bugs.mysql.com/bug.php?id=15667 Recommendation by Valeriy Kravchuk Please, increase your innodb_buffer_pool_size ten times at least if you have a default size. and later: So, this is not a bug. You should just set server variables properly. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBMAIL error on SELECT
On Donnerstag 17 September 2009 Jonathan Feally wrote: > FTI would help searching greatly, however on MySQL the default is to > only index words 4 chars or longer. Thus it makes it unreliable when > searching for a small word of 3 chars or less. You can change it to > index 3 chars, which would probably be sufficient, but since this is > a global change on the whole database server and would require a > restart, not everyone would be able to use it (hosted databases). I > am unsure of SQLite FTI. I really can't see support of SQLite > remaining beyond 2.4 because of the multi-server over a network > requirement of 2.5 Hydra. That's why I said it maybe should be configurable. There's always somebody/something not wanting/supporting that feature, but it could help those with the capabilities to use it. > Do you know what PostgreSQL does in as far as what is indexed? No. I just read on the pg-users ML that 8.3 has that, and we are on 8.4 already. So maybe support is even better there. But I never used it, not having a program using it mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Fw: Error messageblks_idnr urgent help
On Donnerstag 17 September 2009 The 7Crewz wrote: > No my mysql not died Can you reproduce it? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Error messageblks_idnr urgent help
On Donnerstag 17 September 2009 The 7Crewz wrote: > Sep 17 05:28:37 dbmail-util[20495]: Error:[sql] > dbmysql.c,db_query(+290): [Lost connection to MySQL server during > query] [SELECT MIN(messageblk_idnr),MAX(is_header) FROM > dbmail_messageblks GROUP BY physmessage_id HAVING MAX(is_header)=0] And? A problem between dbmail and MySQL, lost connection. Your MySQL died? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBMAIL error on SELECT
On Donnerstag 17 September 2009 Paul J Stevens wrote: > No way around that without full text indexing. Any chance to have FTI support? PostgreSQL 8.3 has that built-in AFAIK, so it could be interesting. Dbmail could support it if the DB supports it, I just don't know how much effort that would be. Maybe just a configuration line, or auto-detection? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] LDAP workflow
On Dienstag 15 September 2009 Peter Rabbitson wrote: > I am toying with the idea to migrate all my services (login, web, > samba, dbmail) to a centralized ldap setup. While I read a lot about > ldap design and general operation principles, I can't quite wrap my > head around it. So here goes: > > Is there some recommended/best practice way of seting up ldap schemas > for dbmail consumption? Also is there some sort of GUI tool for ldap > administration? While I am comfortable with the CLI, some of the > people who will need to eventually administer users are not, and > anything "flashy" and easy to use is a plus. Peter, I'm in the same position. Should you get any info, I'd be glad if you could inform me too. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] use dbmail-deliver instead of dbmail-lmtpd
On Dienstag 15 September 2009 Jorge Bastos wrote: > If this needed? I mean, I REALLY have to add a line per domain? > Can I skip that part and stay only with the parts on main.cf & > master.cf ? Jorge, please read each word: To send all email to DBMail, add this in /etc/postfix/main.cf mailbox_transport = dbmail-deliver: If you want to decide whether or not to send to DBMail per domain, add this in /etc/postfix/transport: dbmail-deliver: Especially the *ALL* and *IF YOU WANT...PER DOMAIN* parts. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBMAIL error on SELECT
On Donnerstag 10 September 2009 Michael Monnerie wrote: > So, this is the query you posted stripped down: > SELECT k.messageblk FROM dbmail_messageblks k WHERE > k.messageblk ILIKE '%multipart/encrypted%'; > > He's right, that query doesn't work on PG 8.1 either. OK, this is a bug in dbmail, which can be fixed in PostgreSQL 8.3 and up: http://www.postgresql.org/docs/8.4/interactive/functions-string.html I would have thought convert_from, possibly combined with convert, would do it. And this should really do the magic, but I'm on 8.1 today, will test on 8.3 soon. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] MySQL tweaks?
On Dienstag 15 September 2009 Jonathan Feally wrote: > If you have minimal writes and the server is on a UPS, this setting > won't make too much difference I have a home server on UPS, and can tell you from real experience what crashes I hade despite all this: 1) Broken power supply -> UPS doesn't help 2) My daughter turning the server off -> UPS doesn't help But you always risk your transactions for a very small performance gain. Even for your home server, never make a setup that can break your DB. It's better to use faster hardware instead, if you really, really need it. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] MySQL tweaks?
On Montag 14 September 2009 Jonathan Feally wrote: > innodb_flush_log_at_trx_commit=2 Note: Everybody who care about their data, you should leave this setting on it's default "1": innodb_flush_log_at_trx_commit=1 mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBMAIL error on SELECT
On Donnerstag 10 September 2009 Michael Monnerie wrote: > PostgreSQL 8.3 issue Interesting, I got this answer from a PG dev: There has *never* been a Postgres release that accepted bytea ILIKE something. I'm not sure what you were really doing before, but that wasn't it. So, this is the query you posted stripped down: SELECT k.messageblk FROM dbmail_messageblks k WHERE k.messageblk ILIKE '%multipart/encrypted%'; He's right, that query doesn't work on PG 8.1 either. How did you make dbmail run such a query? Looks like via a search, but I guess that never worked and would be a bug then. So please, how can I reproduce that query? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBMAIL error on SELECT
On Donnerstag 10 September 2009 David Young wrote: > Sep 10 00:39:49 node1.the.matrix dbmail-imapd[4957]: Error:[sql] > dbpgsql.c,db_query(+287): query failed [SELECT m.message_idnr, > v.header value, k.messageblk FROM dbmail_messageblks k JOIN > dbmail_physmessage p ON k.physmessage_id=p.id JOIN dbmail_messages m > ON m.physmessage _id=p.id JOIN dbmail_headervalue v ON > v.physmessage_id=p.id WHERE m.mailbox_idnr=53 AND m.status in (0,1) > HAVING SUBSTRING(v.headervalue ,0,255) ILIKE '%multipart/encrypted%' > OR k.messageblk ILIKE > '%multipart/encrypted%'] : [ERROR: operator does not exist: bytea > ~~* unkno wn > LINE 1: ...55) ILIKE '%multipart/encrypted%' OR k.messageblk ILIKE > '%mu... ^ HINT: No operator matches the given name and argument > type(s). You might need to add explicit type casts. > ] > > Sep 10 00:39:49 node1.the.matrix dbmail-imapd[4957]: Error:[mailbox] > dbmail-mailbox.c,mailbox_search(+1374): could not execute query PostgreSQL 8.3 issue. They started to have tougher type casts. The message explains that "You might need to add explicit type casts.". I still don't have it, so I don't know exactly how to cast it. Maybe OR k.messageblk::varchar ILIKE '%multipart/encrypted%' would solve the problem, but you can't cast from bytea to varchar, at least in 8.2. Asking on the PostgreSQL list should help, I'll do that. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] stunnel replacement
On Mittwoch 12 August 2009 Jonathan Feally wrote: > Of course 2.3.x has native SSL support, making stunnel just added > overhead. Oh, that's nice. So I'll stick with stunnel for the moment, just compiled it tonight it's painless. Why I don't want to compile myself is because I don't know about security updates then, that's why I prefer to stick with maintained packages. Thanks to the others too, I'll look at nginx for other reasons also. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] AUTH-Methods für dbmail-imapd/dbmail-po p3d
On Mittwoch 12 August 2009 Paul J Stevens wrote: > Not *that* simple, but I did it nonetheless. My GIT master tree now > supports AUTH=CRAM-MD5. > > This will however *only* work for people using authsql and plaintext > passwords. Thank you. Is that dbmail-2.3 only I guess? BTW, you should be called "Scotty", like the guy from Star Trek when he was asked by Captain James T. Kirk "how long you need to fix it?" Scotty: "3 days, it's very complicated, everythings broken" Kirk: "you got 20 minutes" Scotty: "OK" :-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] imapd Temporary files
On Mittwoch 12 August 2009 Reindl Harald wrote: > As the disk ran full it was configured to 1000 and i configured to 25 > because i am hoping that the processes owning the temp-files will die > earlier, but there are also 5 GB of deleted temp-data > > What is wrong in my logic? > If i restart imapd all space gets free because the processes are > dying http://www.mail-archive.com/dbmail@dbmail.org/msg16123.html A bit of /tmp use is normal, I thought you just had a lot of imapd processes and that takes more space then. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] imapd Temporary files
On Mittwoch 12 August 2009 Reindl Harald wrote: > Hm - I think there is a bug because the files are marked as deleted > but space is allocated No, that is intended. This is a security measure, as nobody else can access the files anymore. As soon as you stop the daemons, the space will be freed again. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] imapd Temporary files
On Mittwoch 12 August 2009 Reindl Harald wrote: > Has anybody an idea if there is a screw to reduce temp-usage > > Last friday the disk was full and i had to restart dbmail-imapd > There are many files which are "deleted" and only seen with lsof I think the only thing is to resize that partition or move /tmp to another disk and connect via symlink. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] AUTH-Methods für dbmail-imapd/dbmail-po p3d
On Dienstag 11 August 2009 Reindl Harald wrote: > Please do not missunderstand me: Because of this things i got as > nearly no sleep searching and patching things that should work out of > the box while our customers are standing with a loaded gun behind me By shouting at people you won't get more help. If you offer to pay Paul for a feature you need, or ask very friendly, maybe he'd implement it quickly. Just last week he implemented IPv6 support within a short time. On the other hand, Paul, having secure methods directly implemented would really be nice. Just because the *MD5 methods require plaintext pwds doesn't mean it shouldn't be implemented. It should just be disabled by those having encrypted pwds. (/me having cleartext pwds, so could use the feature now *g*). As far as I could read from your words, it should be easy to implement? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] stunnel replacement
In openSUSE 10.2, I used stunnel to provide pop3s/imaps, but that package isn't anymore in 11.1. Anybody got an idea what I could use instead? It would be best if it's included in os11.1, makes life easier ;-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail looses mail address in From: header
On Freitag 24 Juli 2009 Jonathan Feally wrote: > Michael Monnerie wrote: > > Is this a know bug? > > > > When I receive mail from this guy, in Zarafa/Outlook it stores the > > header like this: > > From: =?windows-1252?Q?M._Oostergo?= > > Is this when you retrieve the message from a non-dbmail pop3/imap > server? Yes. Over Zarafa (MDA) read with Outlook or IMAP (MTA). > > But when received over dbmail, the mail part is lost: > > From: =?windows-1252?Q?M._Oostergo?= > > Is this when the message is inserted via dbmail-smtp/dbmail-lmtp or > an IMAP APPEND? > Is it ok when first inserted, but then the client changes it? Received via dbmail-lmtp from postfix. I didn't know the client could change the headers. Do you mean I'd have to read the message from the DB before accessing it via kmail? I could try to read the message via IMAP from Outlook instead kmail, but I doubt it's kmail. Wasn't there a bug im dbmail once with wrong interpreted headers? Something with the lib used to en/decode those strings? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] dbmail looses mail address in From: header
Is this a know bug? When I receive mail from this guy, in Zarafa/Outlook it stores the header like this: From: =?windows-1252?Q?M._Oostergo?= But when received over dbmail, the mail part is lost: From: =?windows-1252?Q?M._Oostergo?= This is dbmail-2.2.11. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Annoying "DONT DELETE THIS MESSAGE" with previously used imap inbox folder
On Donnerstag 23 Juli 2009 Jonathan Feally wrote: > > select * from dbmail_messages where physmessage_id IN (select > > physmessage_id from dbmail_subjectfield where subjectfield like > > 'Annoying%DELETE THIS MESSAGE%'); > > > > Instead of "select *" simply write "DELETE" and those messages are > > gone. > > > > mfg zmi > > > > I'm glad you responded first. I forgot about those views and was > going to give a very nasty query back to do it. That should work in > both 2.2.x and 2.3.x :-) Please anybody doing above query be reminded to change the Subject you are searching for - otherwise you delete all mails belonging to this thread ;-) My advise is to make the "select" first to see if it works, and only afterwards change it to "delete". mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Annoying "DONT DELETE THIS MESSAGE" with previously used imap inbox folder
On Donnerstag 23 Juli 2009 Piotr Wadas wrote: > When administrator migrates mbox folders to dbmail, in some of them > is a imap message, common pop3/imap ignores it, but when migrated, > this message appears on the list, and frightened users call support, > to ask "what is this and what shall I do with this". And yes, this is > no joke. Any quick sql query to delete from database all messages for > all users (envelopes and bodies) with particular SUBJECT header? or > for particular user? I'd rather to delete the messages, than delete > envelope and let dbmail-util do the rest (it has enough to do with > really deleted messages). Probably Net::POP3 perl script would do the > same, but removing from tables would be much simplier. select * from dbmail_messages where physmessage_id IN (select physmessage_id from dbmail_subjectfield where subjectfield like 'Annoying%DELETE THIS MESSAGE%'); Instead of "select *" simply write "DELETE" and those messages are gone. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] URGENT: Accidentally delete mail user with dbmail-users -d
On Montag 20 Juli 2009 Jonathan Feally wrote: > Perhaps we should have a status column on dbmail_users like we have > on messages. > > 0 = disabled > 1 = enabled > 2 = deleted > 3 = purge ok > > > Then on the dbmail-util run it will moved deleted to purge - then > really delete the purge like we do with messages. +1 for the feature. We've adopted dbmail 2.2, and just have an "active" flag for the user, and your idea is even better. Can we have the same flag on aliases too? And please, if a user/alias is status=0 (disabled), dbmail should do as if it doesn't exist. No delivery/forwarding etc. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] request for extension: "domain" and "customers" table
On Freitag 26 Juni 2009 Paul J Stevens wrote: > I don't follow. It's been in dbmail forever. Take a look at > dbmail.schema. OK, I never looked so far, as LDAP was never really thought about. I looked once into it, but didn't find a nice tool to insert our data in an easy way (like an editor, webpage, whatever). Is there something to start with? Of course I want to adopt our web interface to use that, but it will take some time. > To summarize: > DESC 'DBMail-LDAP User' SUP top AUXILIARY > 'dbmailForwardingAddress' DESC 'DBMail-LDAP Forwarding Address' SUP > DESC 'DBMail-LDAP Virtual Domain' SUP top STRUCTURAL Hm. I understand this are 3 objects user/alias/domain, but that's only part of the story. There need to be objects where users and companies are defined, and how they are connected, where the uidNumber is defined, the mailCluster, etc. I don't really have the full picture of LDAP, only know it's some directory like Novell's NDS used to be (which I loved a lot). Now I looked into dbmail.schema, it says it needs # - core.schema # - cosine.schema # - nis.schema Is this everything you use? I found a company definition there, but are other modifications to make? Might sound stupid, but it's a PITA to start something new. Is there a simple way to copy existing dbmail users into the LDAP schema? I start fresh, so I'd like to copy everything from SQL to LDAP. > > I hope you're able to post your LDAP schema (confidential?), and > > that I can adopt to use it. Then I could start trying out > > dbmail-2.3 with that schema already, so migration should be easier > > also. > There is nothing 2.3-ish about any of this. I didn't mean that, rather that I want to 1) copy SQL users to LDAP 2) setup dbmail-2.3 3) config dbmail-2.3 to use LDAP and the old 2.2 should stay with SQL until I fully trust my LDAP setup. Like this I also have an easy transition from SQL to LDAP, so there is nothing to break on changing the existing server. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] request for extension: "domain" and "customers" table
On Freitag 26 Juni 2009 Paul J Stevens wrote: > Even we do very much the same in our main installation, we use LDAP > to extend the user model, so the extra tables would be redundant for > us. Also, I fail to understand how the additional tables effect > dbmail internals. My business logic builds on ldap, and doesn't > require any tweaking of the dbmail code or tables. Most of the > delivery process is handled by postfix talking to ldap - no dbmail > involved. All the lmtp server needs to be able to do is route a > message (that already was verified as destined for a valid user) to > the correct user's inbox (or sieve script). Can you post your LDAP schema? I guess I really should change and use that. I didn't until now, as I can't see the advantage of LDAP over dbmail (for us). But as you're using it that way, I'd like to change to the same model in order to have the same usage in dbmail-2.3, once we switch. And if others you the same scheme, it'l be easier to understand each other or workout features. I've recently expressed our will to provide our web interface. I'm in the process to do that, but it's tricky as it's heavily using our internals. So using a "standard model" should be less pain for the 2.3 adopted version. I hope you're able to post your LDAP schema (confidential?), and that I can adopt to use it. Then I could start trying out dbmail-2.3 with that schema already, so migration should be easier also. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] request for extension: "domain" and "customers" table
On Mittwoch 24 Juni 2009 Michael Monnerie wrote: > I've extended dbmail since before we started, in order to have an > extra "domains" and "customers" table. This has big advantages. Nobody to comment on this? Too complicated, too harsh, or maybe just a stupid idea of me? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] request for extension: "domain" and "customers" table
eally, as postfix rewrites them to u...@primarydomain itself - It's easy to see which domains are just aliases. This makes displaying on the web interface much more fun. Disadvantage: - DB schema change necessary - at least two more tables (domains, customers) All this might be biased for our purposes, but I guess there are lots of features many of you would appreciate. For example, the per-domain and/or per-customer quotas. Those are currently not implemented in dbmail, but that shouldn't be too hard. We use is from the web interface for a simple display. The customer gets a call in case of heavy use :-) PS: we've also modified dbmail_aliases to include the "domain_idnr", "visible" and "active" fields. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] sieve vacation and aliases
On Dienstag 23 Juni 2009 Aaron Stone wrote: > There is a search for "is this message actually addressed to me?" -- > an important error case being mailing lists that get spammed by > people's autoresponders. I can't think of a good workaround to offer > you off the cuff. Thanks Aaron, I've made a quick patch to our web tool. When a user now makes a vacation entry, all alias domains of them are searched, and vacation gets a list of :addresses [...], where u...@dom1, u...@dom2, etc. is listed. That solves the problem. Luckily we have a patched dbmail where it's easy to find alias domains :-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] sieve vacation and aliases
Dear list, I have vacation via sieve scripts in the form of: require "vacation"; vacation :days 5 :subject "Abwesenheitsnotiz" "Danke für Ihre Nachricht." Now we have a customer who have a lot of alias domains. They get mail to x...@dom1.at and that's place to x...@dom-real.at. I just found that sieve then does NOT reply to messages for that alias. In this discussion http://objectmix.com/imap/201068-sieve-vacation-addresses-wildcards.html they say it's a must to setup all alias addresses, is that true for dbmail also or is there a workaround? I must say that we rewrite alias domains in postfix already, so dbmail only sees x...@dom-real.at, not x...@dom1.at (where the people send mail to). Looks like sieve vacation doesn't see the envelope, but the content of the mail "To:" header. So I guess it won't work on BCC: received mails too? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] MAX_CHILDREN
On Dienstag 16 Juni 2009 Jon Duggan wrote: > The pop3 box is a dedicated quad core with 4gb of ram. And how much memory is used during peak hours? Just curious. Each dbmail-pop3 daemon here is shown as having an RSS footprint of 1-2MB, and a VSZ of 5-10MB. So with 300 users you'd have about 13MB per user available, which should be plenty. 600 users would thus mean ~6MB/user, I guess that would be the hard limit memory wise. What's your average CPU usage during peaks? I guess the pop3 box is not heavy loaded, but what about the db? > We push at peak maybe 10mbit/s so no where near the 30mb/s you quote > but bandwidth is not an issue (it's as good as unlimited). I forgot that with pop3 users usually remove mail from the server directly after receiving (we have lots of IMAP users). And with that many users, your connect rate may be high, but actual transfer rates not. Do you know about how many % of users choose to "leave mail on server for X days"? When we had flat-file storage with pop3d, that setting killed the server, as he had to read through the full file to see if there are new messages. You need only some users with a 100MB mailbox connecting every minute, and your server cries for help. But with dbmail, that is no issue anymore. :-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] MAX_CHILDREN
On Dienstag 16 Juni 2009 Jon Duggan wrote: > MAX_CHILDREN limit of 300 in pop3 Are you sure your box has enough RAM to keep 300 pop3 daemons around, plus the memory they need during I/O? Maybe it'd be better to install a 2nd box? If your machine is already swapping, more processes with actually lower your throughput. If the average pop3 user can receive with 100KB/s, your machine would need 30.000 KB/s (about 30Mb/s) Internet connection, and of course your database (same server? or another?) needs to be fast enough also. Sure you don't hit an I/O limit somewhere? Not want to offend, just help. But I don't know for the 300 limit in the code. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] RELEASE: ripdefang-dbmail 0.01
On Freitag 29 Mai 2009 Paul J Stevens wrote: > > And I have in dbmail.conf: > > [LMTP] > > PORT = 24 > > NCHILDREN = 1 > > MINSPARECHILDREN = 1 > > MAXSPARECHILDREN = 2 > > MAXCHILDREN = 5 > > That is a *very* narrow pipe for lmtp. You better make damn sure your > mta doesn't try to establish more than 1 lmtp connection. It's working on a server with >200 domains... But why 1 lmtp? It starts with 1 plus 1 spare, and goes up to 5 if necessary. And wouldn't postfix just retry later if all 5 are busy? No mail should be lost, right? > > Can dbmail- smtp loose messages? > > Only if the disks are full. Remember, dbmail-smtp (pipe) doesn't have > a mechanism for telling the MTA what errors might have occurred > during delivery. Would it write that to syslog or somewhere? I got about 80 errors on stderr which would explain that no e-mails are sent for that messages, but I'm missing a lot more. There's a "-r" option to dbmail-smtp, but that would only send me the 80 messages instead of on stderr, right? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] RELEASE: ripdefang-dbmail 0.01
On Donnerstag 28 Mai 2009 Michael Monnerie wrote: > http://zmi.at/x/ripdefang-dbmail > > I just released this very first version of a "un-defang" tool. It's > for everybody who has defanged spams and wants to get the original > spam back into the mail system again. Question to Paul: I run above script with formail http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] RELEASE: ripdefang-dbmail 0.01
http://zmi.at/x/ripdefang-dbmail I just released this very first version of a "un-defang" tool. It's for everybody who has defanged spams and wants to get the original spam back into the mail system again. Usage is very simple: Take a spam that is defanged by amavis, and resend or forward it to an alias address which calls this script. In my case I use dbmail ( http://dbmail.org/ ), where I created the following alias: # dbmail-users -x undef...@mydomain -t "|/usr/bin/ripdefang-dbmail" I then grep'ed a sample collection of 7074 mails, saved that to an mbox (if you want it: http://zmi.at/x/spambox.mbox.bz2) and ran a # formail -n 10 http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail performance test
On Donnerstag 28 Mai 2009 Andreja Babic wrote: > Database dbmail took 48G while cyrus mail storage had 30G for the > same amount of mails. Boah, a very huge difference! I'd love to know what dbmail 2.3 would be in size. > What I have got from tests is that search is much faster on dbmail > and fetch is much faster on cyrus. > > For example on the mailbox which had 39661 unread mails search on > cyrus imap took 20 seconds. The same operation on identical mailbox > on dbmail took 12.7 seconds. Please also compare results of the searches. Dbmail has a bug somewhere (don't remember exactly, lookup archives, maybe of -dev), which will not necessarily find all messages. Please also do different kinds of searches (subject, From:, any header, any content, etc.). > On the other side, fetching headers from all mails in inbox with > "fetch 1:* body[header]" took on dbmail 20 seconds while the same > operation on cyrus took 3 seconds. Please perform such accesses always 5 times in a row, and remember each time. Caches will change performance on both products, would be interesting to see how much. Are you also able to do this: *) simulate a single user signing in, read list of all mailboxes (should be 20 or so with subfolders), then for every mailbox get list of messages, read some messages. Close. Make other tests with other users, and deliver about 100 messages into that users mailboxes. Reconnect as that user again, get list of new mails. read some of them. close *) then rerun above test with 20 users in parallel. *) then again with 50 users in parallel. Maybe we can see which product scales better. Although we have no idea which hardware you test on. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Dienstag 12 Mai 2009 Jorge Bastos wrote: > Good to know that I'm forgiven :P > Who was he? Oh Lord ;-) Wikipedia rules: http://en.wikipedia.org/wiki/Douglas_Adams mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Dienstag 12 Mai 2009 Daniel Urstöger wrote: > > Usermapped ip/port or via a special 'virtual' username extension > > '#mobile' or '#noattach' or whatever is decided on. > > Those are the kinds of changes I am quite sure you are the only one > capable of doing that, right? ;) Well, with a good towel, beer and peanuts, and a Vorgon spaceship you could travel to Alpha Centauri to get a three-brained hacker from there. He'd only take 2 years to study the code and do that stuff. On the other hand, there are for sure good hackers on this planet as well, but no one seems to have found his way to dbmail-dev. PS: Those not knowing Douglas Adams are forgiven. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Dienstag 12 Mai 2009 Jonathan Feally wrote: > This could > pose a big problem with the fact that all messages in a mailbox would > have to be rewritten before a simple list command could be fulfilled > as the size of the messages would be different than what is stored > already in a column. We are speaking about a mode which really breaks RFCs anyway. Will there be problems when you report the normal message size, say 5MB, to a client and then the mail is only 20KB received size? I guess the progress bar will get messed up, but the rest should be OK. > As an IT administrator, I > don't want to be the one who gets the call from the CEO when his > email on his blackberry is missing the very important forwarded as an > attachment email is replaced with a message - attachment(s) is/are > available on your non-mobile client. The CEO, or his techie, must explicitly configure #mobile mode. If you are afraid, don't do that. Use it only for people who you can explain the implications. And: the attachments are not only available on his PC, but he gets a https: link sent with the mail, replacing the attachment. A click on that link will download the attachment. After all, this mode helps saving time to receive a message, which is welcome to most mobile users. Blackberry gets mail pushed on it anyway, so maybe you don't want #mobile mode there, as you don't see the time it takes to receive a mail normally. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Montag 11 Mai 2009 Paul J Stevens wrote: > > Not to be nasty with the name, but I think #mobile is not as good a > > name as #noattach, as I might want #mobile mode also when I'm at an > > internet cafe, or other environment. > > ?? Most people are mobile when in a cafe. Also #mobile sounds better > (no negative) to me. Ah, different understanding. "Mobile" here is more interpreted to "mobile phone" (or "Handy", as we call them) or UMTS/GPRS connection, so an Internet cafe would not really be "Mobile" in the users head. Funny that you'd see "no" as negative, as in my head "noattach" gets a positive "wow that will be fast to receive on my phone" connex. But any way, no problem with any name. Just a thought. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Montag 11 Mai 2009 Paul J Stevens wrote: > Of course, you could have some mailclient use the virtual userid > directly without using usermap, but with usermap all you'd have to > explain to your mobile device users would be to use an other > servername. But that servername needs another IP, right? I'd prefer not to waste an IP just for #mobile mode. Another port is sufficient. It should be possible to use it with another IP, though, as some clients might need that. Not to be nasty with the name, but I think #mobile is not as good a name as #noattach, as I might want #mobile mode also when I'm at an internet cafe, or other environment. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Montag 11 Mai 2009 Josh Marshall wrote: > Not sure on your setup, but if you have access to multiple IP > addresses, you can put a rule on the firewall to forward port 110 to > e.g. 111 on the internal server. Otherwise default to internal > clients connect to port 110 and external clients connect to port 111 > via a portforward on the firewall. I prefer to KISS, so doing nasty firewall NAT is something I do as a last resort, as it's something that keeps the "junior admins" bang their heads ;-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode
On Freitag 08 Mai 2009 Paul J Stevens wrote: > We'd have to make sure this doesn't break any rfcs. Do you mean the POP non-delete part? I'd say either you refuse deletion when in #noattach mode, or only allow IMAP then. I guess it's better to allow POP but refuse delete, in order to support as many options as possible (I guess some phones/clients can't be configured to leave POP mails on the server). After all, people must make a special config so they *know* they don't want attachments, and are willing to take this "risk". > Checking the > usernamepart is already done atm with the usermap facility. Perhaps > using a different port would be easier then. Yes, that's better. But aren't there phones/clients where you cannot even configure a port? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] #noattach mode (was: Dbmail Hybrid)
On Donnerstag 07 Mai 2009 Paul J Stevens wrote: > The dbmail-httpd would then, after authentication/authorization > return the attachment involved with the correct mime headers for the > relevant content, i.e. the message, so the client knows how to save > the file. Could that be done in a virtual mode? I mean: a) the clients logs in with a special form of username, lets say instead "cli...@domain" he uses "cli...@domain#noattach". This lets dbmail-(pop| imap) switch to URL mode instead. For POP this only works if messages are left on the server of course. (Maybe just forbid to delete mails for POP when in #noattach mode). b) Client gets, instead attachment, an URL like http://dbmailwebserver/virtualurl. Whenever this URL gets called, a script is executed checking login, and if this passes start the download directly from the dbmail database, without needing to copy the file to the filesystem. Maybe that needs to be done, but only as a temporary file that's deleted after the download. What I'd not want is to copy all attach files where an URL is generated to be copied to the filesystem, just in case someone wants to download it. Sounds very nice, all mobile users would love that! mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Offtopic, Question about FTTH
On Dienstag 05 Mai 2009 Jorge Bastos wrote: > Who has FTTH? In Austria: About 0%. Lots of cable TV+Internet, giving speeds 20Mb/2Mb up/down like for me :-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Dbmail Hybrid
On Montag 04 Mai 2009 Darvin Denmian wrote: > DBmail stores Message and the attachments of messages are stored > outside Mysql DB. Use cyrus as your mailserver, then everything is a file. A mixture of SQL+file combines the disadvantages of both, not the advantages. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] /tmp full
On Donnerstag 23 April 2009 Guntis Bumburs wrote: > MAXCONNECTS = 1 > > what is the benefit to have it so hight? > what would happen if i change it to Paul's suggested 100? A single thread will accept MAXCONNECT connections and then stop, and a fresh one startet. Like this, all memory/disk reservations by that thread will be freed. It has no impact except on very high loaded servers there could be a small performance drop because of permanent thread restarting. No need to worry. It will help to lower it. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] why...?
On Donnerstag 09 April 2009 Josh Marshall wrote: > Since dbmail-util tries to recreate date field > before the other, missing, field, and fails because the unique > restraint stops it, it stops trying to recreate the other header > fields. So it never gets to fix the real problem. I'll have a look into a cleanup of the indices, and Paul will fix the rest. I'm just on holidays this week, so it needs to wait a bit. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] System scalability
On Mittwoch 08 April 2009 David Nillesen wrote: > Our mailstore is currently around 32,000 users with > around 8 million emails on disk at the moment, occupying about 350GB > of mail. > How well does DBmail scale to these numbers on > Postgres? It runs, of course you need competent hardware. I'm working on index optimization for dbmail-2.2, cleaning some indices out or lightening them up. Patches to follow, should help a lot with installations of that size. > Is there a solution for user self administration of > vacation/autoreply messages? Since we have a large number of accounts > self administration for the majority of user issues is important. I > have found a few administration webapps for admins, but nothing for > users as far as I can see. We have developed a complete toolset which I can offer you for free. It's php based, and you can create customers/domains/users/aliases, and each user can have the right to administer his password/vacation with start/stop dates. I was already planning to release it to GPL as a sf.net project. If others are interested too, I'll do that sooner than later. > We use LDAP for aliases, authentication and authorization. Is there > any way to tie this to DBmail? My main issue would be with aliases, > everything else we can work round with our IAM system executing SQL > into Postgres to enable users. Our tool currently directly connects to the db, so some rework would be needed. Shouldn't be a big pain. > If you would like to know more about our site and configuration, let > me know. If you're interested, let me know per PM. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] OT: DBMail Administrator (DBMA) Performance Fix
On Freitag 03 April 2009 Josh Berkus wrote: > FWIW, there's no difference in PostgreSQL either. Yes, but the other way round: In PostgreSQL it's always *FAST*. So, a little bit of difference ;-) EXPLAIN ANALYZE SELECT COUNT(*) FROM dbmail_messageblks; QUERY PLAN --- Aggregate (cost=58336.22..58336.23 rows=1 width=0) (actual time=1574.620..1574.621 rows=1 loops=1) -> Seq Scan on dbmail_messageblks (cost=0.00..57162.37 rows=469537 width=0) (actual time=0.056..1019.980 rows=469683 loops=1) Total runtime: 1574.676 ms And that's just my home server, a XEN vm within a normal PC. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] OT: DBMail Administrator (DBMA) Performance Fix
On Freitag 03 April 2009 Wallace Tan wrote: > select count(1) from t1; That would have been my next question. I've spoken once to Paul, because dbmail uses lots of count(*), but PostgreSQL optimizes this out. Now it seems MySQL would have a performance boost using count(1). Could you please try: 1) first, SELECT COUNT(1) FROM dbmail_messageblks; and afterwards 2) SELECT COUNT(*) FROM dbmail_messageblks; The order is important: After the first select(), the table will be cached, so the 2nd query will be faster. That, BTW, is part of the explanation why your 2nd query was much faster than the 1st. Still, count(1) should be faster than count(*) I would expect from the thread you posted. I do not have a MySQL db with enough data to test around. We're using PostgreSQL because things like that happen to exist in MySQL since years, and I don't need a DBMS where I have to think for it. I wonder why the devs don't manage to work around those problems. But no flames please, everybody should use what they prefer. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] OT: DBMail Administrator (DBMA) Performance Fix
On Freitag 03 April 2009 Wallace Tan wrote: > SELECT COUNT(*) FROM dbmail_messageblks; > 1 row in set (2 min 18.09 sec) > > After optimizing the SQL, it took 0.27 seconds. > SELECT COUNT(*) FROM dbmail_messageblks use > index(physmessage_id_index); The question is: Why is MySQL so stupid not to use the index? That should be done automatically by the DBMS, that's its job. I would oppose against changing the query just because MySQL has a bug. Maybe you use a version that's known to be instable? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail/maintenance causing "manage_stop_children" General stop requested on imap, pop3, & lmtp
On Montag 30 März 2009 Brian Neu wrote: > dbmail-util -c -t -u -p -d -y 2>&1 >> $LOGFILE Would that have to be dbmail-util -c -t -u -p -d -y >> $LOGFILE 2>&1 ? I've thought that if you first do 2>&1, it reconnects stderr to stdout, and later you change stdout to $LOGFILE, but then stderr stays on the previous value (which is normal output). If I'm right, that's a bug and should be reported to Fedora. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Are we alive or am I dead?
On Freitag 27 März 2009 Jake Anderson wrote: > does that mean we can get a new beta in deb format? In order to make people unhappy again? ;-) I just found dbmail_messages to have a _lot_ of indices which seem unimportant. Since some weeks I do a full SQL statement log of postgresql to see which commands are used. I'll try to find out if those indices are of value, and include that in my "sql cleanup patch" ASAP. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Are we alive or am I dead?
On Dienstag 24 März 2009 Jonathan Feally wrote: > Testing the lists. I haven't gotten anything since 3/19. Me too. Seems all are on vacation ;-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Bug in dbmail-util - not cleaning un-cached physmessages, and making other mess
On Mittwoch 18 März 2009 Josh Marshall wrote: > This is interesting. I'm using MySQL here and the UNIQUE is keyed off > the physmessage_id and the datefield. Weird. There's a bug somewhere. I guess the db indices shouldn't be different between SQL flavors. Can someone confirm that mysql & postgresql have different indices here? That should be a bug, right? And then: what would be the right definition of dbmail_datefield_1? In his last mail, Paul confirmed my idea: >> Wouldn't a single physmessage_id entry be enough in dbmail_datefield? >> If yes, the index dbmail_datefield_1, which currently is UNIQUE >> (physmessage_id, id) could be changed to UNIQUE (physmessage_id). > Sounds good. But then we didn't know about the mysql case. So now I'm not sure if that index should be about (physmessage_id) only or (physmessage_id,date). Doesn't sound too bad also. I still think the single (physmessage_id) would be enough, as we don't want two dates for a single physmessage at all, right? > So when I see this problem I > get errors inserting the date due to the duplicate. Again, I get this > repeatedly as the real problem (in this case missing headers - from, > to, subject etc) is not repaired due to it halting on the first > error. > > Maybe the INSERT INTO here can be a REPLACE INTO to avoid duplicates, > otherwise ignore any duplicate errors as obviously that particular > header already exists. The right thing to do is to not insert duplicates, not even try it. The question is: why does dbmail try to insert a value that exists already? "dbmail-util -by" should only cache missing physmessages. The code should be fixed there. If that needs a SELECT prior to INSERT or whatever is in the coders hand ;-) mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Bug in dbmail-util - not cleaning un-cached physmessages, and making other mess
On Dienstag 17 März 2009 Paul J Stevens wrote: > > Wouldn't a single physmessage_id entry be enough in > > dbmail_datefield? If yes, the index dbmail_datefield_1, which > > currently is UNIQUE (physmessage_id, id) could be changed to UNIQUE > > (physmessage_id). > > Sounds good. > > > And the same goes for dbmail_datefield I suppose, and maybe others > > also. Paul, if you say I'm right I'd deliver SQL statements to > > cleanup maybe existing mess, and change indices. But I could be > > wrong, so I wait for your reply. > > Please do. Do you think there will ever be a patch in the 2.2 series to apply my changes? I think no, as 2.2 is end-of-life from devs pov. So I wonder if it's worth the effort at all. But that changes could help find bugs like this one, as the db will complain on duplicate indices. > > Back to the original search: There is no subjectfield value in > > those 3 messages, so no subject gets inserted. And that makes > > dbmail-util never successful in its cleanup. Maybe a "" subject > > should be inserted for messages that don't have it? > > Correct, a perfectly valid empty subject shouldn't lead to any kind > of failure. Does that mean it will be worked on? Should I file a bug report? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Bug in dbmail-util - not cleaning un-cached physmessages, and making other mess
No matter how often I run dbmail-util -by, I always get: Repairing DBMAIL for cached header values... Ok. Found [3] un-cached physmessages. In the code, this generates (in function db.c/db_icheck_headercache ) SELECT p.id FROM dbmail_physmessage p LEFT JOIN dbmail_headervalue h ON p.id = h.physmessage_id WHERE h.physmessage_id IS NULL; which really returns 3 id's. Then function db.c/db_set_headercache should cleanup the mess, but doesn't. That function only logs: Mar 17 09:04:38 mailsrv2.i.zmi.at dbmail/maintenance[9101]: Message: [message] dbmail-message.c,dbmail_message_cache_subjectfield(+1207): no subject field value [1838862] Mar 17 09:04:38 mailsrv2.i.zmi.at dbmail/maintenance[9101]: Message: [message] dbmail-message.c,dbmail_message_cache_subjectfield(+1207): no subject field value [1838861] Mar 17 09:04:38 mailsrv2.i.zmi.at dbmail/maintenance[9101]: Message: [message] dbmail-message.c,dbmail_message_cache_subjectfield(+1207): no subject field value [1838858] There doesn't seem to be an error, as there are no logs for that, but still it's not working. Then I set TRACE_SYSLOG = 5 and re-ran dbmail- util. See attached dbmail.log From those logs, you can see that a dbmail_datefield and dbmail_envelope with a date are inserted into the db. That's a mess already: select * from dbmail_datefield where physmessage_id = 1838862; physmessage_id | id| datefield +-+- 1838862 | 1307186 | 1970-01-01 00:00:00 1838862 | 1307099 | 1970-01-01 00:00:00 1838862 | 1306945 | 1970-01-01 00:00:00 1838862 | 1306701 | 1970-01-01 00:00:00 1838862 | 1306400 | 1970-01-01 00:00:00 1838862 | 1307612 | 1970-01-01 00:00:00 1838862 | 1307616 | 1970-01-01 00:00:00 1838862 | 1307564 | 1970-01-01 00:00:00 1838862 | 1307619 | 1970-01-01 00:00:00 1838862 | 1307350 | 1970-01-01 00:00:00 1838862 | 1307609 | 1970-01-01 00:00:00 Wouldn't a single physmessage_id entry be enough in dbmail_datefield? If yes, the index dbmail_datefield_1, which currently is UNIQUE (physmessage_id, id) could be changed to UNIQUE (physmessage_id). And the same goes for dbmail_datefield I suppose, and maybe others also. Paul, if you say I'm right I'd deliver SQL statements to cleanup maybe existing mess, and change indices. But I could be wrong, so I wait for your reply. Back to the original search: There is no subjectfield value in those 3 messages, so no subject gets inserted. And that makes dbmail-util never successful in its cleanup. Maybe a "" subject should be inserted for messages that don't have it? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[db] dbmodule.c,db_query(+145): last query took [4] seconds Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Info:[db] dbmodule.c,db_query(+151): slow query [SELECT p.id FROM dbmail_physmessage p LEFT JOIN dbmail_headervalue h ON p.id = h.physmessage_id WHERE h.physmessage_id IS NULL] took [4] seconds Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[sql] dbpgsql.c,db_query(+279): [SELECT messageblk, is_header FROM dbmail_messageblks WHERE physmessage_id = 1838862 AND is_header = '1'] Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[db] dbmodule.c,db_query(+145): last query took [0] seconds Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[message] dbmail-message.c,_set_content_from_stream(+425): parse message Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[sql] dbpgsql.c,db_query(+279): [BEGIN] Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[db] dbmodule.c,db_query(+145): last query took [0] seconds Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[sql] dbpgsql.c,db_query(+279): [INSERT INTO dbmail_datefield (physmessage_id, datefield) VALUES (1838862,'1970-01-01 00:00:00')] Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[db] dbmodule.c,db_query(+145): last query took [0] seconds Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Message:[message] dbmail-message.c,dbmail_message_cache_subjectfield(+1207): no subject field value [1838862] Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maintenance[9114]: Debug:[sql] dbpgsql.c,db_query(+279): [INSERT INTO dbmail_envelope (physmessage_id, envelope) VALUES (1838862,'("Thu, 01 Jan 1970 00:00:00 +" NIL NIL NIL NIL NIL NIL NIL NIL NIL)')] Mar 17 09:08:02 mailsrv2.i.zmi.at dbmail/maint
Re: [Dbmail] dbmail-dev list broken?
On Donnerstag 12 März 2009 Aleksander Kamenik wrote: > It's been working fine, I guess. Several messages almost every day. > Though your last message there seems to be dated 28th Feb. Maybe > there is something wrong. Seems I got dropped. I re-subscribed now, and immediately received one message. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] dbmail-dev list broken?
I got no more messages from dbmail-devs since 4.March, and this morning sent a test message there - which also didn't arrive. Do others also have this problem or is it specific to me? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Postfix > DBMail 2.2 (lost connections)
On Mittwoch 11 März 2009 Simon wrote: > status=deferred (delivery temporarily > suspended: lost connection with > 210.OUR.DBMAIL.SERVER[210.OUR.DBMAIL.SERVER] while sending end of > data -- message may be sent more than once) Log into db logs. Maybe too many connections concurrently? mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] mailing list server IP changed?
On Montag 09 März 2009 Paul J Stevens wrote: > Also, the Sender/Reply-to headers for messages from the list are > incorrect. I've already notified the support-team at IC&S. I'll add > the missing PTR record to the list ;-) Funny, now that I "fixed" the missing PTR by allowing that one IP without PTR to pass through, I receive messages that were sent on wednesday already. See the jump from Mar 4 to Mar 9: Received: from dbmail01.icns.fastxs.net (unknown [213.214.111.4]) by protegate5.zmi.at (Postfix) with ESMTP id 92108399 for ; Mon, 9 Mar 2009 10:08:33 +0100 (CET) [that's fastxs's server:] Received: from localhost (localhost [127.0.0.1]) by dbmail01.icns.fastxs.net (Postfix) with ESMTP id 6EFB05D03B5; Wed, 4 Mar 2009 22:48:28 +0100 (CET) So despite my server saying "550 no PTR" they seem to have kept mails, and now that my server allows them maybe I get everything/some mails, but so far none from dbmail-dev. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] marking a mailbox as read is slow, suggesting improvement
connected > sessions. But we might get away by assuming such concurrent clients > are all connected to the same imapd process. If not we'd have to use > some synchronisation channel between different imapd processes using > the same database backend. Right. If STOREs must be atomic, forget about caching it. Syncing between imap processes doesn't sound like something implemented in an afternoon ;-) > It all comes down to keep pushing the code and design and look for > ways to reduce cost of operation - be that for system calls like > Artem is pushing for, or database calls as you are. Yes, and I'd like to help here, for that part that I can help with. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] last message on wednesday?
On Montag 09 März 2009 Jorge Bastos wrote: > When you reply to a message, you must change the To: field. > Mailing list was moved to another server or so and need's some > tunning. > > Paul sent an email to the list, didn't you saw it? I did at least. That's not what I meant. I did not receive any single dbmail message, as the new host didn't have a PTR DNS record. The "reply" seems to work now. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] marking a mailbox as read is slow, suggesting improvement
recent_flag, TO_CHAR(internal_date, '-MM-DD HH24:MI:SS' ), rfcsize, message_idnr FROM dbmail_ messages msg, dbmail_physmessage pm WHERE pm.id = msg.physmessage_id AND message_idnr BETWEEN 3635587 AND 3651745 AND mailbox_idnr = 3324 AND status IN (0,1,2) ORDER BY message_idnr ASC (again, why are those 2 SELECTs needed?) 2009-03-04 00:26:48 CET pid=4609 25/120890 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651501 AND status < 2 AND mailbox_idnr = 3324 2009-03-04 00:26:48 CET pid=4609 25/120891 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651521 AND status < 2 AND mailbox_idnr = 3324 2009-03-04 00:26:48 CET pid=4609 25/120892 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651555 AND status < 2 AND mailbox_idnr = 3324 2009-03-04 00:26:48 CET pid=4609 25/120893 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651557 AND status < 2 AND mailbox_idnr = 3324 2009-03-04 00:26:48 CET pid=4609 25/120894 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651579 AND status < 2 AND mailbox_idnr = 3324 2009-03-04 00:26:48 CET pid=4609 25/120895 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651706 AND status < 2 AND mailbox_idnr = 3324 2009-03-04 00:26:48 CET pid=4609 25/120896 idle: LOG: statement: UPDATE dbmail_messages SET recent_flag=0, seen_flag=1 WHERE message_idnr = 3651745 AND status < 2 AND mailbox_idnr = 3324 Now I know that development to dbmail-2.2 has stopped, but I guess the process is not a lot different in 2.3 so I want to suggest two improvements: 1) Currently for *every single* message a separate UPDATE is done, this could easily be replaced by a multi-message UPDATE. And I guess lots of SELECTs could be dropped also. dbmail=> EXPLAIN UPDATE dbmail_messages SET recent_flag=0, seen_flag=0, answered_flag=0, flagged_flag=0, draft_flag=0 WHERE message_idnr IN (3651501,3651521,3651555) AND status < 2 AND mailbox_idnr = 3324; QUERY PLAN -- Bitmap Heap Scan on dbmail_messages (cost=19.22..23.24 rows=1 width=67) Recheck Cond: ((mailbox_idnr = 3324) AND (message_idnr = ANY ('{3651501,3651521,3651555}'::bigint[]))) Filter: (status < 2) -> BitmapAnd (cost=19.22..19.22 rows=1 width=0) -> Bitmap Index Scan on dbmail_messages_1 (cost=0.00..6.17 rows=253 width=0) Index Cond: (mailbox_idnr = 3324) -> Bitmap Index Scan on dbmail_messages_pkey (cost=0.00..12.80 rows=3 width=0) Index Cond: (message_idnr = ANY ('{3651501,3651521,3651555}'::bigint[])) (8 Zeilen) But I found that leaving "AND mailbox_idnr = 3324" is not needed anyway, and makes the query slower, so let it away: dbmail=> EXPLAIN UPDATE dbmail_messages SET recent_flag=0, seen_flag=0, answered_flag=0, flagged_flag=0, draft_flag=0 WHERE message_idnr IN (3651501,3651521,3651555) AND status < 2; QUERY PLAN Bitmap Heap Scan on dbmail_messages (cost=12.80..24.56 rows=3 width=67) Recheck Cond: (message_idnr = ANY ('{3651501,3651521,3651555}'::bigint[])) Filter: (status < 2) -> Bitmap Index Scan on dbmail_messages_pkey (cost=0.00..12.80 rows=3 width=0) Index Cond: (message_idnr = ANY ('{3651501,3651521,3651555}'::bigint[])) (5 Zeilen) 2) When an IMAP command "UID STORE" arrives, could dbmail wait to see if a 2nd "UID STORE" arrives next? Currently there are 2 updates, first setting all flags=0, later seen=1. That could be grouped. Doesn't matter with only some users, but once you have 500+ concurrent users, or WAL logs (which generate a record for every single transaction), there's a big difference. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] converting from maildir to dbmail
On Sonntag 22 Februar 2009 Andrea Fino wrote: > I thank you for your suggestion. By the way, I never used sieve > functionality at all. Could you point to a sample of such a script? require ["fileinto", "reject", "envelope", "vacation", "subaddress", "relational", "comparator-i;ascii-numeric", "regex"]; if anyof (header :contains "to" ["@domain1"], header :contains "list-id" [""] ) { fileinto "Private/allgemein"; stop; } if header :contains "list-id" ["this.list.id"] { fileinto "Projekte/uhuh"; stop; } if anyof ( header :contains ["from","to","cc","bcc"] ["@suse.com","opensuse-security-annou...@opensuse.org","cert- advis...@cert.org","@us-cert.gov"], header :contains ["list-id"] ["gallery- announce.lists.sourceforge.net",""] ) { fileinto "lists/security"; stop; } mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Automatically create imap folders
On Samstag 21 Februar 2009 Aaron Stone wrote: > And, frankly, Outlook does a very good job at what it does for email > and calendaring with Exchange server. > > Delivering a comprehensive alternative stack that works at least as > well, and can beat out Outlook on Windows for the business people > every organization can't get rid of remains an elusive goal. Right. I did not find a program that is an alternative to Outlook until now. The problem start when trying to sync with mobile/PDA. I will soon test OpenXchange, as a customer wants that. Hope it's good. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 signature.asc Description: This is a digitally signed message part. ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
[Dbmail] Wiki FAQ edited: performance with PostgreSQL (parts may apply to mysql as well)
http://www.dbmail.org/dokuwiki/doku.php?id=performance I added the 2nd unneeded index for the 2.2 dbmail series to be removed. Tested on our production servers, no penalties. I guess that MySQL will have the same indices, so you can remove them there too. But that's untested. mfg zmi -- // Michael Monnerie, Ing.BSc- http://it-management.at // Tel: 0660 / 415 65 31 .network.your.ideas. // PGP Key: "curl -s http://zmi.at/zmi.asc | gpg --import" // Fingerprint: AC19 F9D5 36ED CD8A EF38 500E CE14 91F7 1C12 09B4 // Keyserver: wwwkeys.eu.pgp.net Key-ID: 1C1209B4 ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail