[Dovecot] prevent dovecot from modifying maildirs
Hi all, Is there any possibility to ask dovecot to write nothing to disk, something like a read only state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. Does anybody has any idea on how to achieve this? Regards! Felix
Re: [Dovecot] prevent dovecot from modifying maildirs
On 2013-08-09 5:44 AM, Felix Rubio Dalmau felixrubiodal...@gmail.com wrote: Is there any possibility to ask dovecot to write nothing to disk, something like a read only state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. ??? That is supposed to be (haven't used it yet) one of ZFS's strong points. You don't need to worry about this, it is all handled by the OS. If you think you do need to worry about it, then you'll have to come up with a very good reason why. -- Best regards, */Charles/*
Re: [Dovecot] prevent dovecot from modifying maildirs
Felix Rubio Dalmau skrev den 2013-08-09 11:44: Does anybody has any idea on how to achieve this? stop dovecot/postfix, maybe remember sql/ldap database aswell
Re: [Dovecot] prevent dovecot from modifying maildirs
On 2013-08-09 11:44, Felix Rubio Dalmau wrote: Is there any possibility to ask dovecot to write nothing to disk, something like a read only state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. Does anybody has any idea on how to achieve this? As mentioned before, that's done by ZFS. Just create a snapshot using your ZFS functionality (zfs snapshot name). Regards, Michael
Re: [Dovecot] prevent dovecot from modifying maildirs
On 2013-08-09 8:04 AM, Michael Grimm trash...@odo.in-berlin.de wrote: On 2013-08-09 11:44, Felix Rubio Dalmau wrote: Is there any possibility to ask dovecot to write nothing to disk, something like a read only state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. Does anybody has any idea on how to achieve this? As mentioned before, that's done by ZFS. Just create a snapshot using your ZFS functionality (zfs snapshot name). And the same goes for LVM snapshots. The only thing you might want/need to worry about is SQL databases... for these I always do periodic dumps (how often dicatated by how long the dumps take vs how often the data changes vs how critical the data is). -- Best regards, */Charles/*
[Dovecot] works | Re: Getting default uid/gid of users via socket for virtual user support for sendmail
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On Thu, 1 Aug 2013, Timo Sirainen wrote:
You can't get the mail_uid/gid/home, because they really don't belong to auth
process.. But what you could do with v2.2 is:
userdb {
driver = ldap
args = ..
default_fields = uid=1234 gid=1234 home=/home/user/%u
}
works like charm, thanks!
- --
Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
iQEVAwUBUgTqMF3r2wJMiz2NAQK1PwgAh77/ZC1PTh1qReOQ7yNr0uGswzEmw2aM
dNJTdbAXnWvxUPXGl9nmmYs/GahbyyJbD42/MM2Hpl+w95vIgWOhQxkPp2QyzJFt
T+MfHvLKcg6vDvmeSBUGTL08m9tGyb4EXMROh1ONLW4bAhPHtN8qJrgR4vKTTOqe
Ri75cATI3LbiWPS53ub+9s+DAvCFvoakSdl08BIOJmzzVClEF0iis9AnRpOY9a4p
7y2P6DG0nGY/MvFSXnpu0wP0E3IGqQm9jFD1d7aXgznkPr5lyHFkLXe3xkSmHV0M
nGBRf3WV4WPHyWVPsjZNr1h3Xcl+CzXIQImadZt/WZF41UGUz2GJbQ==
=suGe
-END PGP SIGNATURE-
[Dovecot] Error: Threading lost Message ID?
QUERY:THREAD REFERENCES ISO-8859-1 ALL RESPONSE: [SERVERBUG] Internal error occurred. Refer to server log for more information. [2013-08-09 15:42:34] Aug 9 15:41:48 postamt dovecot: imap(username) tTbs7oPjfACNKs4m: Error: Threading lost Message ID Aug 9 15:42:34 postamt dovecot: imap(username) tTbs7oPjfACNKs4m: Error: Threading lost Message ID What does that mean? WHY has the Message-Id been lost? How can I find out WHICH MAIL caused this? This is the most recent dovecot 2.2.x -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebra...@charite.de | http://www.charite.de
Re: [Dovecot] Error: Threading lost Message ID?
* Ralf Hildebrandt ralf.hildebra...@charite.de: QUERY:THREAD REFERENCES ISO-8859-1 ALL RESPONSE: [SERVERBUG] Internal error occurred. Refer to server log for more information. [2013-08-09 15:42:34] Aug 9 15:41:48 postamt dovecot: imap(username) tTbs7oPjfACNKs4m: Error: Threading lost Message ID Aug 9 15:42:34 postamt dovecot: imap(username) tTbs7oPjfACNKs4m: Error: Threading lost Message ID What does that mean? WHY has the Message-Id been lost? How can I find out WHICH MAIL caused this? This is the most recent dovecot 2.2.x 2.2.5, but actually it is yesterdays hg clone. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebra...@charite.de | http://www.charite.de
Re: [Dovecot] How to troubleshoot LDA or LMTP?
Gnus supports IMAP natively, and even ManageSieve. Use that, don't run a proxy, it's a lot easier. On Thu, Aug 8, 2013 at 4:19 AM, Steffen Kaiser skdove...@smail.inf.fh-brs.de wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Thu, 8 Aug 2013, John Williams wrote: in order to not filter the same message twice or re-filter messages, you've moved around manually? That is not a problem. The filtering process works perfectly when I manually invoke dovecot-lda. My problem is that I have followed the instructions here: http://wiki2.dovecot.org/LDA/ and here: http://wiki2.dovecot.org/LDA/Sendmail and here: http://wiki2.dovecot.org/LMTP but neither dovecot-lda nor LMTP seem to be triggered whenever I send email from my MUA (Gnus). At least, I *think* I have followed the instructions correctly. Would you like me to post my dovecot config again, and the relevant portion of sendmail.cf? Thank you very much for your help, I truly appreciate it. As Stan already pointed out: a local delivery takes place only, when the mail arrives via a MTA. offlineimap synchronizes two IMAP folders, there is no local delivery at your side at all. Hence, neither LDA nor LMTP is invoked. So I see two ways: 1) keep offlineimap to resync your local store back to the server and keep both in-sync. Then you can: 1a) run offlineimap to get new messages from the upstream server and sync current local messages. 1b) remove the new ones from the local store and feed them _manually_ to the LDA or LMTP. Now the filtering takes place and they are re-added to the mail storage. 1c) maybe: re-run the process until no new messages got downloaded, in order to keep the server in-sync 2) no need for server messages in-sync with local message store 2a) setup a local MTA that accepts your domain and drops messages via Dovecot LDA or LMTP. Then get the new messages via fetchmail on a regular basis and hand the messages over to the local MTA. 2b) use fetchmail in combination with Dovecot LDA/LMTP. No local MTA necessary. fetchmail will see only messages in INBOX as far as I know. So no filtering on the server must take place. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUgNiqV3r2wJMiz2NAQISSAgAnSWnyf4kzNrbEd/+UcZGvmeegCWp4QY3 TWAIh8V8vbo+FyKyYomvRLt1mmq5CKJNwOUdz+A3u5R6XT25JZKxA5yYhUKlLNEU n05zIsmWvKV6DWahdTv7GL84kmyETqp7zYo5pBWRf9SqwGFH8+KcBGh1U3MTaKhQ QfzIj3eYk7a1DQld7u3ZaLSiKCBadWCakgNscY2mX+gzoN4EXt+X1zMO52uaZpJ3 QkJyd2AHrnpYgBbmr2maneYox3+67IyQChnzZ0t2c9uPodT4ukEkZFYjrucEGlfv JEUaOaVnuzx/Wi7gxSUL/agSiaksLaEkT/KMWS6wQMSI0NxUaGIHjQ== =f/Uy -END PGP SIGNATURE- -- Sam Flint flintfam.org/~swflint
Re: [Dovecot] prevent dovecot from modifying maildirs
Actually the problem is that the snapshot is instantaneous, so if some commands are being run at the time of the snapshot I could get a snapshot of a non-consistent FS, right? Then, the single solution goes through just shuting down dovecot (and other services, like apache) the seconds required to perform the snapshot, whilst holding the postfix queues to ensure not loosing any mail. Does anybody have a better approach? Regards! Felix On Friday 09 August 2013 08:19:59 Charles Marcus wrote: On 2013-08-09 8:04 AM, Michael Grimm trash...@odo.in-berlin.de wrote: On 2013-08-09 11:44, Felix Rubio Dalmau wrote: Is there any possibility to ask dovecot to write nothing to disk, something like a read only state, without shutting it down? I have set up a ZFS+postfix+dovecot mail server, and I need both postfix (postsuper -h ALL) and dovecot (¿?) to stop modifying the disk to create the snapshot to be saved. Does anybody has any idea on how to achieve this? As mentioned before, that's done by ZFS. Just create a snapshot using your ZFS functionality (zfs snapshot name). And the same goes for LVM snapshots. The only thing you might want/need to worry about is SQL databases... for these I always do periodic dumps (how often dicatated by how long the dumps take vs how often the data changes vs how critical the data is). smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] prevent dovecot from modifying maildirs
On 2013-08-09 1:43 PM, Felix Rubio Dalmau felixrubiodal...@gmail.com wrote: Actually the problem is that the snapshot is instantaneous, so if some commands are being run at the time of the snapshot I could get a snapshot of a non-consistent FS, right? No, that is not right. If it was it would totally defeat the entire purpose of snapshots (which *is* to get a consistent view of the filesystem). Then, the single solution goes through just shuting down dovecot (and other services, like apache) the seconds required to perform the snapshot, whilst holding the postfix queues to ensure not loosing any mail. Does anybody have a better approach? Yes - read up on how snapshots work (in your case ZFS snapshots) and stop wasting brain cycles worrying about a non existent problem. As I said earlier, the only exception to this consistency question is with SQL databases. -- Best regards, */Charles /*
Re: [Dovecot] prevent dovecot from modifying maildirs
On 09.08.2013, at 19:43, Felix Rubio Dalmau felixrubiodal...@gmail.com wrote: Actually the problem is that the snapshot is instantaneous, so if some commands are being run at the time of the snapshot I could get a snapshot of a non-consistent FS, right? As mentioned before: Wrong. Have a look at http://en.wikipedia.org/wiki/Zfs#Snapshots_and_clones and http://en.wikipedia.org/wiki/Snapshot_(computer_storage) and alike. Regards, Michael
Re: [Dovecot] prevent dovecot from modifying maildirs
Michael, Charles, thank you for your comments. I had already seen the wikipedia entries about ZFS, but when I have performed my tests, consisting in: generate a program that writes a 100 MB file to disk and perform the snapshot during the file is being written. Obviously the snapshot shows a view of the file with the information and size it had at the time of the snapshot... so I get a portion of it. In order to save space I prefer no to have such half-files (mails) , and it is for this reason that I am asking if there is any way to prevent this. I'm not an expert in field of file systems, so I can be asking very naive questions... but I appreciate your comments on this topic. Thank you Felix On Friday 09 August 2013 20:39:31 Michael Grimm wrote: On 09.08.2013, at 19:43, Felix Rubio Dalmau felixrubiodal...@gmail.com wrote: Actually the problem is that the snapshot is instantaneous, so if some commands are being run at the time of the snapshot I could get a snapshot of a non-consistent FS, right? As mentioned before: Wrong. Have a look at http://en.wikipedia.org/wiki/Zfs#Snapshots_and_clones and http://en.wikipedia.org/wiki/Snapshot_(computer_storage) and alike. Regards, Michael
Re: [Dovecot] execvp /usr/local/libexec/dovecot/dovecot-lda: Permission denied
Hi,
Can you help me?
Because my config in master.cf is:
dovecot unix - n n - - pipe
flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d
${user}@${nexthop}
But now I have this problem in my postfix, logs:
fatal destination user parameter (-d user) not given
It´s funny because, this problem occur only in my domain, no to external
domains.
Before I was with this problem with permissions, I solved, but now happen
this.
Thanks.
--
View this message in context:
http://dovecot.2317879.n4.nabble.com/execvp-usr-local-libexec-dovecot-dovecot-lda-Permission-denied-tp9592p43797.html
Sent from the Dovecot mailing list archive at Nabble.com.
Re: [Dovecot] How to troubleshoot LDA or LMTP?
Sam Flint harmonicn...@gmail.com writes: Gnus supports IMAP natively, and even ManageSieve. Use that, don't run a proxy, it's a lot easier. I know. I'm using dovecot because I'm getting mail from an extremely slow connection, so Gnus blocks the Emacs UI for several seconds, making Emacs unusable. Using a local server eliminates that problem. On Thu, Aug 8, 2013 at 4:19 AM, Steffen Kaiser skdove...@smail.inf.fh-brs.de wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Thu, 8 Aug 2013, John Williams wrote: in order to not filter the same message twice or re-filter messages, you've moved around manually? That is not a problem. The filtering process works perfectly when I manually invoke dovecot-lda. My problem is that I have followed the instructions here: http://wiki2.dovecot.org/LDA/ and here: http://wiki2.dovecot.org/LDA/Sendmail and here: http://wiki2.dovecot.org/LMTP but neither dovecot-lda nor LMTP seem to be triggered whenever I send email from my MUA (Gnus). At least, I *think* I have followed the instructions correctly. Would you like me to post my dovecot config again, and the relevant portion of sendmail.cf? Thank you very much for your help, I truly appreciate it. As Stan already pointed out: a local delivery takes place only, when the mail arrives via a MTA. offlineimap synchronizes two IMAP folders, there is no local delivery at your side at all. Hence, neither LDA nor LMTP is invoked. So I see two ways: 1) keep offlineimap to resync your local store back to the server and keep both in-sync. Then you can: 1a) run offlineimap to get new messages from the upstream server and sync current local messages. 1b) remove the new ones from the local store and feed them _manually_ to the LDA or LMTP. Now the filtering takes place and they are re-added to the mail storage. 1c) maybe: re-run the process until no new messages got downloaded, in order to keep the server in-sync 2) no need for server messages in-sync with local message store 2a) setup a local MTA that accepts your domain and drops messages via Dovecot LDA or LMTP. Then get the new messages via fetchmail on a regular basis and hand the messages over to the local MTA. 2b) use fetchmail in combination with Dovecot LDA/LMTP. No local MTA necessary. fetchmail will see only messages in INBOX as far as I know. So no filtering on the server must take place. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUgNiqV3r2wJMiz2NAQISSAgAnSWnyf4kzNrbEd/+UcZGvmeegCWp4QY3 TWAIh8V8vbo+FyKyYomvRLt1mmq5CKJNwOUdz+A3u5R6XT25JZKxA5yYhUKlLNEU n05zIsmWvKV6DWahdTv7GL84kmyETqp7zYo5pBWRf9SqwGFH8+KcBGh1U3MTaKhQ QfzIj3eYk7a1DQld7u3ZaLSiKCBadWCakgNscY2mX+gzoN4EXt+X1zMO52uaZpJ3 QkJyd2AHrnpYgBbmr2maneYox3+67IyQChnzZ0t2c9uPodT4ukEkZFYjrucEGlfv JEUaOaVnuzx/Wi7gxSUL/agSiaksLaEkT/KMWS6wQMSI0NxUaGIHjQ== =f/Uy -END PGP SIGNATURE- -- Lecturer Department of Marketing University of Otago Dunedin, New Zealand
Re: [Dovecot] prevent dovecot from modifying maildirs
In order to save space I prefer no to have such half-files (mails) , and it is for this reason that I am asking if there is any way to prevent this. I'm not an expert in field of file systems, so I can be asking very naive questions... but I appreciate your comments on this topic. Filesystem consistency is different than, for lack of a better term, dovecot consistency. The latter places additional constraints on the content of files, rather than treating them as sequences of disk blocks. I don't think you can ensure the latter without stopping all dovecot processes (and maybe the MTA/LDA as well), which will be much more difficult and disruptive than just taking a snapshot. (I think some snapshot aware application like databases and hypervisors allows the operator to put the application in a state of acquiesence, long enough to take a snapshot, then unblock all processes after the snapshot.) I'd take the suggestion of the previous poster: take snapshots, don't worry, be happy. The small amount of inconsistencies is trivial compared with quickly recovering a mail store after disaster. Joseph Tam jtam.h...@gmail.com
