[Dovecot] Deleted mails in dsync backups
Hello we are doing regular backups of the mdbox mail folders using dsync -u username backup mdbox:/somedir/BACKUPS/username (still with version 2.1.10, but 2.2.5 is in testing phase) We do observe that the directory size in the BACKUPS directory is growing with respect to the original mail folders. I believe this is due to deleted mails not being purged in the backup. We are doing regular doveadm purge -A cleanups, but this does (of course) not affect the backups and subsequent dsync backup runs seem not to clean up deleted mails in the backup either. Will the behaviour of the dsync backup command deal with deleted mails in the 2.2.5 release? If not, what could we do to get rid of the deleted mails in the backup (or is there another reason for the growth in size) We have e.g. after 9 month of running with 2.1.10 du -sk username 588520 du -sk /somedir/BACKUPS/username 863024 -- Wolfgang Friebel Deutsches Elektronen-Synchrotron DESY
Re: [Dovecot] Dovecot Dsync
Hi I'm on an Ubuntu LTS release so the dovecot came from their release. I'd prefer to stay that way unless I really have to... Everyone is entitled to their own opinions, but IMHO this kind of attitude is a huge detriment to most software projects. I see very little reason to take such policies personally... 1) I use virtualisation (especially lightweight virtualisation such as vservers) so that each service is in its own container. Now if I have no interest in some container and want to let it rot (ie as per LTS), then I can just do so. 2) I use a fast moving rolling distro (gentoo in my case, Arch is probably a good choice also) so that I have the option to stay up to date when I want to The end result is you can be as up to date as you want, or let things rot, as you please. Unfortunately if you want to use a very old bit of software, then you also get to keep all it's bugs... Sorry. Good luck! Hope this inspires you to try a different route! Ed W
[Dovecot] mdbox - healthy rotation size vs default - WAS Re: Dovecot tuning for GFS2
On 2013-08-22 9:57 PM, Stan Hoeppner s...@hardwarefreak.com wrote: On 8/21/2013 4:07 PM, Jan-Frode Myklebust wrote: I would strongly suggest using mdbox instead. AFAIK clusterfs' aren't I'd recommend mdbox as well, with a healthy rotation size. The larger files won't increase IMAP performance substantially but they can make backup significantly quicker. I'm considering migrating to mdbox... wondering what you consider 'healthy' rotation size. I generally try to avoid changing defaults whenever possible, so, do you consider the default size of 2MB too small? I guess though that it depends on usage. Since we get a decent number of large attachments, maybe that is a good reason to bump it up? Thanks, -- Best regards, */Charles/*
Re: [Dovecot] Dovecot never release preallocated space in mdbox
On 2013-08-02 8:30 AM, Timo Sirainen t...@iki.fi wrote: The problem is that there is no rotation time. In normal operation Dovecot would be wasting time (=disk IO) looking at old files and figuring out if they would need hole punching. I guess the doveadm purge job could do that, but I'm not sure if that's always the best idea either. I remember some people using different mdbox settings for normal operations and for doveadm purge runs, so this could also unintentionally break things. I'm considering migrating my users to mdbox, and thought that I had sent a follow-up to this, but found it in my Drafts folder... This does give me a little pause for concern... Shouldn't there be an internal, automatic mechanism in place for compacting (this I think is the more appropriate term, since it is what Thunderbird and Outlook both use, although it is used for local client files, as opposed to server based files) these files? Personally I'd like it to happen immediately, when a user deletes a(some) message(es). Maybe add a new setting for 'mdbox_compact_trigger' or something like that, where it only does it if it will reclaim at least ## amount of space - although checking for that in and of itself might be as much or more work as just doing it immediately when the email(s) is(are) deleted. But, even if it wasn't fully automatic, maybe simplest would be just another option to pass to doveadm purge (ie, -C for 'compact)? Also - what happens currently when *all* messages in any given mdbox file are deleted? Is the mdbox file deleted? Thanks, -- Best regards, */Charles/*
Re: [Dovecot] piegonhole sieve prepending header lines with an extra space
Hi Stephen, I finally had a chance to re-test this and confirm that v4.1 of the plugin does fix the problem. Thanks for your assistance. Regards, Anand On 25 July 2013 17:11, Stephan Bosch step...@rename-it.nl wrote: On 7/25/2013 8:06 AM, Anand Kumria wrote: Hi Stephan, I'm not sure, I'm using Dovecot-managesieved 0.4.0-14, which I believe is commit 1771:b41f5cf04b8f, which is actually *before* the commit you mentioned. I'm not clear because you already have a release (v4.1) which does contain that patch; are you suggesting that an upgrade to that version might help? Oh, right, it is already released. So, yes, upgrade. Regards, Stephan.
[Dovecot] SSL Cipher Order in Dovecot
Hi, I want that dovecot uses PFS with my Apple Devices. I set the Cipher List to: ssl_cipher_list = DHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!CBC:!PSK:!SRP:!DSS:!SSLv2:!RC4 I got this from here: http://www.kuketz-blog.de/perfect-forward-secrecy-mit-apple-mail/ But then my only Outlook 2010 Client won't connect. If i enable rsa-aes128-SHA again on third place all clients connect without dhe. Dosen't dovecot horner the Cipher Order in the config? Kind regards Marc smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] mdbox - healthy rotation size vs default - WAS Re: Dovecot tuning for GFS2
On 8/23/2013 7:17 AM, Charles Marcus wrote: On 2013-08-22 9:57 PM, Stan Hoeppner s...@hardwarefreak.com wrote: On 8/21/2013 4:07 PM, Jan-Frode Myklebust wrote: I would strongly suggest using mdbox instead. AFAIK clusterfs' aren't I'd recommend mdbox as well, with a healthy rotation size. The larger files won't increase IMAP performance substantially but they can make backup significantly quicker. I'm considering migrating to mdbox... wondering what you consider 'healthy' rotation size. I generally try to avoid changing defaults whenever possible, so, do you consider the default size of 2MB too small? I guess though that it depends on usage. Since we get a decent number of large attachments, maybe that is a good reason to bump it up? It's probably better to err large than to err small. Analyze your current maildir directories and make a distribution graph of file sizes. That should give you a good idea of what your rotation size should be. -- Stan
[Dovecot] Dovecot LDA
OK, I did read http://wiki2.dovecot.org/LDA but it doesn't answer the question I have since it doesn't tell me what I can do with -o, exactly. What I would like to do is be able to call dovecot-lda and pass along '\\Seen', is that possible? -- Up the airy mountains, down the rushy glen... From ghosties and bogles and long-leggity beasties... My mother said I never should... We dare not go a-hunting for fear... And things that go bump... Play with the fairies in the wood... --Lords and Ladies
Re: [Dovecot] Dovecot LDA
On 08/24/2013 02:12 AM LuKreme wrote: OK, I did read http://wiki2.dovecot.org/LDA but it doesn't answer the question I have since it doesn't tell me what I can do with -o, exactly. -o is used to override settings, as documented in dovecot-lda(1)/http://wiki2.dovecot.org/Tools/DovecotLDA What I would like to do is be able to call dovecot-lda and pass along '\\Seen', is that possible? That requires Sieve, see http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#line-59 for an example. Regards, Pascal -- The trapper recommends today: cafebabe.1323...@localdomain.org
[Dovecot] expire plugin doesn't work?
Hello,
I've configured dovecot to use expire plugin:
heres my dovecot -n:
-
# 2.1.7: /etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 ext4
auth_mechanisms = plain login
dict {
expire = mysql:/etc/dovecot/dovecot-dict-expire-sql.conf.ext
}
mail_location = maildir:/home/mail/vhosts/%d/%n
mail_plugins = expire
mail_privileged_group = vmail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy
include variables body enotify environment mailbox date ihave
namespace inbox {
inbox = yes
location =
mailbox Drafts {
auto = no
special_use = \Drafts
}
mailbox Junk {
special_use = \Junk
}
mailbox Sent {
auto = subscribe
special_use = \Sent
}
mailbox Sent Messages {
special_use = \Sent
}
mailbox Spam {
auto = subscribe
special_use = \Junk
}
mailbox Trash {
auto = subscribe
special_use = \Trash
}
prefix =
}
passdb {
args = /etc/dovecot/dovecot-sql.conf.ext
driver = sql
}
plugin {
expire = Trash 7
expire_dict = proxy::expire
sieve = ~/dovecot.sieve
sieve_dir = ~/sieve
sieve_max_actions = 32
sieve_max_redirects = 4
sieve_max_script_size = 1M
sieve_quota_max_scripts = 32
}
protocols = imap pop3 lmtp sieve
service auth-worker {
user = vmail
}
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0666
user = postfix
}
unix_listener auth-userdb {
mode = 0600
user = vmail
}
user = dovecot
}
service imap-login {
inet_listener imap {
port = 0
}
inet_listener imaps {
port = 993
ssl = yes
}
}
service lmtp {
unix_listener /var/spool/postfix/private/dovecot-lmtp {
group = postfix
mode = 0600
user = postfix
}
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
service_count = 1
vsz_limit = 128 M
}
service pop3-login {
inet_listener pop3 {
port = 0
}
inet_listener pop3s {
port = 995
ssl = yes
}
}
ssl = required
ssl_ca = /etc/ssl/my_certs/sub.class1.server.ca.pem
ssl_cert = /etc/ssl/private/chig.in/mail/mail.chig.in.crt
ssl_key = /etc/ssl/private/chig.in/mail/mail.chig.in.key
userdb {
args = uid=vmail gid=vmail home=/home/mail/vhosts/%d/%n
driver = static
}
protocol lmtp {
mail_plugins = expire sieve
}
protocol sieve {
mail_max_userip_connections = 10
managesieve_implementation_string = Cyrus timsieved v2.2.13
managesieve_logout_format = bytes=%i/%o
managesieve_max_compile_errors = 5
}
-
What exactly I did
1) dovecot.conf
dict {
expire = mysql:/etc/dovecot/dovecot-dict-expire-sql.conf.ext
}
2) /etc/dovecot/dovecot-dict-expire-sql.conf.ext
connect = host=127.0.0.1 dbname=mailserver user=mail password=SOMEPASS
map {
pattern = shared/expire/$user/$mailbox
table = expires
value_field = expire_stamp
fields {
username = $user
mailbox = $mailbox
}
}
3) conf.d/10-mail.conf
mail_plugins = expire
4) conf.d/90-plugin.conf
plugin {
#setting_name = value
expire = Trash 7
expire_dict = proxy::expire
}
5) Created table in mysql server
mysql show create table expires;
+-+-+
| Table | Create Table
|
+-+-+
| expires | CREATE TABLE `expires` (
`username` varchar(75) NOT NULL,
`mailbox` varchar(255) NOT NULL,
`expire_stamp` int(11) NOT NULL,
PRIMARY KEY (`username`,`mailbox`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8 |
+-+-+
1 row in set (0.00 sec)
And nothing works
dovecot debug shows nothing: only one string related to expire plugin
Aug 24 04:21:37 piscola dovecot: lmtp(16927): Debug: Module loaded:
/usr/lib/dovecot/modules/lib20_expire_plugin.so
mysql general query log show nothing also...
Can anyone help me please?
Thanks a lot!
Re: [Dovecot] expire plugin doesn't work?
On 08/23/2013 09:05 PM, Anton Chigin wrote:
plugin {
expire = Trash 7
expire_dict = proxy::expire
You're using Dovecot 2.1, that configuration syntax is for 1.2.
Please follow documentation at http://wiki2.dovecot.org/Plugins/Expire
