Replication only sporadic
Hello dear Dovecot Gurus,
I am setting up two servers with Dovecot replication as hot-standby
servers for a small high availability cluster, switch-over through
DNS-redirect.
For testing purposes, both servers are generating a small test mail
every few minutes and delivering to the local dovecot each. In my mail
client, I added both servers through IMAP to watch how the replication
is working. However, I noted that replication is very sporadic:
sometimes a new email is received instantaneous by both servers, then
no replication updates are visible for hours, and suddenly all missing
mail appear in the other server.
Why is this? Can this be changed to be more realtime?
Thank you!
Lucas
doveconf -n:
# 2.2.14: /usr/local/etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.7 ext4
auth_mechanisms = plain login cram-md5
disable_plaintext_auth = no
info_log_path = /var/log/dovecot-info.log
log_timestamp = %Y-%m-%d %H:%M:%S
mail_debug = yes
mail_location = maildir:/home/%d/%n/Maildir
mail_plugins = notify replication
mail_privileged_group = mail
passdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
plugin {
mail_replica = remote:vmail@...
quota = maildir:User quota
quota_rule = *:storage=1GB
replication_full_sync_interval = 1 hours
}
protocols = imap pop3
service aggregator {
fifo_listener replication-notify-fifo {
mode = 0600
user = vmail
}
unix_listener replication-notify {
mode = 0600
user = vmail
}
}
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0660
user = postfix
}
user = root
}
service config {
unix_listener config {
user = vmail
}
}
service doveadm {
user = vmail
}
service replicator {
process_min_avail = 1
}
ssl_cert = ...
ssl_key = ...
userdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
protocol imap {
mail_plugins = quota imap_quota
}
protocol pop3 {
mail_plugins = quota
pop3_uidl_format = %08Xu%08Xv
}
protocol lda {
info_log_path = /var/log/dovecot-lda.log
mail_plugins = quota
postmaster_address = ...
}
--
Lucas Rothamel
Eye Catching Webdesign
i...@eye-catching-webdesign.de - www.eye-catching-webdesign.de
You know, we go to the gym to keep the body fit. Similarly the mind needs some
rest. The mind is bombarded with so many impressions. Our mind has been
bombarded by impressions the whole time. It needs a different kind of rest
other than sleep. And meditation is such a rest. It calms the mind. energizes
the spirit and makes the body more strong and vibrant. improves the immune
system. The immune cells, the T-cell count go higher through Sudarshan Kriya
and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar
I love deadlines. I like the whooshing sound they make as they fly by. --
Douglas Adams
smime.p7s
Description: S/MIME Cryptographic Signature
Re: [Dovecot] Dovecot replication - I'm stuck
Yes, create the vmail user on both boxes and set up key-based
authentication via SSH so the two can talk to each other without passwords.
Also, best upgrade to dovecot 2.2 as mentioned on the wiki page, as only
2.2 supports incremental syncing of mailboxes.
Regards,
Lucas
Am 28.10.13 01:43, schrieb IT geek 31:
Hi,
I've been following the wiki document at
http://wiki2.dovecot.org/Replication, but I've become stuck.
I'm running version 2.1.3 on NetBSD 5.2 (v2.2+ isn't available as a package
yet, and compiling my own is well outside my wheelhouse).
I have a couple of questions:
The wiki page keeps referring to vmail. Is this a just system user I
need to create? Presumably on both Dovecot boxes?
If I don't use virtual users, do I need this?
Here is my dovecot -n:
# 2.1.3: /usr/pkg/etc/dovecot/dovecot.conf
# OS: NetBSD 5.2 cobalt
auth_mechanisms = plain login
dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u
listen = 192.168.1.1
login_greeting = Go on then, let's have it...
mail_location = mbox:~/mail:INBOX=/var/mail/%u
mail_plugins = notify replication
passdb {
driver = passwd
}
plugin {
mail_replica = remote:vm...@server2.mydomain.com
replication_full_sync_interval = 1 hours
}
protocols = imap
service aggregator {
fifo_listener replication-notify-fifo {
user = vmail
}
unix_listener replication-notify {
user = vmail
}
}
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0660
user = postfix
}
user = root
}
service imap-login {
inet_listener imap {
port = 0
}
}
service replicator {
process_min_avail = 1
unix_listener replicator-doveadm {
mode = 0600
}
}
ssl_cert = /etc/openssl/certs/mail.mydomain.com.crt
ssl_key = /etc/openssl/private/mail.mydomain.com.key
userdb {
driver = passwd
}
protocol lda {
postmaster_address = postmas...@mydomain.com
}
Any help would be greatly appreciated, as I'd really love to get this
working.
Thanks,
-Mark
--
Lucas Rothamel
Eye Catching Webdesign
i...@eye-catching-webdesign.de - www.eye-catching-webdesign.de
You know, we go to the gym to keep the body fit. Similarly the mind needs some
rest. The mind is bombarded with so many impressions. Our mind has been
bombarded by impressions the whole time. It needs a different kind of rest
other than sleep. And meditation is such a rest. It calms the mind. energizes
the spirit and makes the body more strong and vibrant. improves the immune
system. The immune cells, the T-cell count go higher through Sudarshan Kriya
and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar
I love deadlines. I like the whooshing sound they make as they fly by. --
Douglas Adams
smime.p7s
Description: S/MIME Cryptographic Signature
[Dovecot] Replication not happening on 2.2
Hello,
first - thanks for the help in getting dovecot 2.2 compiled and
installed on Debian.
I have Dovecot 2.2 running now on two servers, and to test replication,
I am polling mail on one server whilst the other creates mail regularly
from crontab output. I have replication set up, but nothing at all is
appearing on the other server, and I do not have any dsync / doveadm
messages in /var/log/mail.log any more. With 2.1, these two used to spam
many errors into mail.log.
Any hints?
Here is my dovecot-n output:
# 2.2.6: /etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext4
auth_mechanisms = plain login cram-md5
disable_plaintext_auth = no
log_timestamp = %Y-%m-%d %H:%M:%S
mail_location = maildir:/home/%d/%n/Maildir
mail_plugins = notify replication
mail_privileged_group = mail
passdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
plugin {
mail_replica = remote:vmail@mydomain
quota = maildir:User quota
quota_rule = *:storage=1GB
replication_full_sync_interval = 1 hours
}
protocols = imap pop3
service aggregator {
fifo_listener replication-notify-fifo {
mode = 0600
user = vmail
}
unix_listener replication-notify {
mode = 0600
user = vmail
}
}
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0660
user = postfix
}
user = root
}
service config {
unix_listener config {
user = vmail
}
}
service doveadm {
user = vmail
}
service replicator {
process_min_avail = 1
}
ssl_cert = /etc/ssl/certs/dovecot.pem
ssl_key = /etc/ssl/private/dovecot.pem
userdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
protocol imap {
mail_plugins = quota imap_quota
}
protocol pop3 {
mail_plugins = quota
pop3_uidl_format = %08Xu%08Xv
}
protocol lda {
mail_plugins = quota
postmaster_address = sysop@mydomain
}
Thanks,
Lucas
--
Lucas Rothamel
Eye Catching Webdesign
i...@eye-catching-webdesign.de - www.eye-catching-webdesign.de
You know, we go to the gym to keep the body fit. Similarly the mind needs some
rest. The mind is bombarded with so many impressions. Our mind has been
bombarded by impressions the whole time. It needs a different kind of rest
other than sleep. And meditation is such a rest. It calms the mind. energizes
the spirit and makes the body more strong and vibrant. improves the immune
system. The immune cells, the T-cell count go higher through Sudarshan Kriya
and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar
I love deadlines. I like the whooshing sound they make as they fly by. --
Douglas Adams
smime.p7s
Description: S/MIME Cryptographic Signature
[Dovecot] Upgrade from 2.1 to 2.2 on Debian
Hello, I am currently running Dovecot 2.1 on current Debian and need to upgrade to 2.2 to use the replication features. I understand that I therefore need to compile Dovecot myself. I am using a MySQL database for users authentication, therefore I need to compile Dovecot with mysql support: *./configure --with-mysql* Unfortunately this terminates with: *configure: error: Can't build with MySQL support: libmysqlclient not found* I installed libmysqlclient from debian repos, but it does not help. Also, how do I then connect the newly installed dovecot to my existing /etc/init.d/dovecot script? Thank you. Lucas -- Lucas Rothamel Eye Catching Webdesign i...@eye-catching-webdesign.de - www.eye-catching-webdesign.de You know, we go to the gym to keep the body fit. Similarly the mind needs some rest. The mind is bombarded with so many impressions. Our mind has been bombarded by impressions the whole time. It needs a different kind of rest other than sleep. And meditation is such a rest. It calms the mind. energizes the spirit and makes the body more strong and vibrant. improves the immune system. The immune cells, the T-cell count go higher through Sudarshan Kriya and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar I love deadlines. I like the whooshing sound they make as they fly by. -- Douglas Adams smime.p7s Description: S/MIME Cryptographic Signature
[Dovecot] Replication: long detalys
(old uid=1532, file=1381075921.V902I19a318eM521040.srv07.x:2,) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1533, file=1381075981.V902I19a318fM611775.srv07.x:2,) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1534, file=1381076041.V902I19a3190M734263.srv07.x:2,) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1535, file=1381076101.V902I19a3191M850303.srv07.x:2,) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1536, file=1381076881.V902I19a3192M362845.srv07.x:2,S) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1537, file=1380998413.V902I19a315bM206668.srv07.x:2,e) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1538, file=1380999043.V902I19a315cM413578.srv07.x:2,e) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1539, file=1380574384.V902I19a3146M616434.srv07.x:2,e) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Error: remote: dsync-remote(sysop@x): Warning: Maildir /home/x/sysop/Maildir: Expunged message reappeared, giving a new UID (old uid=1540, file=1381110251.V902I19a3186M993173.srv07.x) Oct 7 05:31:46 srv06 dovecot: dsync-local(sysop@x): Warning: Mailbox changes caused a desync. You may want to run dsync again. However, I cannot understand what this log wants to tell me? Please advise. Thanks. Lucas -- Lucas Rothamel Eye Catching Webdesign i...@eye-catching-webdesign.de - www.eye-catching-webdesign.de You know, we go to the gym to keep the body fit. Similarly the mind needs some rest. The mind is bombarded with so many impressions. Our mind has been bombarded by impressions the whole time. It needs a different kind of rest other than sleep. And meditation is such a rest. It calms the mind. energizes the spirit and makes the body more strong and vibrant. improves the immune system. The immune cells, the T-cell count go higher through Sudarshan Kriya and meditation. And you feel so nice inside. - Sri Sri Ravi Shankar I love deadlines. I like the whooshing sound they make as they fly by. -- Douglas Adams smime.p7s Description: S/MIME Kryptografische Unterschrift
