Re: [Dovecot] constant Log synchronization error's
On 30-07-2013 12:01, Timo Sirainen wrote: On 14.7.2013, at 13.18, Kim Bisgaard wrote: 11:45:57 Y dovecot: imap(X): Error: Log synchronization error at seq=6,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size .. # 2.2.4: /etc/dovecot/dovecot.conf This is actually a bug that is fixed already in hg.. I really should have released v2.2.5 already. I guess I'll do that this week after reading this mailing list and fixing any other new issues. Thanks Timo, 2.2.5 did apparently solve the problem - great!! Regards, Kim
Re: [Dovecot] constant Log synchronization error's
Some more detail :-) The previous system (i386) worked fine with dovecot 2.2.2 and pigeonhole 0.4.0 packages also from Atrpms on Fedora 17. I have downgraded to 2.1.16 and pigeonhole 0.3.5 for the time being. Regards, Kim On 2013-07-14 12:18, Kim Bisgaard wrote: Hi, I am seeing constant "Log synchronization error"s in my logs. See later for an example. This is dovecot 2.2.4, pigeonhole 0.4.1, and postfix 2.10.1 (with mailbox_command = /usr/libexec/dovecot/deliver) on a Fedora 19 system. I am using packages from Atrpms so there are some patches applied - ask for details. The mailboxes have resently been moved from a i386 system. I have tried to manually do "doveadm force-resync" for all users, but the problem persists :-( Here are an example from a user which does not use sieve: 11:45:48 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21531, TLS, session= 11:45:52 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21541, TLS, session= 11:45:54 Y dovecot: imap(X): Error: mdbox /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails: map uidvalidity mismatch (0 vs 1283330954) 11:45:54 Y dovecot: imap(X): Disconnected: Internal error occurred. Refer to server log for more information. [2013-07-14 11:45:54] in=353 out=115680 11:45:54 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/storage/dovecot.map.index 11:45:54 Y dovecot: imap(X): Warning: mdbox /var/mail/X/mdbox/storage: rebuilding indexes 11:45:54 Y dovecot: imap(X): Disconnected: Disconnected in IDLE in=707 out=437806 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index: Ex tension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=9,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index: Extensi on header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=13,offset=156 for /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index: Extension h eader update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session= 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21548, TLS, session= 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index: Extension header update
[Dovecot] constant Log synchronization error's
Hi, I am seeing constant "Log synchronization error"s in my logs. See later for an example. This is dovecot 2.2.4, pigeonhole 0.4.1, and postfix 2.10.1 (with mailbox_command = /usr/libexec/dovecot/deliver) on a Fedora 19 system. I am using packages from Atrpms so there are some patches applied - ask for details. The mailboxes have resently been moved from a i386 system. I have tried to manually do "doveadm force-resync" for all users, but the problem persists :-( Here are an example from a user which does not use sieve: 11:45:48 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21531, TLS, session= 11:45:52 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21541, TLS, session= 11:45:54 Y dovecot: imap(X): Error: mdbox /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails: map uidvalidity mismatch (0 vs 1283330954) 11:45:54 Y dovecot: imap(X): Disconnected: Internal error occurred. Refer to server log for more information. [2013-07-14 11:45:54] in=353 out=115680 11:45:54 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/storage/dovecot.map.index 11:45:54 Y dovecot: imap(X): Warning: mdbox /var/mail/X/mdbox/storage: rebuilding indexes 11:45:54 Y dovecot: imap(X): Disconnected: Disconnected in IDLE in=707 out=437806 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index: Ex tension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Kvitteringer/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=9,offset=156 for /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index: Extensi on header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/INBOX/Streams/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=13,offset=156 for /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index: Extension h eader update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Facebook/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Junk/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Sent/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Drafts/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=62.199.61.123, lip=192.168.0.5, TLS, session= 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Archives/2012/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21548, TLS, session= 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=5,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap(X): Error: Log synchronization error at seq=4,offset=156 for /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index: Extension header update points outside header size 11:45:55 Y dovecot: imap(X): Warning: fscking index file /var/mail/X/mdbox/mailboxes/Trash/Spam/dbox-Mails/dovecot.index 11:45:55 Y dovecot: imap-login: Login: user=, method=PLAIN, rip=62.199.61.123, lip=192.168.0.5, mpid=21552, TLS, session= 11:45:5
Re: [Dovecot] Problems Converting Maildir to mdbox
On a side note: Postfix bounces the messages deliver cannot deliver - why does it not keep them in queues until deliver works again? Aug 31 21:10:36 jukebox postfix/local[5087]: 910846B9D9: to=, relay=local, delay=0.07, delays=0.02/0/0/0.05, dsn=5.3.0, status=bounced (Command died with status 89: "/usr/libexec/dovecot/deliver". Command output: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-mail.conf line 54: Unknown setting: separator ) Aug 31 21:10:36 jukebox postfix/cleanup[5086]: A239E6B9D6: message-id=<20100831191036.a239e6b...@jukebox.alleroedderne.adsl.dk> Aug 31 21:10:36 jukebox postfix/qmgr[2218]: A239E6B9D6: from=<>, size=5386, nrcpt=1 (queue active) Aug 31 21:10:36 jukebox postfix/bounce[5135]: 910846B9D9: sender non-delivery notification: A239E6B9D6 Aug 31 21:10:36 jukebox postfix/qmgr[2218]: 910846B9D9: removed Best regards, Kim
Re: [Dovecot] Problems Converting Maildir to mdbox
On 31-08-2010 21:07, Timo Sirainen wrote: On Tue, 2010-08-31 at 20:49 +0200, Kim Bisgaard wrote: What error did lda give? You probably should add: Command output: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-mail.conf line 54: Unknown setting: separator ) That looks like it wasn't inside namespace {} or something else was weird. Anyway, you should have gotten that same error simply by running "doveconf" (or "dovecot", or any Dovecot tool really). (maildir uses '.' (I think)) so I only added: namespace { separator = . } You need inbox=yes there too (or maybe it's added there by default if you have only one namespace, can't remember). namespace { separator = / inbox = yes } Intuitively I would have expected '.' and not '/' (default (m)dbox), since I'm converting between maildir (.) and dbox(/) - right? For dsync it doesn't matter if it's '.' or '/', both will work fine. But if you have existing IMAP clients then you should preserve the separator or they could become confused. Just tried to do it again - I think first time was an error of mine - did not remove enough comments '#' from the config file - sorry! :-[ . This seems to work: namespace { inbox = yes location = prefix = separator = . } Thanks!! Kim
Re: [Dovecot] Problems Converting Maildir to mdbox
On 31-08-2010 20:38, Timo Sirainen wrote: On Sat, 2010-08-28 at 17:17 +0200, Kim Bisgaard wrote: Using this command ($1 is substituted for the user): dsync -u $1 -o "mail_location=maildir:/data/mail/$1/mdir" mirror "mdbox:/data/mail/$1/mdbox" I guess this should work. After having learned that I need to create the destination directory first, I got this error: dsync(root): Fatal: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) Which I am afraid does not help me much - tried to set separator to '.' in namespace but that only ended in lda/deliver refusing to deliver mail. :-( What error did lda give? You probably should add: Command output: doveconf: Fatal: Error in configuration file /etc/dovecot/conf.d/10-mail.conf line 54: Unknown setting: separator ) (maildir uses '.' (I think)) so I only added: namespace { separator = . } namespace { separator = / inbox = yes } Intuitively I would have expected '.' and not '/' (default (m)dbox), since I'm converting between maildir (.) and dbox(/) - right?
Re: [Dovecot] Problems Converting Maildir to mdbox
On 28-08-2010 17:21, Charles Marcus wrote: On 8/28/2010 11:17 AM, Kim Bisgaard wrote: After having learned that I need to create the destination directory first, I got this error: dsync(root): Fatal: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) doveconf -n output? # 2.0.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.33.6-147.2.4.fc13.i686 i686 Fedora release 13 (Goddard) ext3 mail_location = maildir:/data/mail/%u/mdir mbox_write_locks = fcntl passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_subaddress_sep = + } postmaster_address = postmas...@alleroedderne.adsl.dk protocols = imap ssl_cert =
Re: [Dovecot] Problems Converting Maildir to mdbox
On 28-08-2010 16:30, Charles Marcus wrote: dsync mirror maildir:~/Maildir I am just trying to do that now (just testing so far). Using this command ($1 is substituted for the user): dsync -u $1 -o "mail_location=maildir:/data/mail/$1/mdir" mirror "mdbox:/data/mail/$1/mdbox" After having learned that I need to create the destination directory first, I got this error: dsync(root): Fatal: Mail locations must use the same virtual mailbox hierarchy separator (specify separator for the default namespace) Which I am afraid does not help me much - tried to set separator to '.' in namespace but that only ended in lda/deliver refusing to deliver mail. :-( Thanks in advance! Kim
[Dovecot] fchown error on tmp files
Hi, After upgrading to 1.2 I started getting fchown errors in the log. They look like: Jul 12 18:32:54 jukebox dovecot: deliver(kim): fchown(/data/mail/kim/.lists.mythtv-users/tmp/1247416373.M857540P19162.jukebox.alleroedderne.adsl.dk, -1, 500(k im)) failed: Operation not permitted (egid=12(mail), group based on /data/mail/kim/.lists.mythtv-users) I have tried to get rid of the by changing the group of the files to "mail" but that does not help. I can not find a dovecot option that is documented to set the group to %u which would seem ideal. Any advice? Thanks in advance, Kim % dovecot -n # 1.2.0: /etc/dovecot.conf # OS: Linux 2.6.27.25-170.2.72.fc10.i686 i686 Fedora release 10 (Cambridge) ext3 protocols: imaps listen: * login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:/data/mail/%u auth default: passdb: driver: pam userdb: driver: passwd plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/sieve
[Dovecot] Deliver *sometimes* delivers via /tmp?
Hi, I'm running dovecot (1.1.7) deliver and sieve (1.1.5) on a Fedora 9 platform, using selinux targetet mode. Most of the mail deliveries goes well, but once deliver tried to copy the mail to the /tmp directory, which it seems it not allowed by selinux. I guess that deliver wants to sanitize the mail or something and therefore copies it to /tmp. Before I ask for selinux to allow this, I would like to know why? It could also be an error, leading deliver into a seldom used piece of code? I order to get the mail delivered I put selinux into permissive mode, using: semanage permissive -a dovecot_deliver_t And then the mail is delivered - below are excerpts from different logs and I have *NOT* attached the message which could not get delivered - because of its size. Regards, Kim Output from "dovecot -n": # 1.1.7: /etc/dovecot.conf # OS: Linux 2.6.27.9-73.fc9.i686 i686 Fedora release 9 (Sulphur) ext3 protocols: imaps listen: * login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:/data/mail/%u auth default: passdb: driver: pam userdb: driver: passwd Here is the mail-log of the incident: Jan 6 02:20:36 jukebox amavis[30505]: (30505-01) Passed CLEAN, [209.85.219.21] -> , Message-ID: <6fa3b6e20901051715p2a6b03dbt30ce14e9e2bc7...@mail.gmail.com>, mail_id: QsxKXByj4rFd, Hits: -2.599, size: 140563, queued_as: E3E2BBC57D, 10434 ms Jan 6 02:20:36 jukebox postfix/lmtp[32118]: 98350BC57C: to=, relay=127.0.0.1[127.0.0.1]:10024, delay=24, delays=13/0.06/0.44/10, dsn=2.0.0, status=sent (250 2.0.0Ok: queued as E3E2BBC57D) Jan 6 02:20:36 jukebox postfix/qmgr[2205]: 98350BC57C: removed Jan 6 02:20:36 jukebox deliver(kim): stat(/tmp/dovecot.deliver..1231204836.32131.f6db3d4db5020c54) failed: Permission denied Jan 6 02:20:36 jukebox deliver(kim): copy: i_stream_read() failed: Permission denied Jan 6 02:20:36 jukebox deliver(kim): msgid=<6fa3b6e20901051715p2a6b03dbt30ce14e9e2bc7...@mail.gmail.com>: save failed to lists.PostgreSQL.Hacker: Internal error occurred. Refer to server log for more information. [2009-01-06 02:20:36] Jan 6 02:20:36 jukebox deliver(kim): sieve runtime error: Fileinto: Generic Error Jan 6 02:20:36 jukebox deliver(kim): sieve_execute_bytecode(/home/kim/.dovecot.sievec) failed Jan 6 02:20:37 jukebox deliver(kim): copy: i_stream_read() failed: No such file or directory Jan 6 02:20:37 jukebox deliver(kim): msgid=<6fa3b6e20901051715p2a6b03dbt30ce14e9e2bc7...@mail.gmail.com>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-01-06 02:20:36] Jan 6 02:20:37 jukebox postfix/local[32130]: E3E2BBC57D: to=, relay=local, delay=1.3, delays=0.1/0.18/0/1, dsn=4.3.0, status=deferred (temporary failure) Here are the lines from selinux once in permissive mode: Jan 6 16:44:28 jukebox setroubleshoot: SELinux is preventing the deliver from using potentially mislabeled files (./tmp). For complete SELinux messages. run sealert -l 4b6a49fd-c1f8-40f9-98fa-dfe971719c69 Jan 6 16:44:29 jukebox setroubleshoot: SELinux is preventing the deliver from using potentially mislabeled files (./tmp). For complete SELinux messages. run sealert -l 19445c54-9537-45ec-8f3e-7718364b1f1f Jan 6 16:44:29 jukebox setroubleshoot: SELinux is preventing the deliver from using potentially mislabeled files (./dovecot.deliver..1231256667.7940.53f0f908f5a97712). For complete SELinux messages. run sealert -l 0cb74c68-0bbb-4de6-a15f-0bb5fdffcf90 Jan 6 16:44:29 jukebox setroubleshoot: SELinux is preventing the deliver from using potentially mislabeled files (2F746D702F646F7665636F742E64656C697665722E2E313233313235363636372E373934302E35336630663930386635613937373132202864656C6574656429). For complete SELinux messages. run sealert -l afe6e0ae-8c2e-4882-925b-b15e26da2a15 And the AVCs for those: node=jukebox.alleroedderne.adsl.dk type=AVC msg=audit(1231439791.493:10819): avc: denied { search } for pid=9073 comm="deliver" name="tmp" dev=sda3 ino=786433 scontext=system_u:system_r:dovecot_deliver_t:s0 tcontext=system_u:object_r:tmp_t:s0 tclass=dir node=jukebox.alleroedderne.adsl.dk type=SYSCALL msg=audit(1231439791.493:10819): arch=4003 syscall=195 success=no exit=-2 a0=96e0aa0 a1=bfc21120 a2=4f5ff4 a3=bfc21120 items=0 ppid=9072 pid=9073 auid=4294967295 uid=500 gid=100 euid=500 suid=500 fsuid=500 egid=12 sgid=12 fsgid=12 tty=(none) ses=4294967295 comm="deliver" exe="/usr/libexec/dovecot/deliver" subj=system_u:system_r:dovecot_deliver_t:s0 key=(null) node=jukebox.alleroedderne.adsl.dk type=AVC msg=audit(1231439791.493:10820): avc: denied { write } for pid=9073 comm="deliver" name="tmp" dev=sda3 ino=786433 scontext=system_u:system_r:dovecot_deliver_t:s0 tcontext=system_u:object_r:tmp_t:s0 tclass=dir node=jukebox.alleroedderne.adsl.dk type=AVC msg=audit(1231439791.493:10820): avc: denied { add_name } for pid=9073 comm="deliver" name="dovecot.deliver..1231439791.9073.73e6f9811129f7ec" scontext=system_u:system_r:dovecot_de