Re: [Dovecot] Regenerating mdbox/sis
On 2/21/2011 8:23 AM, Daniel L. Miller wrote: After applying last two patches, I see: root@bubba:/var/mail# dsync -u amil...@amfes.com -o mail_plugins=zlib backup maildir:/var/mail/backup/amiller dsync(amil...@amfes.com): Error: Corrupted dbox file /var/mail/amfes.com/amiller/mdbox/storage/m.1 (around offset=237479): Ext refs metadata corrupted: 356039 144422 B72 0a/5a/0a5ae26f12adad628d9e5049e7ec8a756dafe49d-7c35b90f82a1c94ce151000 03bc41c5f dsync(amil...@amfes.com): Error: Corrupted dbox file /var/mail/amfes.com/amiller/mdbox/storage/m.1 (around offset=237479): uid=5 points to broken data at offset=237449 dsync(amil...@amfes.com): Error: msg-get failed: box=Drafts uid=5 guid=1156208717.P32762Q0M962249.amy dsync(amil...@amfes.com): Error: Corrupted dbox file /var/mail/amfes.com/amiller/mdbox/storage/m.2 (around offset=46): Ext refs metadata corrupted: 485733 478770 - f2/12/f212f6dbff17cea018ec1f256cff6f61a873a100-7d35b90f82a1c94ce1513bc41 c5f dsync(amil...@amfes.com): Error: Corrupted dbox file /var/mail/amfes.com/amiller/mdbox/storage/m.2 (around offset=46): uid=9 points to broken data at offset=16 dsync(amil...@amfes.com): Error: msg-get failed: box=Drafts uid=9 guid=1157518326.P23171Q0M772523.amy dsync(amil...@amfes.com): Warning: mdbox /var/mail/amfes.com/amiller/mdbox/storage: rebuilding indexes -- Daniel
Re: [Dovecot] Regenerating mdbox/sis
On 2/16/2011 8:21 AM, Timo Sirainen wrote: On 16.2.2011, at 2.35,dmil...@amfes.com dmil...@amfes.com wrote: It's apparent I have some level of corruption in my mailboxes - something to do with the combination of mdbox, sis, and zlib. I should note that I know I have a mix of compressed and raw messages - if that makes any difference in identifying the problems. The mixing shouldn't make any difference. Would be nice to know if the problem is from mdbox+sis, mdbox+zlib or if it really needs a combination of all 3. I wonder if http://hg.dovecot.org/dovecot-2.0/rev/b71834419ea3 might help here. I think I need to somehow regenerate the mailboxes with issues. Is there a suggestion for how to accomplish this? Should I perhaps use dsync to shift to a temporary mail location and then rename it back? That should do it. Tried dsync to convert to maildir - got this: dsync -u amil...@amfes.com -o mail_plugins=zlib backup maildir:/var/mail/backup/amiller dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Error: read(msg input) failed: Input/output error dsync(amil...@amfes.com): Error: Attachment file /var/mail/attachments/bc/fd/bcfde106b8d0860fb819c613ffc83d02c1dba0e3-5539b90f82a1c94ce1513bc41c5f smaller than expected (530943 530944) dsync(amil...@amfes.com): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq = t-first_new_seq seq = t-last_new_seq) dsync(amil...@amfes.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ca8a) [0x7fde07aaea8a] - /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7fde07aaeb72] - /usr/local/lib/dovecot/libdovecot.so.0(+0x16dea) [0x7fde07a88dea] - /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90397) [0x7fde07d80397] - /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x92f75) [0x7fde07d82f75] - /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0x37) [0x7fde07d72317] - /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x81) [0x7fde07d74041] - /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x46679) [0x7fde07d36679] - /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x4e) [0x7fde07d36bfe] - /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x43381) [0x7fde07d33381] - /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x43489) [0x7fde07d33489] - /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_close+0x85) [0x7fde07d33555] - /usr/local/lib/dovecot/libdovecot-storage.so.0(index_mail_free+0x17) [0x7fde07d32b87] - /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_free+0xd) [0x7fde07d19f0d] - /usr/local/lib/dovecot/libdovecot-storage.so.0(maildir_transaction_save_commit_pre+0x3c1) [0x7fde07d47a01] - /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x52c12) [0x7fde07d42c12] - /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x96) [0x7fde07d7dc76] - /usr/local/lib/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x8a) [0x7fde07d4287a] - /usr/local/lib/dovecot/lib20_zlib_plugin.so(+0x49bc) [0x7fde06ec29bc] - /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7fde07d2000d] - dsync() [0x40fa68] - dsync() [0x411631] - dsync(main+0x66a) [0x406c7a] - /lib/libc.so.6(__libc_start_main+0xfe) [0x7fde07301d8e] - dsync() [0x406439] Aborted -- Daniel
Re: [Dovecot] Regenerating mdbox/sis
On 16.2.2011, at 2.35, dmil...@amfes.com dmil...@amfes.com wrote: It's apparent I have some level of corruption in my mailboxes - something to do with the combination of mdbox, sis, and zlib. I should note that I know I have a mix of compressed and raw messages - if that makes any difference in identifying the problems. The mixing shouldn't make any difference. Would be nice to know if the problem is from mdbox+sis, mdbox+zlib or if it really needs a combination of all 3. I wonder if http://hg.dovecot.org/dovecot-2.0/rev/b71834419ea3 might help here. I think I need to somehow regenerate the mailboxes with issues. Is there a suggestion for how to accomplish this? Should I perhaps use dsync to shift to a temporary mail location and then rename it back? That should do it. If I DO use dsync in this manner, and I have zlib enabled - will this then compress all the messages in the new mail storage? When dsync reads messages it decompresses them into memory, and recompresses them when saving.
[Dovecot] Regenerating mdbox/sis
It's apparent I have some level of corruption in my mailboxes - something to do with the combination of mdbox, sis, and zlib. I should note that I know I have a mix of compressed and raw messages - if that makes any difference in identifying the problems. I think I need to somehow regenerate the mailboxes with issues. Is there a suggestion for how to accomplish this? Should I perhaps use dsync to shift to a temporary mail location and then rename it back? If I DO use dsync in this manner, and I have zlib enabled - will this then compress all the messages in the new mail storage? -- Daniel
