Re: mailboxes.db disagree between master and replica

2019-12-12 Thread Michael Menge
I know that I could just copy the mailboxes.db file from the master to the replica, then manually move the mailboxes that are in the "wrong" place to the "right" place, but this seems a little drastic. Any way I can just tell the replica to update the location of the mailbox on

mailboxes.db disagree between master and replica

2019-12-12 Thread Tod Pike
know about the mupdate server in it's role as a replica. What are my options here - I know that I could just copy the mailboxes.db file from the master to the replica, then manually move the mailboxes that are in the "wrong" place to the "right" place, but this seems a little dras

Re: Replicated RENAME leaves "empty" entry in mailboxes.db

2018-02-26 Thread Sebastian Hagedorn
Hi, [4:11pm] hagedose: user.testuser-clotho1.diesisteintest 16 (null) This sounds like it's the tombstone entry for the deleted mailbox (i.e. a record that there used to be a mailbox with that name). I believe tombstones are relatively new, in which case the master server might not have one

Re: Replicated RENAME leaves "empty" entry in mailboxes.db

2018-02-25 Thread ellie timoney
Hi, > [4:11pm] hagedose: user.testuser-clotho1.diesisteintest 16 (null) This sounds like it's the tombstone entry for the deleted mailbox (i.e. a record that there used to be a mailbox with that name). I believe tombstones are relatively new, in which case the master server might not

Replicated RENAME leaves "empty" entry in mailboxes.db

2018-02-22 Thread Sebastian Hagedorn
Hi, I asked this question on IRC yesterday, but I didn't get any response. Maybe someone here knows? [4:08pm] hagedose: Is it expected behavior that a replicated RENAME leaves an „empy“ mboxlist entry? [4:08pm] hagedose: We’re experimenting with replication from a 2.4.20 server to a 3.0.5

Re: corrupted mailboxes.db

2017-10-22 Thread Deniss
Hello, in case anybody interested, I managed to fix mailboxes.db by this technic (I have no shared folders, groups, complex permissions etc) 1. create plain dump file: cyr_dbtool /mailboxes.db twoskip show | perl -n -e 'if ( ~/^([^\t]+)\t%\(A %\(([^\s]+) ([^\)]+)/ ) { print "$1\t0 de

Re: corrupted mailboxes.db

2017-10-20 Thread Patrick Boutilier
On 10/20/2017 11:52 AM, Deniss wrote: Hello, I run cyrus imap 2.5.11. Somehow mailboxes.db become corrupted. running `ctl_mboxlist -d` leads to segfault, backtrace below. How can I recover mailboxes.db ? Backtrace #0  0x007d43e12952 in printf (__fmt=0x7d43e143c2 "%s\t%d %s %s\n"

corrupted mailboxes.db

2017-10-20 Thread Deniss
Hello, I run cyrus imap 2.5.11. Somehow mailboxes.db become corrupted. running `ctl_mboxlist -d` leads to segfault, backtrace below. How can I recover mailboxes.db ? Backtrace #0 0x007d43e12952 in printf (__fmt=0x7d43e143c2 "%s\t%d %s %s\n") at /usr/include/bits/stdio2.h:104 #

Re: removing folders which are not in mailboxes.db

2017-05-16 Thread Marcus Schopen
Am Montag, den 15.05.2017, 07:59 -0300 schrieb Patrick Boutilier: > rm -fr if you are 100% sure you don't need the files. Move if not 100% > sure .:-) > > Since cyrus doesn't know about the folders in mailboxes.db it shouldn't > care either way. That's working. Thanks Marcus

Re: removing folders which are not in mailboxes.db

2017-05-15 Thread Patrick Boutilier
ve if not 100% sure .:-) Since cyrus doesn't know about the folders in mailboxes.db it shouldn't care either way. Ciao! Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.

Re: removing folders which are not in mailboxes.db

2017-05-15 Thread Marcus Schopen
Hi, Am Montag, den 15.05.2017, 07:34 -0300 schrieb Patrick Boutilier: > That will probably work. You can see what will happen by using -n also . > Another option is just to remove the subfolders from the filesystem > using rm . I just tried: su - cyrus -c " /usr/lib/cyrus/bin/reconstruct -r

Re: removing folders which are not in mailboxes.db

2017-05-15 Thread Patrick Boutilier
are listed in mailboxes.db, which is correct. What's the best way to remove those old folders permanently from the filesystem on the master? Can I use reconstruct with -O option (Delete odd files)? That will probably work. You can see what will happen by using -n also . Another option is just

Re: removing folders which are not in mailboxes.db

2017-05-15 Thread Marcus Schopen
some more info: I did some further checks: those messages are not shown by unexpunge -l. I get a "Failed to open mailbox" if I check the delete subdirs, which is correct to my mind, because these mailbox don't exist any more. The delete subdirs didn't show up in DELETED.user. I use

removing folders which are not in mailboxes.db

2017-05-15 Thread Marcus Schopen
Hi, some time ago I removed several big sized subfolders in a mailbox using my mail client. Yesterday I recognized that for some reasons those folders are still on the file system on master, but not on replica side. Non of those deleted folders are listed in mailboxes.db, which is correct

Re: recovery from complete loss of mailboxes.db?

2017-04-29 Thread Nic Bernstein
umentation is a work in progress. To see how to apply annotations, see the manpage for cyradm(8). Next: Suppose I've completely lost /var/imap/mailboxes.db as well as /var/imap/db.backup1 and /var/imap/db.backup2. Is there any way to recover from this? Given that /usr/lib/cyrus/bin/reco

recovery from complete loss of mailboxes.db?

2017-04-29 Thread Patrick Goetz
idea what this is used for. Can someone give me an example of a mailbox or server annotation. Next: Suppose I've completely lost /var/imap/mailboxes.db as well as /var/imap/db.backup1 and /var/imap/db.backup2. Is there any way to recover from this? Given that /usr/lib/cyrus/bin/reconstruct

Re: mailboxes.db locking problem after updating from 2.4 to 2.5.9

2016-11-17 Thread Wolfgang Breyha via Info-cyrus
> Sorry, I really don't have a clue. 2.5 does have a different mailboxes.db > format, so it's a bit more CPU intensive. The real massive win for CPU > usage is going to come with reverse ACLs: Thanks for the response in the first place! I'm sorry to push this topic continuously because

Re: mailboxes.db locking problem after updating from 2.4 to 2.5.9

2016-11-17 Thread Bron Gondwana via Info-cyrus
I directly asked Bron, but no response as well. Sorry, I really don't have a clue. 2.5 does have a different mailboxes.db format, so it's a bit more CPU intensive. The real massive win for CPU usage is going to come with reverse ACLs: https://blog.fastmail.com/2015/12/05/reverse-acls-making-imap-l

Re: mailboxes.db locking problem after updating from 2.4 to 2.5.9

2016-11-17 Thread Wolfgang Breyha via Info-cyrus
On 17/11/16 14:00, Deniss via Info-cyrus wrote: > Hello, > > I trying to migrate one big cyrus imap server from 2.4 to 2.5.9. > > I updated binaries, fix db backend in imapd.conf and converted > mailboxes.db with ctl_mboxlist -d & -u to twoskip. > > cyrus ran fin

Re: mailboxes.db locking problem after updating from 2.4 to 2.5.9

2016-11-17 Thread Shawn Bakhtiar via Info-cyrus
nd converted mailboxes.db with ctl_mboxlist -d & -u to twoskip. cyrus ran fine until morning when a count of simultanious sessions started to rise. then imapd processes become locked on mailboxes.db when logs show something like Nov 17 08:04:21 srv1 imap[11019]: cmdtimer: 'y...@mail.xxx<m

mailboxes.db locking problem after updating from 2.4 to 2.5.9

2016-11-17 Thread Deniss via Info-cyrus
Hello, I trying to migrate one big cyrus imap server from 2.4 to 2.5.9. I updated binaries, fix db backend in imapd.conf and converted mailboxes.db with ctl_mboxlist -d & -u to twoskip. cyrus ran fine until morning when a count of simultanious sessions started to rise. then imapd proce

Re: mailboxes.db invalid entries

2016-04-23 Thread Bron Gondwana via Info-cyrus
t; First I tried to dump the mailbox.db with ctl_mboxlist -d > >>> /tmp/mailboxes.txt > >>> > >>> After deleting the wrong entry manually I wanted to reload the mailbox > >>> again with ctl_mboxlist -u /tmp/mailboxes.txt. All operation with > >

Re: mailboxes.db invalid entries

2016-04-22 Thread Jan Kowalsky via Info-cyrus
mboxlist -d /tmp/mailboxes.txt >>> >>> After deleting the wrong entry manually I wanted to reload the mailbox >>> again with ctl_mboxlist -u /tmp/mailboxes.txt. All operation with >>> stopped cyrus. >> >> Have you renamed your mailboxes.db after using -d and befo

Re: mailboxes.db invalid entries

2016-04-22 Thread Wolfgang Breyha via Info-cyrus
ed cyrus. Have you renamed your mailboxes.db after using -d and before using -u? Otherwise ctl_mboxlist will import your dump into the existing mailboxes.db. And are this exactly the commands you used? I think ctl_mboxlist -d >/tmp/mailboxes.txt and ctl_mboxlist -f /tmp/mailboxes

Re: mailboxes.db invalid entries

2016-04-21 Thread Bron Gondwana via Info-cyrus
wrote: > Hi all, > > I have an unresolvable problem with one mailbox: > > It got an entry inside the mailboxes.db and a spool directory - but I > can't change it or access it. I always got "invalid identifier" on cyradm. > > Dumping the mailbox with ctl_mboxlist >

mailboxes.db invalid entries

2016-04-21 Thread Jan Kowalsky via Info-cyrus
Hi all, I have an unresolvable problem with one mailbox: It got an entry inside the mailboxes.db and a spool directory - but I can't change it or access it. I always got "invalid identifier" on cyradm. Dumping the mailbox with ctl_mboxlist example.com!user.kontakt.Calendar 0 (n

mailboxes.db discrepancies between mailbox and mupdate servers

2013-07-09 Thread Shawn Winnington-Ball
mailboxes.db file so that I can go about creating the mailboxes afresh. My question is how to do this? Looking through this list's archives, I see that the cyr_dbtool command can be used to query and manipulate the mailboxes.db file itself, but someone mentioned that it's best not to modify

Re: mailboxes.db discrepancies between mailbox and mupdate servers

2013-07-09 Thread Dave McMurtrie
to get these sorts of entries removed from the mupdate server's mailboxes.db file so that I can go about creating the mailboxes afresh. If you log in to mailbox-03-internal and run: # ctl_mboxlist -d | grep ^user\.foo is anything returned? For that matter, run this on each of your backend

Re: mailboxes.db discrepancies between mailbox and mupdate servers

2013-07-09 Thread Shawn Winnington-Ball
Hi Dave, Thanks for the quick, helpful response. If you log in to mailbox-03-internal and run: # ctl_mboxlist -d | grep ^user\.foo is anything returned? For that matter, run this on each of your backend servers and see if it exists anywhere. None of the mailbox servers have any record

Re: mailboxes.db discrepancies between mailbox and mupdate servers

2013-07-09 Thread Simon Amor
On 9 Jul 2013, at 22:20, Shawn Winnington-Ball swb...@uwaterloo.ca wrote: You can force a backend to push all of its mailboxes to the mupdate master by running ctl_mboxlist -m on the backend. If you're not 100% sure whether you want to push every mailbox before you know what state things

Re: mailboxes.db discrepancies between mailbox and mupdate servers

2013-07-09 Thread Shawn Winnington-Ball
, this did the trick to recreate the directory structure on-disk and populate the mailboxes.db file on the backend. Shawn Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo

mailboxes.db inconsistency caused by simultaneous renames

2013-01-29 Thread Sebastian Hagedorn
Hi, running 2.4.16 we noticed something that clearly isn't right. Somehow a user managed to rename (or rather move) a folder twice at the same time. The result is an invalid entry in mailboxes.db without the corresponding folder in the file system. Here's what happened: Jan 24 18:07:36

Re: mailboxes.db inconsistency caused by simultaneous renames

2013-01-29 Thread Sebastian Hagedorn
Hmf, I should've read the release notes first :( It's fixed in 2.4.17: Fixed bug #3696: can no longer rename the same mailbox twice, which left things in a corrupted state if you caught the race. Sorry for the noise. I've also filed a bug report:

Re: mailboxes.db inconsistency caused by simultaneous renames

2013-01-29 Thread janne . peltonen
Interesting, this might solve my problem, too (delayed delete makes two copies of the mailbox in the DELETED tree). So I'm just going to have to upgrade. --Janne Lainaus Sebastian Hagedorn haged...@uni-koeln.de: Hmf, I should've read the release notes first :( It's fixed in 2.4.17:

mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Stephen Ingram
I deleted the old folder 'folder' from the file system and then (after it wouldn't go away from the cyradm listing) used cyr_dbtool to manually remove it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now gone, however, I can't (using the IMAP client) rename

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Patrick Boutilier
on the new set of folders and everything worked. Now I deleted the old folder 'folder' from the file system and then (after it wouldn't go away from the cyradm listing) used cyr_dbtool to manually remove it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now gone

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Bron Gondwana
On Sat, May 19, 2012 at 09:51:38AM -0700, Stephen Ingram wrote: I'm running 2.4.13 from the invoca rpms on CentOS 5.8. I recently had Could be sort order bugs with 2.4.13 if you don't have improved_mboxlist_sort turned on. I've dumped the mailboxes.db file to a flat file to look and see

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Stephen Ingram
on. I've dumped the mailboxes.db file to a flat file to look and see if there is anything in there that wasn't visible in cyradm or using cyr_dbtool show. Everything is as expected except there are some DELETED.user.xxx.folder entries at the top. Are you not allowed the create folders

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Stephen Ingram
it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now gone, however, I can't (using the IMAP client) rename 'folder2' back to 'folder' as when I do, the subfolders are not visible. I've dumped the mailboxes.db file to a flat file to look and see if there is anything

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Patrick Boutilier
cyr_dbtool to manually remove it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now gone, however, I can't (using the IMAP client) rename 'folder2' back to 'folder' as when I do, the subfolders are not visible. I've dumped the mailboxes.db file to a flat file

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Stephen Ingram
' from the file system and then (after it wouldn't go away from the cyradm listing) used cyr_dbtool to manually remove it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now gone, however, I can't (using the IMAP client) rename 'folder2' back to 'folder

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Simon Matter
on the new set of folders and everything worked. Now I deleted the old folder 'folder' from the file system and then (after it wouldn't go away from the cyradm listing) used cyr_dbtool to manually remove it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Bron Gondwana
bugs with 2.4.13 if you don't have improved_mboxlist_sort turned on. I've dumped the mailboxes.db file to a flat file to look and see if there is anything in there that wasn't visible in cyradm or using cyr_dbtool show. Everything is as expected except there are some DELETED.user.xxx.folder

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Bron Gondwana
^ :) Looking at all of the files in there, several are older than the 3 days they are supposed to be. I'm guessing that means there was a bug somewhere. I guess I should remove all of these, reconstruct the mailboxes.db to match and then probably upgrade as Bron suggested. No - the files will have

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Stephen Ingram
it (and the subfolders) from the mailboxes.db file. The old folders and subfolders are now gone, however, I can't (using the IMAP client) rename 'folder2' back to 'folder' as when I do, the subfolders are not visible. I've dumped the mailboxes.db file to a flat file to look and see if there is anything

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Stephen Ingram
, no matter what the name - hence it's hashing on: DELETE.user.x       ^ :) Looking at all of the files in there, several are older than the 3 days they are supposed to be. I'm guessing that means there was a bug somewhere. I guess I should remove all of these, reconstruct the mailboxes.db to match

Re: mailboxes.db vs IMAP client irregularities

2012-05-19 Thread Bron Gondwana
On Sat, May 19, 2012 at 02:02:53PM -0700, Stephen Ingram wrote: BTW, I love 2.4. I've been using now for several months and it is such a HUGE improvement from 2.3. Everything is faster, replication works better, it's like a whole new program! Just wait until you get 2.5 :) There's still lots

Re: Type Number in mailboxes.db

2011-08-03 Thread Frank Elsner
up */ Thanks. It appears that mailcluster1 believes a mailbox transfer was initiated, but has not yet completed (or failed). This happened. You can use cyr_dbtool to manually edit the entry in your mailboxes.db, or remove it. See: http://asg.andrew.cmu.edu/archive/message.php?mailbox

Re: Type Number in mailboxes.db

2011-08-03 Thread Dan White
On 03/08/11 13:45 +0200, Frank Elsner wrote: On Tue, 2 Aug 2011 09:56:19 -0500 Dan White wrote: It appears that mailcluster1 believes a mailbox transfer was initiated, but has not yet completed (or failed). This happened. You can use cyr_dbtool to manually edit the entry in your mailboxes.db

Type Number in mailboxes.db

2011-08-02 Thread Frank Elsner
Hallo, which values are possible and what is the corresponding meaning for the Type Number in mailboxes.db? After failed XFERs we see - on the murder user.richard^hildebrand 1 mailcluster1 - on mailcluster1 user.richard^hildebrand 8 mailbackend-1-febe!default We would like to know

Re: Type Number in mailboxes.db

2011-08-02 Thread Dan White
On 02/08/11 16:30 +0200, Frank Elsner wrote: Hallo, which values are possible and what is the corresponding meaning for the Type Number in mailboxes.db? After failed XFERs we see - on the murder user.richard^hildebrand 1 mailcluster1 - on mailcluster1 user.richard^hildebrand 8

lmtpproxyd is using local mailboxes.db in Cyrus 2.3.16 ?

2010-09-30 Thread Lucas Zinato Carraro
Hi , I find some information about Cyrus Murder Mail Delivery in link: http://www.cyrusimap.org/mediawiki/index.php/Cyrus_Murder_Mail_Delivery This patch is already implemented in Cyrus Imap 2.3.16 ? I try to configure to use local mailboxes.db , . master

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-25 Thread David Mayo
it with the MUPDATE server, but left it in reserved state in the local (backend) mailboxes.db with mbtype=2. This means that it shows up in a LIST or LSUB with the \NoSelect flag, and the users can't do anything with it, including delete it. You should be able to correct this by running ctl_mboxlist -ma

Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Michael Bacon
in the local (backend) mailboxes.db with mbtype=2. This means that it shows up in a LIST or LSUB with the \NoSelect flag, and the users can't do anything with it, including delete it. I know I could do some pretty heavy-handed stuff to clear this condition, like dumping the mailboxes database

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Dave McMurtrie
it with the MUPDATE server, but left it in reserved state in the local (backend) mailboxes.db with mbtype=2. This means that it shows up in a LIST or LSUB with the \NoSelect flag, and the users can't do anything with it, including delete it. I know I could do some pretty heavy-handed stuff to clear

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Michael Bacon
hundred mailboxes where the backend created the mailbox on disk, registered it with the MUPDATE server, but left it in reserved state in the local (backend) mailboxes.db with mbtype=2. This means that it shows up in a LIST or LSUB with the \NoSelect flag, and the users can't do anything

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Dave McMurtrie
On 08/24/2010 01:17 PM, Michael Bacon wrote: Definitely something I hadn't thought of, but in this case, the faulty mbtype appears to be in the mailboxes.db on the backend server, not the mupdate server. I don't think an MUPDATE command would change that, would it? If your mupdate master

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Michael Bacon
--On August 24, 2010 1:22:53 PM -0400 Dave McMurtrie dav...@andrew.cmu.edu wrote: On 08/24/2010 01:17 PM, Michael Bacon wrote: Definitely something I hadn't thought of, but in this case, the faulty mbtype appears to be in the mailboxes.db on the backend server, not the mupdate server. I

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Dave McMurtrie
cyr_dbtool to edit the entry on the backend. For example: # cyr_dbtool /imap/conf/mailboxes.db skiplist get user.testuser3 2 u1 testuser3 lrswipkxtecda # cyr_dbtool /imap/conf/mailboxes.db skiplist set user.testuser3 0 u1 testuser3lrswipkxtecda Set is in the form state location username acl

Re: Stuck mailboxes.db entries with mbtype=2

2010-08-24 Thread Michael Bacon
the entry on the backend. For example: # cyr_dbtool /imap/conf/mailboxes.db skiplist get user.testuser3 2 u1 testuser3 lrswipkxtecda # cyr_dbtool /imap/conf/mailboxes.db skiplist set user.testuser3 0 u1 testuser3lrswipkxtecda Set is in the form state location username acl. Importantly

Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-25 Thread Andrew Morgan
On Mon, 24 Nov 2008, Simon Matter wrote: I just wanted to follow up on this thread, rather than leaving it hanging. It seems there was a more serious issue, which ultimately lead to the failure we experienced, with our murder setup. Specifically our internal DNS servers, were having

Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-24 Thread Eric G. Wolfe
the mailboxes.db to frontends. If the frontends are updating, it is not apparent. I could not verify that either of them were synching from the master after the mupdate master synch. Which is why I copied them to the frontends to speed things up. I've tried this in the past

Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-24 Thread Simon Matter
, Wolfe, Eric G wrote: We are using skiplist, I copied the mailboxes.db to frontends. If the frontends are updating, it is not apparent. I could not verify that either of them were synching from the master after the mupdate master synch. Which is why I copied them to the frontends to speed

Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-20 Thread Eric G. Wolfe
started up the front-ends, per the instructions. The front-ends failed to synch with the mupdate master. So in an effort to try something else. I figured if the mailboxes.db on the front-ends and the master are the same format, I could just shutdown the mupdate master; copy the mailboxes.db

Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-20 Thread Wesley Craig
to skiplist? I made backup copies of all files deleted, renaming them $filename.corrupt. I did this on each server, recovered on the backends, and let it push the updates to the mupdate server. Did you also convert mupdate master to skiplist? Manually recovered mailboxes.db on the frontends

Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-20 Thread Wesley Craig
a good copy on the mupdate master. In what way do the frontends fail to sync? So in an effort to try something else. I figured if the mailboxes.db on the front-ends and the master are the same format, I could just shutdown the mupdate master; copy the mailboxes.db file over

RE: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-20 Thread Wolfe, Eric G
cyrus-imapd-2.2.12-9.RHEL4 From: Wesley Craig [EMAIL PROTECTED] Sent: Thursday, November 20, 2008 10:08 AM To: Eric G.Wolfe Cc: info-cyrus@lists.andrew.cmu.edu Subject: Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

RE: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-20 Thread Wolfe, Eric G
___ From: Wesley Craig [EMAIL PROTECTED] Sent: Thursday, November 20, 2008 10:27 AM To: Eric G.Wolfe Cc: info-cyrus@lists.andrew.cmu.edu Subject: Re: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist On 20 Nov 2008, at 07:39, Eric G

RE: murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-20 Thread Andrew Morgan
On Thu, 20 Nov 2008, Wolfe, Eric G wrote: We are using skiplist, I copied the mailboxes.db to frontends. If the frontends are updating, it is not apparent. I could not verify that either of them were synching from the master after the mupdate master synch. Which is why I copied them

murder setup - mailboxes.db corruption - trouble recovering with ctl_mboxlist

2008-11-19 Thread Eric G. Wolfe
server, recovered on the backends, and let it push the updates to the mupdate server. Manually recovered mailboxes.db on the frontends, as they did not seem to be getting updated. If I am going about this wrong, please someone point me in the right direction for documentation on murder disaster

Restore cyrus mailboxes.db script

2008-05-29 Thread Proskurin Kirill
examination and fixes im found that mailboxes.db was empty (144 bytes). Cyrus can start but it dont know anything about mailboxes what stored in cyrus partition. We look at reconstruction tool and found the magic -m option which must reconstruct mailboxes.db parsing cyrus partition. But... it`s dont

Re: DBERROR: skiplist recovery mailboxes.db 0090 - suddenly all is failing!

2007-03-06 Thread Andrew Morgan
On Mon, 5 Mar 2007, Gregor Wenkelewsky wrote: I don't really know about that. Here is from the log during another controlled shutdown and reboot, of course I had to make sure that my mailboxes.db error would not occur on every reboot. (It did not occur again.) These are the last lines, no sign

Re: DBERROR: skiplist recovery mailboxes.db 0090 - suddenly all is failing!

2007-03-05 Thread Gregor Wenkelewsky
, sadly today it started to fail completely with this error message in mail.warn, mail.error and syslog: cyrus/imap[..]: DBERROR: skiplist recovery /var/lib/cyrus/mailboxes.db: 0090 should be ADD or DELETE cyrus/imap[..]: DBERROR: opening /var/lib/cyrus/mailboxes.db: cyrusdb error You'll

Re: DBERROR: skiplist recovery mailboxes.db 0090 - suddenly all is failing!

2007-02-19 Thread Gregor Wenkelewsky
, mail.error and syslog: cyrus/imap[..]: DBERROR: skiplist recovery /var/lib/cyrus/mailboxes.db: 0090 should be ADD or DELETE cyrus/imap[..]: DBERROR: opening /var/lib/cyrus/mailboxes.db: cyrusdb error You'll need to fix the corruption of the mailboxes.db file. It is a skiplist format file in your

Re: DBERROR: skiplist recovery mailboxes.db 0090 - suddenly all is failing!

2007-02-19 Thread Andrew Morgan
completely with this error message in mail.warn, mail.error and syslog: cyrus/imap[..]: DBERROR: skiplist recovery /var/lib/cyrus/mailboxes.db: 0090 should be ADD or DELETE cyrus/imap[..]: DBERROR: opening /var/lib/cyrus/mailboxes.db: cyrusdb error You'll need to fix the corruption of the mailboxes.db

DBERROR: skiplist recovery mailboxes.db 0090 - suddenly all is failing!

2007-02-15 Thread Gregor Wenkelewsky
/lib/cyrus/mailboxes.db: 0090 should be ADD or DELETE cyrus/imap[..]: DBERROR: opening /var/lib/cyrus/mailboxes.db: cyrusdb error There was a post by Florin Andrei on March 12 2004 in which he described a similar problem and a solution, but his setting is much different to mine and I can't just

Re: DBERROR: skiplist recovery mailboxes.db 0090 - suddenly all is failing!

2007-02-15 Thread Andrew Morgan
: cyrus/imap[..]: DBERROR: skiplist recovery /var/lib/cyrus/mailboxes.db: 0090 should be ADD or DELETE cyrus/imap[..]: DBERROR: opening /var/lib/cyrus/mailboxes.db: cyrusdb error There was a post by Florin Andrei on March 12 2004 in which he described a similar problem and a solution, but his

Re: correct wrong entries in mailboxes.db ?

2007-01-29 Thread Andrew Morgan
On Sun, 28 Jan 2007, peter pilsl wrote: I manually deleted the whole content of spool/user/SOMEUSER to get rid of all the mails and subboxes in it. Big Mistake. Cause cyrus still knows about all the subboxes that this user was supposed to have. How do I tell cyrus that there are no

correct wrong entries in mailboxes.db ?

2007-01-28 Thread peter pilsl
I manually deleted the whole content of spool/user/SOMEUSER to get rid of all the mails and subboxes in it. Big Mistake. Cause cyrus still knows about all the subboxes that this user was supposed to have. How do I tell cyrus that there are no subboxes anymore. I already tried to delete

Monolithic mailboxes.db?

2007-01-16 Thread Janne Peltonen
Hi. We are going to upgrade to Cyrus v2.3 sometime before midsummer. Currently, we are running an old, old version of Cyrus with a plaintext mailboxes file. Now and again, an imapd process gets stuck and keeps the writelock on the mailboxes file - so we have to kill the stuck process manually

Re: Monolithic mailboxes.db?

2007-01-16 Thread Dave McMurtrie
doesn't use byterange locking for plaintext mailboxes.db. It just relies on advisory locking of the whole file, and it updates the file atomically by creating a new version and renaming it. Running 1.5.14, there used to be some locking issues where, much as you describe, we'd end up having

Re: Monolithic mailboxes.db?

2007-01-16 Thread Adam Tauno Williams
We are going to upgrade to Cyrus v2.3 sometime before midsummer. Currently, we are running an old, old version of Cyrus with a plaintext mailboxes file. Now and again, an imapd process gets stuck and keeps the writelock on the mailboxes file - so we have to kill the stuck process manually

Re: problem upgrading mailboxes.db with cvt_cyrusdb : can't open old database / DBERROR db4: Program version 4.4 doesn't match environment version 0.5

2007-01-10 Thread peter pilsl
copy it from the old one) * create an empty mailboxes.db-file on the new installation * ctl_mboxfile -u on the new installation This will create a skipfile-style mailboxes.db - file for me. Closely monitoring syslog will help to detect problems. I put a documentation of my migration-process

problem upgrading mailboxes.db with cvt_cyrusdb : can't open old database / DBERROR db4: Program version 4.4 doesn't match environment version 0.5

2007-01-09 Thread peter pilsl
the mailboxes.db and seen-files with the cvt_cyrusdb-command as recommended, but I run into a strange error: as user cyrus I do: $ /usr/sbin/cvt_cyrusdb /data/cyrus/config/mailboxes.db berkeley /tmp/mailboxes.db.new skiplist Converting from /data/cyrus/config/mailboxes.db (berkeley) to /tmp

Re: problem upgrading mailboxes.db with cvt_cyrusdb : can't open old database / DBERROR db4: Program version 4.4 doesn't match environment version 0.5

2007-01-09 Thread Simon Matter
the mailboxes.db and seen-files with the cvt_cyrusdb-command as recommended, but I run into a strange error: as user cyrus I do: $ /usr/sbin/cvt_cyrusdb /data/cyrus/config/mailboxes.db berkeley /tmp/mailboxes.db.new skiplist Converting from /data/cyrus/config/mailboxes.db (berkeley

Re: mailboxes.db problem

2007-01-08 Thread RJ45
no cyrus is using hte same berkeley DB. I jsut plugged a new disk and the raid sarted reconstruction. In this situation started the problem with mailboxes.db the /var/imap/db directory does exist. but there si also another problem PID USERNAME PRI NICE SIZERES STATE C TIME

Re: mailboxes.db problem

2006-12-31 Thread Andreas Winkelmann
On Sunday 31 December 2006 00:07, RJ45 wrote: OS is FreeBSD 5.5-STABLE cyrus-imapd 2.2.12 installed this problem started accouring after a RAID5 reconstruction. What means RAID5 reconstruction? A Rebuild of a failed Disk or did you reinitialize/reformat the Raid 5? Is the rebuild running

Re: mailboxes.db problem

2006-12-30 Thread Andreas Winkelmann
]: DBERROR: opening /var/imap/mailboxes.db: Invalid argument Dec 29 13:11:59 postino ctl_cyrusdb[2922]: DBERROR: opening /var/imap/mailboxes.db: cyrusdb error how can I solve this problem ? cyrus continue to work but I have these errors on master startup and then after I have errors like

Re: mailboxes.db problem

2006-12-30 Thread RJ45
happened before this? Dec 29 13:11:59 postino ctl_cyrusdb[2922]: DBERROR: init() on berkeley Dec 29 13:11:59 postino ctl_cyrusdb[2922]: DBERROR db3: environment not yet opened Dec 29 13:11:59 postino ctl_cyrusdb[2922]: DBERROR: opening /var/imap/mailboxes.db: Invalid argument Dec 29 13:11:59 postino

mailboxes.db problem

2006-12-29 Thread RJ45
:59 postino ctl_cyrusdb[2922]: DBERROR: opening /var/imap/mailboxes.db: Invalid argument Dec 29 13:11:59 postino ctl_cyrusdb[2922]: DBERROR: opening /var/imap/mailboxes.db: cyrusdb error how can I solve this problem ? cyrus continue to work but I have these errors on master startup

mailboxes.db unreadable, recovery procedure?

2006-08-25 Thread !jeff!{InterVerse}
Hi List, I have a cyrus system with only about 20 users on it. They have about 3 gigs of mail. The mailboxes.db file is unreadable. of course, reconstruct -m is unavailable, in typical dougadamsian fashion. I have seen recommendations to try to 'rebuild the db' using the 'db.backup1

Re: mailboxes.db unreadable, recovery procedure?

2006-08-25 Thread donovan
On Aug 25, 2006, at 12:48 PM, !jeff!{InterVerse} wrote: Hi List, I have a cyrus system with only about 20 users on it. They have about 3 gigs of mail. The mailboxes.db file is unreadable. of course, reconstruct -m is unavailable, in typical dougadamsian fashion. I have seen

Re: mailboxes.db unreadable, recovery procedure?

2006-08-25 Thread Wesley Craig
What error are you getting that indicates that mailboxes.db is unreadable? I suspect that the backups will also be unreadable, due to the way they are made. If they *are* readable, as the cyrus user: ctl_mboxlist -d -f db.backup1/mailboxes.db somefile.txt You'll want to examine

Re: mailboxes.db unreadable, recovery procedure?

2006-08-25 Thread !jeff!{InterVerse}
Wes, thanks for the response. I still have the problem. At 01:42 PM 8/25/2006, you wrote: What error are you getting that indicates that mailboxes.db is unreadable? a bunch of places, but here's one: sudo -u cyrus /usr/local/cyrus/bin/reconstruct -r -f user fatal error: can't read

Re: mailboxes.db unreadable, recovery procedure?

2006-08-25 Thread Wesley Craig
mailboxes.db. Minus anything that's really corrupted -- as opposed to corrupted meta-data. how do I use reconstruct to regenerate mailboxes.db from the contents of the cyrus spool area? Move mailboxes.db and the contents of the db directory out of the way. Then, for each mailbox (derived either

Re: mailboxes.db backend comparison

2006-05-22 Thread Patrick Radtke
On May 18, 2006, at 12:11 PM, Andrew Morgan wrote: On Wed, 17 May 2006, Wesley Craig wrote: On 17 May 2006, at 14:21, Andrew Morgan wrote: My most recent test was to rebuild the mupdate master mailboxes.db from my backend server. skiplist - 20-25 minutes berkeley - 3 minutes How many

Re: mailboxes.db backend comparison

2006-05-22 Thread Andrew Morgan
On Mon, 22 May 2006, Patrick Radtke wrote: On May 18, 2006, at 12:11 PM, Andrew Morgan wrote: On Wed, 17 May 2006, Wesley Craig wrote: On 17 May 2006, at 14:21, Andrew Morgan wrote: My most recent test was to rebuild the mupdate master mailboxes.db from my backend server. skiplist - 20

Re: mailboxes.db backend comparison

2006-05-22 Thread Patrick Radtke
mailboxes.db from my backend server. skiplist - 20-25 minutes berkeley - 3 minutes How many mailboxes are there? About 145000. Is there also a speed difference when running 'time ctl_mboxlist -mw' from your backends? That's what I did. :) haha, yup:) I should have been clearer. I want

Re: mailboxes.db backend comparison

2006-05-22 Thread Andrew Morgan
On Mon, 22 May 2006, Patrick Radtke wrote: haha, yup:) I should have been clearer. I want to know the diff speed, not the rebuild speed. So how long does ctl_mboxlist -mw take to run when the mupdate master is in sync with the backend. For example, with backend and murder master in sync,

Re: mailboxes.db backend comparison

2006-05-22 Thread Wesley Craig
I have a patch set to ctl_mboxlist that outputs mailboxes.db on the backend in a format that may be concatenated and reloaded on the mupdate master. Using this method, we can rebuild our mupdate master from the collective backends in a matter of minutes, even with 800K mailboxes. :wes

  1   2   3   >