Re: Skiplist vs Berkley db
Andrew Morgan wrote: On Thu, 20 Apr 2006, Ken Murchison wrote: Marc G. Fournier wrote: 'k ... just to make sure that I fully understand though ... as long as I use Berkeley DB for *anything*, that directory needs to exist ... ? For instance, if duplicate_db == db3? Yes. I you use BDB for any of the databases, then you will have a configdir/db/ directory. I have only skiplist and quotalegacy backends defined on my v2.2.12 box, and yet I still have the following in configdir/db/: -rw--- 1 cyrus mail16384 Apr 18 11:01 __db.001 -rw--- 1 cyrus mail 663552 Apr 18 11:01 __db.002 -rw--- 1 cyrus mail98304 Apr 18 11:01 __db.003 -rw--- 1 cyrus mail 18563072 Apr 18 11:01 __db.004 -rw--- 1 cyrus mail32768 Apr 18 11:01 __db.005 -rw--- 1 cyrus mail 10485760 Feb 14 00:01 log.01 -rw--- 1 cyrus mail4 Apr 18 11:01 skipstamp It appears that the log.01 is probably leftover from previous BDB days, but the others are obviously being updated regularly during the daily checkpoint of databases. Arrgh! skiptlist does use db/skipstamp, so if you remove db/, it will get recreated which ctl_cyrusdb -r gets run. I *think* __db.nnn are BDB files, but I can't explain why they are being touched if you're not using BDB for any databases. I'd have to look at the code, but its possible that recovery of *all* of the db types is done by ctl_cyrusdb -r , regardless of whether they are being used. -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
Marc G. Fournier wrote: On Wed, 19 Apr 2006, John Hampton wrote: barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend 'k, just read this, thx ... first question I have is what is /var/spool/imap/db? mboxlist? nothing else on that page appears appropriate, but just want to make sure ... AFAIK, there is no such thing as /var/spool/imap/db (not in the IMAP spool). There will be something like /var/imap/db (in configdir), which is the BDB environment directory. -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
John Hampton wrote: barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend Yes, this is a good place to look. One thing that isn't on that page yet is berkeley_hash and berkeley_hash_nosync. These use hash tables instead of btrees. They have the same properties and use cases, but the hash table versions seem to have solved some locking issues that we were seeing at CMU. -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
On Thu, 20 Apr 2006, Ken Murchison wrote: Marc G. Fournier wrote: On Wed, 19 Apr 2006, John Hampton wrote: barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend 'k, just read this, thx ... first question I have is what is /var/spool/imap/db? mboxlist? nothing else on that page appears appropriate, but just want to make sure ... AFAIK, there is no such thing as /var/spool/imap/db (not in the IMAP spool). There will be something like /var/imap/db (in configdir), which is the BDB environment directory. I have my imapd.conf file setup to point to /var/spool/imap ... not sure why I did this, but I've had it like this forever now ... same as the default /var/imap ... So, based on the above ... if I were to switch *everything* to skiplist, then that directory would go away? Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: [EMAIL PROTECTED] Yahoo!: yscrappy ICQ: 7615664 Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
Marc G. Fournier wrote: On Thu, 20 Apr 2006, Ken Murchison wrote: Marc G. Fournier wrote: On Wed, 19 Apr 2006, John Hampton wrote: barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend 'k, just read this, thx ... first question I have is what is /var/spool/imap/db? mboxlist? nothing else on that page appears appropriate, but just want to make sure ... AFAIK, there is no such thing as /var/spool/imap/db (not in the IMAP spool). There will be something like /var/imap/db (in configdir), which is the BDB environment directory. I have my imapd.conf file setup to point to /var/spool/imap ... not sure why I did this, but I've had it like this forever now ... same as the default /var/imap ... So, based on the above ... if I were to switch *everything* to skiplist, then that directory would go away? It wouldn't go away by itself, but you could remove it. -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
On Thu, 20 Apr 2006, Ken Murchison wrote: Marc G. Fournier wrote: On Thu, 20 Apr 2006, Ken Murchison wrote: Marc G. Fournier wrote: On Wed, 19 Apr 2006, John Hampton wrote: barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend 'k, just read this, thx ... first question I have is what is /var/spool/imap/db? mboxlist? nothing else on that page appears appropriate, but just want to make sure ... AFAIK, there is no such thing as /var/spool/imap/db (not in the IMAP spool). There will be something like /var/imap/db (in configdir), which is the BDB environment directory. I have my imapd.conf file setup to point to /var/spool/imap ... not sure why I did this, but I've had it like this forever now ... same as the default /var/imap ... So, based on the above ... if I were to switch *everything* to skiplist, then that directory would go away? It wouldn't go away by itself, but you could remove it. 'k ... just to make sure that I fully understand though ... as long as I use Berkeley DB for *anything*, that directory needs to exist ... ? For instance, if duplicate_db == db3? Basically, I'm going to look at switching over to using the configuration recommended on the WhatDatabaseBackend page, which means using berkeley(_nosync) ... Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: [EMAIL PROTECTED] Yahoo!: yscrappy ICQ: 7615664 Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
On Thu, 20 Apr 2006, Ken Murchison wrote: Marc G. Fournier wrote: 'k ... just to make sure that I fully understand though ... as long as I use Berkeley DB for *anything*, that directory needs to exist ... ? For instance, if duplicate_db == db3? Yes. I you use BDB for any of the databases, then you will have a configdir/db/ directory. I have only skiplist and quotalegacy backends defined on my v2.2.12 box, and yet I still have the following in configdir/db/: -rw--- 1 cyrus mail16384 Apr 18 11:01 __db.001 -rw--- 1 cyrus mail 663552 Apr 18 11:01 __db.002 -rw--- 1 cyrus mail98304 Apr 18 11:01 __db.003 -rw--- 1 cyrus mail 18563072 Apr 18 11:01 __db.004 -rw--- 1 cyrus mail32768 Apr 18 11:01 __db.005 -rw--- 1 cyrus mail 10485760 Feb 14 00:01 log.01 -rw--- 1 cyrus mail4 Apr 18 11:01 skipstamp It appears that the log.01 is probably leftover from previous BDB days, but the others are obviously being updated regularly during the daily checkpoint of databases. Andy Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Skiplist vs Berkley db
I'm considering moving to skiplist from berkley db when deploying a new cyrus server. (So no account transfers are going to be needed) What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I was talking about this move to a friend of mine, whose opinion I respect, and he felt that bdb was the way to go. I have read through the maillists and some of the comments made about skiplist, made me want to move to that. Hopefully this isn't religous in nature...not trying to start a war here. :) Thanks for any advice. Mike B. This message was sent using IMP, the Internet Messaging Program. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend -John Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Skiplist vs Berkley db
On Thu, 20 Apr 2006, Marc G. Fournier wrote: On Wed, 19 Apr 2006, John Hampton wrote: barsalou wrote: What I was wondering iscan someone help list the pro's and cons of skiplist and Bdb? I found the following link to be very helpful http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/WhatDatabaseBackend 'k, just read this, thx ... first question I have is what is /var/spool/imap/db? mboxlist? nothing else on that page appears appropriate, but just want to make sure ... Oh, and what about the cyrus.* files within the mailbox itself: # file cyrus.* cyrus.cache: data cyrus.header: data cyrus.index: data Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: [EMAIL PROTECTED] Yahoo!: yscrappy ICQ: 7615664 Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
