Re: Cyrus 2.2 imapd in AMD64
On Mon, 26 Apr 2010, Carlos Bergero wrote: ./tls_sessions.db: Berkeley DB (Btree, version 8, native byte-order) ./deliver.db: Berkeley DB (Btree, version 8, native byte-order) and there a a couple of cyrus DB files which readme upgrade ask to migrate with a cyrus tool which is not working atm, ./mailboxes.db: Cyrus skiplist DB (which it has a different name simply mailboxes, without the .db extension) ./annotations.db: Cyrus skiplist DB (which is not mentioned in the tutorial) So far im focused in trying to get this DB to the proper format version 9 in the standard Lenny install, and see what happens, without much success. db*_upgrade will upgrade (NOT DOWNGRADE) a berkeley database. Run it from the main environment directory. It is in the db*-util packages. Use the correct target version (for cyrus, see the package dependency list to know which libdb it uses). Just delete tls_sessions.db. It is the TLS session cache. You can consider deleting deliver.db. It is the cache used for duplicate suppression and to avoid sending vacation messages to the same recipient twice. There will be very little harm done (if any) should you delete it. Consider reading the documentation for berkeley DB, especially the stuff prepared by OpenLDAP and samba (look in their web pages). Screw that up, and your performance goes downhill. Consider reading the archives of the cyrus users ML, hunt down from any posts from @fastmail.fm and read them. They _REALLY_ know their stuff. All skiplist DBs are auto-upgraded by cyrus on access. If one wasn't, chances are it is corrupt and you have a big problem. After you manage to start cyrus, run cyrquota and cyrreconstruct over *ALL* mailboxes. I mean *ALL* of them. And this _will_ take time. You could do it with the system in use, but since it is a safety measure to insure there is no inconsistent data, well, it is best done before any read or write access is done to the mailboxes. And do remember cyrus has databases stored in the user dirs as well. Debian packages should have them skiplist or plaintext, which don't require manual intervention, but check it (seen database). Sieve requires conversion of _all_ scripts on all spools. Look for the massievec script and run it on every sieve script. This is _all_ in the cyrus documentation, although probably not organized like that... -- One disk to rule them all, One disk to find them. One disk to bring them all and in the darkness grind them. In the Land of Redmond where the shadows lie. -- The Silicon Valley Tarot Henrique Holschuh -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20100501155315.ga24...@khazad-dum.debian.net
Re: Cyrus 2.2 imapd in AMD64
El 22/04/10 20:50, Carlos Bergero escribió: Hi there list, got some trouble running a cyrus server, actually I have an old setup running in Etch i386 without any trouble, virtual mail server and all pgsql setup for backend and postfix for MTA, all sweat. I installed a new server, better hardware, using AMD64 dist, as Etch is going to be out of security, I copy everithing but the cyrus is not properly working. I cant conect to the imap port or use imtest, to check users, when i start server first cyr_expire and then tls_prune consume lots of time doing not shure what, and i get the following syslog and kern.log error: Apr 22 18:48:08 darwin kernel: [6121490.275489] ctl_cyrusdb[18309] general protection ip:7fecdaef0f30 sp:7fffc46d9380 error:0 in libdb-4.2.so[7fecdae4e000+ea000] Apr 22 19:12:49 darwin kernel: [6122984.242061] ctl_cyrusdb[18505]: segfault at 7f584401cefc ip 7f0a429acf30 sp 7fffb28b3cf0 error 4 in libdb-4.2.so[7f0a4290a000+ea000] Apr 22 19:13:48 darwin kernel: [6123046.804454] ctl_cyrusdb[18594]: segfault at 7f7805960efc ip 7f2a042f0f30 sp 7fff32ae8440 error 4 in libdb-4.2.so[7f2a0424e000+ea000] Apr 22 19:28:52 darwin kernel: [6124020.255192] ctl_cyrusdb[18881]: segfault at 7f8302309efc ip 7f3500c99f30 sp 7fff8d1ed6e0 error 4 in libdb-4.2.so[7f3500bf7000+ea000] Apr 22 19:57:43 darwin kernel: [6125775.477974] ctl_cyrusdb[19100] general protection ip:7fdb78441f30 sp:75879430 error:0 in libdb-4.2.so[7fdb7839f000+ea000] Apr 22 20:17:05 darwin kernel: [6127022.816744] ctl_cyrusdb[19571] general protection ip:7fe3cd7aaf30 sp:7fff03057fe0 error:0 in libdb-4.2.so[7fe3cd708000+ea000] which is wierd! After a while or if I kill this process cyrmaster starts but the re is no way to conect to the imap server. Configuration files are the same in both servers, etch and lenny its just not working in lenny though packages looks to be the same. This is the cyrus.conf file: Any clues about what could be wrong? Cheers, Carlos Apparently for what i read in list and in web pages/lists/readme it might be a compatibility problem in Berkeley DB use by Cyrus. For the record I inherit this system in a Unstable Testing server, in production, and had to do an emergency migration to Etch Old Stable, about a year ago(stable by then). Now I'm moving it to a newer server in Lenny Stable and find my self unable to start the cyrus process properly, apparently the server runs a series of checks in this DB, tls_sessions.db an deliver.db, at start time and in different crons, which get stall while running. So far I haven't been able to fix the problem but at least it seams the issue came that way, which is something. The mentioned DB has the following file format: ./tls_sessions.db: Berkeley DB (Btree, version 8, native byte-order) ./deliver.db: Berkeley DB (Btree, version 8, native byte-order) and there a a couple of cyrus DB files which readme upgrade ask to migrate with a cyrus tool which is not working atm, ./mailboxes.db: Cyrus skiplist DB (which it has a different name simply mailboxes, without the .db extension) ./annotations.db: Cyrus skiplist DB (which is not mentioned in the tutorial) So far im focused in trying to get this DB to the proper format version 9 in the standard Lenny install, and see what happens, without much success. If I manage to work it out ill post the process int list. If anyone has a better clue ill appreciate it :) Sincerely, Carlos -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd5e41e.80...@fcien.edu.uy
Re: Cyrus 2.2 imapd in AMD64
Carlos Bergero wrote: Apparently for what i read in list and in web pages/lists/readme it might be a compatibility problem in Berkeley DB use by Cyrus. Mmm, possible but IME BDB has an unfortunate tendency to create files that are not cross-version-compatible. Upstream supposedly provides an upgrade/conversion script/binary (not sure which one), but I've never found it, and it may be in a -utils package. So far im focused in trying to get this DB to the proper format version 9 in the standard Lenny install, and see what happens, without much success. BDB and other binary hash files are typically discardable and can be regenerated from a plaintext source, IME. See if you can find that source, and the process or script that regenerates the live BDB files. -kgd -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd60148.4000...@vianet.ca
Re: Cyrus 2.2 imapd in AMD64
Carlos Bergero r...@fcien.edu.uy writes: --snip-- Apparently for what i read in list and in web pages/lists/readme it might be a compatibility problem in Berkeley DB use by Cyrus. --snip-- So far im focused in trying to get this DB to the proper format version 9 in the standard Lenny install, and see what happens, without much success. If I manage to work it out ill post the process int list. If anyone has a better clue ill appreciate it :) Have you looked at the db4.x-util packages, for whatever version of library you have? The db4.6-util package contains a program called db4.6-upgrade which might do what you want. There are other version of db-util, so get whichever one matches your current library and try it on a *copy* to see if it does what you want. -- Carl Johnsonca...@peak.org -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/8739yhx1yg@cjlinux.localnet
Re: Cyrus 2.2 imapd in AMD64
On Fri, 23 Apr 2010 16:18:31 -0300, Carlos Bergero wrote: Sorry forget to copy it tlsprune is disable now so it doesnt lock the start up of the cyrus Next time use an online service (such Pastebin) to put the data and send a link ;-) (...) Both are mostly standar files. Yep, I see nothing strange in there. I would start Cyrus setup and user migration from scratch to avoid any incompatibility between the old installation and the new. Greetings, -- Camaleón -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/pan.2010.04.24.08.58...@gmail.com
Re: Cyrus 2.2 imapd in AMD64
On Thu, 22 Apr 2010 20:50:41 -0300, Carlos Bergero wrote: Hi there list, got some trouble running a cyrus server, actually I have an old setup running in Etch i386 without any trouble, virtual mail server and all pgsql setup for backend and postfix for MTA, all sweat. I installed a new server, better hardware, using AMD64 dist, as Etch is going to be out of security, I copy everithing but the cyrus is not properly working. I cant conect to the imap port or use imtest, to check users, when i start server first cyr_expire and then tls_prune consume lots of time doing not shure what, and i get the following syslog and kern.log error: Apr 22 18:48:08 darwin kernel: [6121490.275489] ctl_cyrusdb[18309] general protection ip:7fecdaef0f30 sp:7fffc46d9380 error:0 in libdb-4.2.so[7fecdae4e000+ea000] ctl_cyrusdb is the program in charge of Cyrus databases (man ctl_cyrusdb) so I first would check that. Maybe something got wrong when you migrated the data from the old server to the new one. P.S. I cannot see your cyrus.conf :-? Greetings, -- Camaleón -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/pan.2010.04.23.07.10...@gmail.com
Re: Cyrus 2.2 imapd in AMD64
I copied the old files, but also try to run with the original files of the install, in both cases i have the same problema and files dont differ much. Ezra Taylor escribió: Did you do a fresh install of Cyrus Imap or copied over the config from your old machine? On Thu, Apr 22, 2010 at 7:50 PM, Carlos Bergero r...@fcien.edu.uy wrote: Hi there list, got some trouble running a cyrus server, actually I have an old setup running in Etch i386 without any trouble, virtual mail server and all pgsql setup for backend and postfix for MTA, all sweat. I installed a new server, better hardware, using AMD64 dist, as Etch is going to be out of security, I copy everithing but the cyrus is not properly working. I cant conect to the imap port or use imtest, to check users, when i start server first cyr_expire and then tls_prune consume lots of time doing not shure what, and i get the following syslog and kern.log error: Apr 22 18:48:08 darwin kernel: [6121490.275489] ctl_cyrusdb[18309] general protection ip:7fecdaef0f30 sp:7fffc46d9380 error:0 in libdb-4.2.so [7fecdae4e000+ea000] Apr 22 19:12:49 darwin kernel: [6122984.242061] ctl_cyrusdb[18505]: segfault at 7f584401cefc ip 7f0a429acf30 sp 7fffb28b3cf0 error 4 in libdb-4.2.so[7f0a4290a000+ea000] Apr 22 19:13:48 darwin kernel: [6123046.804454] ctl_cyrusdb[18594]: segfault at 7f7805960efc ip 7f2a042f0f30 sp 7fff32ae8440 error 4 in libdb-4.2.so[7f2a0424e000+ea000] Apr 22 19:28:52 darwin kernel: [6124020.255192] ctl_cyrusdb[18881]: segfault at 7f8302309efc ip 7f3500c99f30 sp 7fff8d1ed6e0 error 4 in libdb-4.2.so[7f3500bf7000+ea000] Apr 22 19:57:43 darwin kernel: [6125775.477974] ctl_cyrusdb[19100] general protection ip:7fdb78441f30 sp:75879430 error:0 in libdb-4.2.so [7fdb7839f000+ea000] Apr 22 20:17:05 darwin kernel: [6127022.816744] ctl_cyrusdb[19571] general protection ip:7fe3cd7aaf30 sp:7fff03057fe0 error:0 in libdb-4.2.so [7fe3cd708000+ea000] which is wierd! After a while or if I kill this process cyrmaster starts but the re is no way to conect to the imap server. Configuration files are the same in both servers, etch and lenny its just not working in lenny though packages looks to be the same. This is the cyrus.conf file: Any clues about what could be wrong? Cheers, Carlos -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd0e0d1.1080...@fcien.edu.uy -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd19d1d.2010...@fcien.edu.uy
Re: Cyrus 2.2 imapd in AMD64
2010/4/23 Carlos Bergero r...@fcien.edu.uy: I copied the old files, but also try to run with the original files of the install, in both cases i have the same problema and files dont differ much. did You copy cyrus database between servers too ? regards -- Wojciech Ziniewicz http://www.rfc-editor.org/rfc/rfc2324.txt -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/g2yd1473ad91004230656p60e0bcf1ycd6c51337be64...@mail.gmail.com
Re: Cyrus 2.2 imapd in AMD64
Sorry forget to copy it
tlsprune is disable now so it doesnt lock the start up of the cyrus
# Debian defaults for Cyrus IMAP server/cluster implementation
# see cyrus.conf(5) for more information
#
# All the tcp services are tcpd-wrapped. see hosts_access(5)
# $Id: cyrus.conf,v 1.16 2003/11/05 01:04:22 hmh Exp $
START {
# do not delete this entry!
recover cmd=/usr/sbin/ctl_cyrusdb -r
# this is only necessary if using idled for IMAP IDLE
# this is NOT to be enabled right now in Debian builds
#idled cmd=idled
# this is useful on backend nodes of a Murder cluster
# it causes the backend to syncronize its mailbox list with
# the mupdate master upon startup
#mupdatepush cmd=/usr/sbin/ctl_mboxlist -m
# this is recommended if using duplicate delivery suppression
delprunecmd=/usr/sbin/ctl_deliver -E 3
# this is recommended if caching TLS sessions
#tlsprune cmd=/usr/sbin/tls_prune
}
# UNIX sockets start with a slash and are absolute paths
# you can use a maxchild=# to limit the maximum number of forks of a service
# you can use babysit=true and maxforkrate=# to keep tight tabs on the
service
# most services also accept -U (limit number of reuses) and -T (timeout)
SERVICES {
# --- Normal cyrus spool, or Murder backends ---
# add or remove based on preferences
imapcmd=imapd -U 30listen=imap prefork=5
maxchild=20
imaps cmd=imapd -s -U 30 listen=imaps prefork=5
maxchild=20
pop3cmd=pop3d -U 30listen=pop3 prefork=5
maxchild=15
pop3s cmd=pop3d -s -U 30 listen=pop3s prefork=5
maxchild=15
# imap cmd=imapd listen=imap prefork=1
# imapscmd=imapd -s listen=imaps prefork=0
# lmtpunix cmd=lmtpd listen=/var/imap/socket/lmtp
# lmtp cmd=lmtpd listen=localhost:lmtp
# At least one form of LMTP is required for delivery
# (you must keep the Unix socket name in sync with imap.conf)
# lmtp cmd=lmtpd listen=localhost:lmtp prefork=0
maxchild=20
lmtpunixcmd=lmtpd listen=/var/run/cyrus/socket/lmtp
prefork=0 maxchild=20
# --
# useful if you need to give users remote access to sieve
# by default, we limit this to localhost in Debian
sieve cmd=timsieved listen=localhost:sieve
prefork=0 maxchild=100
# this one is needed for the notification services
notify cmd=notifyd
listen=/var/run/cyrus/socket/notify proto=udp prefork=1
# --- Murder frontends -
# enable these and disable the matching services above,
# except for sieve (which deals automatically with Murder)
# mupdate database service - must prefork at least 1
# (mupdate slaves)
#mupdate cmd=mupdate listen=3905 prefork=1
# (mupdate master, only one in the entire cluster)
#mupdate cmd=mupdate -m listen=3905 prefork=1
# proxies that will connect to the backends
#imap cmd=proxyd listen=imap prefork=0 maxchild=100
#imaps cmd=proxyd -s listen=imaps prefork=0
maxchild=100
#pop3 cmd=pop3proxyd listen=pop3 prefork=0
maxchild=50
#pop3s cmd=pop3proxyd -s listen=pop3s prefork=0
maxchild=50
#lmtp cmd=lmtpproxyd listen=lmtp prefork=1
maxchild=20
# --
}
EVENTS {
# this is required
checkpoint cmd=/usr/sbin/ctl_cyrusdb -c period=30
# this is only necessary if using duplicate delivery suppression
delprunecmd=/usr/sbin/ctl_deliver -E 3 at=0401
# this is only necessary if caching TLS sessions
tlsprunecmd=/usr/sbin/tls_prune at=0401
# Agregado por Carlos Bergero 20090326
# Error SQUAT
# Tomado de
http://www.linux.org.ve/pipermail/l-linux/2009-March/064798.html
# squatter_1 cmd=/usr/bin/nice -n 19 /usr/sbin/squatter -s
period=120
# squatter_a cmd=/usr/sbin/squatter at=0740
# squatter cmd=/usr/sbin/squatter -r * period=15
}
The imap.conf file
# Debian Cyrus imapd.conf
# See imapd.conf(5) for more information and more options
# Configuration directory
configdirectory: /var/lib/cyrus
# Which partition to use for default mailboxes
defaultpartition: default
partition-default: /var/spool/cyrus/maild1/mail
partition-maild2: /var/spool/cyrus/maild2/mail
# News setup
partition-news: /var/spool/cyrus/maild1/news
newsspool: /var/spool/news
# Alternate namespace
# If enabled, activate the alternate namespace as documented in
# /usr/share/doc/cyrus21-doc/html/altnamespace.html, where an user's
# subfolders are in the same level as the INBOX
# See also userprefix and
Re: Cyrus 2.2 imapd in AMD64
Wojciech Ziniewicz escribió: 2010/4/23 Carlos Bergero r...@fcien.edu.uy: I copied the old files, but also try to run with the original files of the install, in both cases i have the same problema and files dont differ much. did You copy cyrus database between servers too ? regards Yup I copied the mail directories and other cyrus directories /var/lib/cyrus and /var/run/cyrus , plus config files /etc/cyrus.conf /etc/imapd.conf think thats all? Cheers, Carlos -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd21384.20...@fcien.edu.uy
Re: Cyrus 2.2 imapd in AMD64
After checking the DB files I found out the version im using in the etch server uses Berkeley DB (Btree, version 8 native byte-order) while the new lenny server is using Berkeley DB (Btree, version 9, native byte-order) for at least the deliver.db and th tls_sessions.db, do you agree this could be the problem and if so, any clue how to convert one into the other? Sincerely Carlos Carlos Bergero escribió: Hi there list, got some trouble running a cyrus server, actually I have an old setup running in Etch i386 without any trouble, virtual mail server and all pgsql setup for backend and postfix for MTA, all sweat. I installed a new server, better hardware, using AMD64 dist, as Etch is going to be out of security, I copy everithing but the cyrus is not properly working. I cant conect to the imap port or use imtest, to check users, when i start server first cyr_expire and then tls_prune consume lots of time doing not shure what, and i get the following syslog and kern.log error: Apr 22 18:48:08 darwin kernel: [6121490.275489] ctl_cyrusdb[18309] general protection ip:7fecdaef0f30 sp:7fffc46d9380 error:0 in libdb-4.2.so[7fecdae4e000+ea000] Apr 22 19:12:49 darwin kernel: [6122984.242061] ctl_cyrusdb[18505]: segfault at 7f584401cefc ip 7f0a429acf30 sp 7fffb28b3cf0 error 4 in libdb-4.2.so[7f0a4290a000+ea000] Apr 22 19:13:48 darwin kernel: [6123046.804454] ctl_cyrusdb[18594]: segfault at 7f7805960efc ip 7f2a042f0f30 sp 7fff32ae8440 error 4 in libdb-4.2.so[7f2a0424e000+ea000] Apr 22 19:28:52 darwin kernel: [6124020.255192] ctl_cyrusdb[18881]: segfault at 7f8302309efc ip 7f3500c99f30 sp 7fff8d1ed6e0 error 4 in libdb-4.2.so[7f3500bf7000+ea000] Apr 22 19:57:43 darwin kernel: [6125775.477974] ctl_cyrusdb[19100] general protection ip:7fdb78441f30 sp:75879430 error:0 in libdb-4.2.so[7fdb7839f000+ea000] Apr 22 20:17:05 darwin kernel: [6127022.816744] ctl_cyrusdb[19571] general protection ip:7fe3cd7aaf30 sp:7fff03057fe0 error:0 in libdb-4.2.so[7fe3cd708000+ea000] which is wierd! After a while or if I kill this process cyrmaster starts but the re is no way to conect to the imap server. Configuration files are the same in both servers, etch and lenny its just not working in lenny though packages looks to be the same. This is the cyrus.conf file: Any clues about what could be wrong? Cheers, Carlos -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd22b01.3050...@fcien.edu.uy
Cyrus 2.2 imapd in AMD64
Hi there list, got some trouble running a cyrus server, actually I have an old setup running in Etch i386 without any trouble, virtual mail server and all pgsql setup for backend and postfix for MTA, all sweat. I installed a new server, better hardware, using AMD64 dist, as Etch is going to be out of security, I copy everithing but the cyrus is not properly working. I cant conect to the imap port or use imtest, to check users, when i start server first cyr_expire and then tls_prune consume lots of time doing not shure what, and i get the following syslog and kern.log error: Apr 22 18:48:08 darwin kernel: [6121490.275489] ctl_cyrusdb[18309] general protection ip:7fecdaef0f30 sp:7fffc46d9380 error:0 in libdb-4.2.so[7fecdae4e000+ea000] Apr 22 19:12:49 darwin kernel: [6122984.242061] ctl_cyrusdb[18505]: segfault at 7f584401cefc ip 7f0a429acf30 sp 7fffb28b3cf0 error 4 in libdb-4.2.so[7f0a4290a000+ea000] Apr 22 19:13:48 darwin kernel: [6123046.804454] ctl_cyrusdb[18594]: segfault at 7f7805960efc ip 7f2a042f0f30 sp 7fff32ae8440 error 4 in libdb-4.2.so[7f2a0424e000+ea000] Apr 22 19:28:52 darwin kernel: [6124020.255192] ctl_cyrusdb[18881]: segfault at 7f8302309efc ip 7f3500c99f30 sp 7fff8d1ed6e0 error 4 in libdb-4.2.so[7f3500bf7000+ea000] Apr 22 19:57:43 darwin kernel: [6125775.477974] ctl_cyrusdb[19100] general protection ip:7fdb78441f30 sp:75879430 error:0 in libdb-4.2.so[7fdb7839f000+ea000] Apr 22 20:17:05 darwin kernel: [6127022.816744] ctl_cyrusdb[19571] general protection ip:7fe3cd7aaf30 sp:7fff03057fe0 error:0 in libdb-4.2.so[7fe3cd708000+ea000] which is wierd! After a while or if I kill this process cyrmaster starts but the re is no way to conect to the imap server. Configuration files are the same in both servers, etch and lenny its just not working in lenny though packages looks to be the same. This is the cyrus.conf file: Any clues about what could be wrong? Cheers, Carlos -- To UNSUBSCRIBE, email to debian-user-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/4bd0e0d1.1080...@fcien.edu.uy
