Re: reconstruction problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 that worked but you need to be logged in as cyrus (actually holds true for all the cyrus related apps. i.e.:sync_client, etc) Maybe try 'man 8 quota'. -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYarj9bpM15f9s9nAQKQJQQAgxb08Z6Pg0SWLJvUw+Xc6PHfMPcAaQ4c DyIC/CV5z81NnbYkEga0CNJ6jX/eNsTppATRK3omizMAT6kA/Wn76oNXKmHRgzqA kWbyH3Zyiox28xfEld2oWJXhhpBFmcHN1Co+jPDdpQCHVyh95gEBP61LQYBXAcac G7C+XJhhZYY= =du5F -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
reconstruction problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 while working on replication i found that one of the mailboxes was not replicating right as advised i ran recontruction -r user.username i am getting a bunch of these user.username.2004.september: System I/O error System I/O error now the folders that cause the error are no longer there. reconstruction output also shows other folders that no longer exist but with out the above error ie. user.username.Sent.sent_2003 been googling around but haven't found anything of use -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYKt3dbpM15f9s9nAQJacwP+Ol+XDmqKlC0z17VFQD0JPzcO3rmT3vRD J5wIO/NgRrxgT/1nizLl32n2k+9Xob3bse/Vy8pbWl8KTn12iqvyVVe0bbkkgcVb YRvcwRQZ4WeKpqyqwUmXb/PNEpJGN85aq12tzR5idLXD4AZoubi5aqmjp5KAZ58z WXZjCTwR4V0= =YU4T -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruction problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 the folders were not there to begin with they were removed a while ago but when i run reconstruct they are being detected. could the db be corrupt ? or maybe the cyrus.header files still has them indexed some how ? the only thing i can think off to 'fix' it is to manually copy (via a mail client) all the emails from one mailbox to another 'dummy' one. delete old one and copy all the emails back but the mailbox size is outrageous (7.2GB) so doing it will take me some serious time and i'd like to avoid it thanks Wesley Craig wrote: Just to be clear, the problem is that reconstruct inappropriately deleted folders after an error? Or, reconstruct is giving errors for folders that were deleted (by the user) so you feel the errors are inappropriate? :wes On 15 Dec 2006, at 09:14, stas khromoy wrote: while working on replication i found that one of the mailboxes was not replicating right as advised i ran recontruction -r user.username i am getting a bunch of these user.username.2004.september: System I/O error System I/O error now the folders that cause the error are no longer there. reconstruction output also shows other folders that no longer exist but with out the above error ie. user.username.Sent.sent_2003 been googling around but haven't found anything of use -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYK6JNbpM15f9s9nAQIm2gQAjeM7XKCsHVNcFMzBK2bVKfvAR22JpGhR dU+gGLwqTNBUcugwIg11g+b8TYbAhAFnrS4k7uEZe43TsEcSsX+A0zashmtuf7Np R6AZG1570Xvi6pfum8wNQVb4rIDGr4J5Dpt4kiQg2xDjPtzKu+jnib5Gn3geQlYX zGZwKtC5OVQ= =iQ5W -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruction problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 i've tried -f option as well and it came up with the same result i've monitored both /var/log/imapd.log and /var/log/messages for errors during reconstruction ..i did not see anything searched for imap_ioerror string as well in the above logs with no results. http://www.mail-archive.com/info-cyrus@lists.andrew.cmu.edu/msg02200.html i found this old post where the guy resolved the issue by creating the error causing folder and running reconstruct again thou he is getting system I/O error No such file or directory i only see system I/O error system I/O error wish i can try it now instead of waiting for the end of the business day thanks Wesley Craig wrote: reconstruct -r just reads the DB, so yes the DB must be out of sync with the filesystem (not really corruption per se). reconstruct -r -f reads the DB *and* the filesystem, but would still probably be subject to the DB problem you're experiencing. When reconstruct finds mailboxes in the DB that aren't in the filesystem, it attempts to create it on disk. I think the System I/O error you're getting is the result of that attempt to re-create the mailbox. It ought to log something, in addition to displaying that error. The mailbox_create() routine returns IMAP_IOERROR in many places, the syslog should tell more about exactly *why* it's getting the error. :wes On 15 Dec 2006, at 10:07, stas khromoy wrote: the folders were not there to begin with they were removed a while ago but when i run reconstruct they are being detected. could the db be corrupt ? or maybe the cyrus.header files still has them indexed some how ? the only thing i can think off to 'fix' it is to manually copy (via a mail client) all the emails from one mailbox to another 'dummy' one. delete old one and copy all the emails back but the mailbox size is outrageous (7.2GB) so doing it will take me some serious time and i'd like to avoid it -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYLC2tbpM15f9s9nAQJQWQQApBmbm6JzrtBtigfF6N9pVEui93nOi98X 8sjeGTZZLMX9aUp/hayEyeJMupGK+lyRSSZdWbpBfReavRnadaOVddIB0zvgm1A9 PVfOnP2g5rqrChEnEnxPpXtDxnTBGOL/8eHRRLFVqNxVw6lVmQ6a59RS1MItW4tH Go9C/WysxOM= =cIy9 -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruction problems
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 andrew are you sure about quota -f ? i don't believe there is one and looking at the man page for quota i don't see it either it has only -q -l -g -v -u as switches thanks Andrew Morgan wrote: On Fri, 15 Dec 2006, stas khromoy wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 i've tried -f option as well and it came up with the same result i've monitored both /var/log/imapd.log and /var/log/messages for errors during reconstruction ..i did not see anything searched for imap_ioerror string as well in the above logs with no results. http://www.mail-archive.com/info-cyrus@lists.andrew.cmu.edu/msg02200.html i found this old post where the guy resolved the issue by creating the error causing folder and running reconstruct again thou he is getting system I/O error No such file or directory i only see system I/O error system I/O error wish i can try it now instead of waiting for the end of the business day I've ran into this problem occasionally when I goof up and delete a folder from the filesystem rather than using cyradm (usually when I'm trying to restore a folder for a user). What I have done in the past is: 1. Create the missing folder in the filesystem by hand. 2. Copy the cyrus.header file from the user's INBOX into the folder. 3. Set the folder and cyrus.header permissions and ownership correctly for cyrus. 4. Run su cyrus -c '/usr/local/cyrus/bin/reconstruct -f -r user.username'. 5. Run su cyrus -c '/usr/local/cyrus/bin/quota -f user.username'. 6. Using cyradm, delete the folder. Andy -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYLtmdbpM15f9s9nAQI2yAP/QjgbBscVDxtsbd2enzm1uRSiuQg9zP5D VXYd7rvQjza0NVQM8fPO9fOUC9OKN6/iAbqCgPR0OC5dISlvHdbCw0iRbNFGuftq /D6xatMMlLQTAeUKXA2j1HmaHOqfxUCVINF9NfUVhjMUMPDtmk24mhCE80E+E0tp 2LHLdIfYZg0= =6e9V -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 still battling with replication :) i've noticed that for only one of the users i get the following error Error from do_user(-l): bailing out! in the list archives i found some one with a similar issue (at least is sounded like it) the advice was to to reconstruct the mailbox but on which machine - master or replica ? also i don't see that error in the logs it comes as output of sync_client -l -v -u (user list) -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYFisdbpM15f9s9nAQLLKQP+LZKXIPDkTr+GPKWjNxZxQMU/jco9xNxU aALb+Xsh04Fhu6IovI4rXLOHBc7m46kTI/2SHqhlTtdFcVxJYfp/sPFxSJncnPjd ECDDfeYte1Yj+jUO12yzUze8YWIPEZnUEnAE+ia4TK97C9oP//r/XRRzCt9E1XqA CNyoZxDQNzE= =8hR2 -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
still battling with replication :) i've noticed that for only one of the users i get the following error Error from do_user(-l): bailing out! in the list archives i found some one with a similar issue (at least is sounded like it) the advice was to to reconstruct the mailbox but on which machine - master or replica ? also i don't see that error in the logs it comes as output of sync_client -l -v -u (user list) Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 thanks for all your help, wesley i'll try this as soon as i can there is one question that is till puzzling me thou when it replicates, it ignores inactive folders for some reason i looked at the size of my imap/user folder on replica (1.9gb) and size of the same folder on master (2.4gb) i am sure other mailboxes have the same issue since the size of imap/user on replica is smaller then on master any ideas ? or is it normal i checked all the logs i dont see anything that could hint on the problem if there is one by inactive folders i mean folders that u use to store emails and don't touch often thanks again Wesley Craig wrote: On 14 Dec 2006, at 09:41, stas khromoy wrote: i've noticed that for only one of the users i get the following error Error from do_user(-l): bailing out! in the list archives i found some one with a similar issue (at least is sounded like it) That's the error that you'd get from sync_client. Probably a more detailed error is in syslog, and even more detail is likely to be available from sync_server on the replica. the advice was to to reconstruct the mailbox but on which machine - master or replica ? reconstruct on the master. Probably I'd run sync_reset on the user in question on the replica as well. Then sync_client -u again. :wes also i don't see that error in the logs it comes as output of sync_client -l -v -u (user list) The error in the logs is probably more detailed, something like server responded with NO etc. :wes -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iQCVAwUBRYGbatbpM15f9s9nAQIAVwP+N2cdqdlhnhFsJdKvhqez2SvZ1KDI/HcT 2AzIdLtRiLztLr+k0aOwtO6lUXFogA/iWULDlkDyqhaHfa0v0mXzDK9fb8tJexXS e96AtNRjwb+sVrXKvRzcMsgtMMCdEij5MIC1rLm60lTNzi1T75WC0cWQ2BkKRDbs HVkQ4zEPXiA= =BG0M -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
did as you advised now i see folder fro all the users on replica machine but the size of the /imap/users has not changed. basically whatever is inactive be it a full mailbox or an active mailbox's subfolder is not being replicated. Wesley Craig wrote: Like this: sync_client -l -v -u userA userB userC ... Most Unix commands function this way. :wes On 12 Dec 2006, at 21:56, [EMAIL PROTECTED] wrote: do thay have to be separated (user names i mean) by space or coma or something else ?? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
i did as you've said this is now the output of synctest S: * STARTTLS S: * OK mars.edpausa.com Cyrus sync server v2.3.7 Authentication failed. generic failure Security strength factor: 0 /var/log/messages shows : Dec 12 20:56:21 mars syncserver[489]: login: [192.168.0.201] cyrus PLAIN+TLS User logged in Dec 12 20:56:35 mars syncserver[313]: starttls: TLSv1 with cipher AES256-SHA (256/256 bits new) no authentication Dec 12 20:56:35 mars syncserver[313]: login: [192.168.0.201] cyrus PLAIN+TLS User logged in it seems that something did happen it replicated all the active mailboxes ( there are a few innactive from the people who recently left and a few test mailboxes) and replicated only active subfolders of these boxes. so out of 121GB only 58 GB have been replicated i see in logs things like this Dec 12 20:56:45 mars syncserver[313]: Expunged 1 messages from user.stas Dec 12 21:01:50 mars syncserver[313]: skiplist: recovered /var/imap/user/e/edpa.seen.313 (2 records, 11608 bytes) in 0 seconds so something is defetnly going on but why is it replicating only active mailboxes/subfolders ?? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
do thay have to be separated (user names i mean) by space or coma or something else ?? i am getting these Dec 12 21:48:34 mars syncserver[313]: can not unlink /var/imap/user/l/lenny,.seen: No such file or directory Dec 12 21:48:34 mars syncserver[313]: can not unlink /var/imap/user/l/lenny,.mboxkey: No such file or directory when i do name, name, name or name name or name,name On 12 Dec 2006, at 21:08, [EMAIL PROTECTED] wrote: but why is it replicating only active mailboxes/subfolders ?? If you're enabling replication on an already in-production server, you'll probably want to run something like: sync_client -l -v -u list of users That will cause all existing mailboxes to be replicated. Thereafter, you shouldn't need to intervene (much). :wes Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
cyrus replication question
while trying to setup cyrus replication
i am getting the following error
on the secondary server ( the one that is getting a copy of everything)
Dec 9 12:35:34 mars master[7701]: about to exec
/usr/local/cyrus/bin/sync_server
Dec 9 12:35:34 mars syncserver[7701]: executed
Dec 9 12:35:34 mars syncserver[7701]: accepted connection
Dec 9 12:35:34 mars syncserver[7701]: cmdloop(): startup
Dec 9 12:35:34 mars master[7694]: process 7701 exited, status 75
Dec 9 12:35:34 mars master[7694]: service syncserver pid 7701 in BUSY
state: terminated abnormally
here are the settings from both imapd.conf and cyrus.conf
for both master and backup server.
master server
(from where everything is being copied)
cyrus.conf
under START section:
syncclientcmd=/usr/local/cyrus/bin/sync_client -r -t
imapd.conf
#replication configurations
sync_host: server.mydomain.com
sync_authname: cyrus
sync_passwd: password
sync_machineid: 1
sync_log: 1
secondary
(to where everything is bein copied)
cyrus.conf
SERVICES {
syncservercmd=sync_server listen=csync
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
another question :
do i need to create mailboxes
on the replica server or will they be created by the replication
process ?
while trying to setup cyrus replication
i am getting the following error
on the secondary server ( the one that is getting a copy of everything)
Dec 9 12:35:34 mars master[7701]: about to exec
/usr/local/cyrus/bin/sync_server
Dec 9 12:35:34 mars syncserver[7701]: executed
Dec 9 12:35:34 mars syncserver[7701]: accepted connection
Dec 9 12:35:34 mars syncserver[7701]: cmdloop(): startup
Dec 9 12:35:34 mars master[7694]: process 7701 exited, status 75
Dec 9 12:35:34 mars master[7694]: service syncserver pid 7701 in BUSY
state: terminated abnormally
here are the settings from both imapd.conf and cyrus.conf
for both master and backup server.
master server
(from where everything is being copied)
cyrus.conf
under START section:
syncclientcmd=/usr/local/cyrus/bin/sync_client -r -t
imapd.conf
#replication configurations
sync_host: server.mydomain.com
sync_authname: cyrus
sync_passwd: password
sync_machineid: 1
sync_log: 1
secondary
(to where everything is bein copied)
cyrus.conf
SERVICES {
syncservercmd=sync_server listen=csync
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus replication question
i started looking around
for one i found that for whatever reason
both sync and some other default process was using 2005/tcp port
(in /etc/services )
after taking care of that
i kicked off on sync_client on master server
(after logging in as cyrus)
on master server i get
can not connect to server 'replica.mydomain.com trying in 15 seconds.
and in /var/log/messages the following comes up
(still on master server)
Dec 11 16:09:56 master_server sync_client[93038]: TLS client engine:
cannot load CA data
Dec 11 16:09:56 master_server sync_client[93038]: Doing a peer verify
Dec 11 16:09:56 master_server sync_client[93038]: verify error:num=18:self
signed certificate
Dec 11 16:09:56 master_server sync_client[93038]: starttls: TLSv1 with
cipher AES256-SHA (256/256 bits new) no authentication
Dec 11 16:09:57 master_server sync_client[93038]: No worthy mechs found
Dec 11 16:09:57 master_server sync_client[93038]: couldn't authenticate to
backend server: no mechanism available
-
/var/log/messeges on replica server
is not saying anything at this point
but /var/log/debug.log has the following :
Dec 11 15:56:33 replica_server syncserver[92364]: accepted connection
Dec 11 15:56:33 replica_server syncserver[92364]: cmdloop(): startup
Dec 11 15:56:33 replica_server syncserver[92364]: mystore: starting txn
2147483668
Dec 11 15:56:33 replica_server syncserver[92364]: mystore: committing txn
2147483668
Dec 11 15:56:49 replica_server syncserver[92364]: accepted connection
Dec 11 15:56:49 replica_server syncserver[92364]: cmdloop(): startup
Dec 11 15:56:49 replica_server syncserver[92364]: mydelete: starting txn
2147483669
Dec 11 15:56:49 replica_server syncserver[92364]: mydelete: committing txn
2147483669
Dec 11 15:56:49 replica_server syncserver[92364]: mystore: starting txn
2147483670
Dec 11 15:56:49 replica_server syncserver[92364]: mystore: committing txn
2147483670
while trying to setup cyrus replication
i am getting the following error
on the secondary server ( the one that is getting a copy of everything)
Dec 9 12:35:34 mars master[7701]: about to exec
/usr/local/cyrus/bin/sync_server
Dec 9 12:35:34 mars syncserver[7701]: executed
Dec 9 12:35:34 mars syncserver[7701]: accepted connection
Dec 9 12:35:34 mars syncserver[7701]: cmdloop(): startup
Dec 9 12:35:34 mars master[7694]: process 7701 exited, status 75
Dec 9 12:35:34 mars master[7694]: service syncserver pid 7701 in BUSY
state: terminated abnormally
here are the settings from both imapd.conf and cyrus.conf
for both master and backup server.
master server
(from where everything is being copied)
cyrus.conf
under START section:
syncclientcmd=/usr/local/cyrus/bin/sync_client -r -t
imapd.conf
#replication configurations
sync_host: server.mydomain.com
sync_authname: cyrus
sync_passwd: password
sync_machineid: 1
sync_log: 1
secondary
(to where everything is bein copied)
cyrus.conf
SERVICES {
syncservercmd=sync_server listen=csync
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
upgrade from 2.2 to 2.3
hey folks we are planing to finally upgrade our cyrus 2.2 to 2.3 what kind problems if any should we expect ? PS: we are running under FreeBSD 6.1-release 10p and postfix 2.3.3.1 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
