root file system full: master.core?
Hello I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare all works well. After the update from FreeBSD 6.3 to 7.0 I got always when I start cyrus a file which is called master.core in /etc/rc.d which has around 65MB. The probleme here is that the root file system is now quite full. Any ideas? Kind regards, -- Martin Schweizer [EMAIL PROTECTED] Tel.: +41 32 512 48 54 (VoIP) Fax: +1 619 3300587 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: root file system full: master.core?
On Mon, Aug 25, 2008 at 9:30 AM, Martin Schweizer [EMAIL PROTECTED] wrote: Hello I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare all works well. After the update from FreeBSD 6.3 to 7.0 I got always when I start cyrus a file which is called master.core in /etc/rc.d which has around 65MB. The problem here is that the root file system is now quite full. Any ideas? This look like a core dump ! The dump of the memory of a process when it crashed. This should help you to find why it crashed ! Can you look in your log files at the creation time of this core dump to see for any error ? Are you sure master.core is coming from a problem with cyrus ? Because postfix master is also called master ! Could you remove this file and restart cyrus service ? Does this file come back ? If not can you try with postfix service ? FYI : the ulimit command can't be used to disable the core dump creation by setting a maximum size to 0 But this doesnt' solve the problem, just hide it. Kind regards, -- Martin Schweizer [EMAIL PROTECTED] Tel.: +41 32 512 48 54 (VoIP) Fax: +1 619 3300587 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Alain Spineux aspineux gmail com May the sources be with you Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: root file system full: master.core?
On Mon, 25 Aug 2008, Martin Schweizer wrote: I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare all works well. After the update from FreeBSD 6.3 to 7.0 I got always when I start cyrus a file which is called master.core in /etc/rc.d which has around 65MB. The probleme here is that the root file system is now quite full. Any ideas? What do you get if you run... sudo gdb /usr/local/cyrus/bin/master /master.core then type bt. One work around would be to modify the rc.d file to cd somewhere (put cyrus_imapd_chdir=/foo in it) I'm running 2.3.7 without seeing coredumps FWIW. -- Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au The nice thing about standards is that there are so many of them to choose from. -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C signature.asc Description: This is a digitally signed message part. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus-imapd not providing realm information
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password:password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: ([EMAIL PROTECTED]) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK Success. but imtest fails: imtest -u [EMAIL PROTECTED] -a [EMAIL PROTECTED] -t localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base=dc=example,dc=com scope=2 deref=0 filter=(mail=tarjei@) It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsp/pYVRKCnSvzfIRAoN2AJ94nmeUJ1ir+SWICgZQwz1W9JQskACgn4X4 kt/8icmlER1QImZK+ZR/r7U= =zTtD -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus-imapd not providing realm information
Hi, I've got the same setup -- you should have ldap_realm: yourdomain.com in /etc/saslauthd.conf and you should start saslauthd daemon with the -r argument hth, charles On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password:password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: ([EMAIL PROTECTED]) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK Success. but imtest fails: imtest -u [EMAIL PROTECTED] -a [EMAIL PROTECTED] -t localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base=dc=example,dc=com scope=2 deref=0 filter=(mail=tarjei@) It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsp/pYVRKCnSvzfIRAoN2AJ94nmeUJ1ir+SWICgZQwz1W9JQskACgn4X4 kt/8icmlER1QImZK+ZR/r7U= =zTtD -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus-imapd not providing realm information
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 lartc wrote: Hi, I've got the same setup -- you should have ldap_realm: yourdomain.com in /etc/saslauthd.conf and you should start saslauthd daemon with the -r argument Hi Charles, thank you for your quick reply. I tried your suggestions, but they do not seem to solve my problem. The same problem persists. Kind regards, tarjei hth, charles On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password:password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: ([EMAIL PROTECTED]) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK Success. but imtest fails: imtest -u [EMAIL PROTECTED] -a [EMAIL PROTECTED] -t localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base=dc=example,dc=com scope=2 deref=0 filter=(mail=tarjei@) It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei - Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsqdvYVRKCnSvzfIRAjSUAJ0VVE8/qQV1g8Jk5owVOhsvQ3+I7wCgqIa6 o6czot+fnXmO4tfUGFeeWhg= =M20U -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus-imapd not providing realm information
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Again, tarjei wrote: lartc wrote: Hi, I've got the same setup -- you should have ldap_realm: yourdomain.com It seems that the parameter that needed to be set was ldap_default_realm, as I found when reading http://thread.gmane.org/gmane.mail.imap.cyrus/22049. Again, thanks for helping me. Kind regards, Tarjei in /etc/saslauthd.conf and you should start saslauthd daemon with the -r argument Hi Charles, thank you for your quick reply. I tried your suggestions, but they do not seem to solve my problem. The same problem persists. Kind regards, tarjei hth, charles On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password:password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: ([EMAIL PROTECTED]) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK Success. but imtest fails: imtest -u [EMAIL PROTECTED] -a [EMAIL PROTECTED] -t localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base=dc=example,dc=com scope=2 deref=0 filter=(mail=tarjei@) It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsqrrYVRKCnSvzfIRAjBHAKCBQYe6u8ZZOd7ssM68vSQ6en8oAwCgrUl+ 8dnhnjUTrfUoeL/nU6OZxp8= =cPzT -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus-imapd not providing realm information
On Mon, Aug 25, 2008 at 2:51 PM, tarjei [EMAIL PROTECTED] wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Again, tarjei wrote: lartc wrote: Hi, I've got the same setup -- you should have ldap_realm: yourdomain.com It seems that the parameter that needed to be set was ldap_default_realm, as I found when reading http://thread.gmane.org/gmane.mail.imap.cyrus/22049. You set virtdomains: userid What is happening if you configure a second domain name ? I thing your error was to configure defaultdomain: example.com because then when you login as [EMAIL PROTECTED], cyrus remove the @example.com This is working that way because when you updrade from virtdomains: off to virtdomains: userid you can keep your old user (without @domain.name) without any changes. Just create new mailboxes and users specifying a domain name. Regards Again, thanks for helping me. Kind regards, Tarjei in /etc/saslauthd.conf and you should start saslauthd daemon with the -r argument Hi Charles, thank you for your quick reply. I tried your suggestions, but they do not seem to solve my problem. The same problem persists. Kind regards, tarjei hth, charles On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password:password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: ([EMAIL PROTECTED]) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK Success. but imtest fails: imtest -u [EMAIL PROTECTED] -a [EMAIL PROTECTED] -t localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base=dc=example,dc=com scope=2 deref=0 filter=(mail=tarjei@) It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsqrrYVRKCnSvzfIRAjBHAKCBQYe6u8ZZOd7ssM68vSQ6en8oAwCgrUl+ 8dnhnjUTrfUoeL/nU6OZxp8= =cPzT -END PGP SIGNATURE- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Alain Spineux aspineux gmail com May the sources be with you Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus-imapd not providing realm information
Woops. Yep. More coffee needed. Cheers Charles On Mon, 2008-08-25 at 14:51 +0200, tarjei wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Again, tarjei wrote: lartc wrote: Hi, I've got the same setup -- you should have ldap_realm: yourdomain.com It seems that the parameter that needed to be set was ldap_default_realm, as I found when reading http://thread.gmane.org/gmane.mail.imap.cyrus/22049. Again, thanks for helping me. Kind regards, Tarjei in /etc/saslauthd.conf and you should start saslauthd daemon with the -r argument Hi Charles, thank you for your quick reply. I tried your suggestions, but they do not seem to solve my problem. The same problem persists. Kind regards, tarjei hth, charles On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password:password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: ([EMAIL PROTECTED]) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK Success. but imtest fails: imtest -u [EMAIL PROTECTED] -a [EMAIL PROTECTED] -t localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base=dc=example,dc=com scope=2 deref=0 filter=(mail=tarjei@) It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsqrrYVRKCnSvzfIRAjBHAKCBQYe6u8ZZOd7ssM68vSQ6en8oAwCgrUl+ 8dnhnjUTrfUoeL/nU6OZxp8= =cPzT -END PGP SIGNATURE- -- simplified chinese is not nearly as easy as they would have you believe ... a superlative oxymoron --anonymous Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Pruning Duplicates
I've discovered that a user's folder suddenly contains a couple of thousand duplicate messages. Each pair of messages shares the same inode (ext3) but has a different filename (for example, 15715. and 21534.). I haven't determined the cause yet, but I believe it may be due to an aborted attempt to reorganize this large collection of emails (almost 20,000 messages). The account is shared among a handful of users who access it concurrently, using the same login and password, which may have contributed to the issue. Is the shared inode a result of Cyrus IMAPd's duplicate suppression? I've been asked to remove the duplicates. Can anyone recommend a safe and simple method for doing so? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Pruning Duplicates
I've seen this before with Thunderbird. As I recall, Thunderbird requests a lengthy operation but times out (or fills a buffer?) before getting a result back. It then tries the operation again, until the mailbox is woefully full. To clean up, we typically calculate checksums on the files and find duplicates that way. :wes On 25 Aug 2008, at 19:50, Jorey Bump wrote: I've discovered that a user's folder suddenly contains a couple of thousand duplicate messages. Each pair of messages shares the same inode (ext3) but has a different filename (for example, 15715. and 21534.). I haven't determined the cause yet, but I believe it may be due to an aborted attempt to reorganize this large collection of emails (almost 20,000 messages). The account is shared among a handful of users who access it concurrently, using the same login and password, which may have contributed to the issue. Is the shared inode a result of Cyrus IMAPd's duplicate suppression? I've been asked to remove the duplicates. Can anyone recommend a safe and simple method for doing so? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Pruning Duplicates
Jorey Bump wrote: I've been asked to remove the duplicates. Can anyone recommend a safe and simple method for doing so? I have had success with this Thunderbird extension https://addons.mozilla.org/en-US/thunderbird/addon/956 YMMV, have backups. -- Sincerely, John Thomas Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Pruning Duplicates
Wesley Craig wrote, at 08/25/2008 10:45 PM: I've seen this before with Thunderbird. As I recall, Thunderbird requests a lengthy operation but times out (or fills a buffer?) before getting a result back. It then tries the operation again, until the mailbox is woefully full. Interesting. Aside from webmail, Thunderbird is indeed the only other client used to access this account. To clean up, we typically calculate checksums on the files and find duplicates that way. In this case, I can easily find the inodes that reference more than one file: ls -li /var/spool/imap/user/bob/folder | cut -b 1-8 | sort | uniq -d I was hoping to somehow leverage this information to delete the duplicates only, but haven't quite figured it out myself. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Pruning Duplicates
John Thomas wrote, at 08/25/2008 11:01 PM: Jorey Bump wrote: I've been asked to remove the duplicates. Can anyone recommend a safe and simple method for doing so? I have had success with this Thunderbird extension https://addons.mozilla.org/en-US/thunderbird/addon/956 YMMV, have backups. Thanks, that did the trick, although I used a fork that's being actively developed: http://removedupes.mozdev.org/ It's actually a pretty handy extension, as I discovered while testing on some of my own accounts. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
