Re: using imapsync and altnamespace?
So does anyone know *for sure* how the --delete function will behave using imapsync? Does it only delete that which it confirms was successfully transferred? I used it to successfully move over the bulk of my mail. In my experience, the --delete function did exactly that. It only deleted what was successfully moved. Also, the messages are still there in the mailbox. They're just marked as deleted now. To actually remove them from the mailbox, you have to use expunge. David Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance
Quoting John Madden [EMAIL PROTECTED]: The disks are quite fast. bonnie++, for example, shows writes at over 300MB/s. What I'm finding though is that the processes aren't ever pegging them out -- nothing ever goes into iowait. The bottleneck is elsewhere... John This might seem dumb, but are there any issues with name resolution? Could DNS queries be slowing things down? David Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Formatting Messages
Here are the statistics from the first run: Statistics Time : 2454 sec Messages transfered: 5820 Messages skipped : 198 Total bytes transfered : 51575344 Total bytes skipped: 29284546 Total bytes error : 18765985 Detected 1662 errors I tried the --skipheader option, but I still had a lot of errors. In order to get the rest, I used Thunderbird's Redirect option. This way, I was able to move all of the messages to the new account. Now I'll just use Thunderbird's filters to move them to the right folders. David Quoting Andrew Morgan [EMAIL PROTECTED]: If I recall correctly, you can remove that line entirely. Lines beginning with From datestring are used as the message delimiter in mbox format. A real From header would be From: xxx (note the colon). Cyrus doesn't need that header to separate messages since it has one file per message. For the record, that is also why Pine always inserts a in front of any lines beginning with From in the message body as well. Andy On Thu, 3 Nov 2005, David Blewett wrote: Thanks, Leon and Chad for pointing this program out. It worked much better! I was able to copy all the good messages fine with it. I was able to track down the cause of the Invalid Header as well. For some reason, I have a bunch of messages with this header: From XXX Tue Feb 22 20: 16:15 2005 I'm not sure where they came from; possibly an error in migrating between servers. Now the question is, how do I remove these? There is always the From XXX, but the date after changes. Any ideas? David Quoting [EMAIL PROTECTED]: Try imapsync - http://www.linux-france.org/prj/imapsync/README Here is an example of the syntax: imapsync --host1 198.74.48.3 --user1 username1 --password1 secret1 --host2 198.74.48.10 --user2 username2 --password2 secret2 --noauthmd5 --include '^ANYFOLDERNAME' --subscribe Regards, Leon -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of David Blewett Sent: Wednesday, November 02, 2005 9:40 PM To: info-cyrus@lists.andrew.cmu.edu Subject: Formatting Messages I've tested out several different IMAP servers in the last few years (Courier, DBMail, now Cyrus). All my personal mail is currently in DBMail, and I'm trying to migrate it to Cyrus. I've got archives of a few mailing lists that run to the thousands of messages. Interspersed throughout these are random messages that apparently have bare newlines or invalid headers. When trying to move the entire folder, I'll get these often reported errors. Is there a way to move the messages that do not have malformed headers, and leave the rest? I want to move as much as I can to Cyrus, but I really don't want to have to try each message seperately. Alternatively, is there a tool to repair the messages with errors? I've tried having 2 IMAP accounts in Thunderbird, and moving from one to the other. I've tried mailutil, offlineimap, and mbsync with no luck. Any tips would be appreciated! David Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Formatting Messages
Thanks, Leon and Chad for pointing this program out. It worked much better! I was able to copy all the good messages fine with it. I was able to track down the cause of the Invalid Header as well. For some reason, I have a bunch of messages with this header: From XXX Tue Feb 22 20: 16:15 2005 I'm not sure where they came from; possibly an error in migrating between servers. Now the question is, how do I remove these? There is always the From XXX, but the date after changes. Any ideas? David Quoting [EMAIL PROTECTED]: Try imapsync - http://www.linux-france.org/prj/imapsync/README Here is an example of the syntax: imapsync --host1 198.74.48.3 --user1 username1 --password1 secret1 --host2 198.74.48.10 --user2 username2 --password2 secret2 --noauthmd5 --include '^ANYFOLDERNAME' --subscribe Regards, Leon -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of David Blewett Sent: Wednesday, November 02, 2005 9:40 PM To: info-cyrus@lists.andrew.cmu.edu Subject: Formatting Messages I've tested out several different IMAP servers in the last few years (Courier, DBMail, now Cyrus). All my personal mail is currently in DBMail, and I'm trying to migrate it to Cyrus. I've got archives of a few mailing lists that run to the thousands of messages. Interspersed throughout these are random messages that apparently have bare newlines or invalid headers. When trying to move the entire folder, I'll get these often reported errors. Is there a way to move the messages that do not have malformed headers, and leave the rest? I want to move as much as I can to Cyrus, but I really don't want to have to try each message seperately. Alternatively, is there a tool to repair the messages with errors? I've tried having 2 IMAP accounts in Thunderbird, and moving from one to the other. I've tried mailutil, offlineimap, and mbsync with no luck. Any tips would be appreciated! David Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Formatting Messages
I've tested out several different IMAP servers in the last few years (Courier, DBMail, now Cyrus). All my personal mail is currently in DBMail, and I'm trying to migrate it to Cyrus. I've got archives of a few mailing lists that run to the thousands of messages. Interspersed throughout these are random messages that apparently have bare newlines or invalid headers. When trying to move the entire folder, I'll get these often reported errors. Is there a way to move the messages that do not have malformed headers, and leave the rest? I want to move as much as I can to Cyrus, but I really don't want to have to try each message seperately. Alternatively, is there a tool to repair the messages with errors? I've tried having 2 IMAP accounts in Thunderbird, and moving from one to the other. I've tried mailutil, offlineimap, and mbsync with no luck. Any tips would be appreciated! David Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
