Re: [vchkpw] Losing messages when I move them?
Tim, MrSam, Michael Bowe - (Sorry for top-posting;) I do enable IMAP_Emptytrash... but here's what's confusing. This server has been running this exact configuration since January. Only in the last month have I noticed the dropped/lost messages. In that month's time, the only change to the configuration was a move from Squirrelmail v1.40RC1 to v1.4.1 (my stated version was in error on original post). Since Squirrel can or does use its own IMAP engine (I am using Squirrel's IMAP routines), I'm starting to wonder if Squirrel is writing messages when they are touched that names/renames the message file to become confusing for Courier IMAP when it's time to try moving the file to another folder. I don't understand the IMAP file naming system, so this is a complete W.A.G. In a previous post, Michael Bowe noted that PHP 4.3.x has caused some problems after an IMAP mod he proposed. I am using *most* of his excellent configuration - including his proposed IMAP mod. However, since I'm losing messages when using Mozilla's IMAP client as well, I'm inclined to guess that 1) either Squirrel/PHP are mistouching the file/filename, or 2) Michael's IMAP mod is the problem. Tim, your microtime issue is another contender, of course, but I'm confused why it hasn't reared its head until recently. Any takers on this line of thought? Sorry about the long post. THANKS, BTW, for the contributions so far. Dave. Quoting Dave Richardson - Lists [EMAIL PROTECTED]: 1058557796.M109269P14433V0302I0053812F_8.penguin.example.com,S=143 6:2,S 1058557805.M99846P14433V0302I00538130_11.penguin.example.com,S=202 3:2,RS [..snip..] 1059675921.19351.penguin.example.com,S=163777:2,S 1059689347.25043.penguin.example.com,S=2461:2,S Ok, the above says it all (from your last 2 or 3 emails) You also mentioned you are using Couirer-imap 1.7 which I believe is buggy or not backwards compatible!! If you look in Courier-imap's changelog, for version 1.7.0 (changes made by Mr Sam on 2003-01-14), you will see: * maildir/maildircreateh.c (maildir_try_create_hostname): Include microseconds in message filename. When I migrated one of my servers from a courier-imap 1.6.2 to a courier-imap 1.7.0, I had the SAME problem that you are currently having. I think the problem manifests itself only in older messages with the older style names (I could be wrong). Does that problem happen only when you have IMAP_EMPTYTRASH enabled? Anyways, stick with 1.6.1 till Mr Sam, me, or someone else figures out a fix. Perhaps Mr. Sam could shed more light on the subject. I hope he didn't mind me cc'ing him on this, since I wanted to ask him anyhow. Best Regards, Tim
Re: [vchkpw] Losing messages when I move them?
Dave Richardson - Lists wrote: I run Courier1.7/Vpopmail5.2.1/Squirrel1.4.11(?)/Qmail (blah blah). Recently I've had messages get lost/deleted when I try to move them to another folder. If I use Mozilla, I'd drag-and-drop. If I use Squirrel, I'd mark and move-to-folder. Some messages move OK, others get lost. The lost ones don't go to Trash, they just disappear. No errors, nothing in the logs. I've got a theory that most the mail that gets lost on a move is either HTML or has 1+ attachments of any size. The problem doesn't seem to affect all folders of a mailbox/account, but it does seem to be a sticky problem - once a folder goes bad, it stays bad. Not all users exhibit this problem. Disk seems ok, etc... looking for debug ideas. Very strange problem! I wonder what the permissions look like on the bad folders..., any idea? Jeff -- /\ /\ ......[EMAIL PROTECTED] / \/ \ a t r i x . . . . . . . (770) 794-7233 s o f t w a r e i n c ...... http://www.matrixsi.com
Re: [vchkpw] Losing messages when I move them?
The offending user is der drwx--3 vpopmail vchkpw 4096 May 30 07:44 der cd der; ls -l drwx-- 28 vpopmail vchkpw 4096 Jul 25 11:14 Maildir cd Maildir; ls -l -rw-r--r--1 vpopmail vchkpw264 Jul 25 11:14 courierimapsubscribed -rw-r--r--1 vpopmail vchkpw 3955 Aug 1 14:40 courierimapuiddb drwx--2 vpopmail vchkpw 12288 Aug 1 14:49 cur -rw---1 vpopmail vchkpw 4498 Aug 1 14:49 maildirsize drwx--2 vpopmail vchkpw 8192 Aug 1 14:32 new drwx--2 vpopmail vchkpw 4096 Aug 1 14:52 tmp cd cur; ls -l [99 messages, last several shown] -rw---1 vpopmail vchkpw 163847 Jul 31 13:25 1059675921.19351.penguin.example.com,S=163777:2,S -rw---1 vpopmail vchkpw 2530 Jul 31 17:09 1059689347.25043.penguin.example.com,S=2461:2,S -rw---1 vpopmail vchkpw 3110 Jul 31 21:23 1059704582.5611.penguin.surfinbox.com,S=3036:2,S -rw---1 vpopmail vchkpw 2537 Aug 1 13:51 1059763864.10523.penguin.example.com,S=2459:2,S -rw---1 vpopmail vchkpw 3252 Aug 1 14:18 1059765516.11705.penguin.example.com,S=3183:2,S -rw---1 vpopmail vchkpw 1706 Aug 1 14:26 1059765977.11975.penguin.example.com,S=1637:2,S -rw---1 vpopmail vchkpw 3413 Aug 1 14:26 1059766016.11998.penguin.example.com,S=3347:2,RS Did that help more info needed Jeff Hedlund wrote: Dave Richardson - Lists wrote: I run Courier1.7/Vpopmail5.2.1/Squirrel1.4.11(?)/Qmail (blah blah). Recently I've had messages get lost/deleted when I try to move them to another folder. If I use Mozilla, I'd drag-and-drop. If I use Squirrel, I'd mark and move-to-folder. Some messages move OK, others get lost. The lost ones don't go to Trash, they just disappear. No errors, nothing in the logs. I've got a theory that most the mail that gets lost on a move is either HTML or has 1+ attachments of any size. The problem doesn't seem to affect all folders of a mailbox/account, but it does seem to be a sticky problem - once a folder goes bad, it stays bad. Not all users exhibit this problem. Disk seems ok, etc... looking for debug ideas. Very strange problem! I wonder what the permissions look like on the bad folders..., any idea? Jeff
Re: [vchkpw] Losing messages when I move them?
Dave Richardson - Lists wrote: Did that help more info needed How about the offending mail folder? What are it's perms? (and the dirs inside it)? Jeff -- /\ /\ ......[EMAIL PROTECTED] / \/ \ a t r i x . . . . . . . (770) 794-7233 s o f t w a r e i n c ...... http://www.matrixsi.com
Re: [vchkpw] Losing messages when I move them?
an offending folder is INBOX.consulting pwd = der/Maildir cd .consulting; ls -l -rw-r--r--1 vpopmail vchkpw609 Jul 29 14:51 courierimapuiddb drwx--2 vpopmail vchkpw 4096 Jul 29 07:27 cur -rwx--1 vpopmail vchkpw 0 Jul 18 14:49 maildirfolder drwx--2 vpopmail vchkpw 4096 Jul 18 14:49 new drwx--2 vpopmail vchkpw 4096 Jul 29 14:51 tmp ls -l new total 0 ls -l tmp total 0 ls -l cur -rw-r--r--1 vpopmail vchkpw 1436 Jul 18 14:35 1058557796.M109269P14433V0302I0053812F_8.penguin.example.com,S=1436:2,S -rw-r--r--1 vpopmail vchkpw 2023 Jul 17 10:37 1058557805.M99846P14433V0302I00538130_11.penguin.example.com,S=2023:2,RS -rw-r--r--1 vpopmail vchkpw 3296 Jul 18 14:47 1058557959.M590179P14433V0302I0053812D_12.penguin.example.com,S=3296:2,S -rw-r--r--1 vpopmail vchkpw 2135 Jul 18 15:56 1058562075.M937013P14433V0302I0053812E_16.penguin.example.com,S=2135:2,S -rw-r--r--1 vpopmail vchkpw 3969 Jul 18 15:56 1058562075.M937379P14433V0302I00538132_17.penguin.example.com,S=3969:2,S -rw-r--r--1 vpopmail vchkpw 4258 Jul 28 13:37 1059430929.M573029P30452V0302I00538135_3.penguin.example.com,S=4258:2,RS -rw-r--r--1 vpopmail vchkpw 5247 Jul 28 19:37 1059481652.M339393P26685V0302I00538136_3.penguin.example.com,S=5247:2,S More??? Jeff Hedlund wrote: Dave Richardson - Lists wrote: Did that help more info needed How about the offending mail folder? What are it's perms? (and the dirs inside it)? Jeff
Re: [vchkpw] Losing messages when I move them?
- Original Message - From: Dave Richardson - Lists [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Saturday, August 02, 2003 5:16 AM Subject: [vchkpw] Losing messages when I move them? I run Courier1.7/Vpopmail5.2.1/Squirrel1.4.11(?)/Qmail (blah blah). Recently I've had messages get lost/deleted when I try to move them to another folder. If I use Mozilla, I'd drag-and-drop. If I use Squirrel, I'd mark and move-to-folder. Some messages move OK, others get lost. The lost ones don't go to Trash, they just disappear. No errors, nothing in the logs. Dont know if this is your answer or not... : I wrote a guide that shows how to build a server made out of qmail / vpopmail / courier-imap / squirrelmail etc http://www.pipeline.com.au/staff/mbowe/isp/webmail-server.htm Judging by the amount of feedback email that I get, and by the number of time I see this url quoted on mailing lists, it seems that quite a lot of people have used this guide to build mail servers Up until recently this guide had some notes in the courier-imap section that talked about the way that the IMAP_EMPTYTRASH function works. The notes showed how I had modded the maildirpurgetmp.c file so that it would delete files based on mtime rather than ctime. (For those of you who arent sure of what I am talking about here, you can read more info on this subject in the comments of the courier-imap/etc/imapd file) The mod I used was to change maildir/maildirpurgetmp.c (at around line 64) from stat_buf.st_ctime current_time - nage) to stat_buf.st_mtime current_time - nage) Now this mod worked as intended without problem up until June 2003, when I started receiving emails from people who had built servers according to my guide, but they were suddenly experiencing mail going missing after trying to move messages from one folder to another. Only messages that were more than a few days old seemed to be affected. After a bit of digging, we found that the problem only happened with the combination of the mod shown above, and PHP 4.3.x (which was released around June 2003) If you run the mod with PHP 4.2.x or earlier, messages would not go missing on move... I initially thought it unlikely that a change in PHP version would have caused this behaviour, but it was certainly repeatable by flipping the PHP versions on my own mail server between 4.2.x and 4.3.x I dont know why or how the newer version of PHP would trip up this mod, but it does seem to be the cause. Michael.
Re: [vchkpw] Losing messages when I move them?
Quoting Dave Richardson - Lists [EMAIL PROTECTED]: 1058557796.M109269P14433V0302I0053812F_8.penguin.example.com,S=143 6:2,S 1058557805.M99846P14433V0302I00538130_11.penguin.example.com,S=202 3:2,RS [..snip..] 1059675921.19351.penguin.example.com,S=163777:2,S 1059689347.25043.penguin.example.com,S=2461:2,S Ok, the above says it all (from your last 2 or 3 emails) You also mentioned you are using Couirer-imap 1.7 which I believe is buggy or not backwards compatible!! If you look in Courier-imap's changelog, for version 1.7.0 (changes made by Mr Sam on 2003-01-14), you will see: * maildir/maildircreateh.c (maildir_try_create_hostname): Include microseconds in message filename. When I migrated one of my servers from a courier-imap 1.6.2 to a courier-imap 1.7.0, I had the SAME problem that you are currently having. I think the problem manifests itself only in older messages with the older style names (I could be wrong). Does that problem happen only when you have IMAP_EMPTYTRASH enabled? Anyways, stick with 1.6.1 till Mr Sam, me, or someone else figures out a fix. Perhaps Mr. Sam could shed more light on the subject. I hope he didn't mind me cc'ing him on this, since I wanted to ask him anyhow. Best Regards, Tim
