Re: Repeated Identical Messages
this is getting much weirder. following the message below, i tested both my backup and primary to see if they implemented help for qmail. here's what happened: when i test help by doing the following: from an ip inside the local network: telnet mailhost.otec.com smtp [dkelley@mx1 qmail]# telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 mx1.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: % telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) i tested the backup (which is located on a different block in a different geographic location) the exact same way: from an ip inside the local newtork: % telnet dev1.gc.ny.otec.com smtp Trying 10.0.50.102... Connected to dev1.gc.ny.otec.com. Escape character is '^]'. 220 dev1.gc.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: [dkelley@mx1 qmail]# telnet dev1.gc.ny.otec.com smtp Trying 64.209.222.102... Connected to dev1.gc.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) this appears to be hopelessy weird. both smtp connections are made through a firewall, which leaves port 25 open for the respective machines. mailhost.otec.com, after a very recent upgrade, runs qmail-1.03 with the qmail-remote ptach for qmtp delivery, and the qmail-queue patch for use with qmail-scanner. i've looked at the code (both pre and post patch), and can't figure out why this would occur. i've tried this from both a windows terminal and a linux xterm. anyone have any idea how this could happen? thanks- dan At 12:52 AM 3/16/01 +0100, you wrote: On Thu, Mar 15, 2001 at 05:05:30PM -0500, dan kelley wrote: they're definitley qmail; both run qmail-1.03 unpatched under tcpserver. what do you mean by 'help for smtp' ? lagrange(2:2697) $ telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) quit 221 mx1.ny.otec.com this is definitely NOT an unpatched qmail. Unmodified qmail's look like that: lagrange(2:2698) $ telnet mail.space.net smtp Trying 195.30.0.8... Connected to mail.space.net. Escape character is '^]'. 220 mail.space.net ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html quit 221 mail.space.net \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet. Dan Kelley www.otec.com 212-840-8600
RE: Repeated Identical Messages
Your servers are probably behind a Cisco PIX firewall. J. -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: ÄåõôÝñá, 19 Ìáñôßïõ 2001 6:35 ìì To: Markus Stumpf Cc: [EMAIL PROTECTED] Subject: Re: Repeated Identical Messages this is getting much weirder. following the message below, i tested both my backup and primary to see if they implemented help for qmail. here's what happened: when i test help by doing the following: from an ip inside the local network: telnet mailhost.otec.com smtp [dkelley@mx1 qmail]# telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 mx1.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: % telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) ...
RE: Repeated Identical Messages
What would a PIX have to do with it? I am having a random mutiple delivery problem, and I am behind a PIX. Thanks Kep _ ants.com http://www.ants.com scout http://www.ants.com/scout Kep Brown Systems, Network and Database Administrator phone: (805) 560-3781 fax: (805) 560-3991 e: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] -Original Message- From: Moutsos Georgios [mailto:[EMAIL PROTECTED]] Sent: Monday, March 19, 2001 10:21 AM To: dan kelley Cc: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages Your servers are probably behind a Cisco PIX firewall. J. -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: , 19 2001 6:35 To: Markus Stumpf Cc: [EMAIL PROTECTED] Subject: Re: Repeated Identical Messages this is getting much weirder. following the message below, i tested both my backup and primary to see if they implemented help for qmail. here's what happened: when i test help by doing the following: from an ip inside the local network: telnet mailhost.otec.com smtp [dkelley@mx1 qmail]# telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 mx1.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: % telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) ...
Re: Repeated Identical Messages
Kep Brown [EMAIL PROTECTED] wrote: What would a PIX have to do with it? I am having a random mutiple delivery problem, and I am behind a PIX. The PIX contains a (supposedly transparent) SMTP proxy which has, in the past, had very broken behaviour. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
RE: Repeated Identical Messages
as someone here was nice enough to point out to me: by default, certain versions of PIX software come out of the box with fixup protocol smtp 25 enabled. this implements something called 'Mail Guard', which rewrites smtp conversations, only allowing rfc 821 commands. we've been having two types of mail problems since installing the pix: 1. certain domains just couldn't email us. 2. we sometimes receive hundreds of copies of the same email. once i removed the smtp fixup from the pix, mail started soming throough from the domains that fell into category #1. (incidentally, they we're all exchange servers). it appears that number2 is now fixed as well, although that will take more time to verify. basically, what would happen is this: remote mailserver initiates conversation, says something like EHLO server.imaginary.com the PIX would rewrite the line to this (becase EHLO isin't rfc821) server.imaginary.com to which qmail would respond: 502 unimplemented (#5.5.1) the upshot was that eventually i'd have about 50 qmail-smtpd processes running at any given time. what finally gave the source of the problem away: telnet your mailserver 25 from both inside the network , and outside (through the pix). if you type help, and you get 502 unimplemented from the outside, and 214 qmail home page:http://pobox.com/~djb/qmail.html from the inside, the pix may be your problem. dan At 01:12 PM 3/19/01 -0800, you wrote: What would a PIX have to do with it? I am having a random mutiple delivery problem, and I am behind a PIX. Thanks Kep _ ants.com http://www.ants.com scout http://www.ants.com/scout Kep Brown Systems, Network and Database Administrator phone: (805) 560-3781 fax: (805) 560-3991 e: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] -Original Message- From: Moutsos Georgios [mailto:[EMAIL PROTECTED]] Sent: Monday, March 19, 2001 10:21 AM To: dan kelley Cc: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages Your servers are probably behind a Cisco PIX firewall. J. -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: , 19 2001 6:35 To: Markus Stumpf Cc: [EMAIL PROTECTED] Subject: Re: Repeated Identical Messages this is getting much weirder. following the message below, i tested both my backup and primary to see if they implemented help for qmail. here's what happened: when i test help by doing the following: from an ip inside the local network: telnet mailhost.otec.com smtp [dkelley@mx1 qmail]# telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 mx1.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: % telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) ... Dan Kelley www.otec.com 212-840-8600
RE: Repeated Identical Messages
Hey thanks, That seems to have solved the problem. Now I am going to spend the next 30 minutes cussing myself out for not thinking about that myself. Kep _ ants.com http://www.ants.com scout http://www.ants.com/scout Kep Brown Systems, Network and Database Administrator phone: (805) 560-3781 fax: (805) 560-3991 e: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: Monday, March 19, 2001 1:35 PM To: Kep Brown Cc: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages as someone here was nice enough to point out to me: by default, certain versions of PIX software come out of the box with fixup protocol smtp 25 enabled. this implements something called 'Mail Guard', which rewrites smtp conversations, only allowing rfc 821 commands. we've been having two types of mail problems since installing the pix: 1. certain domains just couldn't email us. 2. we sometimes receive hundreds of copies of the same email. once i removed the smtp fixup from the pix, mail started soming throough from the domains that fell into category #1. (incidentally, they we're all exchange servers). it appears that number2 is now fixed as well, although that will take more time to verify. basically, what would happen is this: remote mailserver initiates conversation, says something like EHLO server.imaginary.com the PIX would rewrite the line to this (becase EHLO isin't rfc821) server.imaginary.com to which qmail would respond: 502 unimplemented (#5.5.1) the upshot was that eventually i'd have about 50 qmail-smtpd processes running at any given time. what finally gave the source of the problem away: telnet your mailserver 25 from both inside the network , and outside (through the pix). if you type help, and you get 502 unimplemented from the outside, and 214 qmail home page:http://pobox.com/~djb/qmail.html from the inside, the pix may be your problem. dan At 01:12 PM 3/19/01 -0800, you wrote: What would a PIX have to do with it? I am having a random mutiple delivery problem, and I am behind a PIX. Thanks Kep _ ants.com http://www.ants.com scout http://www.ants.com/scout Kep Brown Systems, Network and Database Administrator phone: (805) 560-3781 fax: (805) 560-3991 e: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] -Original Message- From: Moutsos Georgios [mailto:[EMAIL PROTECTED]] Sent: Monday, March 19, 2001 10:21 AM To: dan kelley Cc: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages Your servers are probably behind a Cisco PIX firewall. J. -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: , 19 2001 6:35 To: Markus Stumpf Cc: [EMAIL PROTECTED] Subject: Re: Repeated Identical Messages this is getting much weirder. following the message below, i tested both my backup and primary to see if they implemented help for qmail. here's what happened: when i test help by doing the following: from an ip inside the local network: telnet mailhost.otec.com smtp [dkelley@mx1 qmail]# telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 mx1.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: % telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) ... Dan Kelley www.otec.com 212-840-8600
Re: Repeated Identical Messages
My first foray into using ezmlm+qmail resulted in a few users getting up to hundreds if copies of the email. Does this mean that they are probably behind a PIX with this broken feature? Why wouldn't it happen with all of their other email? Is it a qmail incompatibility? -K From: dan kelley [EMAIL PROTECTED] Date: Mon, 19 Mar 2001 16:34:47 -0500 To: "Kep Brown" [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages as someone here was nice enough to point out to me: by default, certain versions of PIX software come out of the box with fixup protocol smtp 25 enabled. this implements something called 'Mail Guard', which rewrites smtp conversations, only allowing rfc 821 commands. we've been having two types of mail problems since installing the pix: 1. certain domains just couldn't email us. 2. we sometimes receive hundreds of copies of the same email. once i removed the smtp fixup from the pix, mail started soming throough from the domains that fell into category #1. (incidentally, they we're all exchange servers). it appears that number2 is now fixed as well, although that will take more time to verify. basically, what would happen is this: remote mailserver initiates conversation, says something like EHLO server.imaginary.com the PIX would rewrite the line to this (becase EHLO isin't rfc821) server.imaginary.com to which qmail would respond: 502 unimplemented (#5.5.1) the upshot was that eventually i'd have about 50 qmail-smtpd processes running at any given time. what finally gave the source of the problem away: telnet your mailserver 25 from both inside the network , and outside (through the pix). if you type help, and you get 502 unimplemented from the outside, and 214 qmail home page:http://pobox.com/~djb/qmail.html from the inside, the pix may be your problem. dan At 01:12 PM 3/19/01 -0800, you wrote: What would a PIX have to do with it? I am having a random mutiple delivery problem, and I am behind a PIX. Thanks Kep _ ants.com http://www.ants.com scout http://www.ants.com/scout Kep Brown Systems, Network and Database Administrator phone: (805) 560-3781 fax: (805) 560-3991 e: [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] -Original Message- From: Moutsos Georgios [mailto:[EMAIL PROTECTED]] Sent: Monday, March 19, 2001 10:21 AM To: dan kelley Cc: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages Your servers are probably behind a Cisco PIX firewall. J. -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: , 19 2001 6:35 To: Markus Stumpf Cc: [EMAIL PROTECTED] Subject: Re: Repeated Identical Messages this is getting much weirder. following the message below, i tested both my backup and primary to see if they implemented help for qmail. here's what happened: when i test help by doing the following: from an ip inside the local network: telnet mailhost.otec.com smtp [dkelley@mx1 qmail]# telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 mx1.ny.otec.com ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html from a remote ip: % telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) ... Dan Kelley www.otec.com 212-840-8600
Re: Repeated Identical Messages
On Fri, Mar 16, 2001 at 12:52:40AM +0100, Markus Stumpf wrote: On Thu, Mar 15, 2001 at 05:05:30PM -0500, dan kelley wrote: they're definitley qmail; both run qmail-1.03 unpatched under tcpserver. what do you mean by 'help for smtp' ? lagrange(2:2697) $ telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) quit 221 mx1.ny.otec.com It does give me the 'timestamp qp pid' thing when I send a message thru it... Looks like heavily patched, or maybe old qmail. Greetz, Peter.
Re: Repeated Identical Messages
i think the latter is correct. this is my fault; i'm responsible for setting up our secondary, and the admin who set up our primary told me that it was qmail-1.03. it's definitely qmail, but must be an older version. thanks- dan On Sat, 17 Mar 2001, Peter van Dijk wrote: On Fri, Mar 16, 2001 at 12:52:40AM +0100, Markus Stumpf wrote: On Thu, Mar 15, 2001 at 05:05:30PM -0500, dan kelley wrote: they're definitley qmail; both run qmail-1.03 unpatched under tcpserver. what do you mean by 'help for smtp' ? lagrange(2:2697) $ telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) quit 221 mx1.ny.otec.com It does give me the 'timestamp qp pid' thing when I send a message thru it... Looks like heavily patched, or maybe old qmail. Greetz, Peter.
RE: Repeated Identical Messages
+ dan kelley [EMAIL PROTECTED]: | Is there some type of confilct between .qmail and fastfoward, or is a just | a matter of having the .qmail files not including errors? I don't know, but I know this: It could be very useful if some of you guys seeing these duplicates tried comparing headers of the duplicated messages. Starting from the point of duplication, Received: time stamps will be different. We need data, not idle speculation. - Harald
RE: Repeated Identical Messages
Hi Here are the headers from the first mail and the latest in the repeating cycle that I have received. First mail headers: X-NAV-TimeoutProtection0: X X-NAV-TimeoutProtection1: X X-NAV-TimeoutProtection2: X X-NAV-TimeoutProtection3: X X-NAV-TimeoutProtection4: X X-NAV-TimeoutProtection5: X X-NAV-TimeoutProtection6: X Return-Path: [EMAIL PROTECTED] Delivered-To: [EMAIL PROTECTED] Received: (qmail 60372 invoked by alias); 14 Mar 2001 15:05:28 - Delivered-To: [EMAIL PROTECTED] Received: (qmail 60367 invoked from network); 14 Mar 2001 15:05:28 - Received: from muncher.math.uic.edu (131.193.178.181) by mail-1.traffic.co.uk with SMTP; 14 Mar 2001 15:05:28 - Received: (qmail 6398 invoked by uid 1002); 14 Mar 2001 14:59:46 - Mailing-List: contact [EMAIL PROTECTED]; run by ezmlm Precedence: bulk Delivered-To: mailing list [EMAIL PROTECTED] Received: (qmail 20740 invoked from network); 14 Mar 2001 14:59:45 - Received: from sal.qcc.sk.ca (198.169.27.3) by muncher.math.uic.edu with SMTP; 14 Mar 2001 14:59:45 - Received: (qmail 20874 invoked by uid 1016); 14 Mar 2001 14:59:22 - Date: Wed, 14 Mar 2001 08:59:22 -0600 From: Charles Cazabon [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: Re: Messages Won't Remove From Queue Message-ID: [EMAIL PROTECTED] References: [EMAIL PROTECTED] Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2i In-Reply-To: [EMAIL PROTECTED]; from [EMAIL PROTECTED] on Wed, Mar 14, 2001 at 08:48:55AM -0600 X-UIDL: Hl"!]S!#!$Q="!h6b!! Latest receipt: X-NAV-TimeoutProtection0: X X-NAV-TimeoutProtection1: X X-NAV-TimeoutProtection2: X X-NAV-TimeoutProtection3: X X-NAV-TimeoutProtection4: X X-NAV-TimeoutProtection5: X X-NAV-TimeoutProtection6: X Return-Path: [EMAIL PROTECTED] Delivered-To: [EMAIL PROTECTED] Received: (qmail 34093 invoked by alias); 16 Mar 2001 16:56:46 - Delivered-To: [EMAIL PROTECTED] Received: (qmail 34086 invoked from network); 16 Mar 2001 16:56:46 - Received: from muncher.math.uic.edu (131.193.178.181) by mail-1.traffic.co.uk with SMTP; 16 Mar 2001 16:56:46 - Received: (qmail 6398 invoked by uid 1002); 14 Mar 2001 14:59:46 - Mailing-List: contact [EMAIL PROTECTED]; run by ezmlm Precedence: bulk Delivered-To: mailing list [EMAIL PROTECTED] Received: (qmail 20740 invoked from network); 14 Mar 2001 14:59:45 - Received: from sal.qcc.sk.ca (198.169.27.3) by muncher.math.uic.edu with SMTP; 14 Mar 2001 14:59:45 - Received: (qmail 20874 invoked by uid 1016); 14 Mar 2001 14:59:22 - Date: Wed, 14 Mar 2001 08:59:22 -0600 From: Charles Cazabon [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: Re: Messages Won't Remove From Queue Message-ID: [EMAIL PROTECTED] References: [EMAIL PROTECTED] Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2i In-Reply-To: [EMAIL PROTECTED]; from [EMAIL PROTECTED] on Wed, Mar 14, 2001 at 08:48:55AM -0600 X-UIDL: [`I"!]LB"!e%)"!Je,"! The X-NAV-TimeoutProtection0: X refers to Norton Antivirus email protection. I have had email repeaters on machines with this switched off however. So far I have received twenty seperate instances of this email. We restarted our qmail server last night explicitly adding to control/timeoutsmtpd a value of 1200 as per the mail by \Maex Unfortunately I had another email account experience a repeat in excess of 47 emails today alone from a Hotmail account. I hope I'm missing something really simple, any help much appreciated. Thanks Steve -Original Message- From: Harald Hanche-Olsen [mailto:[EMAIL PROTECTED]] Sent: 16 March 2001 16:11 To: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages + dan kelley [EMAIL PROTECTED]: | Is there some type of confilct between .qmail and fastfoward, or is a just | a matter of having the .qmail files not including errors? I don't know, but I know this: It could be very useful if some of you guys seeing these duplicates tried comparing headers of the duplicated messages. Starting from the point of duplication, Received: time stamps will be different. We need data, not idle speculation. - Harald
Re: Repeated Identical Messages
On Fri, Mar 16, 2001 at 05:44:54PM -, Steve Crowder wrote: We restarted our qmail server last night explicitly adding to control/timeoutsmtpd a value of 1200 as per the mail by \Maex 1200 is the default. So setting this to 1200 won't change anything ;-) btw. you do not need to restart qmail, this file is read by every invocation of qmail-smtpd (i.e. on every new connection). I have looked at the code of qmail-smtpd.c The 451 timeout is issued by the receiver if it doesn't get any infos from the sender within timeout (=1200 default or from timeoutsmtpd). - the message seems to have arrived successfully (including CRLF.CRLF) otherwise the receiver wouldn't have it correctly in queue. At that point if the connection breaks the mail will be delivered. (if there where no local filesystem problems, message size problems, too many hops or the like). - Then the receiver sends back the "250 ok tstamp qp pid". This tells the sender that the message was received ok. And it looks like this code never arrives at the sender. Would all of you that have the problems mind makeing a test and inserting an explicit flush(); call in qmail-smtpd.c in function acceptmessage() as the last statement. This *should* not be needed, as the data command has a flush entry ... What *really* puzzels me is that saferead() spits out an error to the sender before closing, but safewrite() simply does an _exit(1). Maybe inserting some error output could also help tracking down the problem. \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
RE: Repeated Identical Messages
Hi Markus, I see where you are coming from with this, but I don't think that is the problem. We've checked with the senders and their firewalls only log ONE outbound connection to us. If the 250 OK was not being sent, the sender's SMTP gateway would make multiple connections (one for each repeated message). This being the case, it does look like a local problem - but I can't seem to find the message anywhere! We'll investigate further (in case the sender's firewall were not being totally honest ;)). Thanks! Shash -Original Message- From: Markus Stumpf [mailto:[EMAIL PROTECTED]] Sent: 16 March 2001 18:49 To: Steve Crowder Cc: [EMAIL PROTECTED]; Harald Hanche-Olsen; Shashi Dookhee Subject: Re: Repeated Identical Messages On Fri, Mar 16, 2001 at 05:44:54PM -, Steve Crowder wrote: We restarted our qmail server last night explicitly adding to control/timeoutsmtpd a value of 1200 as per the mail by \Maex 1200 is the default. So setting this to 1200 won't change anything ;-) btw. you do not need to restart qmail, this file is read by every invocation of qmail-smtpd (i.e. on every new connection). I have looked at the code of qmail-smtpd.c The 451 timeout is issued by the receiver if it doesn't get any infos from the sender within timeout (=1200 default or from timeoutsmtpd). - the message seems to have arrived successfully (including CRLF.CRLF) otherwise the receiver wouldn't have it correctly in queue. At that point if the connection breaks the mail will be delivered. (if there where no local filesystem problems, message size problems, too many hops or the like). - Then the receiver sends back the "250 ok tstamp qp pid". This tells the sender that the message was received ok. And it looks like this code never arrives at the sender. Would all of you that have the problems mind makeing a test and inserting an explicit flush(); call in qmail-smtpd.c in function acceptmessage() as the last statement. This *should* not be needed, as the data command has a flush entry ... What *really* puzzels me is that saferead() spits out an error to the sender before closing, but safewrite() simply does an _exit(1). Maybe inserting some error output could also help tracking down the problem. \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
Repeated Identical Messages
Hi All I have a situation where emails sent to accounts on our qmail 1.03 server randomly get regenerated so that multiple copies of the same identical email are resent several times. The number repeated can range from a few to several hundred and there seems to be no set pattern as to the time cycle between each mail. The original mails have been sent from a variety of different servers and platforms - MS and Unix. For example the mail that Charles Cazabon sent as a reply to Bill Luckett[EMAIL PROTECTED] to this list Subject Re: Messages Won't Remove From Queue on Wednesday 14/03/2001 15:05 I have now received as fourteen separate instances at these times: Wed 14/03/2001 15:39 Wed 14/03/2001 16:26 Wed 14/03/2001 17:31 Wed 14/03/2001 19.02 Wed 14/03/2001 20:35 Wed 14/03/2001 22.14 Thu 15/03/2001 00:08 Thu 15/03/2001 01:56 Thu 15/03/2001 00:08 Thu 15/03/2001 02:16 Thu 15/03/2001 04:38 Thu 15/03/2001 07:24 Thu 15/03/2001 10:09 Thu 15/03/2001 13:11 All mails are identical and I'm sure Charles is not resending the same mail. Does anyone know why this should be happening or better still how to fix it ? Many thanks for any help. Steve -- Steve Crowder Systems Support Engineer email: [EMAIL PROTECTED] ** http://www.traffic.co.uk Traffic Interactive Limited 191 Old Marylebone Road London NW1 5DW Telephone (Direct Line): +44 (0)20 7298 8281 Telephone (Switchboard): +44 (0)20 7298 8200 Mobile: +44 07718 808 048 Facsimile: +44 (0)20 7298 8201 ISDN: +44 (0)20 7298 8299 **
Re: Repeated Identical Messages
steve- unfortunately, i can't tell you why this is happening, but the *exact* same thing is happening to me. when i started to capture all smtp sessions with recordio to see if that gave any hints, i found that i had lots of these in my logs: 451 timeout are you seeing he same thing? dan At 03:09 PM 3/15/01 -, you wrote: Hi All I have a situation where emails sent to accounts on our qmail 1.03 server randomly get regenerated so that multiple copies of the same identical email are resent several times. The number repeated can range from a few to several hundred and there seems to be no set pattern as to the time cycle between each mail. The original mails have been sent from a variety of different servers and platforms - MS and Unix. For example the mail that Charles Cazabon sent as a reply to Bill Luckett[EMAIL PROTECTED] to this list Subject Re: Messages Won't Remove From Queue on Wednesday 14/03/2001 15:05 I have now received as fourteen separate instances at these times: Wed 14/03/2001 15:39 Wed 14/03/2001 16:26 Wed 14/03/2001 17:31 Wed 14/03/2001 19.02 Wed 14/03/2001 20:35 Wed 14/03/2001 22.14 Thu 15/03/2001 00:08 Thu 15/03/2001 01:56 Thu 15/03/2001 00:08 Thu 15/03/2001 02:16 Thu 15/03/2001 04:38 Thu 15/03/2001 07:24 Thu 15/03/2001 10:09 Thu 15/03/2001 13:11 All mails are identical and I'm sure Charles is not resending the same mail. Does anyone know why this should be happening or better still how to fix it ? Many thanks for any help. Steve -- Steve Crowder Systems Support Engineer email: [EMAIL PROTECTED] ** http://www.traffic.co.uk Traffic Interactive Limited 191 Old Marylebone Road London NW1 5DW Telephone (Direct Line): +44 (0)20 7298 8281 Telephone (Switchboard): +44 (0)20 7298 8200 Mobile: +44 07718 808 048 Facsimile: +44 (0)20 7298 8201 ISDN: +44 (0)20 7298 8299 ** Dan Kelley www.otec.com 212-840-8600
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 03:09:24PM -, Steve Crowder wrote: Hi All I have a situation where emails sent to accounts on our qmail 1.03 server randomly get regenerated so that multiple copies of the same identical email are resent several times. The number repeated can range from a few to several hundred and there seems to be no set pattern as to the time cycle between each mail. The original mails have been sent from a variety of different servers and platforms - MS and Unix. [snip] Missing 250 after successfull DATA during the SMTP conservation?? It's not mail-1.traffic.co.uk is it?? It doesn't look like a qmail server... It's hard for us to take a look at the server unless we know which one it is :) Jörgen
Re: Repeated Identical Messages
i'm having the exact same problem: mailhost.otec.com dan At 04:29 PM 3/15/01 +0100, you wrote: On Thu, Mar 15, 2001 at 03:09:24PM -, Steve Crowder wrote: Hi All I have a situation where emails sent to accounts on our qmail 1.03 server randomly get regenerated so that multiple copies of the same identical email are resent several times. The number repeated can range from a few to several hundred and there seems to be no set pattern as to the time cycle between each mail. The original mails have been sent from a variety of different servers and platforms - MS and Unix. [snip] Missing 250 after successfull DATA during the SMTP conservation?? It's not mail-1.traffic.co.uk is it?? It doesn't look like a qmail server... It's hard for us to take a look at the server unless we know which one it is :) Jrgen Dan Kelley www.otec.com 212-840-8600
Re: Repeated Identical Messages
Steve Crowder [EMAIL PROTECTED] wrote: [...] I have now received as fourteen separate instances at these times: [...] All mails are identical and I'm sure Charles is not resending the same mail. Nope, just the once. Does anyone know why this should be happening or better still how to fix it ? I see this too sometimes; it seems to be bursty. I'll get lots of duplicates for a day or two, then none for a week or three. Dan has mentioned in the past that packet loss on the UIC link during the day regularly hits 25% -- since list.cr.yp.to sits on that network, it might be not seeing the successful response to the DATA command if the connection gets broken before then, and therefore has to re-send the mail (and logging "possible dupe" messages in Dan's logs). I do note that the duplicates are generally received on weekdays during North American office hours, and I only notice them on mail coming from list.cr.yp.to -- not from other ezmlm-managed lists. Perhaps djb himself could comment on whether the network saturation at UIC is causing duplicates? Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: Repeated Identical Messages
i take your point on packetloss / truncated SMTP conversations. however, i'm seeing this from many different domains, including hotmail and yahoo. one oddity: so far, the dups all seems to come from domains that are using qmail for outgoing mail. At 09:39 AM 3/15/01 -0600, you wrote: Steve Crowder [EMAIL PROTECTED] wrote: [...] I have now received as fourteen separate instances at these times: [...] All mails are identical and I'm sure Charles is not resending the same mail. Nope, just the once. Does anyone know why this should be happening or better still how to fix it ? I see this too sometimes; it seems to be bursty. I'll get lots of duplicates for a day or two, then none for a week or three. Dan has mentioned in the past that packet loss on the UIC link during the day regularly hits 25% -- since list.cr.yp.to sits on that network, it might be not seeing the successful response to the DATA command if the connection gets broken before then, and therefore has to re-send the mail (and logging "possible dupe" messages in Dan's logs). I do note that the duplicates are generally received on weekdays during North American office hours, and I only notice them on mail coming from list.cr.yp.to -- not from other ezmlm-managed lists. Perhaps djb himself could comment on whether the network saturation at UIC is causing duplicates? Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. --- Dan Kelley www.otec.com 212-840-8600
RE: Repeated Identical Messages
Hi We have had several instances of the repeating email syndrome and it seems to be from all flavours of mail servers including Lotus Notes Release 5.0.3 (Intl) and MS Exchange which are being used for both incoming and outgoing mail. Not to sure that this information helps though. Thanks Steve -Original Message- From: dan kelley [mailto:[EMAIL PROTECTED]] Sent: 15 March 2001 15:55 To: Charles Cazabon Cc: [EMAIL PROTECTED] Subject: Re: Repeated Identical Messages i take your point on packetloss / truncated SMTP conversations. however, i'm seeing this from many different domains, including hotmail and yahoo. one oddity: so far, the dups all seems to come from domains that are using qmail for outgoing mail. At 09:39 AM 3/15/01 -0600, you wrote: Steve Crowder [EMAIL PROTECTED] wrote: [...] I have now received as fourteen separate instances at these times: [...] All mails are identical and I'm sure Charles is not resending the same mail. Nope, just the once. Does anyone know why this should be happening or better still how to fix it ? I see this too sometimes; it seems to be bursty. I'll get lots of duplicates for a day or two, then none for a week or three. Dan has mentioned in the past that packet loss on the UIC link during the day regularly hits 25% -- since list.cr.yp.to sits on that network, it might be not seeing the successful response to the DATA command if the connection gets broken before then, and therefore has to re-send the mail (and logging "possible dupe" messages in Dan's logs). I do note that the duplicates are generally received on weekdays during North American office hours, and I only notice them on mail coming from list.cr.yp.to -- not from other ezmlm-managed lists. Perhaps djb himself could comment on whether the network saturation at UIC is causing duplicates? Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. --- Dan Kelley www.otec.com 212-840-8600
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 09:39:11AM -0600, Charles Cazabon wrote: Steve Crowder [EMAIL PROTECTED] wrote: [...] I have now received as fourteen separate instances at these times: [...] All mails are identical and I'm sure Charles is not resending the same mail. Nope, just the once. Does anyone know why this should be happening or better still how to fix it ? FWIW We see this very, very, very rarely. I've never seen it in email from this list. I see this too sometimes; it seems to be bursty. I'll get lots of duplicates for a day or two, then none for a week or three. Dan has mentioned in the past that packet loss on the UIC link during the day regularly hits 25% -- since list.cr.yp.to sits on that network, it might be not seeing the successful response to the DATA command if the connection gets broken before then, and therefore has to re-send the mail (and logging "possible dupe" messages in Dan's logs). I do note that the duplicates are generally received on weekdays during North American office hours, and I only notice them on mail coming from list.cr.yp.to -- not from other ezmlm-managed lists. Perhaps djb himself could comment on whether the network saturation at UIC is causing duplicates? cfm -- Christopher F. Miller, Publisher [EMAIL PROTECTED] MaineStreet Communications, Inc 208 Portland Road, Gray, ME 04039 1.207.657.5078 http://www.maine.com/ Content management, electronic commerce, internet integration, Debian linux
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 11:39:38AM -0500, [EMAIL PROTECTED] wrote: SNIP FWIW We see this very, very, very rarely. I've never seen it in email from this list. Funny -- I just got this one twice. ;) I see this happening every so often, and I concur with Charles mostly -- I see it more often from list.cr.yp.to, but also occassionally from the FreeBSD mailing lists. Consistently within North American office hours, 0800EST-1700PST or thereabouts. Strange -- Greg White Those who make peaceful revolution impossible will make violent revolution inevitable. -- John F. Kennedy
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 10:30:07AM -0500, dan kelley wrote: i'm having the exact same problem: mailhost.otec.com [snip] well... mailhost.otec.com and mx2.otec.com doesn't look like qmail servers -- are they behind some service?? qmail implements help for SMTP but it's unimplemented on your server. Jörgen
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 09:06:45AM -0800, Greg White wrote: On Thu, Mar 15, 2001 at 11:39:38AM -0500, [EMAIL PROTECTED] wrote: FWIW We see this very, very, very rarely. I've never seen it in email from this list. Funny -- I just got this one twice. ;) In this case, [EMAIL PROTECTED] was listed in both To: and Cc:. Vince.
Re: Repeated Identical Messages
First let me say I have NEVER seen duplicates from this list (nor from anywhere else, nor did one of our customers complain about dupes from qmail). And we live on the other side of the big pond ;-) On Thu, Mar 15, 2001 at 10:16:35AM -0500, dan kelley wrote: when i started to capture all smtp sessions with recordio to see if that gave any hints, i found that i had lots of these in my logs: 451 timeout are you seeing he same thing? Is this a message from the sender or from your smtpd? If it's yours you might give control/timeoutsmtpd a chance (default is 1200 seconds, see "man qmail-smtpd"). \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
RE: Repeated Identical Messages
I have had the repeated msg problem with some of the users on my ezmlm-idx managed list. I had one user tell me he got the same newsletter 12 times from me. Has anyone found a solution to this yet ? Thanks Jeremy Suo-Anttila
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 08:20:09PM +0100, Markus Stumpf wrote: First let me say I have NEVER seen duplicates from this list (nor from anywhere else, nor did one of our customers complain about dupes from qmail). And we live on the other side of the big pond ;-) Yep, me too. No duplicates ever, about 800km away from maex. Maybe the problem is your own internet connection? overloaded, slow, packet loss, ... ? Maex suggestion of increasing smtptimeout may help then. -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany
RE: Repeated Identical Messages
I know we were experiencing this problem once before. And what it came down to is the .qmail files. Specifically if the .qmail-default was not setup correctly it would send duplicates out. Or if a .qmail file setup as an alias to multiple people was setup incorrectly or included someone that no longer had an account. Everytime that I've experienced duplicate messages on our server it has related back to one of those to items. Andy -Original Message- From: Jeremy Suo-Anttila [mailto:[EMAIL PROTECTED]] Sent: Thursday, March 15, 2001 2:56 PM To: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages I have had the repeated msg problem with some of the users on my ezmlm-idx managed list. I had one user tell me he got the same newsletter 12 times from me. Has anyone found a solution to this yet ? Thanks Jeremy Suo-Anttila
Re: Repeated Identical Messages
they're definitley qmail; both run qmail-1.03 unpatched under tcpserver. what do you mean by 'help for smtp' ? thanks- dan At 06:27 PM 3/15/01 +0100, you wrote: On Thu, Mar 15, 2001 at 10:30:07AM -0500, dan kelley wrote: i'm having the exact same problem: mailhost.otec.com [snip] well... mailhost.otec.com and mx2.otec.com doesn't look like qmail servers -- are they behind some service?? qmail implements help for SMTP but it's unimplemented on your server. Jrgen Dan Kelley www.otec.com 212-840-8600
RE: Repeated Identical Messages
this is interesting: we use dot-forward and fastforward. here's .qmail-default: | /var/qmail/bin/fastforward -d /etc/aliases.cdb i looked at the users that were receiving dups, and pretty much all of them had .qmail files. Is there some type of confilct between .qmail and fastfoward, or is a just a matter of having the .qmail files not including errors? Thanks- Dan At 03:14 PM 3/15/01 -0500, you wrote: I know we were experiencing this problem once before. And what it came down to is the .qmail files. Specifically if the .qmail-default was not setup correctly it would send duplicates out. Or if a .qmail file setup as an alias to multiple people was setup incorrectly or included someone that no longer had an account. Everytime that I've experienced duplicate messages on our server it has related back to one of those to items. Andy -Original Message- From: Jeremy Suo-Anttila [mailto:[EMAIL PROTECTED]] Sent: Thursday, March 15, 2001 2:56 PM To: [EMAIL PROTECTED] Subject: RE: Repeated Identical Messages I have had the repeated msg problem with some of the users on my ezmlm-idx managed list. I had one user tell me he got the same newsletter 12 times from me. Has anyone found a solution to this yet ? Thanks Jeremy Suo-Anttila Dan Kelley www.otec.com 212-840-8600
Re: Repeated Identical Messages
On Thu, Mar 15, 2001 at 05:05:30PM -0500, dan kelley wrote: they're definitley qmail; both run qmail-1.03 unpatched under tcpserver. what do you mean by 'help for smtp' ? lagrange(2:2697) $ telnet mailhost.otec.com smtp Trying 209.3.117.5... Connected to mx1.ny.otec.com. Escape character is '^]'. 220 * help 502 unimplemented (#5.5.1) quit 221 mx1.ny.otec.com this is definitely NOT an unpatched qmail. Unmodified qmail's look like that: lagrange(2:2698) $ telnet mail.space.net smtp Trying 195.30.0.8... Connected to mail.space.net. Escape character is '^]'. 220 mail.space.net ESMTP help 214 qmail home page: http://pobox.com/~djb/qmail.html quit 221 mail.space.net \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
