Re: max concurrency for qmail is 500, what's it for sendmail?
On Thu, 26 Apr 2001, James Stevens wrote: You are correct ;) Sendmail can only sustain one exsistance of it's delivery object meaning it can't multithread like the newer MTA's soo when sendmail runs a large q say 10k messages all those messages go into q and get piped out through one thread instance of sendmail whereas qmail simply fires up 500 threads and crunches through the q message by message until it's done. You can also reconfigure qmail to allow up to 1k What actually happens with sendmail is that you have one sendmail process running all of the time. every queue-scan period (-qX[dhms])it runs the messages in the queue. During this is sorts the messages by destination MTA. It will then start a delivery process per destination MTA (if there is machine load left over) which delivers all of the messages for that MTA. if there is more machine load left over it will start additional delivery processes. Each sendmail process 'locks' the message it is trying to deliver to prevent duplicate sends; when a message is delivered to a remote MTA it is delivered to all recipients at that MTA. RjL == You know that. I know that. But when || Austin, Texas you talk to a monkey you have to || Email: [EMAIL PROTECTED] grunt and wave your arms -ck ||
Re: max concurrency for qmail is 500, what's it for sendmail?
On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. sendmail doesn't have concurrency-limiting. With sendmail, there's usually a daemon that triggers a one-concurrency queue-run. Also, every message injected thru SMTP (or locally, for that matter) gets one chance. This 'one chance' strategy is disabled when the system load is above a configured maximum. In that case *everything* gets queued. Somebody else pointed out that sendmail starts one delivery process per remote host. This is not my observation, but I can be wrong. It comes down to: sendmail stops delivering when the load reaches a configured maximum. No other concurrencylimits are in place. Greetz, Peter.
Re: max concurrency for qmail is 500, what's it for sendmail?
On Wed, Apr 25, 2001 at 06:01:15PM -0700, Brett wrote: Below, you say that you think the big concurrency patch is useless but in your testing: http://www.lamer.de/maex/creative/software/qmail/deliveries/, your lowest evaluation was for 150 remote connections and qmail's default maximum without the patch is 120. So you would still need the big concurrency patch even for your lowest setting and hence, I don't think you meant to say it's useless. By all means correct me if I'm wrong. I usually don't know what I'm talking about. You don't need the patch to do 150. qmail can do 254 or 255 without the patch. Greetz, Peter.
Re: max concurrency for qmail is 500, what's it for sendmail?
On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. 1 if I'm not totally mistaken... -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
RE: max concurrency for qmail is 500, what's it for sendmail?
no way can it be 1. that would be ridiculous and yet... -Original Message- From: Henning Brauer [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 25, 2001 4:43 PM To: [EMAIL PROTECTED] Subject: Re: max concurrency for qmail is 500, what's it for sendmail? On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. 1 if I'm not totally mistaken... -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
Re: max concurrency for qmail is 500, what's it for sendmail?
On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. Dunno about sendmail, but with the big concurrency patch maximum concurrency for qmail can be as high as 2^16 (okay, you need a few descriptors, but 65500 should be possible). And from the README to that patch: **CAUTION** if you do this one should realise that qmail-send might try to open 64K connections to the /same/ host because it doesn't maintain a per-domain concurrency. And as I have posted about 60 minutes ago to this list, I have made the observation that the big concurrency patch for qmail is pretty much useless. \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
Re: max concurrency for qmail is 500, what's it for sendmail?
You are correct ;) Sendmail can only sustain one exsistance of it's delivery object meaning it can't multithread like the newer MTA's soo when sendmail runs a large q say 10k messages all those messages go into q and get piped out through one thread instance of sendmail whereas qmail simply fires up 500 threads and crunches through the q message by message until it's done. You can also reconfigure qmail to allow up to 1k concurrency and if you really want mailing power you can edit and recompile your system and qmail and go up as high as you want. I have mine set at 800 on 6 different servers and have never had a bootleneck... Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) --JT Original Message On 4/25/01, 4:42:34 PM, Henning Brauer [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. 1 if I'm not totally mistaken... -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
RE: max concurrency for qmail is 500, what's it for sendmail?
Yes, it's sad but true... --JT Original Message On 4/25/01, 5:07:13 PM, Brett [EMAIL PROTECTED] wrote regarding RE: max concurrency for qmail is 500, what's it for sendmail?: no way can it be 1. that would be ridiculous and yet... -Original Message- From: Henning Brauer [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 25, 2001 4:43 PM To: [EMAIL PROTECTED] Subject: Re: max concurrency for qmail is 500, what's it for sendmail? On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. 1 if I'm not totally mistaken... -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
RE: max concurrency for qmail is 500, what's it for sendmail?
EZ Mailing List Manager -- using mySQL It's on the qmail.org home page.. --JT Original Message On 4/25/01, 5:35:39 PM, Brett [EMAIL PROTECTED] wrote regarding RE: max concurrency for qmail is 500, what's it for sendmail?: James, Thanks for the info here. I have a couple more questions if you don't mind. What method are you using to cluster these six servers together? We're looking to set something very similar up as we're going to be sending out large quantities of mail to several different mailing lists (not spam). But we can't find any info regarding clustering and/or load balancing for mail servers. Also, have you gotten blocked from any servers with such high concurrencies? Thanks again. I appreciate any help. Brett. -Original Message- From: James Stevens [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 25, 2001 5:12 PM To: Henning Brauer; [EMAIL PROTECTED] Subject: Re: max concurrency for qmail is 500, what's it for sendmail? You are correct ;) Sendmail can only sustain one exsistance of it's delivery object meaning it can't multithread like the newer MTA's soo when sendmail runs a large q say 10k messages all those messages go into q and get piped out through one thread instance of sendmail whereas qmail simply fires up 500 threads and crunches through the q message by message until it's done. You can also reconfigure qmail to allow up to 1k concurrency and if you really want mailing power you can edit and recompile your system and qmail and go up as high as you want. I have mine set at 800 on 6 different servers and have never had a bootleneck... Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) --JT Original Message On 4/25/01, 4:42:34 PM, Henning Brauer [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. 1 if I'm not totally mistaken... -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
RE: max concurrency for qmail is 500, what's it for sendmail?
Actually to be more accurate... EZ Mailing List Manager -- using mySQL databases And on each server there actually 6 qmail instances running called qmqp1.whatever.com thru qmqp6.whatever.com and EZMail in setup to mail to all QMQP servers in basically what equates to a round robin order. 5K here 5k there and so on till all the addresses are spolled out. There are other ways of doing it which include simply splitting a very large list into several smaller lists and sitting each smaller list on it's own server. The biggest problem with running 6 instances of qmail on one server is you have to set your descriptors up high enough and then no matter what you max is you have to get a calculator out and balance out all 6 instances or however many you install on it so that you can never exceed your max descriptors. Even then you still want to leave yourself a safety zone. So when I set mine up I basically recompiled linux to be able to handle 64k discriptors and then applied the big-todo patches and every other patch I could find and ones recomeneded to me here in the list and then set the max concurrency for each qmail (qmqp) service to 800 although obviously I could go allot higher than that without worry about linux.. However you will find the higher you go (anything above 800 or so) the more complaints you will get from ISP's like aol and earthlink.. They really hate it when you open up 2k+ connections to them emagine what the smaller ISP's will tell you. But at any rate it all works just fine.. If your planing on multiple server then setup a linux (standard configuration no editing or recompiling) install qmail and edit the concurrency up to 800 make sure you have already applied the patches required. You should have a system capable at that point of crankin out some serious mail. Now read the install files that came with qmail on the qmqp server.. Get it setup and running make sure you add the appropiate entries for it to start automatically then go download majordomo or EZMail (recommend Ezmail) a couple of guys that work with me say majordomo is easier to learn.. I find Ezmail much faster and more versatile so it's up to you.. If your new then try majordomo if your not new to this then get Ezmail as it will have the capabilities you want. Anyways now I goto bed... For real this time.. --JT Original Message On 4/25/01, 5:35:39 PM, Brett [EMAIL PROTECTED] wrote regarding RE: max concurrency for qmail is 500, what's it for sendmail?: James, Thanks for the info here. I have a couple more questions if you don't mind. What method are you using to cluster these six servers together? We're looking to set something very similar up as we're going to be sending out large quantities of mail to several different mailing lists (not spam). But we can't find any info regarding clustering and/or load balancing for mail servers. Also, have you gotten blocked from any servers with such high concurrencies? Thanks again. I appreciate any help. Brett. -Original Message- From: James Stevens [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 25, 2001 5:12 PM To: Henning Brauer; [EMAIL PROTECTED] Subject: Re: max concurrency for qmail is 500, what's it for sendmail? You are correct ;) Sendmail can only sustain one exsistance of it's delivery object meaning it can't multithread like the newer MTA's soo when sendmail runs a large q say 10k messages all those messages go into q and get piped out through one thread instance of sendmail whereas qmail simply fires up 500 threads and crunches through the q message by message until it's done. You can also reconfigure qmail to allow up to 1k concurrency and if you really want mailing power you can edit and recompile your system and qmail and go up as high as you want. I have mine set at 800 on 6 different servers and have never had a bootleneck... Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) --JT Original Message On 4/25/01, 4:42:34 PM, Henning Brauer [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. 1 if I'm not totally mistaken... -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
Re: max concurrency for qmail is 500, what's it for sendmail?
Laugh... No Stress is when you wake up screaming and realize it wasn't the phone ringing with that irritating customer you hate so much.. Then you realize as you wide the sweat of your forehead that your not even at work!! If anyone can agree with that say 'hell ya!' --JT Original Message On 4/25/01, 5:18:57 PM, Markus Stumpf [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Thu, Apr 26, 2001 at 12:11:46AM +, James Stevens wrote: Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) Lack of caffeine? SCNR, but I can understand what you mean ... (see my .sig) Have a good night! \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
Re: max concurrency for qmail is 500, what's it for sendmail?
Laugh... No Stress is when you wake up screaming and realize it wasn't the phone ringing with that irritating customer you hate so much.. Then you realize as you wide the sweat of your forehead that your not even at work!! If anyone can agree with that say 'hell ya!' --JT Original Message On 4/25/01, 5:18:57 PM, Markus Stumpf [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Thu, Apr 26, 2001 at 12:11:46AM +, James Stevens wrote: Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) Lack of caffeine? SCNR, but I can understand what you mean ... (see my .sig) Have a good night! \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
Re: max concurrency for qmail is 500, what's it for sendmail?
whats this sleep stuff and where can i get some ? - Original Message - From: James Stevens [EMAIL PROTECTED] To: Markus Stumpf [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Wednesday, April 25, 2001 7:55 PM Subject: Re: max concurrency for qmail is 500, what's it for sendmail? Laugh... No Stress is when you wake up screaming and realize it wasn't the phone ringing with that irritating customer you hate so much.. Then you realize as you wide the sweat of your forehead that your not even at work!! If anyone can agree with that say 'hell ya!' --JT Original Message On 4/25/01, 5:18:57 PM, Markus Stumpf [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Thu, Apr 26, 2001 at 12:11:46AM +, James Stevens wrote: Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) Lack of caffeine? SCNR, but I can understand what you mean ... (see my .sig) Have a good night! \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
RE: max concurrency for qmail is 500, what's it for sendmail?
Below, you say that you think the big concurrency patch is useless but in your testing: http://www.lamer.de/maex/creative/software/qmail/deliveries/, your lowest evaluation was for 150 remote connections and qmail's default maximum without the patch is 120. So you would still need the big concurrency patch even for your lowest setting and hence, I don't think you meant to say it's useless. By all means correct me if I'm wrong. I usually don't know what I'm talking about. # On Wed, Apr 25, 2001 at 03:59:04PM -0700, Brett wrote: Does anybody know the maximum concurrency for sendmail? From what I understand, with the big concurrency patch, it's 500 for qmail but I can't find any data on sendmail. Thanks in advance. Dunno about sendmail, but with the big concurrency patch maximum concurrency for qmail can be as high as 2^16 (okay, you need a few descriptors, but 65500 should be possible). And from the README to that patch: **CAUTION** if you do this one should realise that qmail-send might try to open 64K connections to the /same/ host because it doesn't maintain a per-domain concurrency. And as I have posted about 60 minutes ago to this list, I have made the observation that the big concurrency patch for qmail is pretty much useless. \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
RE: max concurrency for qmail is 500, what's it for sendmail?
Sounds like every morning just about for me. ;-D -Original Message- From: James Stevens [mailto:[EMAIL PROTECTED]] Sent: Wednesday, April 25, 2001 8:56 PM To: [EMAIL PROTECTED] Subject: Re: max concurrency for qmail is 500, what's it for sendmail? Laugh... No Stress is when you wake up screaming and realize it wasn't the phone ringing with that irritating customer you hate so much.. Then you realize as you wide the sweat of your forehead that your not even at work!! If anyone can agree with that say 'hell ya!' --JT Original Message On 4/25/01, 5:18:57 PM, Markus Stumpf [EMAIL PROTECTED] wrote regarding Re: max concurrency for qmail is 500, what's it for sendmail?: On Thu, Apr 26, 2001 at 12:11:46AM +, James Stevens wrote: Anyways theres my two cents .. Now I go home and sleep (trying to remember what that word actually means) Lack of caffeine? SCNR, but I can understand what you mean ... (see my .sig) Have a good night! \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
