Higher number of deliveries
Hi there, IM very sorry for the long mail that I have sent. But Just elaborating the problem as I could not understand what and where was the glitch in my config. We have a database of 100,000 mails and we will be sending personalized mails to each user automatically. We use redhat 6.2 ( extfs, kernel 2.2.14 ) and qmail for mailing. Before mentioning the problem the config parameters that I have used in qmail and system config are system config -- dell poweredge server with 1GB RAM and scsi disks with 12000 rpm, dual CPU. redhat 6.2, kernel 2.2.14, extfs. Network bandwidth = 22Mbps qmail config -- concurrencyremote = 400 queuelifetime = 345600 timeoutremote = 600 timeoutsmtpd = 600 and all the others are default parameters. The problem is that, when I tried sending 4700 mails ( to different domains . say like yahoo, hotmail, rediff, etc and not a single user in my domain ), it took one whole day to send all the mails.. qmail-inject placed mails in the queue at a speed of 70 - 90 mails in a second. But, if the logs are checked, it took one whole day to finish sending all the mails Was I wrong anywhere or missed any configuration ??? What should I do to send say a million mails in a day ? Thanks & Regards,Rajesh,tech solutions,[EMAIL PROTECTED],Intercept Consulting - INDIA.
RE: Higher number of deliveries
> qmail config > -- > concurrencyremote = 400 What do your logs say? Did you apply the big-concurrency patch? Did you change conf-spawn before compiling? Because if you didn't, your concurrency is automatically limited to 120.
Re: Higher number of deliveries
On Tue, Jun 26, 2001 at 04:13:29AM -0600, Chris Bolt wrote: > > qmail config > > -- > > concurrencyremote = 400 > > What do your logs say? Did you apply the big-concurrency patch? Did you > change conf-spawn before compiling? Because if you didn't, your concurrency > is automatically limited to 120. A concurrency greater than 250 won't buy you anything in most cases anyway. check the archives, they are full of discussions about this. I've personally written some mails about it one or two weeks ago. -- * Henning Brauer, [EMAIL PROTECTED], http://www.bsws.de * * Roedingsmarkt 14, 20459 Hamburg, Germany * Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
Re: Higher number of deliveries
> D Rajesh wrote: > We have a database of 100,000 mails and we will be sending > personalized mails to each user automatically. We use redhat 6.2 ( > extfs, kernel 2.2.14 ) and qmail for mailing. This should take no longer than 4.5 to 5 hours to deliver to all reachable mail servers, with a low-end box running remoteconcurrency of 120. I have a low-end NetBSD box that delivers 1800 messages every 5 minutes with remoteconcurrency set to 120. > The problem is that, when I tried sending 4700 mails ( to different > domains . say like yahoo, hotmail, rediff, etc and not a single > user in my domain ), it took one whole day to send all the mails.. > qmail-inject placed mails in the queue at a speed of 70 - 90 mails in > a second. But, if the logs are checked, it took one whole day to > finish sending all the mails You didn't happen to get a line like this in /var/log/qmail/current or maybe a rotated log file, did you? @40003b1d11932a837604 delivery 41: deferral: qmail-spawn_unable_to_create_pipe._(#4.3.0)/ If so, then you need to adjust the ulimits of your system and up the max processes and max open files per process. Man ulimit. > What should I do to send say a million mails in a day ? Set up a main qmail box running ezmlm, that has a list with 4 addresses subscribed: sublists. Set the sublists to each route to a seperate qmail box via smtproutes. Set up 4 more qmail boxes, each with ezmlm running the appropriate sublist. Subscribe one quarter of the subscribers to each box in the sublist. This should take between 8-9 hours to send out 1 million mails. BTW, these boxes don't need to be high end monsters like the one you described above. You could probably decrease your sending time to 6 hours or something if you use the large-concurrency patch. You probably also need to use the large to-do patch so the queues can handle more than 10,000 messages at a time. Regards, Mike
Re: Higher number of deliveries
On Tue, Jun 26, 2001 at 03:07:48PM +0530, D Rajesh wrote: > The problem is that, when I tried sending 4700 mails ( to different > domains . say like yahoo, hotmail, rediff, etc and not a single user > in my domain ), it took one whole day to send all the mails.. qmail-inject > placed mails in the queue at a speed of 70 - 90 mails in a second. But, if > the logs are checked, it took one whole day to finish sending all the mails It sometimes takes me 2 or 3 days to get only one message delivered to yahoo. This is not a problem that you can fix with qmail configuration on your side. The problem is with yahoo and their mailservers and I can see it for more than one year. \Maex -- SpaceNet AG| Joseph-Dollinger-Bogen 14 | Fon: +49 (89) 32356-0 Research & Development | D-80807 Muenchen| Fax: +49 (89) 32356-299 Stress is when you wake up screaming and you realize you haven't fallen asleep yet.
Re: Higher number of deliveries
Markus Stumpf wrote:
>
> On Tue, Jun 26, 2001 at 03:07:48PM +0530, D Rajesh wrote:
> > The problem is that, when I tried sending 4700 mails ( to different
> > domains . say like yahoo, hotmail, rediff, etc and not a single user
> > in my domain ), it took one whole day to send all the mails.. qmail-inject
> > placed mails in the queue at a speed of 70 - 90 mails in a second. But, if
> > the logs are checked, it took one whole day to finish sending all the mails
>
> It sometimes takes me 2 or 3 days to get only one message delivered to yahoo.
> This is not a problem that you can fix with qmail configuration on your
> side.
> The problem is with yahoo and their mailservers and I can see it for more
> than one year.
Hi,
You can dedicate a box called slowmail.abc.com and smtproute all of
these problematic domains to it; just add them as they appear. This way
your queues don't stay jammed full of trash, thus slowing down
everything else.
Now, we are up to 6 low-end pentium boxes for a million mail per 8-9
hours list.
lists.abc.com (front-end box)
lists1.abc.com (sublist carrying 25% of subscribers)
lists2.abc.com (" ")
lists3.abc.com (" ")
lists4.abc.com (" ")
slowmail.abc.com (smtproutes from lists1-4 point here)
Mike
