Mailing from One connection
Hi All, I am sending different mails to 20,000recipients at a time. So, each qmail-remote sends a mail to each recipient. or am I wrong If in the total 20,000 mails, say 5000 are hotmail, 5000 are yahoo and the rest are to other domains. Then, is it possible to open a single qmail-remote process and dump all messages to be sent to hotmail on one connection and open another connection for all yahoo messages I guess this speeds up the mail delivery amazingly Cheers, rajesh.
Re: Mailing from One connection
Hi All, Thank you to all for all the replies I also found that Qmail is definitely better than sendmail. After reading lot of documentation links given here and elsewhere I also found that sending mails concurrently is better than sending mails from one connection. I have checked the mailing lists and archives on the same too. Cheers Rajesh. - Original Message - From: John White [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, July 10, 2001 9:44 AM Subject: Re: Mailing from One connection On Mon, Jul 09, 2001 at 12:30:52PM -0600, Roger Walker wrote: Test with stock qmail on a Solaris workstation, 10,000 copies sent to the same email address (obviously the same domain) using qmail-inject: 30 minutes. Test from same workstation with a script to generate 10,000 rcpt to: lines and send via a single connection: 5 minutes. In the first example, 10,000 actual copies were delivered to the mailbox but in the second, only a single copy was delivered. Presuming it should take the same amount of time to wait for a rcpt to: response whether sending a separate message at a time or a single message with multiple rcpt to: lines, I get the results that I expected - to send to the same domain (ignoring VERP requirements), it is faster to use a single connection for multiple messages than to use qmail. Amazing! I guess you're right. What is this MTA called? Where can I download it? Let me know, and I'll set it up on a test box to try to duplicate your test. What were the IP addresses of the two boxes you did this on? What kind of dns library does this server use for it's resolution? And what was the name again? What server did it use for the resolution, and what was the dns latency for that from the sending boxes? I'm going to try to duplicate your test as closely as possible. What was the ip of that dns server again? Wait, I'm reading your post a bit more closely and it doesn't look like you benchmarked qmail against your server, but against a script to generate 10K rcpt to: lines. Is that right? Now I'm a bit confused. qmail is an MTA which handles many things like a safe queue. What are you comparing that to? The case where I have 10K recipients of one message at one domain which never needs queue management? How does your script handle new messages? How does your script handle a randomly mixed list of 10K recipients who are located at 10 different domains? How does your script handle a list of 50M recipients at one domain? Does your script accept message via the smtp protocol? If so, what happens after it replys ok to the 50M message case, and you power off the box 5 seconds later? Can you send me the source of this script? John
conf-spawn and FD_SET SUCCESS
Hi All, Sorry, to bother all eventhough the subject says SUCCESS. Just to Thank all I have gone through the qmail - mailing archives and finally succeeded in applying big-concurrency patch. The archives were simply great with all the help. I have found the solution for the FD_SET error that cropped in qmail - installation with big concurrency patch settingthe conf-spawn to 1000. My thanks to everyone and specially to Peter, James and Adi Prasaja from whose mails I got the solution from the archives in the below link. http://www.ornl.gov/its/archives/mailing-lists/qmail/2000/09/msg01095.html As James mentioned in his mail the installation is successful, but I have 1 million mails to be sent andI' mafraid that the Linux kernel may crash !!! My qmail parameters are as follows on a redhat Linux 6.2 kernel 2.2.14 :- qmail + DNS patch + big - todo patch + big - concurrency patch silent concurrency --- 1000 conf-split --- 15 concurrency remote --- 200 timeout smtp --- 240 timeout remote --- 240 and I am running3 qmail-send's from /var/qmail, /var/qmail1, /var/qmail2 for the operation to send1 million. Will this do to send these 1 million mails and how long it may take for this ??? Is there any way to calculate Finally, Just curious to know whatthis file /usr/include/bits/types.h is used for Cheers, rajesh.
Re: conf-spawn and FD_SET SUCCESS
Hi Henning / Peter, Thanks a lot for your responses.. I'm really very sorry..about the typo mistake conf-split is 17 conf-split should be prime for optimal performance. What's wrong with the default 23? I thought a large conf-split only makes sense if we have more than 20.000 messages *in the queue* . I guess this does not happen even if I send huge volume of mails after applying big concurrency patch. I felt we will decrease the file access time and seek time Was I wrong...??? Do I need to have huge conf-split to send high volumes of mails PL suggest me the optimal parameters that I should use. Cheers, rajesh. - Original Message - From: Henning Brauer [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, July 03, 2001 3:48 PM Subject: Re: conf-spawn and FD_SET SUCCESS On Tue, Jul 03, 2001 at 03:15:36PM +0530, D Rajesh wrote: conf-split --- 15 Congratulations. Nobody knew that 15 was a prime until today. -- * Henning Brauer, [EMAIL PROTECTED], http://www.bsws.de * * Roedingsmarkt 14, 20459 Hamburg, Germany * Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
Re: conf-spawn and FD_SET SUCCESS
Hi Peter, Thanks again for your reply I am actually trying to send 200,000 mails and not 1 mail to 200,000 people... !!! PL suggest me on what parameters should I use ... Cheers, rajesh. - Original Message - From: Peter van Dijk [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, July 03, 2001 4:41 PM Subject: Re: conf-spawn and FD_SET SUCCESS On Tue, Jul 03, 2001 at 04:27:21PM +0530, D Rajesh wrote: [snip] conf-split should be prime for optimal performance. What's wrong with the default 23? I thought a large conf-split only makes sense if we have more than 20.000 messages *in the queue* . I guess this does not happen even if I send huge volume of mails after applying big concurrency patch. 23 is not 'large', and 23 is never too much. Was I wrong...??? Do I need to have huge conf-split to send high volumes of mails If you intend to have more than about 25.000 mails in the queue, a conf-split above 23 might be what you want. However, are you: - sending 25.000 mails or - sending 1 mail to 25.000 people? Greetz, Peter -- Against Free Sex! http://www.dataloss.nl/Megahard_en.html
Re: conf-spawn and FD_SET SUCCESS
Hi Peter, Thanks again for your patience. I will do that. I will send the mails after the config and Hope that atleast my Linux Kernel will not crash ;) I will let you and the list know on the performance I get. Thanks a lot to all... Finally with all your help I am ready for it and waiting for the result keeping my fingers crossed. ;) Cheers, rajesh. - Original Message - From: Peter van Dijk [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Tuesday, July 03, 2001 5:05 PM Subject: Re: conf-spawn and FD_SET SUCCESS On Tue, Jul 03, 2001 at 04:55:59PM +0530, D Rajesh wrote: Hi Peter, Thanks again for your reply I am actually trying to send 200,000 mails and not 1 mail to 200,000 people... !!! PL suggest me on what parameters should I use ... Then set your conf-split to somewhere near 200. A nice prime would be 201. Greetz, Peter -- Against Free Sex! http://www.dataloss.nl/Megahard_en.html
Big - to - do patch not much useful
Hi All, I have a server installed with qmail. I have applied DNS patch and Big-to-do patch and running qmail from 3 different directories parallelly. But, I am able to send 15 mails a second only Inspite of all the above Without Big-to-do patch also qmail gave me same performance !!! But, Is there anyway or config by which I can send say 100 mails a second Thanks Regards,Rajesh,tech solutions,[EMAIL PROTECTED],Intercept Consulting - INDIA.
Re: Problem with conf-split config
I have followed the below steps to run separate qmail's at /var/qmail and /var/qmail2 My system is a Linux 6.2 kernel 2.2.14, ext2fs 1.. # killall qmail-send ( stopped qmail daemon. ) 2.. # mv /var/qmail /var/qmail2. 3.. # cd /usr/src/qmail-1.03 4.. # vi conf-qmail ( Changed /var/qmail in conf-qmail file to /var/qmail2. ) 5.. # make setup check. 6.. # vi conf-qmail ( Changed conf-qmail file back to /var/qmail ) 7.. # make setup check. 8.. # /var/qmail/rc ( this restarted qmail daemons ) 9.. # /var/qmail2/rc . ( When I start this it says qmail-send already running ) Was I wrong anywhere ??? Thanks Regards, Rajesh, - Original Message - From: Vincent Schonau [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, June 27, 2001 1:56 PM Subject: Re: Problem with conf-split config On Wed, Jun 27, 2001 at 10:42:26AM +0530, D Rajesh wrote: Hi there, I have done the conf-split configuration and after make setup It created directory /var/qmail. I have moved the original /var/qmail to /var/qmail2 before the make setup. After finishing the installation, I have started /var/qmail/rc in background. It got started successfully. Then if I try to start /var/qmail2/rc then it gives error saying qmail-send already running... If you want two separate copies of qmail running, you have to put /var/qmail2 into conf-qmail and recompile. If you don't change conf-qmail, the /var/qmail path will still be compiled into your binaries. Vince.
Problem with qmail-remote during Delivery
Hi there, Firstly, sorry for a long mail. I have sent 30,000 mails to different domains like yahoo, hotmail, rediff etc... Before mentioning the problem the configuration that I have used in qmailis as follows:- qmail config -- 1.) Two qmails running at /var/qmail and /var/qmail1 with silent concurrency limit to 200 for both The parameters below are the same in qmail-control of /var/qmail and /var/qmail1 2.) concurrencyremote = 150 3.) queuelifetime = 78400 4.) timeoutremote = 180 5.) timeoutsmtpd = 180 and all the others are default parameters. I have sent 30,000 mails, using qmail-inject of both qmail directories on rotation. All the 30,000 mails were put in queue with in 7 minutes and qmail-remote was also running parallelly to send mails. Now,as in the parameter concurrencyremote totally 300 ( 150from /var/qmail and 150 from /var/qmail1 ) qmail-remote processes have started sending mails. But, here cropped up the problem. Whenever a qmail-remote tries to send a mail to hotmail.com. it hangs for sometime. As I had 8000 out of 30,000 mails as hotmail ID's the number of occurrence's of hotmail were more. So, the 300 qmail-remote processes were just hanging, trying to send those mails. So, whenever one process time-out , it gives way for other mail's to be sent. SO, Due to this it took nearly 24HOURS to SEND all the mails. I feelsending 30,000 mailswould have finishedin less that 20 minutes if this situation is avoided Was I wrong at any config ? how can we avoid these situations ??? Is there any waythat qmail-remote can implicitly drop sending these for some time ?? BTW what is this silent concurrency limit different to concurrency remote ??? Thanks Regards,Rajesh,tech solutions,[EMAIL PROTECTED],Intercept Consulting - INDIA.
Higher number of deliveries
Hi there, IM very sorry for the long mail that I have sent. But Just elaborating the problem as I could not understand what and where was the glitch in my config. We have a database of 100,000 mails and we will be sending personalized mails to each user automatically. We use redhat 6.2 ( extfs, kernel 2.2.14 ) and qmail for mailing. Before mentioning the problem the config parameters that I have used in qmail and system config are system config -- dell poweredge server with 1GB RAM and scsi disks with 12000 rpm, dual CPU. redhat 6.2, kernel 2.2.14, extfs. Network bandwidth = 22Mbps qmail config -- concurrencyremote = 400 queuelifetime = 345600 timeoutremote = 600 timeoutsmtpd = 600 and all the others are default parameters. The problem is that, when I tried sending 4700 mails ( to different domains . say like yahoo, hotmail, rediff, etc and not a single user in my domain ), it took one whole day to send all the mails.. qmail-inject placedmails in the queueat a speed of 70 - 90 mails in a second. But, if the logs are checked, it took one whole day to finish sending all the mails Was I wrong anywhere or missed any configuration ??? What should I do to send say a million mails in a day ? Thanks Regards,Rajesh,tech solutions,[EMAIL PROTECTED],Intercept Consulting - INDIA.
Problem with conf-split config
Hi there, I have done the conf-split configurationand after make setup It createddirectory /var/qmail. I have moved theoriginal /var/qmail to/var/qmail2before the makesetup. After finishing the installation, I have started "/var/qmail/rc " in background. Itgot started successfully.Then if I try to start " /var/qmail2/rc " then it gives error saying qmail-send already running... Do I need to change anything in the /var/qmail2/rc file in the paths etc...to get it started ??? I did not understand on how do I use both qmail directoriesat a time...If I cannot run daemons in both directories /var/qmail/rc and /var/qmail2/rc How do I make it work Thanks Regards,Rajesh,tech solutions,[EMAIL PROTECTED],Intercept Consulting - INDIA.
