Re: 4 million messages per hour - is it possible?
Mark - We developed an EMail delivery system that uses CF to handle subscribe, unsubscribe, and email formatting, but uses PERL to actually process the messages, personalize them using a substitution tag language, and write the files to the mail queue. We're capable of delivering 1.5M per hour on 4 Intel BSD boxes running Sendmail Pro. Additional capacity is as simple as adding more BSD boxes. The advice the others have given is right on - there is no chance at all that CF could even dream of sending this much email. You have to write directly to the spool. You have to work with the developers of whatever mail package you are using to find out the way to optimize the queue - the server might have little tricks that allow it to deliver faster (such as batching by domain). To get the speeds we are getting, we had to write the spool file to RAM disk - physical disk was not fast enough. This means that we don't have a "guaranteed send", since if the machine crashes, we lose that batch. It would be a simple matter to add a machine that has /tmp on disk for guaranteed messages. So, it can be done, but not with CF. Oh, and about the pipe - we spike up to 30Mb/s when we send. We've had to move email sending to its own T3. In case you're wondering, this is for emailed news, severe weather alerts, school closing alerts, forecasts, etc. for a network of news websites. Its a mixed load of text, HTML, multipart, and pager/cell messages. You also will probably need to talk to large ISP's to get on their "good" list - when you try to shove 2-3M emails down AOL's throat in an hour, they notice.. Mark Warrick wrote: > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark -- Edward Smith Internet Broadcasting System Director of Architecture http://www.ibsys.com __ This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
Re: 4 million messages per hour - is it possible?
Matt Liotta wrote: > We did use CF to generate the email files. I can't say how, but I can > tell you that using and to accomplish writing millions > of files in a short period of time is not a problem. I ran some benchmarks on writing files with cffile for my own email system and I never got it higher as 40 writes per second (dual Athhlon, U160 SCSI disk, no other load, but some error checking/locking so I might be able to double that). Also, it is my understanding that ATA is limited to about 200 I/O ops per second and SCSI to about 700. So I am curious as to what you call "a short period of time" and whether you might have used either non-standard hardware :) or a RAM disk. Jochem __ This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
Re: 4 million messages per hour - is it possible?
You can achieve this volume of mail with load-balancing iMS POST Enterprise servers. Each iMS Enterprise POST server has the ability to push upwards of 20 million emails per day (this number can be more or less depending on the size of the mail, the internet connection, customization of the mails, etc.). iMS also supports real-time delivery status notification, emails from queries, tokenization (akin to mail merge), and bounce processing (the full iMS SMTP server can also process any kind of incoming email dynamically). iMS is the mail sending engine behind all of the House of Fusion lists. Please feel free to contact me off-list if you have any questions. Regards, -- Howie Hamlin - inFusion Project Manager On-Line Data Solutions, Inc. - www.CoolFusion.com - 631-737-4668 x101 inFusion Mail Server (iMS) - The Award-winning, Intelligent Mail Server >>> Find out how iMS Stacks up to the competition: >http://www.coolfusion.com/imssecomparison.cfm - Original Message - From: "Mark Warrick" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Monday, July 01, 2002 6:15 PM Subject: 4 million messages per hour - is it possible? > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Actually that's an outdated statement (version 1.0), I just updated the web page. ActivMail can send more than 1000 messages per minute on one server. The current version of ActivMail allows you to specify multiple SMTP servers to distribute load, this improves performance quite a bit and makes it a scalable solution. So to answer the question can ActivMail send 4 million messages per hour? The answer is "it depends" mostly on hardware and bandwidth (it takes a lot of bandwidth to send that many). One client that comes to mind sends over 1/4 million email/hour with one Microsoft SMTP server. If you had the hardware and the bandwidth necessary you could probably do it with ActivMail. In our tests we find performance to be limited by I/O (network bandwidth, memory bandwidth, and disk bandwidth on the SMTP server). One trick is to setup your mail servers spool directory on a RAM drive, Since most mail servers spool messages to disk when they receive them. _ Pete Freitag ([EMAIL PROTECTED]) CTO, CFDEV.COM ColdFusion Developer Resources http://www.cfdev.com/ -Original Message- From: Justin Greene [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 10:55 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? "It is capable of sending up to a thousand emails per minute efficiently and reliably," if it could do this per second, it might work... Justin > -Original Message- > From: Tilbrook, Peter [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 10:41 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > How about ActivMail? http://www.cfdev.com/activmail/ > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, 2 July 2002 12:32 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > > CF takes it square on the chin because the CFMAIL tag is rather weak > and > > polling frequency, maximum records in a directory and lack of > expansion > > are > > nil > > > That is only if you actually use the tag. I wouldn't > be caught dead > using the tag for anything whether it was a single message or > millions. > > -Matt > > > __ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Pete Freitag hangs around CF-Talk and should be able answer this. -Original Message- From: Justin Greene [mailto:[EMAIL PROTECTED]] Sent: Tuesday, 2 July 2002 12:55 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? "It is capable of sending up to a thousand emails per minute efficiently and reliably," if it could do this per second, it might work... Justin > -Original Message- > From: Tilbrook, Peter [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 10:41 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > How about ActivMail? http://www.cfdev.com/activmail/ > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, 2 July 2002 12:32 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > > CF takes it square on the chin because the CFMAIL tag is rather weak > and > > polling frequency, maximum records in a directory and lack of > expansion > > are > > nil > > > That is only if you actually use the tag. I wouldn't > be caught dead > using the tag for anything whether it was a single message or > millions. > > -Matt > > > __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
"It is capable of sending up to a thousand emails per minute efficiently and reliably," if it could do this per second, it might work... Justin > -Original Message- > From: Tilbrook, Peter [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 10:41 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > How about ActivMail? http://www.cfdev.com/activmail/ > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, 2 July 2002 12:32 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > > CF takes it square on the chin because the CFMAIL tag is rather weak > and > > polling frequency, maximum records in a directory and lack of > expansion > > are > > nil > > > That is only if you actually use the tag. I wouldn't > be caught dead > using the tag for anything whether it was a single message or > millions. > > -Matt > > > __ Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
How about ActivMail? http://www.cfdev.com/activmail/ -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Tuesday, 2 July 2002 12:32 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? > CF takes it square on the chin because the CFMAIL tag is rather weak and > polling frequency, maximum records in a directory and lack of expansion > are > nil > That is only if you actually use the tag. I wouldn't be caught dead using the tag for anything whether it was a single message or millions. -Matt __ Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
> -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 10:09 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > Using CF makes a lot of sense if the organizations knowledge > is with CF. > Writing a multi-threaded high-performance C++ application to pull data > from a database and generate email files would take quite a > bit of work > as compared to a CF based application. Yes, but easier is not always better. If CF is the choice because it is the only option, then so be it, but I think it is not a great choice for this type of application given the volume/hour. > The fact that you used C++ and > tight in the same sentence makes me think you don't know much > about C++ > as C++ based programs are anything but tight. This really depends the definition of tight. Mine is small and fast and I see no reason why this would not be both. To handle the desired volume I suspect that it would have to be both. > A more reasonable language to use for this job would be Perl, but the > same knowledge problem comes up. Besides the real work is not sending > the mail; it is dealing with the volume of bounces and unsubscribe > requests that result. Sure, perl would be great for this, but it is not fast. We have some apps using perl to send email and some using Java to send email (all back end processes). I would not use either if performance were an issue. I prefer to spend money on the right code to do the job than extra hardware to compensate for the wrong code. 4 million messages/hour is a lot of messages, the code should be as fast (note I did not say tight) as possible or you will spend a fortune on buying more boxes. Justin > -Matt > > > > -Original Message- > > From: Justin Greene [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 6:23 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > I have to say that CF does not sound like the best tool to use for > > something > > like this. Perhaps it can be done... write to the spool > directly and > let > > DART (if they still use that for mail) pick up the messages and send > them, > > but CF is not that fast and if you want to handle max volume on min > > hardware > > you need speed end efficiency (don't you end up with a page that has > to > > run > > for an hour to complete the task?). I can see using CF to admin the > email > > app but I would think that a nice tight C++ mailer that > sends email in > > batches and marks when things have been successfully queued > (to allow > > restarts without re-sending to everyone) would work much better. > Also, > > queuing the messages is not the only issue (as was pointed out > earlier). > > You will need a fair amount of bandwidth and a huge number > of outbound > > connections on your MTA to handle delivery of all those messages (4M > > messages/60min/60sec = connections/sec and a connection could > take a > > few seconds). Plan on having a bunch of outbound MTA's handling the > > actual > > delivery. > > > > When we have built apps that send email, We typically use a > queue in a > > table > > to control who is getting the mail, then let the spoolers (the app > that > > does > > the sending) each query the table and grab messages in reasonable > blocks > > for > > delivery. This allows multiple spoolers each handle their > part of the > > load > > and deliver to multiple MTA's. > > > > Good luck doing this with CF. > > > > Justin > > > > > > > > > -Original Message- > > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 8:42 PM > > > To: CF-Talk > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > We did use CF to generate the email files. I can't say how, but I > can > > > tell you that using and to accomplish > > > writing millions > > > of files in a short period of time is not a problem. > > > > > > -Matt > > > > > > > > > > -Original Message- > > > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > > > Sent: Monday, July 01, 2002 5:02 PM > > > > To: CF-Talk > > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > > > That makes sense :) > > > > > > > > Did CF call a componet that wrote the files to the queue. > > > > >
RE: 4 million messages per hour - is it possible?
> CF takes it square on the chin because the CFMAIL tag is rather weak and > polling frequency, maximum records in a directory and lack of expansion > are > nil > That is only if you actually use the tag. I wouldn't be caught dead using the tag for anything whether it was a single message or millions. -Matt __ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
With web development all app servers and architectures fail when it comes to such a large volume of anything... In order to pull the aforesaid off a lot of business rules need decided... like unsubscribe mechanism, separation of this mailing cluster from rest of core business machinery and network as well as means to accurately pool, test position, pool resends, handle bounces and generally allow you data to auto-correct itself inter-campaign... It doesn't matter if it's PERL, CF, ASP, JAVA, C, etc. there have to be lots of road-stops, restart points, error-checking and reporting. Otherwise the system will flatten you sooner or later... CF takes it square on the chin because the CFMAIL tag is rather weak and polling frequency, maximum records in a directory and lack of expansion are nil -paris Paris Lundis Founder Areaindex, L.L.C. http://www.areaindex.com http://www.pubcrawler.com (p) 1-212-655-4477 [finding the future in the past, passing the future in the present] [connecting people, places and things] -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 10:09 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? Using CF makes a lot of sense if the organizations knowledge is with CF. Writing a multi-threaded high-performance C++ application to pull data from a database and generate email files would take quite a bit of work as compared to a CF based application. The fact that you used C++ and tight in the same sentence makes me think you don't know much about C++ as C++ based programs are anything but tight. A more reasonable language to use for this job would be Perl, but the same knowledge problem comes up. Besides the real work is not sending the mail; it is dealing with the volume of bounces and unsubscribe requests that result. -Matt > -Original Message- > From: Justin Greene [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 6:23 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > I have to say that CF does not sound like the best tool to use for > something > like this. Perhaps it can be done... write to the spool directly and let > DART (if they still use that for mail) pick up the messages and send them, > but CF is not that fast and if you want to handle max volume on min > hardware > you need speed end efficiency (don't you end up with a page that has to > run > for an hour to complete the task?). I can see using CF to admin the email > app but I would think that a nice tight C++ mailer that sends email in > batches and marks when things have been successfully queued (to allow > restarts without re-sending to everyone) would work much better. Also, > queuing the messages is not the only issue (as was pointed out earlier). > You will need a fair amount of bandwidth and a huge number of outbound > connections on your MTA to handle delivery of all those messages (4M > messages/60min/60sec = connections/sec and a connection could take a > few seconds). Plan on having a bunch of outbound MTA's handling the > actual > delivery. > > When we have built apps that send email, We typically use a queue in a > table > to control who is getting the mail, then let the spoolers (the app that > does > the sending) each query the table and grab messages in reasonable blocks > for > delivery. This allows multiple spoolers each handle their part of the > load > and deliver to multiple MTA's. > > Good luck doing this with CF. > > Justin > > > > > -Original Message----- > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 8:42 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > We did use CF to generate the email files. I can't say how, but I can > > tell you that using and to accomplish > > writing millions > > of files in a short period of time is not a problem. > > > > -Matt > > > > > > > -Original Message- > > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 5:02 PM > > > To: CF-Talk > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > That makes sense :) > > > > > > Did CF call a componet that wrote the files to the queue. > > > > > > I dont assume you did the following but I must ask to make > > sure. Did > > you > > > happen to write the files by querying the DB for addresses then > > looping > > > over > > > the query (Ive heard cfloop is very slow) and using cffile to write > > the > > > email to the mail server's queue? > > >
RE: 4 million messages per hour - is it possible?
Using CF makes a lot of sense if the organizations knowledge is with CF. Writing a multi-threaded high-performance C++ application to pull data from a database and generate email files would take quite a bit of work as compared to a CF based application. The fact that you used C++ and tight in the same sentence makes me think you don't know much about C++ as C++ based programs are anything but tight. A more reasonable language to use for this job would be Perl, but the same knowledge problem comes up. Besides the real work is not sending the mail; it is dealing with the volume of bounces and unsubscribe requests that result. -Matt > -Original Message- > From: Justin Greene [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 6:23 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > I have to say that CF does not sound like the best tool to use for > something > like this. Perhaps it can be done... write to the spool directly and let > DART (if they still use that for mail) pick up the messages and send them, > but CF is not that fast and if you want to handle max volume on min > hardware > you need speed end efficiency (don't you end up with a page that has to > run > for an hour to complete the task?). I can see using CF to admin the email > app but I would think that a nice tight C++ mailer that sends email in > batches and marks when things have been successfully queued (to allow > restarts without re-sending to everyone) would work much better. Also, > queuing the messages is not the only issue (as was pointed out earlier). > You will need a fair amount of bandwidth and a huge number of outbound > connections on your MTA to handle delivery of all those messages (4M > messages/60min/60sec = connections/sec and a connection could take a > few seconds). Plan on having a bunch of outbound MTA's handling the > actual > delivery. > > When we have built apps that send email, We typically use a queue in a > table > to control who is getting the mail, then let the spoolers (the app that > does > the sending) each query the table and grab messages in reasonable blocks > for > delivery. This allows multiple spoolers each handle their part of the > load > and deliver to multiple MTA's. > > Good luck doing this with CF. > > Justin > > > > > -Original Message----- > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 8:42 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > We did use CF to generate the email files. I can't say how, but I can > > tell you that using and to accomplish > > writing millions > > of files in a short period of time is not a problem. > > > > -Matt > > > > > > > -Original Message- > > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 5:02 PM > > > To: CF-Talk > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > That makes sense :) > > > > > > Did CF call a componet that wrote the files to the queue. > > > > > > I dont assume you did the following but I must ask to make > > sure. Did > > you > > > happen to write the files by querying the DB for addresses then > > looping > > > over > > > the query (Ive heard cfloop is very slow) and using cffile to write > > the > > > email to the mail server's queue? > > > > > > jeff > > > > > > -Original Message- > > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 4:32 PM > > > To: CF-Talk > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > > > > Nope, can't be done using cfmail. We wrote files directly > > to the mail > > > server's queue. > > > > > > -Matt > > > > > > > > > > -Original Message- > > > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > > > Sent: Monday, July 01, 2002 4:10 PM > > > > To: CF-Talk > > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > > > How exactly is this cf driven. Cant imagine you did it > > with cfmail. > > > > > > > > Jeff > > > > > > > > -Original Message- > > > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > > > Sent: Monday, July 01, 2002 3:25 PM > > > > To: CF-Talk > > > > Subjec
RE: 4 million messages per hour - is it possible?
I have to say that CF does not sound like the best tool to use for something like this. Perhaps it can be done... write to the spool directly and let DART (if they still use that for mail) pick up the messages and send them, but CF is not that fast and if you want to handle max volume on min hardware you need speed end efficiency (don't you end up with a page that has to run for an hour to complete the task?). I can see using CF to admin the email app but I would think that a nice tight C++ mailer that sends email in batches and marks when things have been successfully queued (to allow restarts without re-sending to everyone) would work much better. Also, queuing the messages is not the only issue (as was pointed out earlier). You will need a fair amount of bandwidth and a huge number of outbound connections on your MTA to handle delivery of all those messages (4M messages/60min/60sec = connections/sec and a connection could take a few seconds). Plan on having a bunch of outbound MTA's handling the actual delivery. When we have built apps that send email, We typically use a queue in a table to control who is getting the mail, then let the spoolers (the app that does the sending) each query the table and grab messages in reasonable blocks for delivery. This allows multiple spoolers each handle their part of the load and deliver to multiple MTA's. Good luck doing this with CF. Justin > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 8:42 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > We did use CF to generate the email files. I can't say how, but I can > tell you that using and to accomplish > writing millions > of files in a short period of time is not a problem. > > -Matt > > > > -Original Message- > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 5:02 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > That makes sense :) > > > > Did CF call a componet that wrote the files to the queue. > > > > I dont assume you did the following but I must ask to make > sure. Did > you > > happen to write the files by querying the DB for addresses then > looping > > over > > the query (Ive heard cfloop is very slow) and using cffile to write > the > > email to the mail server's queue? > > > > jeff > > > > -Original Message- > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 4:32 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > Nope, can't be done using cfmail. We wrote files directly > to the mail > > server's queue. > > > > -Matt > > > > > > > -Original Message- > > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 4:10 PM > > > To: CF-Talk > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > How exactly is this cf driven. Cant imagine you did it > with cfmail. > > > > > > Jeff > > > > > > -Original Message- > > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 3:25 PM > > > To: CF-Talk > > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > > > > I developed a system using LSMTP that could easily do 4 million > > messages > > > per hour that was driven from CF. > > > > > > -Matt > > > > > > > > > > -Original Message- > > > > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > > > > Sent: Monday, July 01, 2002 3:15 PM > > > > To: CF-Talk > > > > Subject: 4 million messages per hour - is it possible? > > > > > > > > Hello, > > > > > > > > Has anyone had experience in creating an emailing > solution driven > by > > > > ColdFusion and SQL on any platform with any mail server that is > > > capable of > > > > handling 4 million deliveries an hour? If so, would you care to > > share > > > > what > > > > software you used to make it happen? And do you have a live > example > > > of a > > > > company using the system? > > > > > > > > ---mark > > > > > > > > > > > > Mark Warrick ([EMAIL PROTECTED]) > > > > Founder, Fusioneers.com / CTO, ZapConnect.com > > > > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > > > > http://www.warrick.net / http://www.fusioneers.com > > > > http://www.zapconnect.com > > > > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > > > > > > > > > > > > > > > > > > > > > > > __ Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
you could do one of two things, actually. 1) use CFFILE to write a raw message to the SMTP queue directory. simple format, really. let the SMTP queue handle routing and such. 2) use CFOBJECT and CDO to create an SMTP mail object native to windows. create it, write a message using the object's methods, send. rinse, repeat. co. -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 8:42 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? We did use CF to generate the email files. I can't say how, but I can tell you that using and to accomplish writing millions of files in a short period of time is not a problem. -Matt > -Original Message- > From: Jeff Green [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 5:02 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > That makes sense :) > > Did CF call a componet that wrote the files to the queue. > > I dont assume you did the following but I must ask to make sure. Did you > happen to write the files by querying the DB for addresses then looping > over > the query (Ive heard cfloop is very slow) and using cffile to write the > email to the mail server's queue? > > jeff > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 4:32 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > Nope, can't be done using cfmail. We wrote files directly to the mail > server's queue. > > -Matt > > > > -Original Message----- > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 4:10 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > How exactly is this cf driven. Cant imagine you did it with cfmail. > > > > Jeff > > > > -Original Message- > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 3:25 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > I developed a system using LSMTP that could easily do 4 million > messages > > per hour that was driven from CF. > > > > -Matt > > > > > > > -Original Message- > > > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 3:15 PM > > > To: CF-Talk > > > Subject: 4 million messages per hour - is it possible? > > > > > > Hello, > > > > > > Has anyone had experience in creating an emailing solution driven by > > > ColdFusion and SQL on any platform with any mail server that is > > capable of > > > handling 4 million deliveries an hour? If so, would you care to > share > > > what > > > software you used to make it happen? And do you have a live example > > of a > > > company using the system? > > > > > > ---mark > > > > > > > > > Mark Warrick ([EMAIL PROTECTED]) > > > Founder, Fusioneers.com / CTO, ZapConnect.com > > > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > > > http://www.warrick.net / http://www.fusioneers.com > > > http://www.zapconnect.com > > > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > > > > > > > > > > > > > > __ Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
We did use CF to generate the email files. I can't say how, but I can tell you that using and to accomplish writing millions of files in a short period of time is not a problem. -Matt > -Original Message- > From: Jeff Green [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 5:02 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > That makes sense :) > > Did CF call a componet that wrote the files to the queue. > > I dont assume you did the following but I must ask to make sure. Did you > happen to write the files by querying the DB for addresses then looping > over > the query (Ive heard cfloop is very slow) and using cffile to write the > email to the mail server's queue? > > jeff > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 4:32 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > Nope, can't be done using cfmail. We wrote files directly to the mail > server's queue. > > -Matt > > > > -Original Message- > > From: Jeff Green [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 4:10 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > How exactly is this cf driven. Cant imagine you did it with cfmail. > > > > Jeff > > > > -----Original Message- > > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 3:25 PM > > To: CF-Talk > > Subject: RE: 4 million messages per hour - is it possible? > > > > > > I developed a system using LSMTP that could easily do 4 million > messages > > per hour that was driven from CF. > > > > -Matt > > > > > > > -Original Message- > > > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > > > Sent: Monday, July 01, 2002 3:15 PM > > > To: CF-Talk > > > Subject: 4 million messages per hour - is it possible? > > > > > > Hello, > > > > > > Has anyone had experience in creating an emailing solution driven by > > > ColdFusion and SQL on any platform with any mail server that is > > capable of > > > handling 4 million deliveries an hour? If so, would you care to > share > > > what > > > software you used to make it happen? And do you have a live example > > of a > > > company using the system? > > > > > > ---mark > > > > > > > > > Mark Warrick ([EMAIL PROTECTED]) > > > Founder, Fusioneers.com / CTO, ZapConnect.com > > > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > > > http://www.warrick.net / http://www.fusioneers.com > > > http://www.zapconnect.com > > > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > > > > > > > > > > > > > > __ Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
please keep me and my email addresses away from that email monster :) tony -Original Message- From: Shawn McKee [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 6:40 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? And in just over two months you have sent an e-mail to everyone in the world! Shawn McKee -Original Message- From: Paris Lundis [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 5:32 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? holly cow... 4 million geez... I am not asking who this is for.. that's a gross amount of emails... First off, I haven't created such a tool... Let's talk about theory here... With CF you can expect how many simultaneous pages per second performance wise? 50-100 on a nice box with tight code.. optimization, etc... so let's be optimistic... 100 x 60 seconds = 6000 messages per minute 6000 per min * 60 minutes = 360, messages per hour... per box... that's about 6 times the spool limit.. which is about 65k files... putting that aside... you need about 10-15 servers essentially with a distributed cooperative pooling mechanism to handle this... ideally... You also need a damn fast DNS or multiple local servers to reduce lookup times... Ideally, if you scrap the mail server need (which would be expensive, clogged, nightmare) and utilized a CF friendly mail server like iMS and ripped the mailing to a giant database table... had a scheduled event whereby each machine grabbed a range, worked it and recorded status errors etc to database and purged valid already mailed stuff or put in another table.. and talked maybe directly SMTP versus the need of a server well then it would be doable... recommend MySQL here... cheap and damn fast but with the machines I mentioned... you might also need some good bandwidth considering the volume of mail and the potential size of the emails themselves... That's my input... -paris Paris Lundis Founder Areaindex, L.L.C. http://www.areaindex.com http://www.pubcrawler.com (p) 1-212-655-4477 [finding the future in the past, passing the future in the present] [connecting people, places and things] __ Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Sounds like you used CF to admin the system... not necessarily read the data from the DB, compose the message and actually deliver it to lsmtp. An overview of your system, plus what technologies were used to implement each step would be greatly appreciated! Andres Leon -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 6:25 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? I developed a system using LSMTP that could easily do 4 million messages per hour that was driven from CF. -Matt > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share > what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
That makes sense :) Did CF call a componet that wrote the files to the queue. I dont assume you did the following but I must ask to make sure. Did you happen to write the files by querying the DB for addresses then looping over the query (Ive heard cfloop is very slow) and using cffile to write the email to the mail server's queue? jeff -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 4:32 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? Nope, can't be done using cfmail. We wrote files directly to the mail server's queue. -Matt > -Original Message- > From: Jeff Green [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 4:10 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > How exactly is this cf driven. Cant imagine you did it with cfmail. > > Jeff > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:25 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > I developed a system using LSMTP that could easily do 4 million messages > per hour that was driven from CF. > > -Matt > > > > -Original Message- > > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 3:15 PM > > To: CF-Talk > > Subject: 4 million messages per hour - is it possible? > > > > Hello, > > > > Has anyone had experience in creating an emailing solution driven by > > ColdFusion and SQL on any platform with any mail server that is > capable of > > handling 4 million deliveries an hour? If so, would you care to share > > what > > software you used to make it happen? And do you have a live example > of a > > company using the system? > > > > ---mark > > > > > > Mark Warrick ([EMAIL PROTECTED]) > > Founder, Fusioneers.com / CTO, ZapConnect.com > > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > > http://www.warrick.net / http://www.fusioneers.com > > http://www.zapconnect.com > > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > > > > > > __ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Nope, can't be done using cfmail. We wrote files directly to the mail server's queue. -Matt > -Original Message- > From: Jeff Green [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 4:10 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > How exactly is this cf driven. Cant imagine you did it with cfmail. > > Jeff > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:25 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > I developed a system using LSMTP that could easily do 4 million messages > per hour that was driven from CF. > > -Matt > > > > -Original Message- > > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 3:15 PM > > To: CF-Talk > > Subject: 4 million messages per hour - is it possible? > > > > Hello, > > > > Has anyone had experience in creating an emailing solution driven by > > ColdFusion and SQL on any platform with any mail server that is > capable of > > handling 4 million deliveries an hour? If so, would you care to share > > what > > software you used to make it happen? And do you have a live example > of a > > company using the system? > > > > ---mark > > > > > > Mark Warrick ([EMAIL PROTECTED]) > > Founder, Fusioneers.com / CTO, ZapConnect.com > > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > > http://www.warrick.net / http://www.fusioneers.com > > http://www.zapconnect.com > > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > > > > > > __ This list and all House of Fusion resources hosted by CFHosting.com. The place for dependable ColdFusion Hosting. FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Back when I developed it we could get about 1.5 million emails an hour out per machine. I expect that number would be higher now as that was about three years ago. -Matt > -Original Message- > From: Dave Watts [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:44 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > I developed a system using LSMTP that could easily do 4 > > million messages per hour that was driven from CF. > > Was that using more than one box to run LSMTP? I thought you could only > get > about 2 million messages per hour through LSMTP Unlimited. Of course, I > feel > kind of silly using the word "only" in the above sentence. > > Dave Watts, CTO, Fig Leaf Software > http://www.figleaf.com/ > voice: (202) 797-5496 > fax: (202) 797-5444 > __ Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
I can't give away all the details of course, but I am willing to answer any question(s) people might have based on my experience doing it. -Matt > -Original Message- > From: Jeff Green [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:49 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > Feel free to elaborate :) > > j > > > -Original Message- > From: Matt Liotta [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:25 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > I developed a system using LSMTP that could easily do 4 million messages > per hour that was driven from CF. > > -Matt > > > > -Original Message- > > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > > Sent: Monday, July 01, 2002 3:15 PM > > To: CF-Talk > > Subject: 4 million messages per hour - is it possible? > > > > Hello, > > > > Has anyone had experience in creating an emailing solution driven by > > ColdFusion and SQL on any platform with any mail server that is > capable of > > handling 4 million deliveries an hour? If so, would you care to share > > what > > software you used to make it happen? And do you have a live example > of a > > company using the system? > > > > ---mark > > > > > > Mark Warrick ([EMAIL PROTECTED]) > > Founder, Fusioneers.com / CTO, ZapConnect.com > > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > > http://www.warrick.net / http://www.fusioneers.com > > http://www.zapconnect.com > > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > > > > > > __ Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Paris (and others), I like the optimistic tone of your message. It brings me hope that I might actually be able to pull this off. I was thinking along the same lines that a distributed solution with a powerful piece of mailing software would probably be the best idea. Plus of course, distributing the physical machines across multiple networks. If I get the chance to build this, I'm sure I'll be back to ask more questions and also to share my observations as I develop the system. If I don't get the chance, I'll post the offer here for anybody else who is interested. ---mark Mark Warrick ([EMAIL PROTECTED]) Founder, Fusioneers.com / CTO, ZapConnect.com Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 http://www.warrick.net / http://www.fusioneers.com http://www.zapconnect.com ICQ: 125160 AIM: markwarric Yahoo: Serengeti > -Original Message- > From: Paris Lundis [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:32 PM > To: CF-Talk > Subject: RE: 4 million messages per hour - is it possible? > > > holly cow... 4 million geez... I am not asking who this is for.. that's a > gross amount of emails... > > First off, I haven't created such a tool... > > Let's talk about theory here... > > With CF you can expect how many simultaneous pages per second performance > wise? 50-100 on a nice box with tight code.. optimization, etc... > > so let's be optimistic... 100 x 60 seconds = 6000 messages per minute > 6000 per min * 60 minutes = 360, messages per hour... per box... > > that's about 6 times the spool limit.. which is about 65k files... > putting that aside... > > you need about 10-15 servers essentially with a distributed cooperative > pooling mechanism to handle this... ideally... > > You also need a damn fast DNS or multiple local servers to reduce lookup > times... > > Ideally, if you scrap the mail server need (which would be expensive, > clogged, nightmare) and utilized a CF friendly mail server like iMS and > ripped the mailing to a giant database table... had a scheduled event > whereby each machine grabbed a range, worked it and recorded status errors > etc to database and purged valid already mailed stuff or put in another > table.. and talked maybe directly SMTP versus the need of a server well > then it would be doable... recommend MySQL here... cheap and damn fast > > but with the machines I mentioned... you might also need some > good bandwidth > considering the volume of mail and the potential size of the emails > themselves... > > That's my input... > > -paris > Paris Lundis > Founder > Areaindex, L.L.C. > http://www.areaindex.com > http://www.pubcrawler.com > (p) 1-212-655-4477 > [finding the future in the past, passing the future in the present] > [connecting people, places and things] > > > > > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 6:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to > share what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > > __ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
How exactly is this cf driven. Cant imagine you did it with cfmail. Jeff -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 3:25 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? I developed a system using LSMTP that could easily do 4 million messages per hour that was driven from CF. -Matt > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share > what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
yeah of course I am interested too... -paris Paris Lundis Founder Areaindex, L.L.C. http://www.areaindex.com http://www.pubcrawler.com (p) 1-212-655-4477 [finding the future in the past, passing the future in the present] [connecting people, places and things] -Original Message- From: Jeff Green [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 6:49 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? Feel free to elaborate :) j -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 3:25 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? I developed a system using LSMTP that could easily do 4 million messages per hour that was driven from CF. -Matt > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share > what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
And in just over two months you have sent an e-mail to everyone in the world! Shawn McKee -Original Message- From: Paris Lundis [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 5:32 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? holly cow... 4 million geez... I am not asking who this is for.. that's a gross amount of emails... First off, I haven't created such a tool... Let's talk about theory here... With CF you can expect how many simultaneous pages per second performance wise? 50-100 on a nice box with tight code.. optimization, etc... so let's be optimistic... 100 x 60 seconds = 6000 messages per minute 6000 per min * 60 minutes = 360, messages per hour... per box... that's about 6 times the spool limit.. which is about 65k files... putting that aside... you need about 10-15 servers essentially with a distributed cooperative pooling mechanism to handle this... ideally... You also need a damn fast DNS or multiple local servers to reduce lookup times... Ideally, if you scrap the mail server need (which would be expensive, clogged, nightmare) and utilized a CF friendly mail server like iMS and ripped the mailing to a giant database table... had a scheduled event whereby each machine grabbed a range, worked it and recorded status errors etc to database and purged valid already mailed stuff or put in another table.. and talked maybe directly SMTP versus the need of a server well then it would be doable... recommend MySQL here... cheap and damn fast but with the machines I mentioned... you might also need some good bandwidth considering the volume of mail and the potential size of the emails themselves... That's my input... -paris Paris Lundis Founder Areaindex, L.L.C. http://www.areaindex.com http://www.pubcrawler.com (p) 1-212-655-4477 [finding the future in the past, passing the future in the present] [connecting people, places and things] __ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
> I developed a system using LSMTP that could easily do 4 > million messages per hour that was driven from CF. Was that using more than one box to run LSMTP? I thought you could only get about 2 million messages per hour through LSMTP Unlimited. Of course, I feel kind of silly using the word "only" in the above sentence. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ voice: (202) 797-5496 fax: (202) 797-5444 __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
and they say also about LSMTP: Fast: LSMTP can perform 600,000 deliveries per hour on a 733 MHz Pentium III system, while an AlphaServer can handle more than 1.8 million hourly deliveries. Reliable: L-Soft has been using LSMTP in house since 1995 to operate the largest LISTSERV site in the world, with more than 5 million daily deliveries on a single host and 10 million total deliveries each weekday. -Original Message- From: Jeff Green [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 6:33 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? Thats what im talking about :) -Original Message- From: Mark Warrick [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 3:15 PM To: CF-Talk Subject: 4 million messages per hour - is it possible? Hello, Has anyone had experience in creating an emailing solution driven by ColdFusion and SQL on any platform with any mail server that is capable of handling 4 million deliveries an hour? If so, would you care to share what software you used to make it happen? And do you have a live example of a company using the system? ---mark Mark Warrick ([EMAIL PROTECTED]) Founder, Fusioneers.com / CTO, ZapConnect.com Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 http://www.warrick.net / http://www.fusioneers.com http://www.zapconnect.com ICQ: 125160 AIM: markwarric Yahoo: Serengeti __ Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
LSMTP stats .. well marketing info... http://www.lsoft.com/products/default.asp?item=lsmtpstats -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 6:25 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? I developed a system using LSMTP that could easily do 4 million messages per hour that was driven from CF. -Matt > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share > what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
holly cow... 4 million geez... I am not asking who this is for.. that's a gross amount of emails... First off, I haven't created such a tool... Let's talk about theory here... With CF you can expect how many simultaneous pages per second performance wise? 50-100 on a nice box with tight code.. optimization, etc... so let's be optimistic... 100 x 60 seconds = 6000 messages per minute 6000 per min * 60 minutes = 360, messages per hour... per box... that's about 6 times the spool limit.. which is about 65k files... putting that aside... you need about 10-15 servers essentially with a distributed cooperative pooling mechanism to handle this... ideally... You also need a damn fast DNS or multiple local servers to reduce lookup times... Ideally, if you scrap the mail server need (which would be expensive, clogged, nightmare) and utilized a CF friendly mail server like iMS and ripped the mailing to a giant database table... had a scheduled event whereby each machine grabbed a range, worked it and recorded status errors etc to database and purged valid already mailed stuff or put in another table.. and talked maybe directly SMTP versus the need of a server well then it would be doable... recommend MySQL here... cheap and damn fast but with the machines I mentioned... you might also need some good bandwidth considering the volume of mail and the potential size of the emails themselves... That's my input... -paris Paris Lundis Founder Areaindex, L.L.C. http://www.areaindex.com http://www.pubcrawler.com (p) 1-212-655-4477 [finding the future in the past, passing the future in the present] [connecting people, places and things] -Original Message- From: Mark Warrick [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 6:15 PM To: CF-Talk Subject: 4 million messages per hour - is it possible? Hello, Has anyone had experience in creating an emailing solution driven by ColdFusion and SQL on any platform with any mail server that is capable of handling 4 million deliveries an hour? If so, would you care to share what software you used to make it happen? And do you have a live example of a company using the system? ---mark Mark Warrick ([EMAIL PROTECTED]) Founder, Fusioneers.com / CTO, ZapConnect.com Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 http://www.warrick.net / http://www.fusioneers.com http://www.zapconnect.com ICQ: 125160 AIM: markwarric Yahoo: Serengeti __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Feel free to elaborate :) j -Original Message- From: Matt Liotta [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 3:25 PM To: CF-Talk Subject: RE: 4 million messages per hour - is it possible? I developed a system using LSMTP that could easily do 4 million messages per hour that was driven from CF. -Matt > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share > what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
Re: 4 million messages per hour - is it possible?
I hope the customer has a nice net feed. Assuming each message (with headers) is 1024 bytes, it would require about 9.2 Mbit/s just for the messages, not even including the TCP/IP overhead, etc. To get that many messages, you're looking at multiple SMTP spooling servers (the IIS SMTP spooler on each would work just fine, or maybe some Linux/BSD servers running sendmail?). Multiple CF boxes would probably also be required to create the messages to drop into the mail spools at that rate. If your e-mails are static, you would probably be better off outsourcing it to a company that specializes in mass e-mail handling. I can't think of any services right off hand though.. -Justin Scott, Lead Developer Sceiron Internet Services, Inc. http://www.sceiron.com - Original Message - From: "Mark Warrick" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Monday, July 01, 2002 6:15 PM Subject: 4 million messages per hour - is it possible? > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Your ad could be here. Monies from ads go to support these lists and provide more resources for the community. http://www.fusionauthority.com/ads.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
I developed a system using LSMTP that could easily do 4 million messages per hour that was driven from CF. -Matt > -Original Message- > From: Mark Warrick [mailto:[EMAIL PROTECTED]] > Sent: Monday, July 01, 2002 3:15 PM > To: CF-Talk > Subject: 4 million messages per hour - is it possible? > > Hello, > > Has anyone had experience in creating an emailing solution driven by > ColdFusion and SQL on any platform with any mail server that is capable of > handling 4 million deliveries an hour? If so, would you care to share > what > software you used to make it happen? And do you have a live example of a > company using the system? > > ---mark > > > Mark Warrick ([EMAIL PROTECTED]) > Founder, Fusioneers.com / CTO, ZapConnect.com > Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 > http://www.warrick.net / http://www.fusioneers.com > http://www.zapconnect.com > ICQ: 125160 AIM: markwarric Yahoo: Serengeti > > > > __ Signup for the Fusion Authority news alert and keep up with the latest news in ColdFusion and related topics. http://www.fusionauthority.com/signup.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
RE: 4 million messages per hour - is it possible?
Thats what im talking about :) -Original Message- From: Mark Warrick [mailto:[EMAIL PROTECTED]] Sent: Monday, July 01, 2002 3:15 PM To: CF-Talk Subject: 4 million messages per hour - is it possible? Hello, Has anyone had experience in creating an emailing solution driven by ColdFusion and SQL on any platform with any mail server that is capable of handling 4 million deliveries an hour? If so, would you care to share what software you used to make it happen? And do you have a live example of a company using the system? ---mark Mark Warrick ([EMAIL PROTECTED]) Founder, Fusioneers.com / CTO, ZapConnect.com Phone: 714-547-5386 / 714-667-0203 / Efax: 801-730-7289 http://www.warrick.net / http://www.fusioneers.com http://www.zapconnect.com ICQ: 125160 AIM: markwarric Yahoo: Serengeti __ Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
