RE: Sending lots of mail

2004-04-21 Thread Tim Blair
> Is there some kind of software 
> (preferrably cheap or free) that can actually handle the 
> "mailing" part in the background without slowing down CF? 

We've written a mailing-list-manager type app here which allows the user
to send combined plain text/HTML emails to an opt-in mailing list.  All
creation of mails etc is handled by ColdFusion but the actual sending is
done using a perl script run as a cron job.

Doing it this way takes lots of load off the server and speeds up the
process (the user doesn't have to wait for 10s of thousands of mails to
be sent - can you imagine the requesttimeout setting on that?!), and
even means we can generate the mail from one server (the CF/web server)
and send it from another (a dedicated "mailing" server).

Tim.

--
---

Maze Solver - http://tech.badpen.com/cfcontest/
---
RAWNET LTD - Internet, New Media and ebusiness Gurus.
WE'VE MOVED - for our new address, please visit our
website at http://www.rawnet.com/ or call us any time
on 0800 294 24 24.
---
This message may contain information which is legally
privileged and/or confidential.  If you are not the
intended recipient, you are hereby notified that any
unauthorised disclosure, copying, distribution or use
of this information is strictly prohibited. Such
notification notwithstanding, any comments, opinions,
information or conclusions expressed in this message
are those of the originator, not of rawnet limited,
unless otherwise explicitly and independently indicated
by an authorised representative of rawnet limited.
---
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




RE: Sending lots of mail

2004-04-21 Thread Burns, John D
Tim,

I'm not very familiar with perl at all.  I'm getting ready to move to a
dedicated Windows server.  Is this something I could do from there?
That was one thing I thought about as well was the requesttimeout and
the time the user would have to sit there while the CF page processed
all of those mails (unless I created a CF Schedule event or something to
do the mail).  How much control do you have over the outgoing mail if
you did it in perl?  I know I need to do the usual spam avoidance
techniques and headers to make sure it gets to the person.  Any info,
resources or direction you could give would be great!

John 

-Original Message-
From: Tim Blair [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, April 21, 2004 9:49 AM
To: CF-Talk
Subject: RE: Sending lots of mail

> Is there some kind of software
> (preferrably cheap or free) that can actually handle the "mailing" 
> part in the background without slowing down CF?

We've written a mailing-list-manager type app here which allows the user
to send combined plain text/HTML emails to an opt-in mailing list.  All
creation of mails etc is handled by ColdFusion but the actual sending is
done using a perl script run as a cron job.

Doing it this way takes lots of load off the server and speeds up the
process (the user doesn't have to wait for 10s of thousands of mails to
be sent - can you imagine the requesttimeout setting on that?!), and
even means we can generate the mail from one server (the CF/web server)
and send it from another (a dedicated "mailing" server).

Tim.

--
---
 Maze Solver -
http://tech.badpen.com/cfcontest/
---
RAWNET LTD - Internet, New Media and ebusiness Gurus.
WE'VE MOVED - for our new address, please visit our website at
http://www.rawnet.com/ or call us any time on 0800 294 24 24.
---
This message may contain information which is legally privileged and/or
confidential.  If you are not the intended recipient, you are hereby
notified that any unauthorised disclosure, copying, distribution or use
of this information is strictly prohibited. Such notification
notwithstanding, any comments, opinions, information or conclusions
expressed in this message are those of the originator, not of rawnet
limited, unless otherwise explicitly and independently indicated by an
authorised representative of rawnet limited.
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




Re: Sending lots of mail

2004-04-21 Thread Adrocknaphobia
John, currently we have CF sending out 20k+ emails per day. (Usually within a one hour timeframe). The setup I inherited is all on one box. The site shows delayed responses during this mailing, however it's not too bad. I think the majority of the spped issues have to with bad coding.

I'm currently working on a new setup whereas the emails will be sent from a CFserver dedicated to email only.

-Adam

> -Original Message-
> From: Burns, John D [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, April 21, 2004 01:45 PM
> To: 'CF-Talk'
> Subject: Sending lots of mail
> 
> I know this discussion came up before about how many emails can be sent
> *reliably* using  in CFMX 6.1.  I'm curious what the numbers are
> on that and then also what is out there that people would recommend for
> doing mail-outs that are too big for CF.  I'm thinking that I want to
> use CF to give some Admin controls to users for formatting an email and
> then sending to their list.  Some of the lists for clients are upwards
> of 2,000+ members. I'm thinking CF could probably handle one client at a
> time doing this, but in the odd situation where two people are on at
> once trying it, I'm afraid CF will choke.  Is there some kind of
> software (preferrably cheap or free) that can actually handle the
> "mailing" part in the background without slowing down CF?  Let me know.
>  
> John
> 
> 
>
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




RE: Sending lots of mail

2004-04-21 Thread Burns, John D
Adam,

Good idea. Any ideas for a way around the waiting while the thousands of
emails are sent by a user?  Or are yours done through a scheduled task?
Also, any idea on performace issues etc with doing it as 
query=""> vs. ?  I'm guessing the
first is better but I'd be interested to hear of any other information.

John 

-Original Message-
From: Adrocknaphobia [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, April 21, 2004 10:15 AM
To: CF-Talk
Subject: Re: Sending lots of mail

John, currently we have CF sending out 20k+ emails per day. (Usually
within a one hour timeframe). The setup I inherited is all on one box.
The site shows delayed responses during this mailing, however it's not
too bad. I think the majority of the spped issues have to with bad
coding.

I'm currently working on a new setup whereas the emails will be sent
from a CFserver dedicated to email only.

-Adam

> -Original Message-
> From: Burns, John D [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, April 21, 2004 01:45 PM
> To: 'CF-Talk'
> Subject: Sending lots of mail
> 
> I know this discussion came up before about how many emails can be 
> sent
> *reliably* using  in CFMX 6.1.  I'm curious what the numbers 
> are on that and then also what is out there that people would 
> recommend for doing mail-outs that are too big for CF.  I'm thinking 
> that I want to use CF to give some Admin controls to users for 
> formatting an email and then sending to their list.  Some of the lists

> for clients are upwards of 2,000+ members. I'm thinking CF could 
> probably handle one client at a time doing this, but in the odd 
> situation where two people are on at once trying it, I'm afraid CF 
> will choke.  Is there some kind of software (preferrably cheap or 
> free) that can actually handle the "mailing" part in the background
without slowing down CF?  Let me know.
>  
> John
> 
> 
>
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




Re: Sending lots of mail

2004-04-21 Thread Doug White
Why not leave CF out of the mail picture entirely, as far as mail list is
concerned.   Instead us a list server that provides for an opt-in./ opt-out like
most of the world uses?

With a list server, all you do is send an email to the list, and the server will
distribute it to  the subscribers..  The email server software maintains the
address list.

You will use much less server resources this way.

Doug

==
We can get rid of spam on your domain! , Anti-spam solutions
http://www.clickdoug.com/mailfilter.cfm
For hosting solutions http://www.clickdoug.com
==

  - Original Message

  I know this discussion came up before about how many emails can be sent
  *reliably* using  in CFMX 6.1.  I'm curious what the numbers are
  on that and then also what is out there that people would recommend for
  doing mail-outs that are too big for CF.  I'm thinking that I want to
  use CF to give some Admin controls to users for formatting an email and
  then sending to their list.  Some of the lists for clients are upwards
  of 2,000+ members. I'm thinking CF could probably handle one client at a
  time doing this, but in the odd situation where two people are on at
  once trying it, I'm afraid CF will choke.  Is there some kind of
  software (preferrably cheap or free) that can actually handle the
  "mailing" part in the background without slowing down CF?  Let me know.

  John
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




RE: Sending lots of mail

2004-04-21 Thread cfhelp
I send out about 30,000 emails every morning for the BlueEar.com web site. I
created scheduled tasks that compiles the newsletters and then creates a
scheduled task that runs every few minutes and grabs 500 subscribers at a
time for a given subscription (BlueEar.com has multiple subscription
Options). After the list of subscribers have all been ran it resets the Sent
Status for each subscriber and deletes the Scheduled Task.

 
I have ran it this way on CF5 for the last few years and just in the last
few weeks on CFMX without any problems. I am thinking of bumping it up to
700 and maybe 1000 subscribers at once.

 
Rick

-Original Message-
From: Burns, John D [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, April 21, 2004 6:46 AM
To: CF-Talk
Subject: Sending lots of mail

 
I know this discussion came up before about how many emails can be sent
*reliably* using  in CFMX 6.1.  I'm curious what the numbers are
on that and then also what is out there that people would recommend for
doing mail-outs that are too big for CF.  I'm thinking that I want to
use CF to give some Admin controls to users for formatting an email and
then sending to their list.  Some of the lists for clients are upwards
of 2,000+ members. I'm thinking CF could probably handle one client at a
time doing this, but in the odd situation where two people are on at
once trying it, I'm afraid CF will choke.  Is there some kind of
software (preferrably cheap or free) that can actually handle the
"mailing" part in the background without slowing down CF?  Let me know.

John
  _
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




RE: Sending lots of mail

2004-04-21 Thread Katz, Dov B (IT)
Rick,

 
I do the same thing for my onlysimchas.com email lists. I have it set to
send 500 mails every 3 minutes, which is safe.

 
Last time I bumped it up, I actually ended up causing the CF Mail Spool
delivery thread to die, causing all mail outbound from the site to sit
in the spool forever.

 
Just a head's up, so be careful, as I don't know what caused that..

 
-dov

  _  

From: cfhelp [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, April 21, 2004 10:38 AM
To: CF-Talk
Subject: RE: Sending lots of mail

I send out about 30,000 emails every morning for the BlueEar.com web
site. I
created scheduled tasks that compiles the newsletters and then creates a
scheduled task that runs every few minutes and grabs 500 subscribers at
a
time for a given subscription (BlueEar.com has multiple subscription
Options). After the list of subscribers have all been ran it resets the
Sent
Status for each subscriber and deletes the Scheduled Task.

I have ran it this way on CF5 for the last few years and just in the
last
few weeks on CFMX without any problems. I am thinking of bumping it up
to
700 and maybe 1000 subscribers at once.

Rick

-Original Message-
From: Burns, John D [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, April 21, 2004 6:46 AM
To: CF-Talk
Subject: Sending lots of mail

I know this discussion came up before about how many emails can be sent
*reliably* using  in CFMX 6.1.  I'm curious what the numbers are
on that and then also what is out there that people would recommend for
doing mail-outs that are too big for CF.  I'm thinking that I want to
use CF to give some Admin controls to users for formatting an email and
then sending to their list.  Some of the lists for clients are upwards
of 2,000+ members. I'm thinking CF could probably handle one client at a
time doing this, but in the odd situation where two people are on at
once trying it, I'm afraid CF will choke.  Is there some kind of
software (preferrably cheap or free) that can actually handle the
"mailing" part in the background without slowing down CF?  Let me know.

John
  _ 
  _
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




Re: Sending lots of mail

2004-04-21 Thread Adrocknaphobia
Each email we send is dynamic per a user's settings and options. If it was static across the board I'd agree with you completely.

-adam

> -Original Message-
> From: Doug White [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, April 21, 2004 02:22 PM
> To: 'CF-Talk'
> Subject: Re: Sending lots of mail
> 
> Why not leave CF out of the mail picture entirely, as far as mail list is
> concerned.   Instead us a list server that provides for an opt-in./ opt-out like
> most of the world uses?
> 
> With a list server, all you do is send an email to the list, and the server will
> distribute it to  the subscribers..  The email server software maintains the
> address list.
> 
> You will use much less server resources this way.
> 
> Doug
> 
> ==
> We can get rid of spam on your domain! , Anti-spam solutions
> http://www.clickdoug.com/mailfilter.cfm
> For hosting solutions http://www.clickdoug.com
> ==
> 
> 
>   - Original Message
> 
>   I know this discussion came up before about how many emails can be sent
>   *reliably* using  in CFMX 6.1.  I'm curious what the numbers are
>   on that and then also what is out there that people would recommend for
>   doing mail-outs that are too big for CF.  I'm thinking that I want to
>   use CF to give some Admin controls to users for formatting an email and
>   then sending to their list.  Some of the lists for clients are upwards
>   of 2,000+ members. I'm thinking CF could probably handle one client at a
>   time doing this, but in the odd situation where two people are on at
>   once trying it, I'm afraid CF will choke.  Is there some kind of
>   software (preferrably cheap or free) that can actually handle the
>   "mailing" part in the background without slowing down CF?  Let me know.
> 
> 
>   John
> 
> 
>
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




RE: Sending lots of mail

2004-04-21 Thread Burns, John D
At a previous job, we had a system set up where we created a .txt file
with header information and such on it as well as a space for an SQL
statement to grab the names of the people to send to.  We'd then feed
the .txt into some special mail program by making a terminal connection
and pasting the text.  There was also an option to send the txt from a
trusted email address and it would process the rest.  I'm just not sure
what the software was called but something along those lines would be
great for me.  Then, I could manage the emails and lists through CF as
well as the specific list that an email was supposed to go out to and
then I could pass a single file over to the other server for processing.
Anyone know of something like that?

John 

-Original Message-
From: Adrocknaphobia [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, April 21, 2004 11:26 AM
To: CF-Talk
Subject: Re: Sending lots of mail

Each email we send is dynamic per a user's settings and options. If it
was static across the board I'd agree with you completely.

-adam

> -Original Message-
> From: Doug White [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, April 21, 2004 02:22 PM
> To: 'CF-Talk'
> Subject: Re: Sending lots of mail
> 
> Why not leave CF out of the mail picture entirely, as far as mail list
is
> concerned.   Instead us a list server that provides for an opt-in./
opt-out like
> most of the world uses?
> 
> With a list server, all you do is send an email to the list, and the 
> server will distribute it to  the subscribers..  The email server 
> software maintains the address list.
> 
> You will use much less server resources this way.
> 
> Doug
> 
> ==
> We can get rid of spam on your domain! , Anti-spam solutions 
> http://www.clickdoug.com/mailfilter.cfm
> For hosting solutions http://www.clickdoug.com 
> ==
> 
> 
>   - Original Message
> 
>   I know this discussion came up before about how many emails can be
sent
>   *reliably* using  in CFMX 6.1.  I'm curious what the numbers
are
>   on that and then also what is out there that people would recommend
for
>   doing mail-outs that are too big for CF.  I'm thinking that I want
to
>   use CF to give some Admin controls to users for formatting an email
and
>   then sending to their list.  Some of the lists for clients are
upwards
>   of 2,000+ members. I'm thinking CF could probably handle one client
at a
>   time doing this, but in the odd situation where two people are on at
>   once trying it, I'm afraid CF will choke.  Is there some kind of
>   software (preferrably cheap or free) that can actually handle the
>   "mailing" part in the background without slowing down CF?  Let me
know.
> 
> 
>   John
> 
> 
>
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




Re: Sending lots of mail

2004-04-21 Thread Scott Weikert
My main project (CF based) is an online publishing and email broadcasting 
system. I used to use ActivMail for sending out broadcasts when we were on 
CF5, but found with CFMX that the cfmail tag was VASTLY improved (both 
feature-wise and performance-wise) and have moved back to that.

That said, concerning multiple clients trying to send... I had to write a 
whole queueing system so as not to potentially overwhelm my servers if 
multiple clients wanted to send at the same time. I basically break each 
send up into 5k blocks (should the send be more than 5k), and have a 
scheduled task running a script that basically picks up a single 5k block, 
processes it, and then terminates.

Hit me up off-list if you'd like to chat more on it, I'd be happy to try 
and nudge you in the right direction.
--Scott

At 07:45 AM 4/21/2004, you wrote:
>I know this discussion came up before about how many emails can be sent
>*reliably* using  in CFMX 6.1.  I'm curious what the numbers are
>on that and then also what is out there that people would recommend for
>doing mail-outs that are too big for CF.  I'm thinking that I want to
>use CF to give some Admin controls to users for formatting an email and
>then sending to their list.  Some of the lists for clients are upwards
>of 2,000+ members. I'm thinking CF could probably handle one client at a
>time doing this, but in the odd situation where two people are on at
>once trying it, I'm afraid CF will choke.  Is there some kind of
>software (preferrably cheap or free) that can actually handle the
>"mailing" part in the background without slowing down CF?  Let me know.
>
>
>John
>
>--
>[Todays Threads] 
>[This Message] 
>[Subscription] 
>[Fast 
>Unsubscribe] [User Settings]
>
>--
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




Re: Sending lots of mail

2004-04-21 Thread Thomas Chiverton
On Wednesday 21 Apr 2004 16:37 pm, Burns, John D wrote:
> Anyone know of something like that?

You can replace tokens in the file easily enough with reg. exps. in your 
favorite language.

-- 
Tom Chiverton 
Advanced ColdFusion Programmer

Tel: +44(0)1749 834997
email: [EMAIL PROTECTED]
BlueFinger Limited
Underwood Business Park
Wookey Hole Road, WELLS. BA5 1AF
Tel: +44 (0)1749 834900
Fax: +44 (0)1749 834901
web: www.bluefinger.com
Company Reg No: 4209395 Registered Office: 2 Temple Back East, Temple
Quay, BRISTOL. BS1 6EG.
*** This E-mail contains confidential information for the addressee
only. If you are not the intended recipient, please notify us
immediately. You should not use, disclose, distribute or copy this
communication if received in error. No binding contract will result from
this e-mail until such time as a written document is signed on behalf of
the company. BlueFinger Limited cannot accept responsibility for the
completeness or accuracy of this message as it has been transmitted over
public networks.***
 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]




RE: Sending lots of mail

2004-04-21 Thread Matt Robertson
John Burns wrote:
>Some of the lists for clients are upwards of 2,000+ 
>members. I'm thinking CF could probably handle one 
>client at a time doing this, but in the odd situation 
>where two people are on at once trying it, I'm afraid 
>CF will choke.

Thats not even close to enough mail to worry about.  I've got clients
with 5,000+ lists and have seen three or four of them hit the server at
once.  No problemo.

If you want you can throttle down the mail send rate for lists in this
size range.

http://mysecretbase.com/Slowing_Down_CFMAIL.cfm


 Matt Robertson   [EMAIL PROTECTED] 
 MSB Designs, Inc.  http://mysecretbase.com

 [Todays Threads] 
 [This Message] 
 [Subscription] 
 [Fast Unsubscribe] 
 [User Settings]