qmail Digest 17 Jul 2000 10:00:00 -0000 Issue 1065

Mon, 17 Jul 2000 02:57:13 -0700 


qmail Digest 17 Jul 2000 10:00:00 -0000 Issue 1065

Topics (messages 44836 through 44854):

Re: Announcing qmail-autoresponder version 0.90
        44836 by: Russ Allbery

Re: Domain forwarding]
        44837 by: Henry Baragar

Qmail is *NOT* reliable with ReiserFS
        44838 by: Jedi/Sector One

ERR Authorization failed w/qmail-pop
        44839 by: James Phillips

Announcing: SPAMCONTROL 1.3.0
        44840 by: Erwin Hoffmann

Re: ERR Authorization failed w/qmail-pop (New)
        44841 by: Hubbard, David
        44842 by: James Phillips

pop3d questions
        44843 by: Tony Campisi
        44844 by: Henry Baragar

Re: scan4virus problem
        44845 by: Jason Haar

checking and fixing ownership of files
        44846 by: Vincent Danen

Re: questions about performance and setup
        44847 by: Oliver White
        44848 by: markd.bushwire.net
        44849 by: Steve Wolfe

bounce management
        44850 by: Thomas Duterme

ESMTP
        44851 by: Tobias Neubert
        44853 by: Jedi/Sector One

sqwebmail cannot compile
        44852 by: Jia Rong

rc file problem
        44854 by: Georg Thoma

Administrivia:

To unsubscribe from the digest, e-mail:
        [EMAIL PROTECTED]

To subscribe to the digest, e-mail:
        [EMAIL PROTECTED]

To bug my human owner, e-mail:
        [EMAIL PROTECTED]

To post to the list, e-mail:
        [EMAIL PROTECTED]


----------------------------------------------------------------------


Bruce Guenter <[EMAIL PROTECTED]> writes:
> On Fri, Jul 14, 2000 at 06:28:44PM -0700, Russ Allbery wrote:

>> I consider it to be an absolute requirement for any autoresponder to
>> not reply to a message that isn't addressed to the recipient it is
>> acting on behalf of.

> And that's part of why it's rate limited.

Rate limiting will indeed cover up a multitude of sins, but it's still
possible even with a rate-limited autoresponder to generate responses to
mailing list traffic.  Another significant ameliorating factor in your
implementation, though, is...

> By default, it will only reply to a particular sender address once an
> hour, no matter how many are sent.  Hmmmm.  Ezmlm uses a different
> recipient address each time (but ezmlm will also add both a "Precedence:
> bulk" and a "Delivered-To: mailing list ..." header).

...that it sounds like you're sending your replies to the envelope sender,
and therefore it's somewhat less likely they would end up on the mailing
list.

There are various schools of thought on this topic.  My experience is that
sending the autoreply to the From/Reply-To address is generally what
people expect and that sending it to the envelope sender can often be
confusing or unsuccessful.  But using the envelope sender is certainly
cleaner from an implementation standpoint, and helps avoid a few of the
problems of mailing lists, at least for mailing lists managed by software.

> I understand the argument you're making, and it's valid to a degree.  If
> you want to contribute a simple GPL-able RFC822 parser, I'll make it a
> feature of my autoresponder.

That's not the main problem.  That's a tractable technical problem, even
if annoying.  The real problem is that unless you're willing to let your
autoresponder generate significantly fewer responses than the person would
expect, you have to deal with alternate forms of their address.  For
example, there are literally hundreds of rra@*.stanford.edu address forms
that all deliver to [EMAIL PROTECTED], and unfortunately in some cases a
not insignificant number of them are in use for various things or due to
various historical reasons.

You're correct that I overstated my feelings somewhat, and determining
whether a given e-mail address was addressed directly to the recipient in
the To or Cc header is not a fully solveable problem.  The rather ugly
hack that I'm currently using is:

my @addressees = ($addressees =~ /(?:^|\G|\s)(\S+)\@\S+\.\S+\s/g);

(and then applying some canonicalization to deal with removing the leading
bracket, supporting varient forms that our LDAP database supports, and
removing the "sub-address" parts).

This fails to recognize all sorts of weird addressing forms that are
fairly uncommon in practice.  This is reasonable for my purposes since the
algorithm "fails closed"; if it can't find the recipient, it doesn't send
an autoreply.  More worrisome is the fact that it only considers the
username portion, in part to deal with the address varient problem
mentioned above (and because that was the historical behavior of the
autoresponder that I was rewriting to use LDAP instead of our old method
of handling vacation).  In practice, though, that seems to work reasonably
well.

This is certainly not a substitute for rate limiting or for watching for
list headers and not replying to those messages.  (My autoresponder also
refuses to reply to any message coming from an envelope sender ending in
-request or containing any of the words daemon, postmaster, mailer-daemon,
mailer, root, or majordomo.)  In combination with those other checks,
though, the additional check makes me feel a lot better about releasing
the autoresponder on an unsuspecting Internet.

Autoresponses to mailing list traffic are a personal annoyance of mine;
every time I, for example, send mail to the CVS mailing list, I get three
or four vacation messages and I'm extremely tired of it.  Given how much
it annoys me personally, I wanted to be reasonably certain that I wouldn't
be the cause of someone else being similarly annoyed.

> Or list-id, or mailing-list, or x-mailing-list, or x-ml-name.  I should
> actually add a test for ezmlm to check if a "Delivered-To:" line starts
> with "mailing list ".

I believe ezmlm always adds Mailing-List and Precedence; given that, I
don't see a reason for adding another rule.

(Precedence has been an informal standard for many years now, and no
reasonably maintained mailing list management package really has much
excuse for not using it, IMO.)

-- 
Russ Allbery ([EMAIL PROTECTED])             <http://www.eyrie.org/~eagle/>



Michael,

This can easily be accomplished using qmail:

  1. Add first.com and second.com to control/rcpthosts
  2. Put second.com (but not first.com) into control/locals
  3. Make sure the MX record for first.com in your internal DNS points
to
     MS-Exchange

This tells qmail to accept mail for both first.com and second.com, but
to
handle only second.com locally.

Henry

Michael Hinds wrote:

> Hello,
>
> Our company has always used MS-Exchange for internet e-mail, but we are
> trying to add a Linux/qmail server to the configuration.
> We're currently using a Raptor firewall to route all SMTP transmissions
> to the MS box. For the sake of example, we'll call our original domain
> first.com.
>
> What we want to do is host a separate domain on the qmail server (say,
> second.com). The problem is, our firewall can't decide where mail is
> destined for, it can only recognise the protocol. So we either have to
> route all mail to qmail and make qmail accept mail for second.com and
> forward all first.com mail to the MS server, or route all mail to the MS
> server and make that accept mail for first.com and forward all
> second.com mail to qmail.
>
> The first option would be preferrable, but by now I'm willing to try
> anything. I'm having trouble finding any concrete examples or documents
> describing how to do this. I've found lots of ways to forward mail for
> particular e-mail addresses, but not for whole domains. I don't want to
> set up users on the qmail server for all the e-mail users on the MS box.
>
> I've installed fastforward, but the documentation is skimpy! It points
> me to the aliases docs, which don't appear to tell me how to do this
> either.
>
> Somebody, please, point me in the right direction!
>
> Many thanks,
>
> Michael Hinds

S/MIME Cryptographic Signature



  ReiserFS does not commit link() synchronously (mounting with "sync"
doesn't change anything). Therefore, if there is a power outage during
the Maildir delivery or if qmail-smtpd answered the final "queued"
message without actually commiting the link in queue/todo, the message
will not be processed by qmail-send.

  Here is a patch to make Qmail more reliable for Linux users using a
ReiserFS partition.

  Best regards,
-- 
         Frank DENIS aka Jedi/Sector One aka DJ Chrysalis <[EMAIL PROTECTED]>
                -> Software : http://www.jedi.claranet.fr <-
      If Bill Gates had a dime for every time a Windows box crashed...
                  ...oh, wait a minute -- he already does.
--- ../qmail-1.03.orig/qmail-local.c    Mon Jun 15 12:53:16 1998
+++ qmail-local.c       Sun Jul 16 16:19:04 2000
@@ -1,5 +1,6 @@
 #include <sys/types.h>
 #include <sys/stat.h>
+#include <fcntl.h>
 #include "readwrite.h"
 #include "sig.h"
 #include "env.h"
@@ -128,6 +129,9 @@
  if (close(fd) == -1) goto fail; /* NFS dorks */
 
  if (link(fntmptph,fnnewtph) == -1) goto fail;
+ if ((fd = open(fnnewtph, O_RDONLY)) < 0 ||
+     fsync(fd) < 0 || close(fd) < 0) goto fail;
+   
    /* if it was error_exist, almost certainly successful; i hate NFS */
  tryunlinktmp(); _exit(0);
 
--- ../qmail-1.03.orig/qmail-queue.c    Mon Jun 15 12:53:16 1998
+++ qmail-queue.c       Sun Jul 16 16:19:33 2000
@@ -1,5 +1,6 @@
 #include <sys/types.h>
 #include <sys/stat.h>
+#include <fcntl.h>
 #include "readwrite.h"
 #include "sig.h"
 #include "exit.h"
@@ -155,6 +156,7 @@
 {
  unsigned int len;
  char ch;
+ int fd;
 
  sig_blocknone();
  umask(033);
@@ -183,7 +185,7 @@
  todofn = fnnum("todo/",0);
  intdfn = fnnum("intd/",0);
 
- if (link(pidfn,messfn) == -1) die(64);
+ if (link(pidfn,messfn) == -1) die(64); 
  if (unlink(pidfn) == -1) die(63);
  flagmademess = 1;
 
@@ -248,6 +250,8 @@
  if (fsync(intdfd) == -1) die_write();
 
  if (link(intdfn,todofn) == -1) die(66);
+ if ((fd = open(todofn, O_RDONLY)) < 0 ||
+     fsync(fd) < 0 || close(fd) < 0) die(66); 
 
  triggerpull();
  die(0);



I have setup qmail+qmailadmin with all associated packages.  I have set up a few 
accounts via qmailadmin and am able to send messages with out a problem.

Now I want to use pop3 to get messages from qmail.

I have qmail-pop running as I used the example in #12 of INSTALL in vpopmail package.  
I installed checkpassword but I always get -ERR authorization 
failed even using a valid password.

I tried accessing the pop server via Outlook Express to verifiy that pop server is 
running and it is because it gives me the error:

There was a problem logging onto your mail server. Your Password was rejected. 
Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server Response: '-ERR aack, 
child crashed', Port: 110, Secure(SSL): No, Server Error: 0x800CCC90, Error Number: 
0x800CCC92

Any help would be appreciated as I am stuck here.

James Phillips


_____________________________________________________________
Get free email at http://www.Kidsware.com.  Keeping an Eye on the KIDS SoftWARE 
Industry.



Hi,

a new version of the SPAMCONTROL patch is available by now. 
Version 1.3.0 includes now Will Harris' SMTP SIZE extension.

Pls. check my Web-Site http://www.fehcom.de/qmail_en.html

For users of Version 1.2.1: Pls upgrade to 1.2.2 or 1.3.0. Due to a mistake
generating the archive, mods from Version 1.2.0 to Version 1.2.1 were not
incorporated. 
I have to apologize. Tx.

cheers.
eh.
+-----------------------------------------------------------------------+
|  fff        hh         http://www.fehcom.de        Dr. Erwin Hoffmann |
| ff          hh                                                        |
| ff    eee   hhhh      ccc   ooo    mm mm  mm       Wiener Weg 8       |
| fff  ee ee  hh  hh   cc   oo   oo  mmm  mm  mm     50858 Koeln        |
| ff  ee eee  hh  hh  cc   oo     oo mm   mm  mm                        |
| ff  eee     hh  hh   cc   oo   oo  mm   mm  mm     Tel 0221 484 4923  |
| ff   eeee   hh  hh    ccc   ooo    mm   mm  mm     Fax 0221 484 4924  |
+-----------------------------------------------------------------------+



I'd like to add a question on to James' problems.  I'm doing
the same thing, my setup is working, but if a user enters
a bad password, he gets the message as shown below.  Is there
really a process crashing?  And is it not cleaning up after
itself?  So this could end up causing problems later?  Also,
when someone doesn't log in correctly and I get that child
crashed message, there is no mention of the connection in the
logs, that is not good, someone could hit my server all day
using brute force and I'd never know...

Thanks,

Dave

-----Original Message-----
From: James Phillips [mailto:[EMAIL PROTECTED]]
Sent: Sunday, July 16, 2000 2:44 PM
To: [EMAIL PROTECTED]
Subject: ERR Authorization failed w/qmail-pop


I have setup qmail+qmailadmin with all associated packages.  I have set up a
few accounts via qmailadmin and am able to send messages with out a problem.

Now I want to use pop3 to get messages from qmail.

I have qmail-pop running as I used the example in #12 of INSTALL in vpopmail
package.  I installed checkpassword but I always get -ERR authorization 
failed even using a valid password.

I tried accessing the pop server via Outlook Express to verifiy that pop
server is running and it is because it gives me the error:

There was a problem logging onto your mail server. Your Password was
rejected. Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server
Response: '-ERR aack, child crashed', Port: 110, Secure(SSL): No, Server
Error: 0x800CCC90, Error Number: 0x800CCC92

Any help would be appreciated as I am stuck here.

James Phillips


_____________________________________________________________
Get free email at http://www.Kidsware.com.  Keeping an Eye on the KIDS
SoftWARE Industry.



Actually sometimes I get that error and other times I get:

Unable to logon to the server using Secure Password Authentication. Account: 'abcd', 
Server: 'xyz123.com', Protocol: POP3, Server Response: '-ERR authorization first', 
Port: 110, Secure(SSL): No, Server Error: 0x800CCC90, Error Number: 0x800CCC18

Problem is it always fails, even when I telnet to 110 on the host machine.  

--- "Hubbard, David" <[EMAIL PROTECTED]>
> wrote:
>I'd like to add a question on to James' problems.  I'm doing
>the same thing, my setup is working, but if a user enters
>a bad password, he gets the message as shown below.  Is there
>really a process crashing?  And is it not cleaning up after
>itself?  So this could end up causing problems later?  Also,
>when someone doesn't log in correctly and I get that child
>crashed message, there is no mention of the connection in the
>logs, that is not good, someone could hit my server all day
>using brute force and I'd never know...
>
>Thanks,
>
>Dave
>
>-----Original Message-----
>From: James Phillips [mailto:[EMAIL PROTECTED]]
>Sent: Sunday, July 16, 2000 2:44 PM
>To: [EMAIL PROTECTED]
>Subject: ERR Authorization failed w/qmail-pop
>
>
>I have setup qmail+qmailadmin with all associated packages.  I have set up a
>few accounts via qmailadmin and am able to send messages with out a problem.
>
>Now I want to use pop3 to get messages from qmail.
>
>I have qmail-pop running as I used the example in #12 of INSTALL in vpopmail
>package.  I installed checkpassword but I always get -ERR authorization 
>failed even using a valid password.
>
>I tried accessing the pop server via Outlook Express to verifiy that pop
>server is running and it is because it gives me the error:
>
>There was a problem logging onto your mail server. Your Password was
>rejected. Account: 'abcd', Server: 'xyz123.com', Protocol: POP3, Server
>Response: '-ERR aack, child crashed', Port: 110, Secure(SSL): No, Server
>Error: 0x800CCC90, Error Number: 0x800CCC92
>
>Any help would be appreciated as I am stuck here.
>
>James Phillips
>
>
>_____________________________________________________________
>Get free email at http://www.Kidsware.com.  Keeping an Eye on the KIDS
>SoftWARE Industry.

_____________________________________________________________
Get free email at http://www.Kidsware.com.  Keeping an Eye on the KIDS SoftWARE 
Industry.



Hi,
I created  a /var/qmail/supervise/qmail-pop3d/run file

#!/bin/sh
QMAILDUID=`id -u qmaild`
NOFILESGID=`id -g qmaild`
exec /usr/local/bin/softlimit -m 2000000 \
    /usr/local/bin/tcpserver -v -R 0 pop3 /var/qmail/bin/qmail-popup
mailperson2.cardinalservices.com \
        /usr/local/bin/checkpassword /var/qmail/bin/qmail-pop3d Maildir 2>&1

Does anyone see any drawbacks to running pop3d like this?

My /var/log/qmail/pop3d/current files contents look like this:
@4000000039720b74038df72c tcpserver: end 3255 status 256
@4000000039720b74038ee574 tcpserver: status: 0/40

I want my log files to have dates that I can read. I tried putting this in
my /var/qmail/supervise/qmail-pop3d/log/run file but it's not working as
planned.

exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t |
/usr/local/bin/tai64nlocal /var/log/qmail/pop3d

Can someone tell me if I am anywhere close to getting this right?

thanks
tony.campisi





Tony,

I am doing the same thing.   To see readable dates, use:

     tai64nlocal </var/log/qmail/pop3d/current

Henry

Tony Campisi wrote:

> Hi,
> I created  a /var/qmail/supervise/qmail-pop3d/run file
>
> #!/bin/sh
> QMAILDUID=`id -u qmaild`
> NOFILESGID=`id -g qmaild`
> exec /usr/local/bin/softlimit -m 2000000 \
>     /usr/local/bin/tcpserver -v -R 0 pop3 /var/qmail/bin/qmail-popup
> mailperson2.cardinalservices.com \
>         /usr/local/bin/checkpassword /var/qmail/bin/qmail-pop3d Maildir 2>&1
>
> Does anyone see any drawbacks to running pop3d like this?
>
> My /var/log/qmail/pop3d/current files contents look like this:
> @4000000039720b74038df72c tcpserver: end 3255 status 256
> @4000000039720b74038ee574 tcpserver: status: 0/40
>
> I want my log files to have dates that I can read. I tried putting this in
> my /var/qmail/supervise/qmail-pop3d/log/run file but it's not working as
> planned.
>
> exec /usr/local/bin/setuidgid qmaill /usr/local/bin/multilog t |
> /usr/local/bin/tai64nlocal /var/log/qmail/pop3d
>
> Can someone tell me if I am anywhere close to getting this right?
>
> thanks
> tony.campisi

begin:vcard 
n:Baragar;Henry
tel;cell:416-453-5626
tel;work:416-453-5626
x-mozilla-html:TRUE
url:www.instantiated.on.ca
org:Instantiated Software Inc.
adr:;;130 Banff Road;Toronto;Ontario;M4P 2P5;Canada
version:2.1
email;internet:[EMAIL PROTECTED]
title:Principal
fn:Henry Baragar
end:vcard

S/MIME Cryptographic Signature



On Sat, Jul 15, 2000 at 12:05:30PM +0300, Kimmo Berghäll wrote:
> Hello,
> 
> If I put QMAILQUEUE="/var/qmail/antivirus-qmail-queue.pl"
>        export QMAILQUEUE 
> to /etc/rc.d/init.d/qmail I get "qq temporary problem (#4.3.0) when I
> try to send mail.
> 
> I have applied qmail-queue patch

You should really join the Scan4Virus mailing-list via
[EMAIL PROTECTED] instead of worrying every
other Qmail site :-)

Anyway, make sure you're running the latest release (0.53). Then make sure
you did like it asked. Have you su'ed to qmaild and run
"/var/qmail/antivirus-qmail-queue.pl -g" to test that perl scripts can run
setuid to another usercode on your system? If not that's your problem (and I
bet it is).

Read the documentation about what to do in that case - it may help...

-- 
Cheers

Jason Haar

Unix/Network Specialist, Trimble NZ
Phone: +64 3 9635 377 Fax: +64 3 9635 417
               



I know you can use instcheck to verify if the owners/permissions of
files are correct, but is there something I can use to fix this?  I'm
sure there is a tool of some sort I can use to verify all permissions
and fix them if incorrect (besides doing another make install).

Reason I ask is I'm almost finished an RPM to install the stock qmail
(no patches) and it would make life so much easier if I could run a
script or program afterwards to fix all permissions/ownership issues
since RPM makes a mess of some of them (particularly directories).

Any ideas how I can do this?

Thanks.

-- 
[EMAIL PROTECTED], OpenPGP key available on www.keyserver.net
Freezer Burn BBS:  telnet://bbs.freezer-burn.org . ICQ: 54924721
Webmaster for the Linux Portal Site Freezer Burn:  http://www.freezer-burn.org

Current Linux uptime: 6 days 18 hours 11 minutes.



We're in a similar situation at the moment.  However, we want to send out
100,000 UNIQUE emails per day, expanding to 500,000 or more in the near
future.  Also, our send window is only actually a couple of hours.

I'm trying to work out the best settings for the concurrencyremote and
conf-split parameters.  Our system is a HP Netserver 2000r PIII-667 RAID5
running Linux.  Are there any problems in setting conf-split to a very large
value?  Is it necessary on a Linux system, assuming a queue size of, say
100,000?  Any information appreciated.

 - Oliver.

"Austad, Jay" wrote:

> Non-unique emails will most likely be generated by other machines and send
> the box running mini-qmail via smtp.  Non-unique emails will be a small
> percentage of what gets sent out, for now.
>
> Jay
>
> -----Original Message-----
> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> Sent: Saturday, July 15, 2000 12:10 AM
> To: '[EMAIL PROTECTED]'
> Subject: Re: questions about performance and setup
>
> On Fri, Jul 14, 2000 at 07:01:46PM -0500, Austad, Jay wrote:
> > >Then have the script that does the mailing call randomly
> > >on of the /var/qmail#/bin/qmail-inject. This will emulate round robin
> > >without any patching.
> >
> > Won't this way be a performance hit though?  I admit, it is an easy
> solution
>
> No. My experience is that the cost of running a script to inject the mail
> in a way similar to that mentioned above, is pretty small compared to the
> queue injection cost and the delivery cost. sh or perl will be fine.
>
> > and would work excellent, but I have to think about efficiency also.  C
> code
> > is much faster than shell or perl, and I'd like to set it up once and not
> > have to ever worry about again, or at least for a long, long time.
> >
> > As I said, we're doing 50 million emails a month right now, but this is
> > increasing substantially each month, and as we rollout new subscription
> > services, we'll have even more load.  Sending 10 times this amount by the
> > same time next year is a good possibility, possibly sooner as we seem to
> > underestimate the rate at which we're growing much of the time...
>
> You may also need to look at the scalability of the generation of the
> emails. One system I recently looked at claimed to be able to generate
> nicely unique emails at a targetted database, but it burned CPU like
> it was free - just in generating the content.
>
> Mark.
>
> >
> > Jay
> >
> > -----Original Message-----
> > From: JuanE [mailto:[EMAIL PROTECTED]]
> > Sent: Friday, July 14, 2000 5:55 PM
> > To: '[EMAIL PROTECTED]'
> > Subject: Re: questions about performance and setup
> >
> >
> >
> > Jay,
> >
> > That's the beauty of having multiple instances, not having to patch qmail.
> > All you need to do is install qmail once per machine (ie, /var/qmail1,
> > /var/qmail2,...). Then have the script that does the mailing call randomly
> > on of the /var/qmail#/bin/qmail-inject. This will emulate round robin
> > without any patching.
> >
> > JES
> >
> > Austad, Jay writes:
> >
> > > Where would I start in the code to modify the QMQP servers list so that
> it
> > > would load balance between all of the servers in the list instead of
> just
> > > using the first one it can contact?  This would be very useful to me.  I
> > > assume qmail-qmqpc.c is one of them, are there others I would need to
> play
> > > around with?
> > >
> > > Jay
> > >
> > > -----Original Message-----
> > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > > Sent: Friday, July 14, 2000 3:55 PM
> > > To: '[EMAIL PROTECTED]'
> > > Subject: Re: questions about performance and setup
> > >
> > >
> > > On Fri, Jul 14, 2000 at 02:29:06PM -0500, Austad, Jay wrote:
> > > > I already have Mandrake Linux 7.0 and 7.1 running on multiple Dell
> boxes
> > > > with no trouble, some of them took work to get going, but it runs
> well.
> > I
> > > > have a few Crystal PC's here also that I may use instead, dual PIII
> > 550's
> > > > with 512MB ram and 9 or 18GB 10000rpm drives.  I'll probably use these
> > for
> > > > testing.
> > >
> > > I agree with the earlier poster that more spindles for your queue
> > > (c/- raid) is a good thing in general.
> > >
> > > > The bulk of the messages will be the same content to many rcpt's.
> > > However,
> > > > once in awhile we'll have 100,000 different messages go out to 100,000
> > > > different people.
> > > >
> > > > Since the QMQP support under mini-qmail doesn't load balance, can I
> feed
> > > it
> > > > a hostname with multiple dns entries (round-robin dns)?  Or better
> yet,
> > > how
> > > > easy would it be to modify the qmail code to just load balance between
> > > them?
> > >
> > > The manpage for qmail-qmqpc tells us that they have to be IP addresses
> > > in qmqpservers so a RR DNS won't help. If all of the messages are
> > generated
> > > on one machine, then I'd be inclined to go for a much simpler solution
> > > than modifying qmail. I'd have an instance of qmail for each outbound
> > > server with the appropriate qmqpservers entry, then have your queue
> > > insertion script do a round-robin itself by simply cycling thru
> > > the qmail-inject command associated with each instance.
> > >
> > > for instance in 1 2 3 4 5
> > > do
> > >     getnext_message_details()
> > >     /var/qmail{$instance}/bin/qmail-inject currentmessage .... details
> > > done
> > >
> > > Or some such.
> > >
> > >
> > > Alternatively, if you have money to burn, maybe a layer four switch
> > > with load-balancing skills.
> > >
> > >
> > > Mark.
> > >
> > >
> > > >
> > > > Jay
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > > > Sent: Friday, July 14, 2000 2:09 PM
> > > > To: '[EMAIL PROTECTED]'
> > > > Subject: Re: questions about performance and setup
> > > >
> > > >
> > > > > Here's what I need to know:
> > > > >
> > > > > 1.  How well does qmail take advantage of multiple processors?  How
> > much
> > > >
> > > > Indreectly, quite well as it forks many processes, thus if the OS
> takes
> > > > good advantage of your CPUs, then qmail inherits that advantage.
> > > >
> > > > > memory and disk will I need?  (we're at 50 million messages per
> month
> > > now,
> > > >
> > > > Are these message unique per target address or the same. If unique,
> your
> > > > requirements are vastly different and very queue/disk intensive. If
> they
> > > > are the same and you take advantage or VERP support on qmail, then
> > > > your load will mainly be sending related which will benefit from
> > > > more memory, multiple instances, etc.
> > > >
> > > > > and we only send out monday-friday, so that's over 2 million
> messages
> > > per
> > > > > day, and it's only going up)
> > > > >
> > > > > 2.  How many messages per day would one estimate that each of these
> > > > servers
> > > > > could do?
> > > > >
> > > > > 3. I read about mini-qmail and how it's about 100 times faster
> > blasting
> > > > out
> > > > > email to QMQP servers.  Since you can specify multiple QMQP servers,
> > if
> > > I
> > > > > have a fourth machine running mini-qmail and managing the actual
> > mailing
> > > > > list, can I add the other 3 as QMQP servers and have it load balance
> > > > between
> > > > > all 3 for sending out mail?  (this way I could add more servers
> easily
> > > if
> > > > I
> > > > > needed to)
> > > >
> > > > The qmqp support doesn't load balance. It simply takes the first one
> > > > it can connect to.
> > > >
> > > > > 4. Can I easily make qmail run an external script for each bounced
> > mail?
> > > >
> > > > Absolutely.
> > > >
> > > > > 5.  Anything else I should know?
> > > >
> > > > That all hinges on whether your emails are unique for each recipient
> or
> > > > not. Or more importantly, the average number of recipients per unique
> > > > email.
> > > >
> > > >
> > > > Regards.
> > >
> >
> >




On Mon, Jul 17, 2000 at 03:33:54PM +1000, Oliver White wrote:
> We're in a similar situation at the moment.  However, we want to send out
> 100,000 UNIQUE emails per day, expanding to 500,000 or more in the near
> future.  Also, our send window is only actually a couple of hours.

Is that for your TV stuff?

500K queue insertions and delivery (reliably) within 2-3 hours is a lot. I
would not rely on one server, nor one point of internet connection.

One thing that you may want to think about is the amount of
bandwidth you will need. Let's see now, assuming a 10Kbyte message
size (which is pretty close to the current average, especially if it's
HTML)...

500,000 x 10,000 x 8 = 
40000000000 bits. In two hours, that makes
20000000000 bits per hour, that makes
333333333 bits per minute, that makes
5555555 bits per second.

Let's put some commas in to make this obvious:

5,555,555

In other words you'll need to pump out 5+ megabits per second, which
means a connection of around double that, say 10 Mbits per second.

Is that what you have available?


Looking at the disk I/O, 500K queue insertions and deletions implies
1Million fsynced I/Os (one for insertion, one for delivery) in 2 hours,
which means:

500000 fsynched I/Os per hour, that makes
8333 fsynched I/Os per minute, that makes
138 fsynched I/Os per second, that means that a 7ms access disk
will be flat out. Again doubling it to make a safety margin means
that you're looking at a disk subsystem that will give you an
fsynced I/O rate of 3ms.


Regards.


> I'm trying to work out the best settings for the concurrencyremote and
> conf-split parameters.  Our system is a HP Netserver 2000r PIII-667 RAID5
> running Linux.  Are there any problems in setting conf-split to a very large
> value?  Is it necessary on a Linux system, assuming a queue size of, say
> 100,000?  Any information appreciated.
> 
>  - Oliver.
> 
> "Austad, Jay" wrote:
> 
> > Non-unique emails will most likely be generated by other machines and send
> > the box running mini-qmail via smtp.  Non-unique emails will be a small
> > percentage of what gets sent out, for now.
> >
> > Jay
> >
> > -----Original Message-----
> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > Sent: Saturday, July 15, 2000 12:10 AM
> > To: '[EMAIL PROTECTED]'
> > Subject: Re: questions about performance and setup
> >
> > On Fri, Jul 14, 2000 at 07:01:46PM -0500, Austad, Jay wrote:
> > > >Then have the script that does the mailing call randomly
> > > >on of the /var/qmail#/bin/qmail-inject. This will emulate round robin
> > > >without any patching.
> > >
> > > Won't this way be a performance hit though?  I admit, it is an easy
> > solution
> >
> > No. My experience is that the cost of running a script to inject the mail
> > in a way similar to that mentioned above, is pretty small compared to the
> > queue injection cost and the delivery cost. sh or perl will be fine.
> >
> > > and would work excellent, but I have to think about efficiency also.  C
> > code
> > > is much faster than shell or perl, and I'd like to set it up once and not
> > > have to ever worry about again, or at least for a long, long time.
> > >
> > > As I said, we're doing 50 million emails a month right now, but this is
> > > increasing substantially each month, and as we rollout new subscription
> > > services, we'll have even more load.  Sending 10 times this amount by the
> > > same time next year is a good possibility, possibly sooner as we seem to
> > > underestimate the rate at which we're growing much of the time...
> >
> > You may also need to look at the scalability of the generation of the
> > emails. One system I recently looked at claimed to be able to generate
> > nicely unique emails at a targetted database, but it burned CPU like
> > it was free - just in generating the content.
> >
> > Mark.
> >
> > >
> > > Jay
> > >
> > > -----Original Message-----
> > > From: JuanE [mailto:[EMAIL PROTECTED]]
> > > Sent: Friday, July 14, 2000 5:55 PM
> > > To: '[EMAIL PROTECTED]'
> > > Subject: Re: questions about performance and setup
> > >
> > >
> > >
> > > Jay,
> > >
> > > That's the beauty of having multiple instances, not having to patch qmail.
> > > All you need to do is install qmail once per machine (ie, /var/qmail1,
> > > /var/qmail2,...). Then have the script that does the mailing call randomly
> > > on of the /var/qmail#/bin/qmail-inject. This will emulate round robin
> > > without any patching.
> > >
> > > JES
> > >
> > > Austad, Jay writes:
> > >
> > > > Where would I start in the code to modify the QMQP servers list so that
> > it
> > > > would load balance between all of the servers in the list instead of
> > just
> > > > using the first one it can contact?  This would be very useful to me.  I
> > > > assume qmail-qmqpc.c is one of them, are there others I would need to
> > play
> > > > around with?
> > > >
> > > > Jay
> > > >
> > > > -----Original Message-----
> > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > > > Sent: Friday, July 14, 2000 3:55 PM
> > > > To: '[EMAIL PROTECTED]'
> > > > Subject: Re: questions about performance and setup
> > > >
> > > >
> > > > On Fri, Jul 14, 2000 at 02:29:06PM -0500, Austad, Jay wrote:
> > > > > I already have Mandrake Linux 7.0 and 7.1 running on multiple Dell
> > boxes
> > > > > with no trouble, some of them took work to get going, but it runs
> > well.
> > > I
> > > > > have a few Crystal PC's here also that I may use instead, dual PIII
> > > 550's
> > > > > with 512MB ram and 9 or 18GB 10000rpm drives.  I'll probably use these
> > > for
> > > > > testing.
> > > >
> > > > I agree with the earlier poster that more spindles for your queue
> > > > (c/- raid) is a good thing in general.
> > > >
> > > > > The bulk of the messages will be the same content to many rcpt's.
> > > > However,
> > > > > once in awhile we'll have 100,000 different messages go out to 100,000
> > > > > different people.
> > > > >
> > > > > Since the QMQP support under mini-qmail doesn't load balance, can I
> > feed
> > > > it
> > > > > a hostname with multiple dns entries (round-robin dns)?  Or better
> > yet,
> > > > how
> > > > > easy would it be to modify the qmail code to just load balance between
> > > > them?
> > > >
> > > > The manpage for qmail-qmqpc tells us that they have to be IP addresses
> > > > in qmqpservers so a RR DNS won't help. If all of the messages are
> > > generated
> > > > on one machine, then I'd be inclined to go for a much simpler solution
> > > > than modifying qmail. I'd have an instance of qmail for each outbound
> > > > server with the appropriate qmqpservers entry, then have your queue
> > > > insertion script do a round-robin itself by simply cycling thru
> > > > the qmail-inject command associated with each instance.
> > > >
> > > > for instance in 1 2 3 4 5
> > > > do
> > > >     getnext_message_details()
> > > >     /var/qmail{$instance}/bin/qmail-inject currentmessage .... details
> > > > done
> > > >
> > > > Or some such.
> > > >
> > > >
> > > > Alternatively, if you have money to burn, maybe a layer four switch
> > > > with load-balancing skills.
> > > >
> > > >
> > > > Mark.
> > > >
> > > >
> > > > >
> > > > > Jay
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > > > > Sent: Friday, July 14, 2000 2:09 PM
> > > > > To: '[EMAIL PROTECTED]'
> > > > > Subject: Re: questions about performance and setup
> > > > >
> > > > >
> > > > > > Here's what I need to know:
> > > > > >
> > > > > > 1.  How well does qmail take advantage of multiple processors?  How
> > > much
> > > > >
> > > > > Indreectly, quite well as it forks many processes, thus if the OS
> > takes
> > > > > good advantage of your CPUs, then qmail inherits that advantage.
> > > > >
> > > > > > memory and disk will I need?  (we're at 50 million messages per
> > month
> > > > now,
> > > > >
> > > > > Are these message unique per target address or the same. If unique,
> > your
> > > > > requirements are vastly different and very queue/disk intensive. If
> > they
> > > > > are the same and you take advantage or VERP support on qmail, then
> > > > > your load will mainly be sending related which will benefit from
> > > > > more memory, multiple instances, etc.
> > > > >
> > > > > > and we only send out monday-friday, so that's over 2 million
> > messages
> > > > per
> > > > > > day, and it's only going up)
> > > > > >
> > > > > > 2.  How many messages per day would one estimate that each of these
> > > > > servers
> > > > > > could do?
> > > > > >
> > > > > > 3. I read about mini-qmail and how it's about 100 times faster
> > > blasting
> > > > > out
> > > > > > email to QMQP servers.  Since you can specify multiple QMQP servers,
> > > if
> > > > I
> > > > > > have a fourth machine running mini-qmail and managing the actual
> > > mailing
> > > > > > list, can I add the other 3 as QMQP servers and have it load balance
> > > > > between
> > > > > > all 3 for sending out mail?  (this way I could add more servers
> > easily
> > > > if
> > > > > I
> > > > > > needed to)
> > > > >
> > > > > The qmqp support doesn't load balance. It simply takes the first one
> > > > > it can connect to.
> > > > >
> > > > > > 4. Can I easily make qmail run an external script for each bounced
> > > mail?
> > > > >
> > > > > Absolutely.
> > > > >
> > > > > > 5.  Anything else I should know?
> > > > >
> > > > > That all hinges on whether your emails are unique for each recipient
> > or
> > > > > not. Or more importantly, the average number of recipients per unique
> > > > > email.
> > > > >
> > > > >
> > > > > Regards.
> > > >
> > >
> > >
> 



> We're in a similar situation at the moment.  However, we want to send out
> 100,000 UNIQUE emails per day, expanding to 500,000 or more in the near
> future.  Also, our send window is only actually a couple of hours.

  That shouldn't be too hard.  With a Pentium 233 (not a P-II, a regular
Pentium) attached to a 512k dsl line, using an IDE hard drive, I sent out
1,000 unique emails from a Perl script, the script took about 30 seconds to
run, and all (deliverable) remote messages were delivered in about 45
seconds.  That was with a concurrencyremote of 60.

  So, with equal hardware, 500,000 would take about 6 hours to run.
Considering that you have about 10 times the CPU of the machine I used, and
a much better disk, if you have a large enough pipe, you can turn the
concurrencyremote to 200 (or even more), and it should work out in a couple
of hours.

steve




Hi folks,

I'm new to managing bounces, so please bear with me.  I've had a very tough
time finding any good documentation which could guide me to building some
scripts to parse through my bounces and semi-automate them.  I do fairly
large mailings at a time, and I'd like to properly manage my bounces.
Basically, I'm curious to what everyone else is doing for managing bounces
and if anyone has any good online documentation they could point me to.

Any help would be appreciated.

Thanks,
Thomas



Hi,

my ISP has changed the mailsystem so that I have to change my
configuration too. They sent me an email in which they tell me to send my
user-id and password when sending mail. They call it ESMTP.

So far I used

/usr/local/bin/maildirsmtp ~alias/pppdir alias-ppp- sendmail.neubert.com
$IPADDR 

to send my mail. But if I try this now, I get the following error:

maildirserial: info: new/963816027.832.chakoty bounced: 209.231.49.20
said: 553 To send mail, first check your mail with a valid POP account;
this prevents unauthorized SPAM relaying. (#5.7.1) 

Does anybody know how to configure my site to use ESMTP?

Kind regards,
Tobias




Tobias Neubert a écrit :
> /usr/local/bin/maildirsmtp ~alias/pppdir alias-ppp- sendmail.neubert.com
> $IPADDR
> to send my mail. But if I try this now, I get the following error:
> maildirserial: info: new/963816027.832.chakoty bounced: 209.231.49.20
> said: 553 To send mail, first check your mail with a valid POP account;
> this prevents unauthorized SPAM relaying. (#5.7.1)
> Does anybody know how to configure my site to use ESMTP?

  This has nothing to do with ESMTP. Relaying is only allowed is you
check your mail with POP before, to authenticate yourself.
  You can do it with fetchmail, before running maildirsmtp.

  Best regards,
-- 
         Frank DENIS aka Jedi/Sector One aka DJ Chrysalis <[EMAIL PROTECTED]>
                -> Software : http://www.jedi.claranet.fr <-
      If Bill Gates had a dime for every time a Windows box crashed...
                  ...oh, wait a minute -- he already does.



      Hi all:  

                                                                   
   I use vpopmail+mysql+sqwebmail,and have installed vopopmail+mysql.  i think it is 
ok.
  then there is some problem when i install sqwebmail.
  
     i run ./configure --enalbe-authvchkpw --without-authpam
--without-authuserdb --without-authpwd --without-authshadow
--enable-webpass=no
 
   then run make
 
there is some error massage like this:
 ...
 /usr/local/vpopmail-4.8.4/vauth.c 537:undefined reference to 'mysql_free_result'
 /home/vpopmail/lib/libvpopmail.a vuth.o):infunction'vopen_smtp_relay':
 /usr/local/vpopmail-4.8.4/vauth.c 563:undefined reference to 'mysql_query'
 /usr/local/vpopmail-4.8.4/vauth.c 584:undefined reference to 'mysql_query'
 .
 .  
 .                                                              
 make[1]:***[authvchkpw] Error 1
 make:***[all-recursive] Error 1
 
/usr/local/vpopmail-4.8.4 is the path i unzip the tar file
/home/vpopmail is the path i install

even if i delete the path /usr/local/vpopmail-4.8.4 ,the error is the same.
i think  maybe mysql lib path is wrong, but i try to copy the mysql lib file to 
/usr/lib . but it is of no effect.

 Today i reinstall Redhat6.2+qmail+mysql+vpopmail, it is all ok.
 when i install sqwebmail, it is the same error.

i am very vey anxious and will appreciate for ur help.  pls reply asap.



                  

           
            [EMAIL PROTECTED]




Hello,
i have a problem i didn't find in the archive.
I run qmail on solaris 2.6 and it works fine with one
restriction. Every message sent with qmail or recieved with qmail
gets a:" content length:  0"  as body. I think the problem lies in the rc file
i use but i can't find the mistake
My rc file:
#!/bin/sh

# Using splogger to send the log through syslog.
# Using dot-forward to support sendmail-style ~/.forward files.
# Using binmail to deliver messages to /var/spool/mail/$USER by default.
# Using BSD 4.4 binmail interface: /usr/libexec/mail.local -r

exec env - PATH="/var/qmail/bin:$PATH" qmail-start '|dot-forward .forward \ 
|preline -f /usr/lib/mail.local -f "${SENDER:-MAILER-DAEMON}" "$USER"' \
splogger  qmail

Thanks for any sugestions in advance

Georg Thoma



-- 
Georg Thoma             Tel. 0731/6020123
Suedblick 3         [EMAIL PROTECTED]
89075 Ulm

Reply via email to