Re: [qmailtoaster] Load-balancing in SMTP route

[Hasan Akgöz]

Hi ;

Multiple MX records can be defined for a domain, each with a different
priority where the lowest number is the highest priority. If mail can't be
delivered using the first priority record, the second priority record is
used, and so on. you can create a second "MX" record for mail server.


2013/10/28 Amit Dalia 

> Hi,
>
> ** **
>
> Can we set load balancing in smtproute. I have a broadband connection with
> dynamic ip and currently all emails are getting relayed from my smtp
> server. But if this smtp relay server get down all emails get stuck in
> queue.
>
> Can I define 1 more smtproute entry so if first server is down then it
> will automatically relay mails from second smtp server.
>
> ** **
>
>
>
> *Amit Dalia * 
>
> ** **
>
>
> --
>
>
> This email is free from viruses and malware because avast! 
> Antivirusprotection is active.
>
>

[qmailtoaster] Load-balancing in SMTP route

[Amit Dalia]

Hi,

 

Can we set load balancing in smtproute. I have a broadband connection with
dynamic ip and currently all emails are getting relayed from my smtp server.
But if this smtp relay server get down all emails get stuck in queue.

Can I define 1 more smtproute entry so if first server is down then it will
automatically relay mails from second smtp server.

 



Amit Dalia  

 



---
This email is free from viruses and malware because avast! Antivirus protection 
is active.
http://www.avast.com

RE: [qmailtoaster] Load balancing

[Dairenn Lombard]

Hi Kyle,

It's probably going to take a while for Qmail to hammer through its
queue, and deal with everything that simscan still has to handle.  You
probably wont notice a difference for a few hours, or even tomorrow.

regards,
Dairenn Lombard
Linux Engineer, Systems Administration Department
BroadSpire, Inc.
-
Hosting | Colocation | Design


> -Original Message-
> From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
> Sent: Friday, May 23, 2008 1:01 PM
> To: qmailtoaster-list@qmailtoaster.com
> Subject: RE: [qmailtoaster] Load balancing
> 
> 
> Well all,
> 
> After doing everything in here except the firewall rules and 
> with the reordering of the RBL's server loads are 1.14, 1.37, 
> 1.46.  They seem to be staying that way consistently only 
> time will tell though.  If things kick up a little I will 
> drop the Firewall rules in. 
> 
> I want to say thanks to everyone for the help.  The Dups seem 
> to have stopped as well. 
> 
> This is my server 
> Intel xeon Dual cpu 3.2ghz 6 gigs of ram with 500 gig scsi drives. 
> 
> I have almost 2000 email accounts on 3 domains and this box 
> also does mail cleaning for a fourth. 
> 
> Thank you very much 
> Kyle 
> 
> 
>  
> 
> 
> On Fri, 2008-05-23 at 10:50 -0700, Dairenn Lombard wrote:
> > Hi Kyle,
> > 
> > We have the same issue with our toasters.
> > 
> > The long and short of it is, try to keep your total mail 
> users under 
> > about 1,000 (this usually works out to about 100-200 domains).  
> > Anything over that, and you should deploy another mail server.
> > 
> > When a remote SMTP server connects to your Qmail Toaster 
> and delivers 
> > a message, it is timing out awaiting for Qmail to send back an 
> > acknowledgement it got your message, because, for some 
> weird reason, 
> > Qmail waits until after simscan has finished processing 
> (which itself 
> > is waiting for clamav and spamassassin to do the actual processing) 
> > before returning such an acknowledgement.
> > 
> > Several other things can cause duplicates too like POP3 clients 
> > leaving a copy of mail messages on the server and then 
> losing track of 
> > what it's already downloaded (a common scenario when the 
> client has to 
> > go through a local anti-virus application on the mail user's 
> > computer).  But also, bad .qmail files in the user's vpopmail 
> > directory can cause delivery to happen two times.
> > 
> > That's easy to fix.  What's not easy is taming spamassassin and 
> > clamav. We have had to do a lot of work--a lot more than I feel we 
> > should have had to for a proported out-of-the-box solution--to keep 
> > spamassassin and clamav from killing your mail server...
> > 
> > First of all, throttle SMTP traffic with iptables to 
> prevent excessive 
> > connections (and resultant spamd/clamd instances) in the 
> first place:
> > 
> > -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp 
> --dport 25 
> > -m recent --set -A RH-Firewall-1-INPUT -m state --state NEW 
> -m tcp -p 
> > tcp --dport 25 -m recent --update --seconds 60 --hitcount 12 -j DROP
> > 
> > (works in typical CentOS/RedHat /etc/sysconfig/iptables files)
> > 
> > Then, SERIOUSLY change how spamd starts and runs:
> > 
> > /var/qmail/supervise/spamd/run:
> > 
> > #!/bin/sh
> > exec /bin/nice --adjustment=20 /usr/bin/spamd -m 4 --max-children=2 
> > --max-conn-per-child=15 -l -L -x -u vpopmail -s stderr 2>&1
> > 
> > Tweak /etc/mail/spamassassin/local.cf:
> > 
> > ok_locales all
> > skip_rbl_checks 0
> > rbl_timeout 5
> > 
> > required_hits 5
> > report_safe 0
> > rewrite_header Subject ***SPAM***
> > 
> > use_pyzor 1
> > 
> > # Use for any MTA servers from which you want to trust will 
> not spam 
> > you, such as another server in your # own network.
> > # trusted_networks 127.0.0.1/18
> > # If you use Postini, uncomment this line:
> > # trusted_networks 64.18.6.10
> > 
> > 
> > use_auto_whitelist 0
> > 
> > use_bayes 1
> > use_bayes_rules 1
> > bayes_auto_learn 1
> > bayes_auto_expire 1
> > bayes_expiry_max_db_size 18750
> > 
> > # Inserted to ignore all mail from Postini, if you use it, 
> and pass it 
> > on unmodified # This should lessen our overall load.
> > bayes_ignore_header X-pstn-levels
> > 
> > Make sure to be running THE most current version of 
> SpamAssassin and 
> > ClamAV (SpamAssassin in particular is exceedingly

RE: [qmailtoaster] Load balancing

[Kyle Quillen]

:.cla:.class:.cmd:.com:.cpl:.crt:.csh:.dll:.dot:.email:.
> eml:.exe:.fxp:.hlp:.hta:.inf:.ins:.isp:.js:.jse:.ksh:.lnk:.mda:.mdb:.mde
> :.mdt:.mdw:.mdz:.mpe:.msc:.msi:.msp:.mst:.nws:.ocx:.ops:.pcd:.pif:.pl:.p
> m:.pot:.prf:.prg:.ps:.reg:.scf:.scr:.sct:.shb:.shm:.shs:.url:.vb:.vbe:.v
> bs:.vxd:.wmd:.wmf:.wms:.wmz:.wsc:.wsf:.wsh:.wsz:.xsl:.xlt:.xlw
> 
> Be sure to run qmailctl cdb to rehash the simcontrol.cdb file.
> 
> Finally, we've decided to not allow catch-all aliases.  This has been
> the single biggest helpful thing we have done to resolve high load
> issues on our mail servers.  I can't tell you how badly your mail server
> can get beat up by a domain catch-all accepting loads of spam.  (Just
> look at your MRTG or ISOQLOG pages, and you'll see what I mean.)  So,
> you'll want to set catchall to BOUNCE (not delete, because it goes
> through the ENTIRE process of accepting an e-mail before finally
> realizing it should be deleted).  Here's a way to do this to the entire
> mail server:
> 
> Make a file called .qmail-default in /usr/local/etc that looks like
> this:
> 
> | /home/vpopmail/bin/vdelivermail '' bounce-no-mailbox
> 
> Then run this command:
> 
> find /home/vpopmail/domains -name ".qmail-default" -type f -exec /bin/cp
> -rp /usr/local/etc/.qmail-default {} \;
> 
> I was able to get mail servers running loads in excess of 7-14 down to a
> nominal average of .55 (on servers running 700-900 domains or over 2,000
> mailboxes), and I've been able to get the queues down from an average of
> hundreds of messages to dozens.
> 
> Do these things at your own risk.  I Rarely check this mailing list so
> definitely test, experiment and investigate these settings on a
> NON-production server first before trying it out on a mail server you
> have any paying customers use.  If it works out for you, and I sincerely
> hope it does, please pass on the knowledge.
> 
> 
> regards,
> Dairenn Lombard
> BroadSpire, Inc.
> Linux Engineer, Systems Administration Dept.
> -
> Hosting | Colocation | Design
> 
> 
> 
> 
> > -Original Message-
> > From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
> > Sent: Friday, May 23, 2008 9:33 AM
> > To: qmailtoaster-list@qmailtoaster.com
> > Subject: Re: [qmailtoaster] Load balancing
> > 
> > 
> > Spamdyke is installed and has been for about a week It has 
> > seemed to help but my loads are still staying around 3.5-4.5
> > 
> > The largest problem that I have right now is that users are 
> > getting duplicate emails and I can't figure out how to stop it. 
> > 
> > Since I implemented the greylisting things seem to be calming 
> > a little bit but the dups are still coming in. I have gotten 
> > multiple copies of emails that were sent yesterday  at like 
> > 1030 in the am and i did get them.
> > 
> > Suggestions?
> > 
> > 
> > thanks
> > q
> > 
> > 
> > 
> > On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
> > > Kyle Quillen wrote:
> > > > All,
> > > > 
> > > > Does anyone have any resources that I can pull from that 
> > will point 
> > > > me in the direction of setting up load balancing with the 
> > toaster?  
> > > > I want to keep using this mail server but I have to find a way to 
> > > > deal with the large amount of mail that I am having to 
> > process.  It 
> > > > is mostly spam so maybe what I am looking for is a spam 
> > scanning system.
> > > > 
> > > > Thoughts?
> > > > 
> > > 
> > > Spamdyke.
> > > Do it.
> > > 
> > -- 
> > Thanks,
> > Kyle Quillen
> > Lightspeed Wireless
> > [EMAIL PROTECTED]
> > 330.473.1231 ext.202
> 
> -
>  QmailToaster hosted by: VR Hosted <http://www.vr.org>
> -
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: [EMAIL PROTECTED]
> 
> 
-- 
Thanks,
Kyle Quillen
Lightspeed Wireless
[EMAIL PROTECTED]
330.473.1231 ext.202


-
 QmailToaster hosted by: VR Hosted <http://www.vr.org>
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Eric Shubert]

That's a good question, Sergio. It's possible that one or more of these is
part of Kyle's problem.

.) Put the heavy hitters first (such as spamhaus). With spamhaus first, you
might not get many hits with some of the others, making them pretty much
useless.
.) dsbl.org is no longer active

FWIW, I presently use only:
check-dnsrbl=zen.spamhaus.org
check-dnsrbl=bl.spamcop.net

Sergio Minini {NETKEY} wrote:
> List,
> If i were to choose a couple of these RBLs, which ones should I choose?
> I mean a couple to avoid creating a lot of queries and adding more connection
> time.
> Thanks.
> 
> 
>> -Original Message-
>>
>> Spamdyke.conf
>>
>> check-dnsrbl=zombie.dnsbl.sorbs.net
>> check-dnsrbl=dul.dnsbl.sorbs.net
>> check-dnsrbl=bogons.cymru.com
>> check-dnsrbl=zen.spamhaus.org
>> check-dnsrbl=bl.spamcop.net
>> check-dnsrbl=list.dsbl.org
>>
> 



-- 
-Eric 'shubes'

-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Eric Shubert]

.email:.
> eml:.exe:.fxp:.hlp:.hta:.inf:.ins:.isp:.js:.jse:.ksh:.lnk:.mda:.mdb:.mde
> :.mdt:.mdw:.mdz:.mpe:.msc:.msi:.msp:.mst:.nws:.ocx:.ops:.pcd:.pif:.pl:.p
> m:.pot:.prf:.prg:.ps:.reg:.scf:.scr:.sct:.shb:.shm:.shs:.url:.vb:.vbe:.v
> bs:.vxd:.wmd:.wmf:.wms:.wmz:.wsc:.wsf:.wsh:.wsz:.xsl:.xlt:.xlw
> 
> Be sure to run qmailctl cdb to rehash the simcontrol.cdb file.
> 
> Finally, we've decided to not allow catch-all aliases.  This has been
> the single biggest helpful thing we have done to resolve high load
> issues on our mail servers.  I can't tell you how badly your mail server
> can get beat up by a domain catch-all accepting loads of spam.  (Just
> look at your MRTG or ISOQLOG pages, and you'll see what I mean.)  So,
> you'll want to set catchall to BOUNCE (not delete, because it goes
> through the ENTIRE process of accepting an e-mail before finally
> realizing it should be deleted).  Here's a way to do this to the entire
> mail server:
> 
> Make a file called .qmail-default in /usr/local/etc that looks like
> this:
> 
> | /home/vpopmail/bin/vdelivermail '' bounce-no-mailbox
> 
> Then run this command:
> 
> find /home/vpopmail/domains -name ".qmail-default" -type f -exec /bin/cp
> -rp /usr/local/etc/.qmail-default {} \;
> 
> I was able to get mail servers running loads in excess of 7-14 down to a
> nominal average of .55 (on servers running 700-900 domains or over 2,000
> mailboxes), and I've been able to get the queues down from an average of
> hundreds of messages to dozens.
> 
> Do these things at your own risk.  I Rarely check this mailing list so
> definitely test, experiment and investigate these settings on a
> NON-production server first before trying it out on a mail server you
> have any paying customers use.  If it works out for you, and I sincerely
> hope it does, please pass on the knowledge.
> 
> 
> regards,
> Dairenn Lombard
> BroadSpire, Inc.
> Linux Engineer, Systems Administration Dept.
> -
> Hosting | Colocation | Design
> 
> 
> 
> 
>> -Original Message-
>> From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
>> Sent: Friday, May 23, 2008 9:33 AM
>> To: qmailtoaster-list@qmailtoaster.com
>> Subject: Re: [qmailtoaster] Load balancing
>>
>>
>> Spamdyke is installed and has been for about a week It has 
>> seemed to help but my loads are still staying around 3.5-4.5
>>
>> The largest problem that I have right now is that users are 
>> getting duplicate emails and I can't figure out how to stop it. 
>>
>> Since I implemented the greylisting things seem to be calming 
>> a little bit but the dups are still coming in. I have gotten 
>> multiple copies of emails that were sent yesterday  at like 
>> 1030 in the am and i did get them.
>>
>> Suggestions?
>>
>>
>> thanks
>> q
>>
>>
>>
>> On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
>>> Kyle Quillen wrote:
>>>> All,
>>>>
>>>> Does anyone have any resources that I can pull from that 
>> will point 
>>>> me in the direction of setting up load balancing with the 
>> toaster?  
>>>> I want to keep using this mail server but I have to find a way to 
>>>> deal with the large amount of mail that I am having to 
>> process.  It 
>>>> is mostly spam so maybe what I am looking for is a spam 
>> scanning system.
>>>> Thoughts?
>>>>
>>> Spamdyke.
>>> Do it.
>>>
>> -- 
>> Thanks,
>> Kyle Quillen
>> Lightspeed Wireless
>> [EMAIL PROTECTED]
>> 330.473.1231 ext.202
> 


-- 
-Eric 'shubes'

-
 QmailToaster hosted by: VR Hosted <http://www.vr.org>
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

RE: [qmailtoaster] Load balancing

[Sergio Minini {NETKEY}]

After a trial-error approach, I set mine to 400. Maybe in better hardware is too
high, but's been working fine in my old server.
I found out this helped when I got dups with large attachments.
Sergio

> -Original Message-
> From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
> Sent: Friday, May 23, 2008 3:33 PM
> To: qmailtoaster-list@qmailtoaster.com
> Subject: RE: [qmailtoaster] Load balancing
> 
> 
> What would you suggest moving this setting to?
> 
> thanks
> q
> 
> 
> 
> On Fri, 2008-05-23 at 15:11 -0300, Sergio Minini {NETKEY} wrote:
> > Kyle,
> > Maybe you could try raising the idle-timeout-secs value.
> > 
> > \Sergio
> > 
> > > -Original Message-
> > > From: Kyle Quillen [mailto:[EMAIL PROTECTED]
> > > Sent: Friday, May 23, 2008 2:50 PM
> > > To: qmailtoaster-list@qmailtoaster.com
> > > Subject: Re: [qmailtoaster] Load balancing
> > > 
> > > 
> > > 
> > > My spamdyke.conf is below along with my package versions.
> > > 
> > > Dups seem to be slowing down but then my load averages are
> > > coming down as well
> > > 
> > > 
> > > Spamdyke.conf
> > > 
> > > check-dnsrbl=zombie.dnsbl.sorbs.net
> > > check-dnsrbl=dul.dnsbl.sorbs.net check-dnsrbl=bogons.cymru.com
> > > check-dnsrbl=zen.spamhaus.org
> > > check-dnsrbl=bl.spamcop.net
> > > check-dnsrbl=list.dsbl.org
> > > graylist-dir=/var/spamdyke/graylist
> > > graylist-max-secs=2678400
> > > graylist-min-secs=80
> > > greeting-delay-secs=5
> > > idle-timeout-secs=60 ip-blacklist-file=/etc/spamdyke/blacklist_ip
> > > ip-in-rdns-keyword-file=/etc/spamdyke/blacklist_keywords
> > > ip-whitelist-file=/etc/spamdyke/whitelist_ip
> > > local-domains-file=/var/qmail/control/rcpthosts
> > > log-level=2
> > > log-target=0
> > > max-recipients=25
> > > #policy-url=http://my.policy.explanation.url/
> > > rdns-blacklist-file=/etc/spamdyke/blacklist_rdns
> > > rdns-whitelist-file=/etc/spamdyke/whitelist_rdns
> > > recipient-blacklist-file=/etc/spamdyke/blacklist_recipients
> > > reject-empty-rdns
> > > reject-ip-in-cc-rdns
> > > reject-missing-sender-mx
> > > reject-unresolvable-rdns 
> > > sender-blacklist-file=/etc/spamdyke/blacklist_senders
> > > tls-certificate-file=/var/qmail/control/servercert.pem
> > > 
> > > 
> > > 
> > > qtp-whatami v0.3
> > > DISTRO=CentOS
> > > OSVER=5
> > > QTARCH=i686
> > > BUILD_DIST=cnt50
> > > BUILD_DIR=/usr/src/redhat
> > > This machine's OS is supported, but this version/arch has not
> > > been tested.
> > > 
> > > 
> > > average scan times seem to be 2.1-2.7
> > > 
> > > My packages are all current except for clamav
> > > 
> > > Thanks
> > > q
> > > 
> > > 
> > > 
> > > 
> > > On Fri, 2008-05-23 at 10:20 -0700, Eric Shubert wrote:
> > > > The dups are understandable. I'm guessing that the smtp
> > > sessions are
> > > > timing out because the load is high and subsequently scanning is
> > > > taking a long time. How long are scans taking typically?
> > > > 
> > > > Please post your spamdyke.conf file.
> > > > 
> > > > What toaster package versions are you running?
> > > > 
> > > > Are you seeing clamav eating your cpu?
> > > > 
> > > > Kyle Quillen wrote:
> > > > > Spamdyke is installed and has been for about a week It
> > > has seemed to
> > > > > help but my loads are still staying around 3.5-4.5
> > > > > 
> > > > > The largest problem that I have right now is that users
> > > are getting
> > > > > duplicate emails and I can't figure out how to stop it.
> > > > > 
> > > > > Since I implemented the greylisting things seem to be 
> calming a
> > > > > little bit but the dups are still coming in. I have 
> > > gotten multiple
> > > > > copies of emails that were sent yesterday  at like 
> 1030 in the 
> > > > > am
> > > > > and i did get them.
> > > > > 
> > > > > Suggestions?
> > > > > 
> > > > > 
> > > > > thanks
> > > > > q
> > > > > 
> > > > > 
> > > >

RE: [qmailtoaster] Load balancing

[Kyle Quillen]

What would you suggest moving this setting to?

thanks
q



On Fri, 2008-05-23 at 15:11 -0300, Sergio Minini {NETKEY} wrote:
> Kyle,
> Maybe you could try raising the idle-timeout-secs value.
> 
> \Sergio
> 
> > -Original Message-
> > From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
> > Sent: Friday, May 23, 2008 2:50 PM
> > To: qmailtoaster-list@qmailtoaster.com
> > Subject: Re: [qmailtoaster] Load balancing
> > 
> > 
> > 
> > My spamdyke.conf is below along with my package versions.
> > 
> > Dups seem to be slowing down but then my load averages are 
> > coming down as well
> > 
> > 
> > Spamdyke.conf
> > 
> > check-dnsrbl=zombie.dnsbl.sorbs.net
> > check-dnsrbl=dul.dnsbl.sorbs.net
> > check-dnsrbl=bogons.cymru.com
> > check-dnsrbl=zen.spamhaus.org
> > check-dnsrbl=bl.spamcop.net
> > check-dnsrbl=list.dsbl.org
> > graylist-dir=/var/spamdyke/graylist
> > graylist-max-secs=2678400
> > graylist-min-secs=80
> > greeting-delay-secs=5
> > idle-timeout-secs=60 ip-blacklist-file=/etc/spamdyke/blacklist_ip
> > ip-in-rdns-keyword-file=/etc/spamdyke/blacklist_keywords
> > ip-whitelist-file=/etc/spamdyke/whitelist_ip
> > local-domains-file=/var/qmail/control/rcpthosts
> > log-level=2
> > log-target=0
> > max-recipients=25
> > #policy-url=http://my.policy.explanation.url/
> > rdns-blacklist-file=/etc/spamdyke/blacklist_rdns
> > rdns-whitelist-file=/etc/spamdyke/whitelist_rdns
> > recipient-blacklist-file=/etc/spamdyke/blacklist_recipients
> > reject-empty-rdns
> > reject-ip-in-cc-rdns
> > reject-missing-sender-mx
> > reject-unresolvable-rdns 
> > sender-blacklist-file=/etc/spamdyke/blacklist_senders
> > tls-certificate-file=/var/qmail/control/servercert.pem
> > 
> > 
> > 
> > qtp-whatami v0.3
> > DISTRO=CentOS
> > OSVER=5
> > QTARCH=i686
> > BUILD_DIST=cnt50
> > BUILD_DIR=/usr/src/redhat
> > This machine's OS is supported, but this version/arch has not 
> > been tested.
> > 
> > 
> > average scan times seem to be 2.1-2.7
> > 
> > My packages are all current except for clamav
> > 
> > Thanks
> > q
> > 
> > 
> > 
> > 
> > On Fri, 2008-05-23 at 10:20 -0700, Eric Shubert wrote:
> > > The dups are understandable. I'm guessing that the smtp 
> > sessions are 
> > > timing out because the load is high and subsequently scanning is 
> > > taking a long time. How long are scans taking typically?
> > > 
> > > Please post your spamdyke.conf file.
> > > 
> > > What toaster package versions are you running?
> > > 
> > > Are you seeing clamav eating your cpu?
> > > 
> > > Kyle Quillen wrote:
> > > > Spamdyke is installed and has been for about a week It 
> > has seemed to 
> > > > help but my loads are still staying around 3.5-4.5
> > > > 
> > > > The largest problem that I have right now is that users 
> > are getting 
> > > > duplicate emails and I can't figure out how to stop it.
> > > > 
> > > > Since I implemented the greylisting things seem to be calming a 
> > > > little bit but the dups are still coming in. I have 
> > gotten multiple 
> > > > copies of emails that were sent yesterday  at like 1030 in the am 
> > > > and i did get them.
> > > > 
> > > > Suggestions?
> > > > 
> > > > 
> > > > thanks
> > > > q
> > > > 
> > > > 
> > > > 
> > > > On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
> > > >> Kyle Quillen wrote:
> > > >>> All,
> > > >>>
> > > >>> Does anyone have any resources that I can pull from that will 
> > > >>> point me in the direction of setting up load balancing with the 
> > > >>> toaster?  I want to keep using this mail server but I 
> > have to find 
> > > >>> a way to deal with the large amount of mail that I am having to 
> > > >>> process.  It is mostly spam so maybe what I am looking 
> > for is a spam scanning system.
> > > >>>
> > > >>> Thoughts?
> > > >>>
> > > >> Spamdyke.
> > > >> Do it.
> > > >>
> > > 
> > > 
> > -- 
> > Thanks,
> > Kyle Quillen
> > Lightspeed Wireless
> > [EMAIL PROTECTED]
> > 330.473.1231 ext.202
> > 
> > 
> > -
> >  QmailToaster hosted by: VR Hosted <http://www.vr.org>
> > -
> > To unsubscribe, e-mail: [EMAIL PROTECTED]
> > For additional commands, e-mail: 
> > [EMAIL PROTECTED]
> > 
> 
> 
> -
>  QmailToaster hosted by: VR Hosted <http://www.vr.org>
> -
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: [EMAIL PROTECTED]
> 
> 
-- 
Thanks,
Kyle Quillen
Lightspeed Wireless
[EMAIL PROTECTED]
330.473.1231 ext.202


-
 QmailToaster hosted by: VR Hosted <http://www.vr.org>
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

RE: [qmailtoaster] Load balancing

[Sergio Minini {NETKEY}]

Kyle,
Maybe you could try raising the idle-timeout-secs value.

\Sergio

> -Original Message-
> From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
> Sent: Friday, May 23, 2008 2:50 PM
> To: qmailtoaster-list@qmailtoaster.com
> Subject: Re: [qmailtoaster] Load balancing
> 
> 
> 
> My spamdyke.conf is below along with my package versions.
> 
> Dups seem to be slowing down but then my load averages are 
> coming down as well
> 
> 
> Spamdyke.conf
> 
> check-dnsrbl=zombie.dnsbl.sorbs.net
> check-dnsrbl=dul.dnsbl.sorbs.net
> check-dnsrbl=bogons.cymru.com
> check-dnsrbl=zen.spamhaus.org
> check-dnsrbl=bl.spamcop.net
> check-dnsrbl=list.dsbl.org
> graylist-dir=/var/spamdyke/graylist
> graylist-max-secs=2678400
> graylist-min-secs=80
> greeting-delay-secs=5
> idle-timeout-secs=60 ip-blacklist-file=/etc/spamdyke/blacklist_ip
> ip-in-rdns-keyword-file=/etc/spamdyke/blacklist_keywords
> ip-whitelist-file=/etc/spamdyke/whitelist_ip
> local-domains-file=/var/qmail/control/rcpthosts
> log-level=2
> log-target=0
> max-recipients=25
> #policy-url=http://my.policy.explanation.url/
> rdns-blacklist-file=/etc/spamdyke/blacklist_rdns
> rdns-whitelist-file=/etc/spamdyke/whitelist_rdns
> recipient-blacklist-file=/etc/spamdyke/blacklist_recipients
> reject-empty-rdns
> reject-ip-in-cc-rdns
> reject-missing-sender-mx
> reject-unresolvable-rdns 
> sender-blacklist-file=/etc/spamdyke/blacklist_senders
> tls-certificate-file=/var/qmail/control/servercert.pem
> 
> 
> 
> qtp-whatami v0.3
> DISTRO=CentOS
> OSVER=5
> QTARCH=i686
> BUILD_DIST=cnt50
> BUILD_DIR=/usr/src/redhat
> This machine's OS is supported, but this version/arch has not 
> been tested.
> 
> 
> average scan times seem to be 2.1-2.7
> 
> My packages are all current except for clamav
> 
> Thanks
> q
> 
> 
> 
> 
> On Fri, 2008-05-23 at 10:20 -0700, Eric Shubert wrote:
> > The dups are understandable. I'm guessing that the smtp 
> sessions are 
> > timing out because the load is high and subsequently scanning is 
> > taking a long time. How long are scans taking typically?
> > 
> > Please post your spamdyke.conf file.
> > 
> > What toaster package versions are you running?
> > 
> > Are you seeing clamav eating your cpu?
> > 
> > Kyle Quillen wrote:
> > > Spamdyke is installed and has been for about a week It 
> has seemed to 
> > > help but my loads are still staying around 3.5-4.5
> > > 
> > > The largest problem that I have right now is that users 
> are getting 
> > > duplicate emails and I can't figure out how to stop it.
> > > 
> > > Since I implemented the greylisting things seem to be calming a 
> > > little bit but the dups are still coming in. I have 
> gotten multiple 
> > > copies of emails that were sent yesterday  at like 1030 in the am 
> > > and i did get them.
> > > 
> > > Suggestions?
> > > 
> > > 
> > > thanks
> > > q
> > > 
> > > 
> > > 
> > > On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
> > >> Kyle Quillen wrote:
> > >>> All,
> > >>>
> > >>> Does anyone have any resources that I can pull from that will 
> > >>> point me in the direction of setting up load balancing with the 
> > >>> toaster?  I want to keep using this mail server but I 
> have to find 
> > >>> a way to deal with the large amount of mail that I am having to 
> > >>> process.  It is mostly spam so maybe what I am looking 
> for is a spam scanning system.
> > >>>
> > >>> Thoughts?
> > >>>
> > >> Spamdyke.
> > >> Do it.
> > >>
> > 
> > 
> -- 
> Thanks,
> Kyle Quillen
> Lightspeed Wireless
> [EMAIL PROTECTED]
> 330.473.1231 ext.202
> 
> 
> -
>  QmailToaster hosted by: VR Hosted <http://www.vr.org>
> -
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: 
> [EMAIL PROTECTED]
> 


-
 QmailToaster hosted by: VR Hosted <http://www.vr.org>
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

RE: [qmailtoaster] Load balancing

[Sergio Minini {NETKEY}]

List,
If i were to choose a couple of these RBLs, which ones should I choose?
I mean a couple to avoid creating a lot of queries and adding more connection
time.
Thanks.


> -Original Message-
> 
> Spamdyke.conf
> 
> check-dnsrbl=zombie.dnsbl.sorbs.net
> check-dnsrbl=dul.dnsbl.sorbs.net
> check-dnsrbl=bogons.cymru.com
> check-dnsrbl=zen.spamhaus.org
> check-dnsrbl=bl.spamcop.net
> check-dnsrbl=list.dsbl.org
> 


-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

RE: [qmailtoaster] Load balancing

[Dairenn Lombard]

mail-default" -type f -exec /bin/cp
-rp /usr/local/etc/.qmail-default {} \;

I was able to get mail servers running loads in excess of 7-14 down to a
nominal average of .55 (on servers running 700-900 domains or over 2,000
mailboxes), and I've been able to get the queues down from an average of
hundreds of messages to dozens.

Do these things at your own risk.  I Rarely check this mailing list so
definitely test, experiment and investigate these settings on a
NON-production server first before trying it out on a mail server you
have any paying customers use.  If it works out for you, and I sincerely
hope it does, please pass on the knowledge.


regards,
Dairenn Lombard
BroadSpire, Inc.
Linux Engineer, Systems Administration Dept.
-
Hosting | Colocation | Design




> -Original Message-
> From: Kyle Quillen [mailto:[EMAIL PROTECTED] 
> Sent: Friday, May 23, 2008 9:33 AM
> To: qmailtoaster-list@qmailtoaster.com
> Subject: Re: [qmailtoaster] Load balancing
> 
> 
> Spamdyke is installed and has been for about a week It has 
> seemed to help but my loads are still staying around 3.5-4.5
> 
> The largest problem that I have right now is that users are 
> getting duplicate emails and I can't figure out how to stop it. 
> 
> Since I implemented the greylisting things seem to be calming 
> a little bit but the dups are still coming in. I have gotten 
> multiple copies of emails that were sent yesterday  at like 
> 1030 in the am and i did get them.
> 
> Suggestions?
> 
> 
> thanks
> q
> 
> 
> 
> On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
> > Kyle Quillen wrote:
> > > All,
> > > 
> > > Does anyone have any resources that I can pull from that 
> will point 
> > > me in the direction of setting up load balancing with the 
> toaster?  
> > > I want to keep using this mail server but I have to find a way to 
> > > deal with the large amount of mail that I am having to 
> process.  It 
> > > is mostly spam so maybe what I am looking for is a spam 
> scanning system.
> > > 
> > > Thoughts?
> > > 
> > 
> > Spamdyke.
> > Do it.
> > 
> -- 
> Thanks,
> Kyle Quillen
> Lightspeed Wireless
> [EMAIL PROTECTED]
> 330.473.1231 ext.202

-
 QmailToaster hosted by: VR Hosted <http://www.vr.org>
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Kyle Quillen]

My spamdyke.conf is below along with my package versions.

Dups seem to be slowing down but then my load averages are coming down
as well


Spamdyke.conf

check-dnsrbl=zombie.dnsbl.sorbs.net
check-dnsrbl=dul.dnsbl.sorbs.net
check-dnsrbl=bogons.cymru.com
check-dnsrbl=zen.spamhaus.org
check-dnsrbl=bl.spamcop.net
check-dnsrbl=list.dsbl.org
graylist-dir=/var/spamdyke/graylist
graylist-max-secs=2678400
graylist-min-secs=80
greeting-delay-secs=5
idle-timeout-secs=60
ip-blacklist-file=/etc/spamdyke/blacklist_ip
ip-in-rdns-keyword-file=/etc/spamdyke/blacklist_keywords
ip-whitelist-file=/etc/spamdyke/whitelist_ip
local-domains-file=/var/qmail/control/rcpthosts
log-level=2
log-target=0
max-recipients=25
#policy-url=http://my.policy.explanation.url/
rdns-blacklist-file=/etc/spamdyke/blacklist_rdns
rdns-whitelist-file=/etc/spamdyke/whitelist_rdns
recipient-blacklist-file=/etc/spamdyke/blacklist_recipients
reject-empty-rdns
reject-ip-in-cc-rdns
reject-missing-sender-mx
reject-unresolvable-rdns
sender-blacklist-file=/etc/spamdyke/blacklist_senders
tls-certificate-file=/var/qmail/control/servercert.pem



qtp-whatami v0.3
DISTRO=CentOS
OSVER=5
QTARCH=i686
BUILD_DIST=cnt50
BUILD_DIR=/usr/src/redhat
This machine's OS is supported, but this version/arch has not been
tested.


average scan times seem to be 2.1-2.7

My packages are all current except for clamav

Thanks
q




On Fri, 2008-05-23 at 10:20 -0700, Eric Shubert wrote:
> The dups are understandable. I'm guessing that the smtp sessions are timing
> out because the load is high and subsequently scanning is taking a long
> time. How long are scans taking typically?
> 
> Please post your spamdyke.conf file.
> 
> What toaster package versions are you running?
> 
> Are you seeing clamav eating your cpu?
> 
> Kyle Quillen wrote:
> > Spamdyke is installed and has been for about a week It has seemed to
> > help but my loads are still staying around 3.5-4.5
> > 
> > The largest problem that I have right now is that users are getting
> > duplicate emails and I can't figure out how to stop it. 
> > 
> > Since I implemented the greylisting things seem to be calming a little
> > bit but the dups are still coming in. I have gotten multiple copies of
> > emails that were sent yesterday  at like 1030 in the am and i did get
> > them.
> > 
> > Suggestions?
> > 
> > 
> > thanks
> > q
> > 
> > 
> > 
> > On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
> >> Kyle Quillen wrote:
> >>> All,
> >>>
> >>> Does anyone have any resources that I can pull from that will point me
> >>> in the direction of setting up load balancing with the toaster?  I want
> >>> to keep using this mail server but I have to find a way to deal with the
> >>> large amount of mail that I am having to process.  It is mostly spam so
> >>> maybe what I am looking for is a spam scanning system.  
> >>>
> >>> Thoughts?
> >>>
> >> Spamdyke.
> >> Do it.
> >>
> 
> 
-- 
Thanks,
Kyle Quillen
Lightspeed Wireless
[EMAIL PROTECTED]
330.473.1231 ext.202


-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Eric Shubert]

Have you enabled
reject-ip-in-cc-rdns
in /etc/spamdyke/spamdyke.conf ?
That's turned off by default, but is effective at filtering non-US IPs.

Kyle Quillen wrote:
> Spamdyke is installed and has been for about a week It has seemed to
> help but my loads are still staying around 3.5-4.5
> 
> The largest problem that I have right now is that users are getting
> duplicate emails and I can't figure out how to stop it. 
> 
> Since I implemented the greylisting things seem to be calming a little
> bit but the dups are still coming in. I have gotten multiple copies of
> emails that were sent yesterday  at like 1030 in the am and i did get
> them.
> 
> Suggestions?
> 
> 
> thanks
> q
> 
> 
> 
> On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
>> Kyle Quillen wrote:
>>> All,
>>>
>>> Does anyone have any resources that I can pull from that will point me
>>> in the direction of setting up load balancing with the toaster?  I want
>>> to keep using this mail server but I have to find a way to deal with the
>>> large amount of mail that I am having to process.  It is mostly spam so
>>> maybe what I am looking for is a spam scanning system.  
>>>
>>> Thoughts?
>>>
>> Spamdyke.
>> Do it.
>>


-- 
-Eric 'shubes'

-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Eric Shubert]

The dups are understandable. I'm guessing that the smtp sessions are timing
out because the load is high and subsequently scanning is taking a long
time. How long are scans taking typically?

Please post your spamdyke.conf file.

What toaster package versions are you running?

Are you seeing clamav eating your cpu?

Kyle Quillen wrote:
> Spamdyke is installed and has been for about a week It has seemed to
> help but my loads are still staying around 3.5-4.5
> 
> The largest problem that I have right now is that users are getting
> duplicate emails and I can't figure out how to stop it. 
> 
> Since I implemented the greylisting things seem to be calming a little
> bit but the dups are still coming in. I have gotten multiple copies of
> emails that were sent yesterday  at like 1030 in the am and i did get
> them.
> 
> Suggestions?
> 
> 
> thanks
> q
> 
> 
> 
> On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
>> Kyle Quillen wrote:
>>> All,
>>>
>>> Does anyone have any resources that I can pull from that will point me
>>> in the direction of setting up load balancing with the toaster?  I want
>>> to keep using this mail server but I have to find a way to deal with the
>>> large amount of mail that I am having to process.  It is mostly spam so
>>> maybe what I am looking for is a spam scanning system.  
>>>
>>> Thoughts?
>>>
>> Spamdyke.
>> Do it.
>>


-- 
-Eric 'shubes'

-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Kyle Quillen]

Spamdyke is installed and has been for about a week It has seemed to
help but my loads are still staying around 3.5-4.5

The largest problem that I have right now is that users are getting
duplicate emails and I can't figure out how to stop it. 

Since I implemented the greylisting things seem to be calming a little
bit but the dups are still coming in. I have gotten multiple copies of
emails that were sent yesterday  at like 1030 in the am and i did get
them.

Suggestions?


thanks
q



On Fri, 2008-05-23 at 08:51 -0700, Eric Shubert wrote:
> Kyle Quillen wrote:
> > All,
> > 
> > Does anyone have any resources that I can pull from that will point me
> > in the direction of setting up load balancing with the toaster?  I want
> > to keep using this mail server but I have to find a way to deal with the
> > large amount of mail that I am having to process.  It is mostly spam so
> > maybe what I am looking for is a spam scanning system.  
> > 
> > Thoughts?
> > 
> 
> Spamdyke.
> Do it.
> 
-- 
Thanks,
Kyle Quillen
Lightspeed Wireless
[EMAIL PROTECTED]
330.473.1231 ext.202


-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[[EMAIL PROTECTED]]

LVS seemed to work very well for me. Pretty straight forward setup once you get 
the idea.

Or you could set up a shared environment, one mysql server, one shared 
/home/vpopmail directory, simlinked users and control from the qmail directory. 
Then use LVS (or other software based LB) as your front end to balance between 
the servers.

Mike


-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Jake Vickers]

Kyle Quillen wrote:

All,

Does anyone have any resources that I can pull from that will point me
in the direction of setting up load balancing with the toaster?  I want
to keep using this mail server but I have to find a way to deal with the
large amount of mail that I am having to process.  It is mostly spam so
maybe what I am looking for is a spam scanning system.  

  


Not sure of too many resources other than a couple mailing-list posts 
that talk about load balancing.  I've built a couple systems that 
utilize multiple frontends to spread the load around while tying into a 
shared back end.
There's some commercial resources on the wiki that offer these services 
 I'm one of these resources .  
http://wiki.qmailtoaster.com/index.php/Main_Page#Additional_Resources
Not knowing any metrics on your system/mail use I'd guess that you could 
probably get by with some RBL and spam tuning maybe coupled with some 
firewall magic.  I've fixed a few systems like this for various clients 
that just needed some "tuning".




-
QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: [qmailtoaster] Load balancing

[Eric Shubert]

Kyle Quillen wrote:
> All,
> 
> Does anyone have any resources that I can pull from that will point me
> in the direction of setting up load balancing with the toaster?  I want
> to keep using this mail server but I have to find a way to deal with the
> large amount of mail that I am having to process.  It is mostly spam so
> maybe what I am looking for is a spam scanning system.  
> 
> Thoughts?
> 

Spamdyke.
Do it.

-- 
-Eric 'shubes'

-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

[qmailtoaster] Load balancing

[Kyle Quillen]

All,

Does anyone have any resources that I can pull from that will point me
in the direction of setting up load balancing with the toaster?  I want
to keep using this mail server but I have to find a way to deal with the
large amount of mail that I am having to process.  It is mostly spam so
maybe what I am looking for is a spam scanning system.  

Thoughts?

-- 
Thanks,
Kyle Quillen
Lightspeed Wireless
[EMAIL PROTECTED]
330.473.1231 ext.202


-
 QmailToaster hosted by: VR Hosted 
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]