Re: Clustering qmail servers
Tracy R Reed wrote: On Fri, Feb 09, 2001 at 01:08:47PM -0600, Herbie wrote: Well the simplest way is to have one machine act as the gateway for all mail and create alias files to forward the mail onto the second machine. I used a simple perl script from a flat file to create the .qmail alias's. I guess that could work but there is no easy automated way to manage so many qmail files and we already have 1760 in there already. I think I'll just have my qmail-queue wrapper rewrite the envelope recipient address and add a headerline which is basically what qmail-alias does when it forwards an email on somewhere else. I was just wondering if anyone came up with a more correct solution but it seems not. I'd think a NFS solution would be appropriate, so the SMTP boxes and the POP boxes can all be different boxes, that access the same user directories. This is the whole point of maintaining MailDir NFS-safety isn't it? -- David Nicol 816.235.1187 [EMAIL PROTECTED] "Nothing in the definition of the word `word' says that a word has to be in a dictionary to be called one." -- Anu Garg
Re: Clustering qmail servers
I guess that depends how you set up your users, we have ours in a flat file: username [EMAIL PROTECTED] so we just run a script on that file and autocreate the .qmail files on a nightly cron job. soon I guess we'll create the flat file from an LDAP database but that's not done yet. Herbie On Sat, 10 Feb 2001, Tracy R Reed wrote: On Fri, Feb 09, 2001 at 01:08:47PM -0600, Herbie wrote: Well the simplest way is to have one machine act as the gateway for all mail and create alias files to forward the mail onto the second machine. I used a simple perl script from a flat file to create the .qmail alias's. I guess that could work but there is no easy automated way to manage so many qmail files and we already have 1760 in there already. I think I'll just have my qmail-queue wrapper rewrite the envelope recipient address and add a headerline which is basically what qmail-alias does when it forwards an email on somewhere else. I was just wondering if anyone came up with a more correct solution but it seems not. -- Tracy Reed http://www.ultraviolet.org * Maelcum likes his flame broiled dragon on sourdough
Re: Clustering qmail servers
On Fri, Feb 09, 2001 at 04:52:51PM -0800, Tracy R Reed wrote: I am not trying to send a bunch of email (aka spam). I am trying to receive a bunch of email (aka spam) and let users pop/imap it. Using the perdition (search freshmeat) imap/pop proxy I think I can have multiple pop/imap servers with users assigned to each one and pass the user off to the correct one according to a dbm/ldap/whatever lookup. Now the problem is how do I get email addressed to a particular user onto the correct server? Say I want all email for users with names from a-m to go to server1 and m-z to server2? qmail-ldap can do this. http://www.nrg4u.com and http://www.lifewithqmail.org/ldap/ -- Henning Brauer | BS Web Services Hostmaster BSWS| Roedingsmarkt 14 [EMAIL PROTECTED] | 20459 Hamburg http://www.bsws.de | Germany
Re: Clustering qmail servers
On Fri, Feb 09, 2001 at 01:08:47PM -0600, Herbie wrote: Well the simplest way is to have one machine act as the gateway for all mail and create alias files to forward the mail onto the second machine. I used a simple perl script from a flat file to create the .qmail alias's. I guess that could work but there is no easy automated way to manage so many qmail files and we already have 1760 in there already. I think I'll just have my qmail-queue wrapper rewrite the envelope recipient address and add a headerline which is basically what qmail-alias does when it forwards an email on somewhere else. I was just wondering if anyone came up with a more correct solution but it seems not. -- Tracy Reed http://www.ultraviolet.org * Maelcum likes his flame broiled dragon on sourdough
Re: Clustering qmail servers
Well the simplest way is to have one machine act as the gateway for all mail and create alias files to forward the mail onto the second machine. I used a simple perl script from a flat file to create the .qmail alias's. Or am I misunderstanding the question. Herbi On Fri, 9 Feb 2001, Tracy R Reed wrote: I am not trying to send a bunch of email (aka spam). I am trying to receive a bunch of email (aka spam) and let users pop/imap it. Using the perdition (search freshmeat) imap/pop proxy I think I can have multiple pop/imap servers with users assigned to each one and pass the user off to the correct one according to a dbm/ldap/whatever lookup. Now the problem is how do I get email addressed to a particular user onto the correct server? Say I want all email for users with names from a-m to go to server1 and m-z to server2? I've searched the archives and can't find anything conclusive. I do have a perl script wrapping qmail-queue which does some basic mail filtering. I suppose I could alter the envelope "to" address appropriately to send it to the correct machine but I am wondering if there is any more elegant way to accomplish this. -- Tracy Reed http://www.ultraviolet.org My pid is Inigo Montoya. You kill -9 my parent process. Prepare to vi.
Re: Clustering Qmail
I think coda came up on this list a while ago, and someone said it was, like afs, slow. I don't think actual statistics were posted, though. Try the archives. Faried. -- self name. i want to live/to see the earth turn one more time i wanna live/to feel a hand that isn't mine superstar!
Re: Clustering Qmail
do there exist any solutions for clustering qmail to build high-volume-servers i`m looking for some tools or patches to do load-balancing, put pop-boxes on more than one server, use more than one smtp-server... help??? There are several server load balancer solutions available. I use the 'ServerIron' product from Foundry Networks (www.foundrynet.com), it seems to perform very well. You also have Alteon (www.alteonwebsystems.com), cisco, and others. These boxes are regular layer-2 switches. In addition to switching packets like other switches, they perform load balancing. One way they can do this is to reply to ARP requests for the IP addresses your mail server is known by on the Internet. Your router will therefore send all incoming IP packets to the ethernet address of the switch. The switch will pick up a packet, choose the front-end mail processor (FEP) it thinks has the lowest load at the moment, put that ethernet address on the packet instead of its own and put the packet back on the wire for the FEP to pick up. The switch also monitors the FEP's and routes connection requests to other working servers if a FEP is discovered to be faulty. This makes error situations and maintainance downtime invisible to the clients. -- Gjermund Sorseth
RE: Clustering Qmail
None as such..I have been meaning to write a HOWTO for something similar but this year has just been crazy...maybe next year. BUT some suggestions: - Look into a NFS/NIS combination (I use this for a distributed e-mail system currently spanning a city, soon to be spanning several locations on the planet) - AFS (Andrew File System) also looks interesting for some real hard-core distributed, clustered work There are probably other ideas, but those are the two I would look into first. /BR Manager InterPlanetary Solutions http://ipsware.com/ -Original Message- From: Thomas Ackermann [mailto:[EMAIL PROTECTED]] Sent: Thursday, October 05, 2000 6:50 PM To: MailingList Qmail Subject: Clustering Qmail do there exist any solutions for clustering qmail to build high-volume-servers ?? i`m looking for some tools or patches to do load-balancing, put pop-boxes on more than one server, use more than one smtp-server... help??? thx
RE: Clustering Qmail
"Brett Randall" [EMAIL PROTECTED] wrote: - AFS (Andrew File System) also looks interesting for some real hard-core distributed, clustered work Yeah, AFS *looks* good on paper... Know anyone who's actually using it? What do they think of it? -Dave
Re: Clustering Qmail
On Thu, Oct 05, 2000 at 08:11:22PM +1000, Brett Randall wrote: None as such.. Except that the concepts and some details have been discussed on this list quite a few times - often by people who have implemented such schemes. The archives are your friend. - Look into a NFS/NIS combination (I use this for a distributed e-mail hopefully via secured means - especially NIS. Regards.
RE: Clustering Qmail
None as such.. Except that the concepts and some details have been discussed on this list quite a few times - often by people who have implemented such schemes. Must have had a subject with no meaning and so hello to the good old 'delete' key :P - Look into a NFS/NIS combination (I use this for a distributed e-mail hopefully via secured means - especially NIS. Yeah...I am away of the risks, but a few ACLs and a little Kerberos or similar go a long way... /BR Manager InterPlanetary Solutions http://ipsware.com/
Re: Clustering Qmail
I had this done once, and I used my mailservers used multiple NICs, IP aliasing, and NAT to deliver mail from a real IP mail server, to a Private IP fileserver mounted via NFS. Not really any security issues that I found, since the mail servers only have to run NFS client, and the fileserver is inaccessible from the internet. It worked out all right. Rob [EMAIL PROTECTED] wrote: On Thu, Oct 05, 2000 at 08:11:22PM +1000, Brett Randall wrote: None as such.. Except that the concepts and some details have been discussed on this list quite a few times - often by people who have implemented such schemes. The archives are your friend. - Look into a NFS/NIS combination (I use this for a distributed e-mail hopefully via secured means - especially NIS. Regards. -- Rob Hines Jr. System Administrator Phone: (317)469-4535 Fax: (317)469-4508 Email: [EMAIL PROTECTED] URL: http://www.joboptions.com
Re: Clustering Qmail
On Thu, 05 Oct 2000 11:08:38 EDT, Dave Sill wrote: Yeah, AFS *looks* good on paper... Know anyone who's actually using it? What do they think of it? What about Coda? Is it a viable solution for a distributed filesystem? It has been in development since 1987 if I remember correctly... You would think that is enough time to mature. :-) Andy
Re: Clustering Qmail
On Fri, Oct 06, 2000 at 06:57:27AM +1000, Brett Randall wrote: None as such.. Except that the concepts and some details have been discussed on this list quite a few times - often by people who have implemented such schemes. Must have had a subject with no meaning and so hello to the good old 'delete' key :P Hmm. The archive search shows these as the first 20 of 187 entries, how much meaning do you need in a subject? 1.Re: Large Mail Cluster Questions 2.Re: Large Mail Cluster Questions 3.Re: Qmail on a linux cluster 4.Large Mail Cluster Questions 5.RE: Qmail on a linux cluster 6.Re: Large Mail Cluster Questions 7.Re: Qmail on a linux cluster 8.Re: Large Mail Cluster Questions 9.Re: Qmail on a linux cluster 10.Qmail on a linux cluster 11.RE: Qmail on a linux cluster 12.Re: Qmail on a linux cluster 13.Cluster Awareness of qmail 14.Re: Cluster Awareness of qmail 15.Re: Cluster Awareness of qmail 16.Re: Server cluster 17.Re: Server cluster 18.Re: Server cluster 19.Re: Server cluster 20.Re: Server cluster Regards.
Re: Clustering Qmail
also sprach andyb:
On Thu, 05 Oct 2000 11:08:38 EDT, Dave Sill wrote:
Yeah, AFS *looks* good on paper... Know anyone who's actually using
it? What do they think of it?
I'd be interested in hearing about this as well.
What about Coda? Is it a viable solution for a distributed filesystem?
It has been in development since 1987 if I remember correctly... You
would think that is enough time to mature. :-)
I posted to the coda mailing list asking just this. I will cut-and-paste all
of the responses I got:
---start responses---
---end responses---
HTH!
(FWIW, it looks fairly stable, but still horrendously complex. I don't think
I would trust it to a production system, if for no other reason than it
seems awfully easy to mess up.)
/pg
--
Peter Green : Gospel Communications Network, SysAdmin : [EMAIL PROTECTED]
---
panic("Fod fight!");
(In the kernel source aha1542.c, after detecting a bad segment list.)
