RE: questions about performance and setup
I overlooked that when I posted this message; I totally forgot about the write penalty. Sorry about that. -Original Message- From: John White [mailto:[EMAIL PROTECTED]] Sent: Friday, July 14, 2000 7:08 PM To: qmail mailing list Subject: Re: questions about performance and setup On Fri, Jul 14, 2000 at 12:21:57PM -0700, Jason Murphy wrote: > The machine I built contains a DPT SmartRAID V SCSI RAID 0/1/5 controller > with 5 1RPM 9.1 gig drives. The thing I notice about RAID 5 in the > right configuration is that you can throw tons of IO at it and you will > see little decrease in performance. Our Database server (Ya, I know, its > not MAIL SERVER) gets tons of IO and its nothing to it; just eats it up > and continues on its way. A massive mail injection, especially if the content is unique to the user, can overwhelm a disk subsystem. This is reccomending the exact -wrong- kind of disk system. RAID 5 has a write penalty, as it has to calculate parity for each write, and write to multiple spindles. The best type of RAID for small block writes is RAID 10 or RAID 1+0 (not to be confused with RAID 0+1). Even better is to use a disk system with write-back cache. Ideally, you need at least seven spindles. I've seen great things with the Infortrend controller. A great setup would be 1U pc's connected to an external RAID. John smime.p7s
RE: questions about performance and setup
I might as well jump into this since I just built a RAID 5 system for a database. The machine I built contains a DPT SmartRAID V SCSI RAID 0/1/5 controller with 5 1RPM 9.1 gig drives. The thing I notice about RAID 5 in the right configuration is that you can throw tons of IO at it and you will see little decrease in performance. Our Database server (Ya, I know, its not MAIL SERVER) gets tons of IO and its nothing to it; just eats it up and continues on its way. I gotta say that you can't go wrong with this controller. It's a I2O controller and thus supported in FreeBSD and Linux. As Dave stated, you will get stuck with Dell and their proprietary drivers, this I would avoid like the plague. -Original Message- From: Hubbard, David [mailto:[EMAIL PROTECTED]] Sent: Friday, July 14, 2000 11:48 AM To: '[EMAIL PROTECTED]' Subject: RE: questions about performance and setup Hey Jay, I don't know much about setting that type of thing up in qmail, but I would like to give you some ideas on the hardware. I'm not sure how much load qmail would generate in a scenario like that, but you may want to consider Solaris x86 for the superior SMP performance. Also, you should know what you're getting into on the Dell boxes if you choose to run linux. I've got a Dell PE2400 dual that runs linux and you're going to be at the mercy of Dell and Adaptec on when you upgrade your kernel because they have some sorry proprietary drivers for their RAID controllers that are tailored to a specific kernel version and redhat sub-revision. If you can put up with that, then Redhat Linux/Qmail on a Dell runs very fast, I'm happy with mine. But at the same time, I'm sitting on a kernel with a known suid exploit hoping Dell will release newer drivers soon... It is much nicer running Linux on an older Dell server of mine that has an AMI MegaRaid card with drivers built into the kernel. Dave -Original Message- From: Austad, Jay To: '[EMAIL PROTECTED]' Sent: 7/14/00 2:18 PM Subject: questions about performance and setup I've been given the task of setting up our own "blaster" for sending out emails of our financial news and charts to our subscribers. We outsource this right now, and it's abysmally expensive. Basically, we want 3 boxes (or so) that run in parallel and blast out the emails, about 50 million per month, but the subscription rate is growing rapidly each month. It needs to handle bounced mail by dumping the addresses into a file for later retrieval so they can be removed from the database, or by running an external script for each bounced address. I'm looking at getting 3 dell dual PIII 750's, with a 18 or 36GB 1rpm disk, and 512M or 1G of mem each. Each will run Linux or BSD. Here's what I need to know: 1. How well does qmail take advantage of multiple processors? How much memory and disk will I need? (we're at 50 million messages per month now, and we only send out monday-friday, so that's over 2 million messages per day, and it's only going up) 2. How many messages per day would one estimate that each of these servers could do? 3. I read about mini-qmail and how it's about 100 times faster blasting out email to QMQP servers. Since you can specify multiple QMQP servers, if I have a fourth machine running mini-qmail and managing the actual mailing list, can I add the other 3 as QMQP servers and have it load balance between all 3 for sending out mail? (this way I could add more servers easily if I needed to) 4. Can I easily make qmail run an external script for each bounced mail? 5. Anything else I should know? Thanks. -- Jay Austad Network Administrator CBS Marketwatch 612.817.1271 [EMAIL PROTECTED] http://cbs.marketwatch.com http://www.bigcharts.com smime.p7s
Re: qmail book coming?
> > Howabout "The Wonderful and Weird World of DJ Bernstein" Naw. I am waiting for the movie to come out, I think Robin Williams is going to play DJ Berstein. His Arch-Nemesis, Wietse Venema, is going to be played by John Malkovich. > > > --- "M.B." <[EMAIL PROTECTED]> wrote: > > http://www.amazon.com/exec/obidos/ASIN/0672319454/qid%3D962246891/sr%3D1-2/0 > > 02-4056617-0867210 > > > > anyone notice the above? > > > > mike. > > > > ___ > > Why pay for something you could get for free? > > NetZero provides FREE Internet Access and Email > > http://www.netzero.net/download/index.html > > > = > John van Vlaanderen > > # > #CXN, Inc. Contact: [EMAIL PROTECTED] # # > # Proud Sponsor of Perl/Unix of NY # > #http://puny.vm.com # > # > > ______ > Do You Yahoo!? > Send instant messages & get email alerts with Yahoo! Messenger. > http://im.yahoo.com/ -- Jason Murphy Web Developer and Systems and Database Administrator E-mail: [EMAIL PROTECTED] URL: http://www.lawinfo.com -- Lawinfo.com - Legal Industry Marketing for the 21st Century Phone: 800-397-3743 Fax: 800-220-4546 --
Re: scan4virus
You need to get the QMAILQUEUE patch and make sure you have something like this in the shell that starts qmail. QMAILQUEUE="/var/qmail/bin/antivirus-qmail-queue.pl" export QMAILQUEUE The Enviromental setting will picked up by qmail and run this program instead. Which is the virus scanner. The virus scanner will check it and then send it back along its way. -- Jason Murphy Web Developer and Systems and Database Administrator E-mail: [EMAIL PROTECTED] URL: http://www.lawinfo.com -- Lawinfo.com - Legal Industry Marketing for the 21st Century Phone: 800-397-3743 Fax: 800-220-4546 -- - Original Message - From: "Kimmo Berghäll" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Friday, July 07, 2000 12:19 AM Subject: scan4virus > Hello, > > How do I exactly modify /etc/rc.d/init.d/qmail to use scan4virus? > > Kimmo Berghäll > [EMAIL PROTECTED] >
Re: Mail Server Sizing
I am going to say that machine is overkill. I think 1 CPU (700 MZH+) with about 512 megs of RAM is more than enough. You have to remember qmail runs really fast, much faster than sendmail, and does not take much RAM. The only problem I ever see with qmail, from working with it and reading this list are IO Bounding problems (The Disks/Controllers can't move fast enought for qmail). -- Jason Murphy Web Developer and Systems and Database Administrator E-mail: [EMAIL PROTECTED] URL: http://www.lawinfo.com -- Lawinfo.com - Legal Industry Marketing for the 21st Century Phone: 800-397-3743 Fax: 800-220-4546 -- - Original Message - From: "Alexis Castanares Lopez" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Thursday, July 06, 2000 9:20 AM Subject: Mail Server Sizing > > Hi! > > I have been using Qmail, over x86 Boxes with Linux for a while, with > excelent results. But now I'm plannig to make my first move in the big > leagues on QMail. > > The company I work for is using Netscape Messaging Server on a Sun > Enterprise 250 Box, with 2 Cpu's, 36 Gb. HD and 512 Mb. RAM. They have 8000 > users in 10 different domains, and something arround 1.1 Million Messages a > week of traffic, all the mail is read using POP3 Clients. No Webmail, No > Distribution Lists, no "[EMAIL PROTECTED] and [EMAIL PROTECTED]" > capabilities, Very Expensive LDAP solution, etc. > > We have had a lot of problems with Messaging Server. Sometimes the server > simply doesn't answer port 25, or 110, or doesn't deliver messages... etc. > This is not the point of this message. > > My move is to change everything and migrate the systems to a x86 (Compaq > Proliant 3000, 2 Cpu's, 512 Mb. Ram, 50 Gb. SCSI Array) with Linux Redhat > 6.2 Installed on it, and (of course) Qmail, Vpopmail and TcpServer. > > A Couple of newbie questions: > > Do you think that this x86 machine would be able to manage the email in the > scenario I outlined above? > If Not, waht would you recommend? > Do you know any site that has information about correct sizing of QMail > Servers? > > Note: I'm trying NOT to re-use the Sun E250 Box, because I need it for other > projects, but if this is the best solution, please let me know. > > Thank you very, very much for your help. > > Regards, > Alexis. > > Alexis Castañares > Director de Tecnología > MVS Telecom > [EMAIL PROTECTED] >
Re: desperately looking for solution to this virtual domain problem
Well, it is your lucky day, or unlucky if I am wrong. However, I just finished doing what you want to do. I will try to make this detailed but brief. What you are trying to do is make a POP3 Toaster (Or IMAP Toaster) with vitural users and vitural domains. Where each user of one domain is independent of other unrelated users on other domains. So that means [EMAIL PROTECTED] has nothing to do with [EMAIL PROTECTED] and both get mail without bugging each other, and more importantly, not bugging you. (IE: The first bob as nothing to do with the second bob and their mail will be seperate of each other.) What my list of software and instructions will give in the end is machine takes mail for whatever domains and put them in maildir format on your machine. What is cool about this setup is that you can have normal mail users like you would regularly think of, and also have virtual users, who will never login to the machine execpt for pop and imap. So its a duel type system Some of the great things about this system is that you can have quotas for vitural user based on amount of messages and/or total size of all messages for a user. You will also only have real accounts for the vitural domains. For example, when you host hell.com, will have a user call "hellcom" (For example). Then VmailManger will put the vitural users in "hellcom" account. So you can host a tons virtual domains. The whole system is alittle clumsy at first, but it works really well and it grows on you after a couple of days. For example, its a couple of steps to add a new user to a virtual domain, and more steps if it is new virtual domain you have to add. I am kinda running out of steam, so the docs are below. Post questions and will get replies back to the list on my second wind. To make this system you will need all/most of these below to make this beast. (Note: I did not use LDAP, so that might change things.) Unix Box that is up and working. (www.Linux.org or www.FreeBSD.org (Just to name two)) qmail-1.03 (www.qmail.org) tcpserve (http://cr.yp.to/ucspi-tcp.html) Courier IMAP (http://www.inter7.com/courierimap/) OpenSSL (www.openssl.org) (Encrypted IMAP) stunnel (http://mike.daewoo.com.pl/computer/stunnel/) (Encrypted IMAP) VmailManager (http://www.vmailmgr.org/) relay-ctrl (http://em.ca/~bruceg/relay-ctrl/) (If you want to let non-local users send mail through your server) You need these need these patches: qmail-103.patch (Big DNS patch. AKA: The AOL Patch. Just about required) qmail-1.03-quotas-1.1.patch (Hard quotas error patch. If you want support hardquota independent of VmailerManager) big-todo.103.patch (If you have a busy high volume server) big-concurrency.patch (If you have a busy high volume server) qmail-etrn-0.1f.diff (If you want to support stupid Exchange people) and the LDAP directory patch if your going to use LDAP. Install tcpserver. Apply qmail patches to qmail. Configure, compile and install qmail. Configure, compile and install OpenSSL and stunnel, and then Courier IMAP (In that order). Get VmailManger; configure, compile and install it. Get relay-ctrl, configure, compile and install. Make sure to read docs to all the software. This give you a good idea of whats going on. > > >hi everybody > > I know this is a tense subject on the mailing list, but please bear with > me. ;o) I haven't even INSTALLED qmail yet, but would much rather use it on > my RedHat 6.1 box than the stock sendmail that's full of holes. However, my > dilemma is that I'm going to be running multiple virtual domains on one > qmail server and dont want to use /etc/passwd rather i am planning to use > LDAP DIRECTORY SERVER (WHERE I CAN SPECIFY MAILMESSAGESTORE AS WELL AS > USERS HOME DIRECTORY ) and am curious to know what steps exactly I should > follow to get the setup completed with qmail. , I have read through the > FAQ's and found them a little confusing. I also searched through the > mailing list archives and am even more confused. What I'm looking for here > is a way to set up my server to accept mail for > domain1.com, > domain2.com and > domain3.com ... etc, to > domainn.com. > Each domain should have its own unique users. > That is, [EMAIL PROTECTED] is NOT [EMAIL PROTECTED] > Is this going to be a problem? This is the issue that I fail to see > (easily) addressed from what I've read so far for each of the domains so > that each user can login using POP/IMAP to retrieve their mail( i am > planning to use Maildir rather then Mailbox . I'd also like an way to > handle Email aliasing so that > [EMAIL PROTECTED] can be sent to [EMAIL PROTECTED] or wherever else I need > it to go. > I'm not new to Linux, but I'm new to the idea of setting up multiple > domains on a single host using qmail and directory server , so any > hand-holding would be appreciate
POP/IMAP Question.
I have to build a good size mail server, and need to know the anwser to a couple of questions. 1) Is there a way have qmail have two users at two different virtual domains have the same username and have thier mail delivered to two different mail accounts and fetchmail with the same username but of course using the different virtual names. For example: Mail sent to [EMAIL PROTECTED] and [EMAIL PROTECTED] would end up on mail.lawinfo.com (Using MX records) in two different mailboxes. So when they want their email, one would connect as joe on mail.example.com and the other would connect as joe on mail.otherdomain.com. I dont care what their maildir's is called on the mail server are, just as long as it is stored on our server and they get their mail with joe user name. 2) Has anyone here used the qmail-ldap patch? The feature list makes it look good. However, it much be able to fullfil the #1 requirement. I know these are simple questions, but I cant find any information to verify the first of the two. -- Jason Murphy Web Developer and Systems and Database Administrator E-mail: [EMAIL PROTECTED] URL: http://www.lawinfo.com -- Lawinfo.com - Legal Industry Marketing for the 21st Century Phone: 800-397-3743 Fax: 800-220-4546 --
