Re: big rcpthosts file
At 23:43 28/12/99 +0100, bert hubert wrote: Rule of thumb for large sites: Put your 50 most com- monly used domains into rcpthosts, and the rest into morercpthosts. ah, but does it matter? I have nearly 900 in my rcpthosts file and I'm not noticing anything in particular. I'm doing a constant stream of mail, but never more than one stream at anyone time really... performance is fine. I don't *really* know which domains are the busiest. To work that out I would have to do something like get all the domains from the qmail logs, use qmail-analog to weight them, sort the list of domains, and then split them appropriately. Currently I have a script that just generates the rcpthosts file from the virtualdomains file, and that is generated out of a simple script that just prints out a mysql table contents. Ranking everything would be a bit OTT IMHO. So, should I be worried? Does it matter? When does it matter? cheers peter -- peter at gradwell dot com; online @ http://www.gradwell.com/
Re: big rcpthosts file
Petr Novotny wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 29 Dec 99, at 10:50, Peter Gradwell wrote: At 23:43 28/12/99 +0100, bert hubert wrote: Rule of thumb for large sites: Put your 50 most com- monly used domains into rcpthosts, and the rest into morercpthosts. ah, but does it matter? I have nearly 900 in my rcpthosts file and I'm not noticing anything in particular. I'm doing a constant stream of mail, but never more than one stream at anyone time really... performance is fine. You don't HUP or restart qmail-send too often then. That has no effect. [snip] So, should I be worried? Does it matter? When does it matter? The file is scanned during startup of qmail-send, and after HUPing qmail-send. If you don't do that often, you don't need to worry. rcpthosts is scanned every time an email comes in (by qmail-smtpd). But then again, if you need to administer a file with like 900 significant lines, you'd like to use some automatic tool for that. It's easy to adapt that tool to work with morercpthosts and cdb format. Please correct me if I'm wrong - you may also leave rcpthosts empty and stuff everything in morercpthosts if it matters. Probably. -- Andre
Re: big rcpthosts file
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 29 Dec 99, at 12:03, Andre Oppermann wrote: Petr Novotny wrote: The file is scanned during startup of qmail-send, and after HUPing qmail-send. If you don't do that often, you don't need to worry. rcpthosts is scanned every time an email comes in (by qmail-smtpd). Oops. Sorry everyone for misleading you. I should be reading more carefully... -BEGIN PGP SIGNATURE- Version: PGP 6.0.2 -- QDPGP 2.60 Comment: http://community.wow.net/grt/qdpgp.html iQA/AwUBOGn9yFMwP8g7qbw/EQLNgACghnNSn8X/5eMi4Qcpms6E+f2EgPAAoLIR kf5zuo0+eFMUkVpUcfyGiXVw =VvQQ -END PGP SIGNATURE- -- Petr Novotny, ANTEK CS [EMAIL PROTECTED] http://www.antek.cz PGP key ID: 0x3BA9BC3F -- Don't you know there ain't no devil there's just God when he's drunk. [Tom Waits]
Re: big rcpthosts file
At 12:03 29/12/99 +0100, you wrote: rcpthosts is scanned every time an email comes in (by qmail-smtpd). But then again, if you need to administer a file with like 900 significant lines, you'd like to use some automatic tool for that. It's easy to adapt that tool to work with morercpthosts and cdb format. so, the "most frequently used domains" rule is a vague one then... What is more effective? - searching a fairly empty (5 lines) rcpthosts file and then searching morercpthosts or - just searching a large rcpthosts file. Does the speed in searching a cdb more than outweigh the multiple file handling/access delay? If so, I'll just bung the few "static" things (like the machine names) in rcpthosts, and make the mysql-rcpthosts script generate morercpthosts, and also run qmail-newwhatsit. what do we think? cheers peter -- peter at gradwell dot com; online @ http://www.gradwell.com/
Re: big rcpthosts file
Peter Gradwell spake unto me and said: - searching a fairly empty (5 lines) rcpthosts file and then searching morercpthosts, or Um, that should be '(50 lines)', meaning 'your 50 most commonly used domains' (man qmail-smtpd). When a domain is found in rcpthosts, then morercpthosts is not touched. Depending how common 'most common' is, morercpthosts will not be used much. - just searching a large rcpthosts file. Um, qmail-smtpd doesn't actually search the rcpthosts file. It parses the file into an in-memory cdb, and searches that. qmail-newmrh parses morercpthosts into an on-disk cdb, which qmail-smtpd searches from the disk _when necessary_. So your choice really is: - searching a fairly small (50 domains) in-memory cdb, and then searching a large on-disk cdb when necessary, or - just(!) searching a large in-memory cdb. (Remember, large in-memory structures are paged, so disk I/O is required in either case, with a suitable definition of 'large'.) Looking at the source code suggests that search speed is not the issue; memory is. Smaller qmail-smtpd processes mean more qmail-smtpd (and qmail-remote) processes, which means greater concurrency. No doubt Dan has profiled this, and seen that the bottom line is greater overall throughput. Len.
Re: big rcpthosts file
Frank Greven spake unto me and said: Should I only use rcptshosts or not? You should use morercpthosts, because Dan knows what he's doing. If it's a question of memory - because of what you called in-memory cdb - what is the needed size of RAM? I can't answer that; this is a case of 'profile, don't speculate.' If you're using just rcpthosts, and your performance is acceptable, then obviously you _can_ just keep doing what you're doing. Or maybe the whole diskussion is wasted time because either a small Linux Pentium system with 128 MB RAM and let's say 10,000 mails per day will never run into a performance leak? Could be (see above). However, total throughput isn't the only test of load. You should install qmailanalog, if you haven't already. Look at your average concurrency. If it is high, then you should _definitely_ use morercpthosts--and also use concurrencyremote to allow more concurrent deliveries. If your concurrency is very low, you probably don't have to change anything. HTH, Len.
big rcpthosts file
Hello, I've a rcpthosts file with more than 500 domains listed in it. I've read somewhere not to put more than 50 in it. Are there any performance problems with such a big rcpthosts? If so, what can I do to avoid this? Thanks, Frank
Re: big rcpthosts file
On Tue, Dec 28, 1999 at 11:41:59PM +0100, Frank Greven wrote: Hello, I've a rcpthosts file with more than 500 domains listed in it. I've read somewhere not to put more than 50 in it. Are there any performance problems with such a big rcpthosts? If so, what can I do to avoid this? from man qmail-smtpd: morercpthosts Extra allowed RCPT domains. If rcpthosts and mor- ercpthosts both exist, morercpthosts is effectively appended to rcpthosts. You must run qmail-newmrh whenever morercpthosts changes. Rule of thumb for large sites: Put your 50 most com- monly used domains into rcpthosts, and the rest into morercpthosts. -- +---+ | http://www.rent-a-nerd.nl | nerd for hire | | +---+ | - U N I X - | | Inspice et cautus eris - D11T'95
