Re: Separating master processes for different services to utilise multiple cores/cpus
I've never seen this problem. I've been running cyrus for eight years now on dual P3 systems, dual Xeon (hyperthreaded), and now dual quad core systems. The load has always been distributed across all processors. Are you sure you're running an SMP kernel? Although I'd think htop would only report on one core if you weren't. Quoting Atif Ghaffar : > Hello all, > > Sorry to reply to myself, > > Has no-one else really experienced this? > > > Sorry again for the re-post and best regads > -- > Atif > > > On Wed, Feb 25, 2009 at 11:47 PM, Atif Ghaffar wrote: > >> Hello, >> >> I am a long time cyrus user but have not been hands on for a while. >> At my current job we are running cyrus to manage all mailstore for our ISP. >> >> Recently I have migrate a couple of boxes to newer ones with more cores per >> cpu. >> >> when running htop -u cyrus, i see that only one core is being used for >> most of the work and that seems to be a waste of the rest of the cpus. >> >> We are using the following services (imap, pop3, lmtp, sieve) >> >> One thought that comes to mind is to run different master processes which >> do one service at a time. >> >> I am thinking on consolidating into >> >> 1. cyrus-master-main (running imap/sieve) >> 2. cyrus-master-pop3 (running pop3) >> 3. cyrus-master-lmtp (running lmtp) >> >> Does this makes any sense? >> Would this balance the usage of the CPUs. >> >> If yes, I will post the config files for inspection. >> >> >> best regards >> Atif >> > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Separating master processes for different services to utilise multiple cores/cpus
> On Wed, Feb 25, 2009 at 11:47 PM, Atif Ghaffar wrote: > >> Hello, >> >> I am a long time cyrus user but have not been hands on for a while. >> At my current job we are running cyrus to manage all mailstore for our ISP. >> >> Recently I have migrate a couple of boxes to newer ones with more cores per >> cpu. >> >> when running htop -u cyrus, i see that only one core is being used for >> most of the work and that seems to be a waste of the rest of the cpus. >> >> We are using the following services (imap, pop3, lmtp, sieve) >> >> One thought that comes to mind is to run different master processes which >> do one service at a time. >> >> I am thinking on consolidating into >> >> 1. cyrus-master-main (running imap/sieve) >> 2. cyrus-master-pop3 (running pop3) >> 3. cyrus-master-lmtp (running lmtp) >> >> Does this makes any sense? >> Would this balance the usage of the CPUs. >> >> If yes, I will post the config files for inspection. Cyrus is already a multi-process program. Each new incoming connection spawns a separate imapd, pop3d, timsieved, or lmtpd process. You won't gain any additional efficiency by running multiple master processes. Most of the time, Cyrus is not limited by your cpu performance but it is often limited by your I/O (disk) performance. On some operating systems, all I/O operations are handled by one particular cpu. For example, I/O from a network card may always be processed by cpu #0. It is possible that is happening to you, although I don't know if Linux does that. Are you having a performance problem? Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Separating master processes for different services to utilise multiple cores/cpus
On Tuesday 03 March 2009 10:52:06 Atif Ghaffar wrote: > Has no-one else really experienced this? Sounds like a problem with the scheduler rather than cyrus.. Since each connection is a separate process I imagine all the CPUs would get used. (Not that I have a dual core cyrus box) -- Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C signature.asc Description: This is a digitally signed message part. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
log reporting
Hello, I'm looking for a script or program to process cyrus log entries in /var/log/mail.log and produce a report. There is a reference to a logwatch script at http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/Logwatch but the attachment no longer seems to exist. I've also search this mail list for "log report". I guess for starters I'd like to know who is checking mail, but it would also be nice to know the popularity of shared folders. Is anyone on this list getting log reports and how are you doing it? Thanks, Josh -- IT Support Desk Harms Consulting Pty Ltd Suite 302, 5 Hunter Street, SYDNEY NSW 2000 Phone: +61 2 9221 2000, Fax: +61 2 9221 1600 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Separating master processes for different services to utilise multiple cores/cpus
Hello all, Sorry to reply to myself, Has no-one else really experienced this? Sorry again for the re-post and best regads -- Atif On Wed, Feb 25, 2009 at 11:47 PM, Atif Ghaffar wrote: > Hello, > > I am a long time cyrus user but have not been hands on for a while. > At my current job we are running cyrus to manage all mailstore for our ISP. > > Recently I have migrate a couple of boxes to newer ones with more cores per > cpu. > > when running htop -u cyrus, i see that only one core is being used for > most of the work and that seems to be a waste of the rest of the cpus. > > We are using the following services (imap, pop3, lmtp, sieve) > > One thought that comes to mind is to run different master processes which > do one service at a time. > > I am thinking on consolidating into > > 1. cyrus-master-main (running imap/sieve) > 2. cyrus-master-pop3 (running pop3) > 3. cyrus-master-lmtp (running lmtp) > > Does this makes any sense? > Would this balance the usage of the CPUs. > > If yes, I will post the config files for inspection. > > > best regards > Atif > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Pop process hangs in the write()
ram wrote: > I have problem at a clients end exactly same as described in this > > http://marc.info/?l=info-cyrus&m=108967188821511&w=2 > > A pop process blocks at write() for any mail at random. And they start > getting pop lock issues > > I have checked with the customer , there is no IDS on their network > Is there any other way I can debug this issue > > You could enable telemetry logging, which should help to rule out a problem with the client. - Dan Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Pop process hangs in the write()
Hi, On Monday 02 March 2009 12:33:43 ram wrote: > I have problem at a clients end exactly same as described in this > > http://marc.info/?l=info-cyrus&m=108967188821511&w=2 > > A pop process blocks at write() for any mail at random. And they > start getting pop lock issues > > I have checked with the customer , there is no IDS on their network > Is there any other way I can debug this issue I have seen issues with pop3d's locking up some weeks agao while maintaining our University's Cyrus IMAPD installation. It turned out to be caused by the used file system for /var/lib/imap. We used reiserfs there - the system itself is a openSUSE 11.1 and has been older SUSE-variants before. After reformatting with xfs, which we have used for the mailbox partitions everything went smooth again. I didi not follow this issue, as the system had to be running without flaws in the shortest possible time. This should be no reiserfs-bashing. I use it frequently without problems, but here it broke something. HTH, Stefan -- Stefan Schmidt listrea...@jsj.dyndns.org Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: List to Spam Harvest
Sorry, ignore my last. I wasn't thinking. --On 27 February 2009 10:03:10 -0800 David Lang wrote: > On Fri, 27 Feb 2009, John Thomas wrote: > >> I know little, so please forgive if this is wrong. >> The following link seems to be crawled by Google and exposes our email >> addresses to spam harvesters. I wonder if it makes sense and is >> possible to not do this or obfuscate the addresses? >> http://cyrusimap.web.cmu.edu/archive/mailbox.php?mailbox=archive.info-cy >> rus > > if you send mail to a public mailing list it can be harvested by spammers. > > David Lang > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Ian Eiloart IT Services, University of Sussex x3148 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: List to Spam Harvest
--On 27 February 2009 10:03:10 -0800 David Lang wrote: > On Fri, 27 Feb 2009, John Thomas wrote: > >> I know little, so please forgive if this is wrong. >> The following link seems to be crawled by Google and exposes our email >> addresses to spam harvesters. I wonder if it makes sense and is >> possible to not do this or obfuscate the addresses? >> http://cyrusimap.web.cmu.edu/archive/mailbox.php?mailbox=archive.info-cy >> rus > > if you send mail to a public mailing list it can be harvested by spammers. That's his email address, not his entire userbase. Most public mailing lists do obfuscated email addresses, and those that don't ought to. > David Lang > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Ian Eiloart IT Services, University of Sussex x3148 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Pop process hangs in the write()
I have problem at a clients end exactly same as described in this http://marc.info/?l=info-cyrus&m=108967188821511&w=2 A pop process blocks at write() for any mail at random. And they start getting pop lock issues I have checked with the customer , there is no IDS on their network Is there any other way I can debug this issue Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
