Re: choosing a file system

2008-12-31 Thread Scott Likens

Hi,

I would not discount using reiserfs (v3) by any means.  It's still by  
far a better choice for a filesystem with Cyrus then Ext3 or Ext4.  I  
haven't really seen anyone do any tests with Ext4, but I imagine it  
should be about par for the course for Ext3.


as far as the NFS... NFS isn't itself that bad, it's just that people  
tend to find ways to use NFS in a incorrect manner that only ends up  
leading to failure.


Scott

On Dec 31, 2008, at 2:47 AM, LALOT Dominique wrote:

Thanks for everybody. That was an interesting thread. Nobody seems  
to use a NetApp appliance, may be due to NFS architecture problems.


I believe I'll look to ext4 that seemed to be available in last  
kernel, and also to Solaris, but we are not enough to support  
another OS.


Dom

And Happy New Year !

2008/12/31 Bron Gondwana br...@fastmail.fm
On Tue, Dec 30, 2008 at 02:43:14PM -0700, Shawn Nock wrote:
 Bron and the fastmail guys could tell you more about reiserfs...  
we've

 used RHSuSE/reiserfs/EMC for quite a while and we are very happy.

Yeah, sure could :)

You can probably find plenty of stuff from me in the archives about  
our

setup - the basic things are:

* separate metadata on RAID1 10kRPM (or 15kRPM in the new boxes)  
drives.
* data files on RAID5 big slow drives - data IO isn't a limiting  
factor

* 300Gb slots with 15Gb associated meta drives, like this:

/dev/sdb6 14016208   8080360   5935848  58% /mnt/meta6
/dev/sdb7 14016208   8064848   5951360  58% /mnt/meta7
/dev/sdb8 14016208   8498812   5517396  61% /mnt/meta8
/dev/sdd2292959500 248086796  44872704  85% /mnt/data6
/dev/sdd3292959500 242722420  50237080  83% /mnt/data7
/dev/sdd4292959500 248840432  44119068  85% /mnt/data8

as you can see, that balances out pretty nicely.  We also store
per-user bayes databases on the associated meta drives.

We balance our disk usage by moving users between stores when usage
reaches 88% on any partition.  We get emailed if it goes above 92%
and paged if it goes above 95%.

Replication.  We have multiple slots on each server, and since
they are all the same size, we have replication pairs spread pretty
randomly around the hosts, so the failure of any one drive unit
(SCSI attached SATA) or imap server doesn't significantly overload
any one other machine.  By using Cyrus replication rather than,
say, DRBD, a filesystem corruption should only affect a single
partition, which won't take so long to fsck.

Moving users is easy - we run a sync_server on the Cyrus master, and
just create a custom config directory with symlinks into the tree on
the real server and a rewritten piece of mailboxes.db so we can
rename them during the move if needed.  It's all automatic.

We also have a CheckReplication perl module that can be used to
compare two ends to make sure everything is the same.  It does full
per-message flags checks, random sha1 integrity checks, etc.
Does require a custom patch to expose the GUID (as DIGEST.SHA1)
via IMAP.

I lost an entire drive unit on the 26th.  It stopped responding.
8 x 1TB drives in it.

I tried rebooting everything, then switched the affected stores over
to their replicas.  Total downtime for those users of about 15
minutes because I tried the reboot first just in case (there's a
chance that some messages were delivered and not yet replicated,
so it's better not to bring up the replica uncleanly until you're
sure there's no other choice)

In the end I decided that it wasn't recoverable quickly enough to
be viable, so chose new replica pairs for the slots that had been
on that drive unit (we keep some empty space on our machines for
just this eventuality) and started up another handy little script
sync_all_users which runs sync_client -u for every user, then
starts the rolling sync_client again at the end.  It took about
16 hours to bring everything back to fully replicated again.

Bron.



--
Dominique LALOT
Ingénieur Systèmes et Réseaux
http://annuaire.univmed.fr/showuser?uid=lalot
!DSPAM:495b4f1f47731804284693! 
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

!DSPAM:495b4f1f47731804284693!



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: choosing a file system

2008-12-31 Thread Scott Likens
Ah the saga of Hans Reiser.  That unfortunately is the Downfall of  
Reiserfs.

Yes, his company has disappeared, and a void has appeared from his  
lack of presence?

However, the Reiserfs4 patch set is current against the linux kernel  
2.6.28 (see 
http://www.kernel.org/pub/linux/kernel/people/edward/reiser4/reiser4-for-2.6/)

However I think that (http://en.wikipedia.org/wiki/Reiser4) pretty  
much sums up the future of Reiserfs4.

... However I haven't really run into show stopping bugs on Reiserfs3  
in quite some time (with excellent hardware).  However you replace it  
with dodgy hardware and things change.

I haven't looked at btrfs yet with Cyrus, perhaps I'll do that  
sometime soon.


On Dec 31, 2008, at 6:20 AM, Janne Peltonen wrote:

 On Wed, Dec 31, 2008 at 04:58:57AM -0800, Scott Likens wrote:
 I would not discount using reiserfs (v3) by any means.  It's still  
 by far a
 better choice for a filesystem with Cyrus then Ext3 or Ext4.  I  
 haven't really
 seen anyone do any tests with Ext4, but I imagine it should be  
 about par for
 the course for Ext3.

 There are /lots/ of (comparative) tests done: The most recent I could
 find with a quick Google is here:

  http://www.phoronix.com/scan.php?page=articleitem=ext4_benchmarks

 The problem with reiserfs is... well. The developers have explicitely
 stated that the development of v3 has come to its end, and there was  
 the
 long argument between Hans Reiser and kernel delevopers about  
 whether v4
 could be included in kernel. When Hans Reiser was charged with murder
 (not the crow or Cyrus variant), his company assured that the
 development (of v4) would continue, but the last time I tried to find
 out anything about the project, it appeared more or less dead. Of
 course, the current reiserfs (v3) is very stable, but if you run into
 any issues, there really isn't a developer you can contact (or send
 patches to, if you figure out the bug).


 --Janne
 -- 
 Janne Peltonen janne.pelto...@helsinki.fi PGP Key ID: 0x9CFAC88B
 Please consider membership of the Hospitality Club 
 (http://www.hospitalityclub.org 
 )


 !DSPAM:495b87d570801804284693!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Cyrus Deadblocking

2008-12-26 Thread Scott Likens
Hi Teresa,

I've been running Cyrus 2.3.13 successfully on Gentoo (amd64/x86_64)  
for quite some time without any issues.

It's currently linked against bdb 4.6, however I use skiplist for all  
my databases as I found overall that is much cleaner in the long run.

However, I can honestly say I have never run into your issue with  
cyrus starting to hang like that.  However, you want to ensure that  
both cyrus-sasl and imapd are linked to the same version of bdb,  
otherwise there's issues.

... So far the point of this email is pretty pointless, but I wanted  
to say that switching distributions is not ever an acceptable  
question/answer.

Having more detail from /var/log/messages would be very helpful as  
cyrus does tend to send debug information to syslog when it's  
crashing, so we can get more detail of why.

Scott


On Dec 26, 2008, at 4:06 AM, Teresa wrote:

 Adam Tauno Williams wrote:
 Why?  If so it makes more sense to convert your databases to skiplist
 and see if that helps than to flop library versions.

 Problem looks to be localized. After switching deliver.db to skiplist
 format it looks to run more stable (not sure yet, have to wait some  
 time).
 More about what did found i will write later after i am 100% sure
 problem is identified.

 One thing i noticed over all this days, if i completely wipe  
 deliver.db
 it takes longer to make cyrus processes hang again than just only
 restart cyrus.

 Maddly flipping versions seems a poor diagnostic method (if it even
 qualifies as a diagnostic method).

 In some special way, you have right. But as example cyrus-sasl crash  
 if
 it is compiled against 4.3.x versions of Berkeley DB.
 And works great with 4.5, 4.6 and 4.7
 So sometimes trying deifferent version gives some result too.

 The best approach is to switch to a distribution
 1) not acceptable
 2) you dont believe realy self what you wrote here, didnt you ?

 -- 
 Teresa
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:4954caa2131671804284693!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Cyrus IMAPd 2.3.13 Released

2008-10-29 Thread Scott Likens
Hi,

Recently updated to Cyrus IMAPd 2.3.13 with Gentoo, and ahem i'm  
having a unreliable connection on 1 account getting in with sieveshell.

There is no decent way for me to debug this at this time except strace  
(gdb was not very useful).

One account that has an active sieve script can login, however an  
account with a no sieve script... cannot login

Dirty fix, copy the sieve.bc and sieve script from that user, ln -sf  
defaultbc it... login it works.

Otherwise, it just sits there hanging at the prompt...

Thanks,

Scott M. Likens

syslog here.

Oct 29 21:25:27 desolation master[28464]: about to exec /usr/lib/cyrus/ 
timsieved
Oct 29 21:25:27 desolation sieve[28464]: executed
Oct 29 21:25:27 desolation sieve[28464]: accepted connection
Oct 29 21:25:27 desolation perl: DIGEST-MD5 client step 2
Oct 29 21:25:39 desolation sieve[28464]: login: localhost[127.0.0.1]  
scott DIGEST-MD5 User logged in
Oct 29 21:25:39 desolation perl: DIGEST-MD5 client step 3


I did try and nuke my mailboxes.db thinking that was related, nah...  
not even close.

//

[EMAIL PROTECTED] /usr/lib/cyrus $ strace -p 28464
Process 28464 attached - interrupt to quit
select(1, [0], NULL, NULL, {215992, 633000}) = 1 (in [0], left  
{215987, 975000})
read(0, {352+}\r\n..., 4096)  = 8
select(1, [0], NULL, NULL, {216000, 0}) = 1 (in [0], left {215999,  
96})
read(0, dXNlcm5hbWU9InNjb3R0IixyZWFsbT0iZ..., 4096) = 354
open(/etc/sasl2/sasldb2, O_RDONLY)= 12
fstat(12, {st_mode=S_IFREG|0600, st_size=12398, ...}) = 0
flock(12, LOCK_SH|LOCK_NB)  = 0
read(12, \316\232W\23\0\20\0\0\0\20\0\0\0\0\0\0\0\20\0\0\t 
\0\0\0\0\20\0\0\246\0\0\0\0..., 72) = 72
read(12,  
\0 
\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0...,  
4024) = 4024
lseek(12, 4096, SEEK_SET)   = 4096
read(12, \0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0  
\0\0\0\0\0\0\0..., 4096) = 4096
brk(0x734000)   = 0x734000
brk(0x755000)   = 0x755000
brk(0x776000)   = 0x776000
lseek(12, 8192, SEEK_SET)   = 8192
read(12,  
\1 
\0\0\0\0\0\0\0\222\17\0\0\0\0\0\0n0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0...,  
4096) = 4096
lseek(12, 12324, SEEK_SET)  = 12324
read(12, scott\0desolation\0userPasswordjade..., 37) = 37
flock(12, LOCK_UN)  = 0
close(12)   = 0
brk(0x72b000)   = 0x72b000
brk(0x729000)   = 0x729000
brk(0x728000)   = 0x728000
open(/etc/sasl2/sasldb2, O_RDONLY)= 12
fstat(12, {st_mode=S_IFREG|0600, st_size=12398, ...}) = 0
flock(12, LOCK_SH|LOCK_NB)  = 0
read(12, \316\232W\23\0\20\0\0\0\20\0\0\0\0\0\0\0\20\0\0\t 
\0\0\0\0\20\0\0\246\0\0\0\0..., 72) = 72
read(12,  
\0 
\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0...,  
4024) = 4024
lseek(12, 4096, SEEK_SET)   = 4096
read(12, \0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0 \0\0\0\0\0\0\0  
\0\0\0\0\0\0\0..., 4096) = 4096
brk(0x749000)   = 0x749000
brk(0x76a000)   = 0x76a000
brk(0x78b000)   = 0x78b000
lseek(12, 8192, SEEK_SET)   = 8192
read(12,  
\1 
\0\0\0\0\0\0\0\222\17\0\0\0\0\0\0n0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0...,  
4096) = 4096
flock(12, LOCK_UN)  = 0
close(12)   = 0
brk(0x72b000)   = 0x72b000
brk(0x729000)   = 0x729000
brk(0x728000)   = 0x728000
socket(PF_FILE, SOCK_STREAM, 0) = 12
fcntl(12, F_SETFL, O_RDWR|O_NONBLOCK)   = 0
connect(12, {sa_family=AF_FILE, path=/var/run/nscd/socket...}, 110)  
= -1 ENOENT (No such file or directory)
close(12)   = 0
socket(PF_FILE, SOCK_STREAM, 0) = 12
fcntl(12, F_SETFL, O_RDWR|O_NONBLOCK)   = 0
connect(12, {sa_family=AF_FILE, path=/var/run/nscd/socket...}, 110)  
= -1 ENOENT (No such file or directory)
close(12)   = 0
open(/etc/ld.so.cache, O_RDONLY)  = 12
fstat(12, {st_mode=S_IFREG|0644, st_size=102465, ...}) = 0
mmap(NULL, 102465, PROT_READ, MAP_PRIVATE, 12, 0) = 0x7fa5e4099000
close(12)   = 0
open(/lib/libnss_compat.so.2, O_RDONLY) = 12
read(12, \177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0 
\0\1\0\0\0\320\22\0\0\0\0\0\0@..., 832) = 832
fstat(12, {st_mode=S_IFREG|0755, st_size=40294, ...}) = 0
mmap(NULL, 2127088, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE,  
12, 0) = 0x7fa5dea74000
mprotect(0x7fa5dea7b000, 2093056, PROT_NONE) = 0
mmap(0x7fa5dec7a000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED| 
MAP_DENYWRITE, 12, 0x6000) = 0x7fa5dec7a000
close(12)   = 0
open(/lib/libnsl.so.1, O_RDONLY)  = 12
read(12, \177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0\0\1\0\0\@ 
\0\0\0\0\0\0@..., 832) = 832
fstat(12, {st_mode=S_IFREG|0755, st_size=108430, ...}) = 0
mmap(NULL, 219, 

Re: Cyrus vs Dovecot

2008-08-15 Thread Scott Likens
Can we please stop this thread?

No offense, but it's absolutely disgusting and should have never gone  
on this long.  This Mailing list is Dedicated to Cyrus, we do not need  
the rhetoric about Dovecot, or Courier, or Exchange.  If you have  
questions, ask them, if you need help, ask.  There is absolutely no  
need to bad mouth Dovecot, Cyrus, Exchange, etc.  It has no place on  
this mailing list what so ever.

I will end this email on, there are people here like Bron Godwana and  
others who have helped everyone who asked a question and spent a great  
deal of time fixing bugs.

Now, please if we can end this rhetoric and go back to our normal day  
please?

Thanks.

On Aug 14, 2008, at 11:30 AM, David Lang wrote:

 On Wed, 13 Aug 2008, Wesley Craig wrote:

 On 13 Aug 2008, at 10:31, kbajwa wrote:
 I think you are missing a point which is most important, i.e., what
 type of
 support Cyrus vs Dovecot offers. In my experience:

 Cyrus  =  0
 Dovecot=  100

 As someone who answers many help requests for cyrus (and I'm very far
 from the only one), I can honestly say I've never seen a requests
 from you.  Perhaps you've had a lot of occasion to ask for help with
 Dovecot.  I'm happy to hear you've gotten that help.  Community is a
 lot of what open source software is about.  As for your experience
 with the cyrus imapd community, perhaps your sample size is too  
 small.

 Or perhaps you're thinking of paid support?  Because I know very well
 that you can get that for cyrus imap.

 can you provide links to where from?

 David Lang
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:48a4930e231921909919347!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Cyrus + Ldap + sasl question

2008-07-27 Thread Scott Likens
Hi Sergio,

Unfortunately it's not possible to use CRAM-MD5 and DIGEST-MD5 without  
the plaintext password available to compare it with.

... Unless there is some patch or something I was not aware of, i've  
seen attempts in the past to bridge this gap.  so I doubt there is  
anything currently updated, however I suggest you to use ldapdb if you  
are not already.

Scott

On Jul 27, 2008, at 8:31 PM, Sergio Belkin wrote:

 Hi,

 I have a server running with Centos 5.1  and:

 Cyrus: Lan POP and IMAP server  both with SSL and plain and login  
 mechanisms

 LDAP with SSL + SASL

 User passwords in LDAP are encrypted.

 Everything works fine. But I'd want to reduce overhead due SSL and
 change to Cyrus with md5 mechanism (or another nonplain mechanism) Can
 I do that? Please bear in mind, that I don't want to use
 non-encrypyted passwords on LDAP.

 Thanks in advance!

 -- 
 --
 Open Kairos http://www.openkairos.com
 Watch More TV http://sebelk.blogspot.com
 Sergio Belkin -
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:488d4517244599194996942!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Couple of questions

2008-07-21 Thread Scott Likens
Hi,

When you deal with pop3, and migration there is typically 1 pain that  
is epic.

'UIDL' Output has changed, it can make duplicate emails appear because  
Outlook, or whatever you are using will not see the same 'results' as  
it had before.

Example, telnet localhost pop3

user foo
pass foo

+OK Mailbox locked and ready
stat
+OK 664 55805692
uidl
+OK unique-id listing follows
1 1202699390.3863
2 1202699390.3864

and so forth.  If you used Sendmail + UW it will be different then  
what you had before.  So the user will download their whole mailbox  
over.  Easiest solution I've always done is just create a folder in  
their inbox and move all their old mails to that folder, and then let  
them retrieve their email and they should be fine.  IMAP Users won't  
suffer this because they never download the whole mailbox.

Now let's say if you delete 1, and then quit, and log back in there is  
a new email 1... with a different uidl number shown.  So you are not  
downloading a duplicate email, a brand new one.  This is the proper  
behavior, if you are not experiencing this behavior; then clearly we  
need more detail about your setup.

Now there is a header added with LMTP

This is what I personally see in my headers,

Received: from deliver ([unix socket])
 by desolation (Cyrus v2.3.12p2-Gentoo) with LMTPA;
 Mon, 21 Jul 2008 14:20:31 -0700
X-Sieve: CMU Sieve 2.3

I use deliver (because of DSPAM, I can tell it to talk to LMTP but I  
don't) ... if you are using LMTP the header will show  
[EMAIL PROTECTED] instead.  If this is screwing up your procmail  
recipes I suggest you make modifications to such recipes so they are  
no longer fooled.

FWIW,

Return-Path: [EMAIL PROTECTED]

That's my return path, note it has nothing to do with [EMAIL PROTECTED], so I  
think we'll need to know more about your setup before we can  
accurately give any help.

Scott

On Jul 21, 2008, at 2:15 PM, Steve Webb wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 1.)  If a pop user selects keep messages on server they start to  
 see
 duplicate emails.  I saw that other people on the listserv have  
 also had
 the same issues, but there's not been any resolution to this  
 issue.  Q:
 How come Cyrus doesn't implement the correct bahaviour, and is  
 there any
 work-around other than switching to IMAP over POP?  I've got pop  
 users
 that can't access IMAP (using phones for checking email when on  
 travel
 with leave messages on server then suck down the emails when  
 they arrive
 back at a desktop).  It's not feasable for them to move to IMAP  
 and they
 require this functionality.

 Are you certain this is the fault of Cyrus and not a deficient client
 that happened to work with UW?  Are they all using the same kind of
 phone (what phone)?

 I confirmed that this happens with outlook, thunderbird and fetchmail.

 The phone is a Palm Treo.

 2.)  It seems that Cyrus is inserting headers that confuse  
 sendmail and/or
 procmail.  When I'm tailing my procmail log, I see that all emails  
 are
 From: [EMAIL PROTECTED].  I'm guessing that procmail is getting this  
 from the
 Return-Path: header that doesn't get inserted into the email with
 sendmail.  Q: Can I tell Cyrus to not insert this header or is  
 there a
 work-around for procmail to detect the correct From: header and  
 not get
 confused?

 I'm pretty certain such headers are coming from your MTA (postfix)  
 and
 not Cyrus.  But I've never used Cyrus with procmail as SIEVE is  
 usually
 sufficient.

 Would postfix be inserting the Return-Path: [EMAIL PROTECTED] header?  I
 thought that it got inserted by the 'deliver' binary which I thought  
 was
 part of Cyrus.

 - - Steve

 - --
 Steve Webb - Lead System Administrator for Pronto.com
 Email: [EMAIL PROTECTED]  (Please send any work requests to: [EMAIL 
 PROTECTED] 
 )
 Cell: 303-564-4269, Office: 303-497-9367, YIM: scumola
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.5 (GNU/Linux)

 iD8DBQFIhPyDbhtJr2D5JAsRAnK/AJ9MwnnDHzJhkwRfi/7Z+w445M3/eACdFIad
 nDRAb0GEVlPXP+37pDWFeN0=
 =aJej
 -END PGP SIGNATURE-
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:4884fd9f121869173225906!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Problem on receiving emails

2008-07-19 Thread Scott Likens
Dear Stephen,

SugarCRM does not use Cyrus to send emails.  This would fall under  
Postfix I believe is what you use for an MTA.

I suggest you to verify that 'localhost' or the host SugarCRM is  
sitting on to be configured as a relay host, or configure SugarCRM to  
use SMTP Authentication.  Otherwise Please seek assistance with the  
Postfix mailing list.

Thanks,

Scott

On Jul 18, 2008, at 10:15 PM, Stephen Liu wrote:

 Hi folks,


 Postfix
 Cyrus
 SugarCRM


 Previously I have been sufferring users can't send emails on mail
 client, Evolution, on local PC.  They can receive mails.  With the
 assistance of folk on [EMAIL PROTECTED] the problem  
 was
 fixed.


 Now I'm suffering on users can't receive emails on SugarCRM on local  
 PC
 but can send emails on SugarCRM.  The emails are download displayed on
 a popup window.  But Sugar users can't find them on Sugar folder.


 $ tail /var/log/syslog
 Jul 19 12:42:11 satimis cyrus/pop3[4512]: login: satimis.com
 [192.168.0.52] rey plaintext User logged in
 Jul 19 12:42:11 satimis cyrus/pop3[4512]: accepted connection
 Jul 19 12:42:11 satimis cyrus/pop3[4512]: login: satimis.com
 [192.168.0.52] rey plaintext User logged in
 Jul 19 12:42:11 satimis last message repeated 2 times
 Jul 19 12:42:16 satimis cyrus/pop3[4512]: accepted connection
 Jul 19 12:42:16 satimis cyrus/pop3[4512]: login: satimis.com
 [192.168.0.52] rey plaintext User logged in
 Jul 19 12:42:16 satimis last message repeated 2 times
 Jul 19 12:43:01 satimis /USR/SBIN/CRON[4523]: (root) CMD (cd
 /var/www/SugarCE-Full-5.0.0e; php -f cron.php  /dev/null 21)
 Jul 19 12:43:17 satimis cyrus/master[3876]: process 4512 exited,  
 status
 0
 Jul 19 12:44:01 satimis /USR/SBIN/CRON[4527]: (root) CMD (cd
 /var/www/SugarCE-Full-5.0.0e; php -f cron.php  /dev/null 21)


 $ tail /var/log/mail.log
 Jul 19 12:42:11 satimis cyrus/pop3[4512]: accepted connection
 Jul 19 12:42:11 satimis cyrus/pop3[4512]: login: satimis.com
 [192.168.0.52] rey plaintext User logged in
 Jul 19 12:42:11 satimis last message repeated 2 times
 Jul 19 12:42:16 satimis cyrus/pop3[4512]: accepted connection
 Jul 19 12:42:16 satimis cyrus/pop3[4512]: login: satimis.com
 [192.168.0.52] rey plaintext User logged in
 Jul 19 12:42:16 satimis last message repeated 2 times
 Jul 19 12:43:17 satimis cyrus/master[3876]: process 4512 exited,  
 status
 0
 Jul 19 12:45:14 satimis postfix/anvil[4502]: statistics: max  
 connection
 rate 1/60s for (smtp:192.168.0.52) at Jul 19 12:41:53
 Jul 19 12:45:14 satimis postfix/anvil[4502]: statistics: max  
 connection
 count 1 for (smtp:192.168.0.52) at Jul 19 12:41:53
 Jul 19 12:45:14 satimis postfix/anvil[4502]: statistics: max cache  
 size
 1 at Jul 19 12:41:53



 Would there be any connection with Cyrus?  If YES please advise how to
 fix the problem.  TIA


 B.R.
 Stephen L

 Send instant messages to your online friends http://uk.messenger.yahoo.com
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:48817c5e119561804284693!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Fwd: NDN: Re: Simple Sieve question

2008-07-05 Thread Scott Likens

If someone can please remove this user from the mailing lists?

Thanks :)



Begin forwarded message:


From: [EMAIL PROTECTED]
Date: July 4, 2008 3:54:47 PM PDT
To: Scott Likens [EMAIL PROTECTED]
Subject: NDN: Re: Simple Sieve question

Sorry. Your message could not be delivered to:

0aheebdd (The name was not found at the remote site. Check that the  
name

has been entered correctly.)



!DSPAM:486f4636130771546544105!





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Fwd: NDN: Re: Simple Sieve question

2008-07-05 Thread Scott Likens

another ...


Begin forwarded message:


From: [EMAIL PROTECTED]
Date: July 5, 2008 3:32:02 AM PDT
To: [EMAIL PROTECTED]
Subject: Re: Fwd: NDN: Re: Simple Sieve question

Dear Business Partner,
for months the mails of our user have been sent to you from our new  
Domain.
This Domain has now been closed. If you have not changed the e-mail  
adress of the respective person in our company to his new one,  
please do it now!

The new Domain is [EMAIL PROTECTED] intial [EMAIL PROTECTED]
In case you have any question please adress them to [EMAIL PROTECTED]


!DSPAM:486f50da134771804284693!





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Simple Sieve question

2008-07-04 Thread Scott Likens

Assuming that user has the 'p' right to user.fred.INBOX.Spam then yes.

If they don't have the 'p' right, the mail will just be sent in limbo.

On Jul 4, 2008, at 9:30 AM, Bob Bob wrote:


Hi all

Cant seem to find an answer on this one.. I should experiment but  
would like some advance info.


Can sieve fileinto into a mailbox folder that is not at or below  
the Inbox?. If so what would the syntax look like;


ie

fileinto /user.fred.INBOX.Spam instead of just INBOX.Spam as  
user fred.


Assumes of course that the user has ACL rights to the folder in  
question.


Am experimenting with Outlook Calenders, Free/Busy and an  
autoresponder/resource booking system under Bynari's Insight  
connector.


Tnxs, Bob


!DSPAM:486e57c0223491646824759!

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

!DSPAM:486e57c0223491646824759!



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Is skiplist dependant on byte order?

2008-06-16 Thread Scott Likens
I'm going to take a shot in the dark,

BIG Endian vs. Little Endian?

Unfortunately I do believe bdb databases do care if it was big or  
little... and going from Sparc (BIG) to x86 (little)...

Would not work very well :(

I am going to guess that a reconstruct may not be a bad idea, your  
seen databases may or may not work, and pretty much guess that any and  
all databases related to Cyrus will need to be re-worked... I'm sure  
someone like Bron (fastmail.fm) might have something already whipped  
up for this.

...

Seen should be in /var/imap/user
... I would check on sieve (it is compiled also) ... (/var/imap/sieve?)

as well as /var/imap/db/*

then the /var/spool/imap/a/user/.. and you can more then likely just  
do a reconstruct -rf and be fine...

This is at least what I would do, I might have overstated how much  
fun it will be, or under.

On Jun 15, 2008, at 6:38 PM, Gary Mills wrote:

 I recently upgraded a murder front end server from Solaris 9 SPARC to
 Solaris 10 x86 by copying the /imap directory.  I did dump the
 mailboxes database before the copy.  It's a skiplist database.  I'm
 running cyrus-imapd-2.3.8 on both systems.  As a test, I first checked
 on the mailboxes database like this:

# su cyrus -c ksh
# /usr/local/cyrus/bin/ctl_mboxlist -d | wc -l
   0

 This message appeared in the log:

Jun 11 16:24:43 setup01 ctl_mboxlist[14082]: [ID 864961  
 local6.crit] DBERROR: critical database situation

 After I reloaded it, I got the correct output:

# /usr/local/cyrus/bin/ctl_mboxlist -u  mailboxes.txt
# /usr/local/cyrus/bin/ctl_mboxlist -d | wc -l
  77

 This is a test server with only a few mailboxes.  I'll upgrade the
 production server later.

 I'm assuming that skiplist is dependant on the machine's byte order,
 and that a dump and reload is necessary in this case.

 Are there any other databases that I should also dump and reload?  As
 far as I can tell, the annotation_db, duplicate_db, and tlscache_db
 are empty and can simply be removed.  Are there any others on a murder
 front end that I've missed?  Where do they reside?

 -- 
 -Gary Mills--Unix Support--U of M Academic Computing and  
 Networking-
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:4855c85a167801880617195!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Cyrus - GFS slow start and poor performace

2008-05-19 Thread Scott Likens
Hi Maurizo,

Technically, even if you were using duplicate suppression it would not  
be a huge loss to store it on a local filesystem.

You don't usually see duplicate id's unless someone's MTA goes  
bonkers; or their MUA is stupid; oh and SPAM.

So yeah go for it, that'll save you a good deal of heartache.


On May 19, 2008, at 3:18 AM, Maurizio Lo Bosco wrote:

 Using the flat configuration for the mailbox.db the slow start
 disapepars. May I use a flat database for 4300+ mailbox?
 Do you think I could have other performance problems in
 delivery/accessing the mailbox?

 I considered creating a GFS spool for a 5 mailbox system, but  
 during
 testing, the GFS lock overhead would've been too much during delivery
 peaks. Probably had to do mostly with delivery.db locking.

 so far, with 4300+ users it is safe to use a flat database for the  
 mailbox.db
 but I will encounter issues with the delivery.
 If I'm not wrong the delivery.db database is reported as  
 duplicate_db in the
 imapd.conf and it is not possible to set it as flat. We don't use the
 suppression capability of the cyrus ( a bug of the outlook message  
 id in the
 read_confirmreply ) so It could be safe to put 2 separate database  
 on the
 local FS. Is this correct?

 Regards
  Maurizio
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:48315d3550081699917803!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Cyrus - GFS slow start and poor performace

2008-05-15 Thread Scott Likens

If you wish to do load balancing,

I suggest looking at nginx.

For documentation ... http://wiki.codemongers.com/Main

I don't have a lot of experience with GFS1 or OCFS, however I don't  
expect great performance.  I would imagine worse then ext3 or about  
the same is the best you will be able to achieve.


You may have better luck with syncclient, or setting up Murder with 2  
Front ends and 1 backend.  I guess the bottom line is read-write  
configuration shared between 2 servers is .. (to me) hit and miss.  It  
really depends on what your trying to do with it, and how your trying  
to make it work.


In this case, I would not personally suggest a read-write with DRBD or  
ocfs/gfs as you are going to either encounter bugs from filesystems,  
cyrus, or both; if someone has a configuration where any 3 of those I  
just mentioned works great... then by all means please chime in.


Scott
On May 15, 2008, at 6:25 AM, Maurizio Lo Bosco wrote:


Given that he's got two machines, I might suggest mupdate_config:
replicated and definitely have mailboxes.db on local disk.
I'm taking a look at the configuration of the mupdate replicated  
architecture.


As stated in an old post on this list (20-Dec-2005), the Cyrus 2.3  
replicated
configuration seams a very good solution, but in the current  
documentation is

stated :Note that load balancing is not possible with the current
replication code, but it is intended to be supported in the future.

I would like to use both server in active/active configuration, is  
it possible

with the mupdate replication?
Otherwise I will study the solution proposed by Bron to sync a local
mailbox.db with the GFS...but I have to pay attention on the  
contemporary of

the sync from the two servers.
Regards
 Maurizio

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


!DSPAM:482c4325166021222944467!





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus - GFS slow start and poor performace

2008-05-14 Thread Scott Likens
Going to toss in my 10 cents.

I'm assuming the GFS is the same lun/id on both servers, and you are  
using GFS to read-write between 2 or more servers.

You could try OCFS2 instead of GFS... Other then that the only thing I  
can think of is using DRBD in a read-write configuration.  However  
that would be using 2 lun/id's instead of only 1.

However I imagine the results will be more or less the same, as GFS2  
and OCFS2 may handle reads and writes to ensure accuracy?


On May 14, 2008, at 7:46 AM, Wesley Craig wrote:

 Given that he's got two machines, I might suggest mupdate_config:
 replicated and definitely have mailboxes.db on local disk.

 :wes

 On 14 May 2008, at 06:30, Bron Gondwana wrote:
 Depending on your requirements, it may make sense to place your
 mailboxes.db on local
 disk (it's pretty small) and regularly copy/rsync it onto your GFS
 partition.  Worst
 case you lose a couple of mailboxes.db records in a crash.  Depends
 what you can afford
 to lose.  You could probably stat the file every second and copy it
 on any change pretty
 cheaply and risk losing at most the last second's changes (it
 doesn't change often)

 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:482b00dc195276105139502!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Fwd: NDN: Re: Cyrus - GFS slow start and poor performace

2008-05-14 Thread Scott Likens

Can someone please remove this user from the list?

...


Begin forwarded message:


From: [EMAIL PROTECTED]
Date: May 14, 2008 12:57:34 PM PDT
To: Scott Likens [EMAIL PROTECTED]
Subject: NDN: Re: Cyrus - GFS slow start and poor performace

Sorry. Your message could not be delivered to:

pemoyetd,Golden Gate Language Sc (The name was not found at the remote
site. Check that the name has been entered correctly.)



!DSPAM:482b47ac208081263019146!





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Backscatter solutions

2008-05-08 Thread Scott Likens
I wish that was really true,

However having a spammer recently using my domain and email address to  
spam viagra.  SPF etc don't really work unless the receiver is using  
SPF checking.

The simple truth is, bots check mailing lists, spam as users like you  
or I.  They find a new target, and start over and over again.

They don't care about SPF, or  anything related to that.  Because if  
5-10% of their spam gets filtered, that still means they were only  
shorted by 10,000 emails maybe.

... Truthfully the real solution is for ISPS to cancel those accounts  
when reported, and report them when you catch them.  It's a cat and  
mouse game that until there is a OS that 90% of the World uses that  
isn't exploitable in under 30 Seconds... will never end.

As there is always some vulnerability, there is always someone willing  
to use that vulnerability for purposes of making money.


On May 8, 2008, at 4:55 PM, Jules Agee wrote:

 Marc Grober wrote:
 I am getting pounded by backscatter as a result of one of my  
 addresses
 being used by some major spammers. Are there any solutions  
 available to
 address all the Delivery failure and bounce notices.  I would at  
 least
 like to be able to sort between such responses from mail I am  
 actually
 sending and the backscatter. I have looked through headers and  
 nothing
 seems an obvious candidate.

 Setting up SPF for your domains will help.
 http://www.openspf.org/

 -- 
 Jules Agee
 System Administrator
 Pacific Coast Feather Co.
 [EMAIL PROTECTED]  x284
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:48239ac333621804284693!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Account re-initialization after directory deletion

2008-04-28 Thread Scott Likens
Hi,

Easiest fix is to re-create the directory of the account that was  
deleted, with the cyrus.* files in it.

Easiest thing if you can find an empty account on your server.  cp -pr  
it to your account name, ensure the permissions are the same (owner  
cyrus) then you can reconstruct -r -f user.usernamethatwasdeleted

then you should be good to go.

Basic problem was/is that the folder does not exist anymore and you  
need to re-create it so the system see's it again and it works.

Best of luck

On Apr 27, 2008, at 11:34 AM, Thomas Manson wrote:

 Hi,

   I've an issue with my account.

   the directory of the account in /var/spool/imap/t/user was deleted.

   When I try to gets its mail, I get : Unable to open maildrop :  
 System I/O error
 (Apr 27 20:33:06 dell1 pop3[29552]: Unable to open maildrop for  
 thomas: System I/O error)

   A restart of cyrus do not correct the issue.

   How can I re init the account ?

 Regards,
 Thomas.
 !DSPAM:4814d268291701804284693! 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

 !DSPAM:4814d268291701804284693!


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Miserable performance of cyrus-imapd 2.3.9 -- seems to be locking issues

2008-02-28 Thread Scott Likens
Okay, I read over this and I felt worth commenting...

There's mention of using MD, DRBD, LVM2, etc... it sounds extremely  
conviluted and way to complex for what you are needing.

When you are doing a read or a write, each thing takes it's time  
before it gets commited to disk.

If you are doing DRBD, you may want to change a few settings
you're doing raid5 with 3 sata disks using md and drbd... on top of  
lvm etc.

For Example,

quote
protocol prot-id
On the TCP/IP link the specified protocol is used. Valid protocol  
specifiers are A, B, and C.

Protocol A: write IO is reported as completed, if it has reached local  
disk and local TCP send buffer.

Protocol B: write IO is reported as completed, if it has reached local  
disk and remote buffer cache.

Protocol C: write IO is reported as completed, if it has reached both  
local and remote disk.
/quote

 From personal experience, I have found that people usually use  
Protocol C... it's great however it can result in slower writes...  
which depending on your hardware can be very painful.  The fact that  
you have LVM2 sitting in there, as well as MD that means your average  
write has to go through DRBD (and wrote to both servers) ... as well  
as LVM2, and MD before it's actually written... (in a very vague sense)

Additionally you can use LVM2 Striping I really won't get into that  
but that may be more beneficial then a RAID-5 with 3 Disks.

There's lots of hints if you read over the archives for speed, I can  
just tell you from what I have read there is nothing you can do with  
your complex setup to make it better.


My best hint for you would be hardware raid, for one that's a big  
step, if you really want raid-5, it may be more beneficial to use 4  
SATA disks... You can and will expect no matter how good your hardware  
is (read slow writes) with RAID-5 and MD.  I had a Zimbra mailserver  
with RAID-5 and the best write I could get was 75Mbit, and that was  
using 8 15k RPM SCSI disks... :(

Hardware Raid, remove LVM unless you really need it... remove DRBD  
unless you totally need it there is other ways to create  
redundancy that are better then DRBD... It's not that I hate DRBD... I  
just hate seeing it implemented in places where it just does not  
belong

I don't know if this will make sense, if it doesn't let me know and  
I'll break it down further if you need it.

Lastly, if you could show us some of your syslog to see if there is  
actually any warnings about '440 lockers in use' or such?

Scott

On Feb 28, 2008, at 2:54 PM, Michael Bacon wrote:

 Jeff,

 Just as a rule of thumb, if you've got problems with Cyrus (or any  
 mail
 system), 90% of the time they're related to I/O performance.

 I've never seen drbd used for Cyrus, but it looks like other folks  
 have
 done it.  The combination of drbd+lvm2+ext3 might put you somewhere
 unpleasant, but I'll have to let the Linux-heads jump in on that one.

 Beyond that, I don't see anything obviously wrong, but maybe someone  
 who's
 run it more on Linux can chime in.

 -Michael

 --On Thursday, February 28, 2008 3:36 PM -0700 Jeff Fookson
 [EMAIL PROTECTED] wrote:

 Michael Bacon wrote:

 What database format are you using for the mailboxes database?  What
 kind of storage is the metapartition (usually /var/imap) on?  What
 kind of storage are your mail partitions on?

 Databases are all skiplist. Our mail partition and the  
 metapartition are
 both on the same filesystem, as we intended that both be part of  
 the same
 drbd mirror. That partition is
 a linux software RAID 5 (3 SATA disks). On top of the md layer is the
 drbd device; on top of that is an lvm2 logical volume; on top of  
 that is
 an ext3 filesystem, mounted
 as '/var/imap'. The mail is then in /var/imap/mail and the metadata  
 in
 /var/imap/config (and we also have /var/imap/certs for the ssl  
 stuff, and
 /var/imap/sieve for sieve scripts).

 Thanks.

 Jeff Fookson



 --On Thursday, February 28, 2008 2:38 PM -0700 Jeff Fookson
 [EMAIL PROTECTED] wrote:

 Folks-

 I am hoping to get some help and guidance as to why our  
 installation of
 cyrus-imapd 2.3.9
 is unusably slow. Here are the specifics:

 The software is running on a 1.6GHz Opteron with 2Gb memory  
 supporting a
 user base of about 400
 users. The average rate of arriving mail is on the order of 1-2
 messages/sec. The active mailstore
 is about 200GB.  There are typically about 200  'imapd'
 processes at a given time and a hugely varying number of  
 'lmtpds' (from
 about 6 to many hundreds during
 times of greatest pathology). System load is correspondingly in  
 the 2-15
 range, but can spike to 50-70!

 Our users complain that the system is extremely sluggish during  
 the day
 when the system is most busy.

 The most obvious thing we observe is that both the lmtpds and the  
 imapds
 are spending HUGE times waiting
 on locks. Even when the system load is only 1-2, an 'strace'  
 attached to
 an instance of lmtpd or imapd shows
 waits 

Re: Open files issues

2008-01-16 Thread Scott Likens
Hi Tom,

I am more concerned with,

 990804:Jan 16 13:39:16 zeus kernel: imapd[32503]: segfault at  
 d6f556fc eip
 0806fd0a esp bfa06d90 error 5
 990805:Jan 16 13:39:16 zeus master[24939]: service imaps pid 32503  
 in BUSY
 state: terminated abnormally


the 'Open' file issue would also worry me, but if imapd is segfaulting  
like this, it may leave a file open? for a time (unsure on this but it  
seems plausable).

Either way the first thing I would be looking at was the eip/esp  
segfault error.  Since that reminds me of a kernel panic of some kind,  
I would verify with dmesg and see if you can track down what's going  
on.  imo if you fix the eip/esp segfault(kernel panic) you'll fix the  
open files.

Scott


On Jan 16, 2008, at 8:57 AM, Tom Myny wrote:

 It maybe has not directly anything to see with open files.

 I also see this in my logs:

 990618:Jan 16 13:39:14 zeus master[32503]: about to exec
 /usr/cyrus/bin/imapd
 990636:Jan 16 13:39:14 zeus imaps[32503]: executed
 990650:Jan 16 13:39:15 zeus imaps[32503]: accepted connection
 990671:Jan 16 13:39:15 zeus imaps[32503]: imapd:Loading hard-coded DH
 parameters
 990697:Jan 16 13:39:15 zeus imaps[32503]: SSL_accept() incomplete -  
 wait
 990708:Jan 16 13:39:15 zeus imaps[32503]: SSL_accept() succeeded -  
 done
 990716:Jan 16 13:39:15 zeus imaps[32503]: starttls: TLSv1 with cipher
 DHE-RSA-AES256-SHA (256/256 bits reused) no authentication
 990746:Jan 16 13:39:15 zeus imaps[32503]: login: www.someip.net
 [192.168.1.1] user1 plain+TLS User logged in
 990747:Jan 16 13:39:15 zeus imaps[32503]: seen_db: user user1 opened
 /var/imap/user/a/user1.seen
 990748:Jan 16 13:39:15 zeus imaps[32503]: open: user user1 opened  
 INBOX
 990796:Jan 16 13:39:16 zeus master[24939]: process 32503 exited,  
 signaled to
 death by 11
 990804:Jan 16 13:39:16 zeus kernel: imapd[32503]: segfault at  
 d6f556fc eip
 0806fd0a esp bfa06d90 error 5
 990805:Jan 16 13:39:16 zeus master[24939]: service imaps pid 32503  
 in BUSY
 state: terminated abnormally

 Regards,
 Tom

 -Original Message-
 From: Scott Likens [mailto:[EMAIL PROTECTED]
 Sent: dinsdag 15 januari 2008 18:49
 To: Alain Spineux
 Cc: Tom Myny; info-cyrus@lists.andrew.cmu.edu
 Subject: Re: Open files issues

 Step 1, su -
 Step 2, su cyrus -
 Step 3, ulimit -a

 More then likely the cyrus user does not have the same ability as
 'root' does for maxfiles, so then you would need to modify them.
 Depending on how your Linux configuration is setup that can be just a
 simple addition to /etc/profile, or you may need to modify login.conf
 or some security file in order to up the maxfiles for that user.

 Since cyrus is not in the 'wheel' group it is not considered a
 superuser, so it does not inherit the 'superuser' permissions for
 maxopenfiles.

 This is a known thing for like NetBSD, and they fix it appropriately
 by telling the script to change the ulimit while it runs...

 hth

 Scott
 On Jan 15, 2008, at 7:54 AM, Alain Spineux wrote:

 On Jan 15, 2008 3:31 PM, Tom Myny [EMAIL PROTECTED] wrote:
 Hi Guys,

 I'm having this each day:

 Jan 15 09:06:03 zeus lmtpunix[1029]: IOERROR: creating quota file
 /var/imap/quota/l/user.user1.NEW: Too many open files
 Jan 15 09:51:29 zeus lmtpunix[24100]: IOERROR: creating quota file
 /var/imap/quota/i/user.user2.NEW: Too many open files
 Jan 15 09:51:50 zeus lmtpunix[24100]: IOERROR: opening quota file
 /var/imap/quota/f/user.user3: Too many open files
 Jan 15 09:52:01 zeus lmtpunix[24100]: IOERROR: opening quota file
 /var/imap/quota/i/user.user4: Too many open files
 Jan 15 10:34:04 zeus lmtpunix[16510]: IOERROR: creating quota file
 /var/imap/quota/w/user.user5.NEW: Too many open files
 ..


 Are you sure cyrus is guilty and no simply suffering of another
 process ?
 You can use lsof command to see who open what.

 I've tried the following:

 ---

 Check file-max:

 cat /proc/sys/fs/file-max

 359801

 ---

 Checking ulimit:

 ulimit -a
 core file size  (blocks, -c) 0
 data seg size   (kbytes, -d) unlimited
 max nice(-e) 0
 file size   (blocks, -f) unlimited
 pending signals (-i) unlimited
 max locked memory   (kbytes, -l) unlimited
 max memory size (kbytes, -m) unlimited
 open files  (-n) 1024
 pipe size(512 bytes, -p) 8
 POSIX message queues (bytes, -q) unlimited
 max rt priority (-r) 0
 stack size  (kbytes, -s) 8192
 cpu time   (seconds, -t) unlimited
 max user processes  (-u) unlimited
 virtual memory  (kbytes, -v) unlimited
 file locks  (-x) unlimited

 Set ulimit -n 1 on start-up script - No effect :(


 ---

 Changed NR_OPEN and NR_FILE in kernel, recompile - No effect :(

 ---


 Anybody an idea ?

 Regards,
 Tom

 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu

Re: Open files issues

2008-01-15 Thread Scott Likens
Step 1, su -
Step 2, su cyrus -
Step 3, ulimit -a

More then likely the cyrus user does not have the same ability as  
'root' does for maxfiles, so then you would need to modify them.   
Depending on how your Linux configuration is setup that can be just a  
simple addition to /etc/profile, or you may need to modify login.conf  
or some security file in order to up the maxfiles for that user.

Since cyrus is not in the 'wheel' group it is not considered a  
superuser, so it does not inherit the 'superuser' permissions for  
maxopenfiles.

This is a known thing for like NetBSD, and they fix it appropriately  
by telling the script to change the ulimit while it runs...

hth

Scott
On Jan 15, 2008, at 7:54 AM, Alain Spineux wrote:

 On Jan 15, 2008 3:31 PM, Tom Myny [EMAIL PROTECTED] wrote:
 Hi Guys,

 I'm having this each day:

 Jan 15 09:06:03 zeus lmtpunix[1029]: IOERROR: creating quota file
 /var/imap/quota/l/user.user1.NEW: Too many open files
 Jan 15 09:51:29 zeus lmtpunix[24100]: IOERROR: creating quota file
 /var/imap/quota/i/user.user2.NEW: Too many open files
 Jan 15 09:51:50 zeus lmtpunix[24100]: IOERROR: opening quota file
 /var/imap/quota/f/user.user3: Too many open files
 Jan 15 09:52:01 zeus lmtpunix[24100]: IOERROR: opening quota file
 /var/imap/quota/i/user.user4: Too many open files
 Jan 15 10:34:04 zeus lmtpunix[16510]: IOERROR: creating quota file
 /var/imap/quota/w/user.user5.NEW: Too many open files
 ..


 Are you sure cyrus is guilty and no simply suffering of another  
 process ?
 You can use lsof command to see who open what.

 I've tried the following:

 ---

 Check file-max:

 cat /proc/sys/fs/file-max

 359801

 ---

 Checking ulimit:

 ulimit -a
 core file size  (blocks, -c) 0
 data seg size   (kbytes, -d) unlimited
 max nice(-e) 0
 file size   (blocks, -f) unlimited
 pending signals (-i) unlimited
 max locked memory   (kbytes, -l) unlimited
 max memory size (kbytes, -m) unlimited
 open files  (-n) 1024
 pipe size(512 bytes, -p) 8
 POSIX message queues (bytes, -q) unlimited
 max rt priority (-r) 0
 stack size  (kbytes, -s) 8192
 cpu time   (seconds, -t) unlimited
 max user processes  (-u) unlimited
 virtual memory  (kbytes, -v) unlimited
 file locks  (-x) unlimited

 Set ulimit -n 1 on start-up script - No effect :(


 ---

 Changed NR_OPEN and NR_FILE in kernel, recompile - No effect :(

 ---


 Anybody an idea ?

 Regards,
 Tom

 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html




 -- 
 Alain Spineux
 aspineux gmail com
 May the sources be with you
 
 Cyrus Home Page: http://cyrusimap.web.cmu.edu/
 Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


 !DSPAM:478cf03271951804284693!




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html