Re: backup rsync

[David R Bosso]

--On August 29, 2014 at 4:27:57 PM +0200 Marcus Schopen 
 wrote:

> Hi,
>
> I'm planing to use lvm snaps and rsync for a daily disaster recovery
> backup on my master cyrus (2.4.12 Ubuntu 12.04 LTS):

Have you tested lvm snaps for this purpose yet?  When I tried to use lvm 
snapshots in this way a few years ago, it absolutely killed performance on 
the volume with the active snapshots.  Hopefully things have improved, but 
I wouldn't bet on it.

-David

>  ctl_cyrusdb -c
>  ctl_mboxlist -d > mailboxes.db.dump
>  stop cyrus
>  lvm snaps
>  start cyrus
>  rsync /var/lib/cyrus/ and /var/spool/cyrus to backup host
>  remove snaps
>
> Is there something to be aware with rsync especially
> with /var/spool/cyrus directories?
>
> Beside that the master is in master-slave replication too. In a case of
> disaster recovery - if you don't want to make the slave to the master -
> would it work out to rsync /var/lib/cyrus/ and /var/spool/cyrus from the
> slave to the master or is that not a good idea?
>
> Ciao
> Marcus
>
>
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

2.4 bugfix release?

[David R Bosso]

Hi All,

I seem to recall talk of a bugfix 2.4.18 release sometime in January.  Is 
this in the works, or is there a list of patches to apply to 2.4.17 for 
unreleased fixes somewhere?

Thanks.

-David

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Cyrus-imapd memory tuning

[David R Bosso]

--On March 12, 2014 11:53:03 PM +1100 Bron Gondwana  
wrote:

>
> Looks like on a medium-loaded server we have about 15,000 connections open
> at the moment.  It's about 40% masters, 40% replicas, 20% unallocated.
>
>> About disk, what is the high size of a single partition managed by Cyrus?
>
> We're just using a single partition (default) in each instance of Cyrus,
> but there are multiple instances installed.

Hi Bron,

Just curious about what filesystem (and any special mount options) you're 
using these days for large cyrus stores.  We've been using ext4 for a while 
now (we used to use reiser) and have seen performance degradation over 
time.  I've been wondering if anyone has any positive experience with using 
recent XFS.

Thanks.

-David

-- 
David R Bosso 
Systems & Network Architect, Letters and Science IT
UC Santa Barbara - 1107 SSMS Bldg. 805 451-7160

> The config is somewhat complex, we're running a patch which enables
> 'archive' storage.  It's a little bit buggy still, but good enough for
> our purposes with some babysitting.
>
> The 'spool' path is on a shared SSD (400Gb x RAID1), but there's a
> separate archive partition for each slot with 1Tb of space allocated.
>
> So overall it's laid out as two x 12 drive RAID6 of 2Tb drives, each with
> a 20Tb volume which is them configured with GPT partition table as 20
> separate 1Tb partitions.
>
> There's also a separate 3-drive RAID 1e (3Tb storage striped over 3 disks)
> with search data, using yet another set of patches which integrate the
> Xapian search engine into our Cyrus system for fast full-text searches.
>
> I've nearly finished writing a blog post which incidentally glances over
> some of this stuff while talking about a recent outage.
>
> Bron.
>
> --
>   Bron Gondwana
>   br...@fastmail.fm
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Stability of idled

[David R Bosso]

This is useful information, I was going to send out a query on idled 
experience because I recall that message a while ago stating that it was 
not well tested.  Are there others using it on a large scale?

Thanks.

-David

--On August 15, 2011 3:57:14 PM +0200 Pascal Gienger 
 wrote:

> Just a little remark:
>
> We have > 4000 connections in IDLE state(*) and idled works flawlessly.
> I had some headaches because some members of this list pointed out that
> imapd was not tested for thousands of connections.
>
> It justs works.
>
> Cyrus IMAPD 2.3.19.
>
> (*) due to a heavily migration to Thunderbird including Lightning
> (connecting to our SOGo servers) in many of the faculty and professors'
> secretaries.
>
> --
> Pascal Gienger Jabber/XMPP/Mail: pascal.gien...@uni-konstanz.de
> University of Konstanz, IT Services Department ("Rechenzentrum")
> Electronic Communications and Web Services
> Building V, Room V404, Phone +49 7531 88 5048, Fax +49 7531 88 3739
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

caches on tmpfs?

[David R Bosso]

Both the tls_sessions cache and statuscache look like good candidates to 
move to tmpfs.  I don't see an easy way to relocate them, am I missing it, 
or should this be a feature request?

I've currently got proc on tmpfs as previously suggested.

Thanks.

-David

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus IMAPd 2.2.13p1 & 2.3.15 Released

[David R Bosso]

Is there a specific reason the patch for bug #3159 wasn't included?  I've 
been adding it locally and just wondering if should continue to do so.

Thanks.

-David

--On September 9, 2009 9:47:14 AM -0400 Ken Murchison 
 wrote:

> I'd like to announce the releases of Cyrus IMAPd 2.2.13p1 and 2.3.15.
> These releases should both be considered production quality.  These
> releases are being made at this time to fix the potential buffer
> overflow vulnerability described in CERT VU#336053:
> http://www.kb.cert.org/vuls/id/336053
>
> The 2.2.13p1 release is no different from 2.2.13 other than the buffer
> overflow fix.  The 2.3.15 release contains several other non-critical
> bugfixes and feature enhancements.  For full details, please see
> doc/changes.html and doc/install-upgrade.html which are included in the
> distribution.
>
> I'd personally like to thank Bron Gondwana of Fastmail.fm for finding
> and fixing the buffer overflow, as well as his numerous other
> contributions to the 2.3.15 release.
>
> URLs for these releases:
> ftp://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.2.13p1.tar.gz
> ftp://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.3.15.tar.gz
> or
> http://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.2.13p1.tar.gz
> http://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.3.15.tar.gz
>
>
> Questions and comments can be directed to
> info-cyrus@lists.andrew.cmu.edu (public list), or
> cyrus-b...@andrew.cmu.edu.
>
> --
> Kenneth Murchison
> Systems Programmer
> Project Cyrus Developer/Maintainer
> Carnegie Mellon University
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> 
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Another cache bug!

[David R Bosso]

--On December 10, 2008 10:36:56 AM +1100 Bron Gondwana  
wrote:



Wow, this is the thanks I get for doing sanity checks on files, find more
bugs!

This one is due to delayed expunge, plain and simple.  Cyrus decides what
cache records to copy during an IMAP COPY command by reading the cache
offsets for msgno and msgno+1 (or the end of the cache file if it's the
last msgno).

Obviously if some intervening messages have already been deleted from the
cyrus.index then it will be copying all those cache records as well to the
destination folder.  Oops.

The attached patch reworks mailbox_cache_size into two functions, the
second being mailbox_cache_size_detail that takes memory locations for
the cache mmap rather than a mailbox object (because imapd doesn't update
the locations in the object correctly according to my testing, *sigh*.
Gotta love global variables)

It then uses mailbox_cache_size_detail to calculate the ACTUAL record
length for this single cache item rather than blindly copying everything
up to the next index record's pointer.

Also note: in the event of cache corruption, mailbox_cache_size_detail
returns zero bytes, which correctly makes append_copy re-parse the
message file.  It's all shiny :)

Wes/Ken - please apply to CVS :)

Thanks,

Bron.
--
  Bron Gondwana
  br...@fastmail.fm


Going through my list of 2.3.13 patches to put together a local 2.3.14 
build, I ran across this one.  It doesn't appear to have made it into 
2.3.14.  Oversight, or is there something wrong with it?


Thanks.

-David

Index: cyrus-imapd-2.3.13/imap/index.c
===
--- cyrus-imapd-2.3.13.orig/imap/index.c	2008-12-07 23:51:36.0 +
+++ cyrus-imapd-2.3.13/imap/index.c	2008-12-08 01:51:28.0 +
@@ -3574,13 +3574,9 @@ void *rock;
 	/* Force copy and re-parse of message */
 	copyargs->copymsg[copyargs->nummsg].cache_len = 0;
 }
-else if (msgno < (unsigned) imapd_exists) {
-	copyargs->copymsg[copyargs->nummsg].cache_len =
-	  CACHE_OFFSET(msgno+1) - CACHE_OFFSET(msgno);
-}
 else {
 	copyargs->copymsg[copyargs->nummsg].cache_len =
-	  cache_end - CACHE_OFFSET(msgno);
+	  mailbox_cache_size_detail(copyargs->copymsg[copyargs->nummsg].cache_begin, cache_base, cache_end);
 }
 copyargs->copymsg[copyargs->nummsg].seen = seenflag[msgno];
 copyargs->copymsg[copyargs->nummsg].system_flags = SYSTEM_FLAGS(msgno);
Index: cyrus-imapd-2.3.13/imap/mailbox.c
===
--- cyrus-imapd-2.3.13.orig/imap/mailbox.c	2008-12-08 01:46:02.0 +
+++ cyrus-imapd-2.3.13/imap/mailbox.c	2008-12-08 02:04:34.0 +
@@ -301,8 +301,6 @@ unsigned long mailbox_cache_size(struct 
 {
 const char *p;
 unsigned long cache_offset;
-unsigned int cache_ent;
-const char *cacheitem, *cacheitembegin;
 
 assert((msgno > 0) && (msgno <= mailbox->exists));
 
@@ -310,22 +308,33 @@ unsigned long mailbox_cache_size(struct 
  ((msgno-1) * mailbox->record_size));
 
 cache_offset = ntohl(*((bit32 *)(p+OFFSET_CACHE_OFFSET)));
-if (cache_offset > mailbox->cache_size) {
+
+return mailbox_cache_size_detail(mailbox->cache_base + cache_offset,
+ mailbox->cache_base,
+ mailbox->cache_size);
+}
+
+unsigned long mailbox_cache_size_detail(const char *cache_item,
+const char *cache_base,
+	unsigned long cache_size)
+{
+unsigned int cache_ent;
+const char *begin = cache_item;
+
+if (begin < cache_base || begin >= cache_base + cache_size) {
+	/* already not in the area */
 	return 0;
 }
 
 /* Compute size of this record */
-cacheitembegin = cacheitem = mailbox->cache_base + cache_offset;
-if (cache_offset >= mailbox->cache_size)
-	return 0;
 for (cache_ent = 0; cache_ent < NUM_CACHE_FIELDS; cache_ent++) {
-	cacheitem = CACHE_ITEM_NEXT(cacheitem);
-	if (cacheitem < cacheitembegin ||
-	cacheitem > cacheitembegin + mailbox->cache_size) {
+	cache_item = CACHE_ITEM_NEXT(cache_item);
+	if (cache_item < begin ||
+	cache_item > cache_base + cache_size) {
 	return 0; /* clearly bogus */
 	}
 }
-return (cacheitem - cacheitembegin);
+return (cache_item - begin);
 }
 
 /* function to be used for notification of mailbox changes/updates */
Index: cyrus-imapd-2.3.13/imap/mailbox.h
===
--- cyrus-imapd-2.3.13.orig/imap/mailbox.h	2008-12-08 01:51:37.0 +
+++ cyrus-imapd-2.3.13/imap/mailbox.h	2008-12-08 02:03:23.0 +
@@ -292,6 +292,9 @@ unsigned mailbox_cached_header(const cha
 unsigned mailbox_cached_header_inline(const char *text);
 
 unsigned long mailbox_cache_size(struct mailbox *mailbox, unsigned msgno);
+unsigned long mailbox_cache_size_detail(const char *cache_item, 
+	const char *cache_base, 
+	unsigned long cache_size);
 
 typedef unsigned mailbox_decideproc_t(struct

Re: unexpunge segfaults with -l on some mailboxes

[David R Bosso]

--On March 13, 2009 10:18:53 AM -0300 Patrick Boutilier 
 wrote:



>> This will be real easy to test though. I will just run ipurge on a
>> subfolder of my mailbox and see if it corrupts it. :-)

FWIW we see the same corruption here with ipurge.  We use ipurge to clean 
out old messages from a spam box for each user.  We've worked around it 
currently by reconstructing the box after the ipurge which adds a lot of 
work to our nightly maintenance.

I'd love to see a fix for this.

-David

> I can duplicate the corruption by following steps similar to this report:
>
> http://archives.devshed.com/forums/networking-100/cyr-expire-sigsegv-2146
> 878.html
>
>
> Current directory here is /var/imap/metadata/G/user/boutilpj/Testmail
>
>
> Clean mailbox:
>
>
> [cy...@student2 Testmail]$ ll
> total 60
> -rw--- 1 cyrus cyrus 49612 Mar 13 10:03 cyrus.cache
> -rw--- 1 cyrus cyrus   189 Mar 13 10:03 cyrus.header
> -rw--- 1 cyrus cyrus  3792 Mar 13 10:03 cyrus.index
>
>
> Quick way to show number of messages in the folder:
>
>
>
> [cy...@student2 Testmail]$ cat cyrus.cache |grep -a Prec|wc -l
> 42
>
>
> Delete 11 messages through IMAP client:
>
> [cy...@student2 Testmail]$ ll
> total 64
> -rw--- 1 cyrus cyrus 49612 Mar 13 10:03 cyrus.cache
> -rw--- 1 cyrus cyrus  1064 Mar 13 10:05 cyrus.expunge
> -rw--- 1 cyrus cyrus   189 Mar 13 10:03 cyrus.header
> -rw--- 1 cyrus cyrus  2824 Mar 13 10:05 cyrus.index
>
>
> Run ipurge with a number high enough not to delete anything. I purge
> only sees 31 messages and removes them from cyrus.cache:
>
>
> [cy...@student2 Testmail]$ /usr/local/cyrus/bin/ipurge -f -d 2333
> user.boutilpj.Testmail
> Working on user.boutilpj.Testmail...
> total messages   31
> total bytes  539400
> Deleted messages 0
> Deleted bytes0
> Remaining messages   31
> Remaining bytes  539400
>
> [cy...@student2 Testmail]$ ll
> total 48
> -rw--- 1 cyrus cyrus 36652 Mar 13 10:08 cyrus.cache
> -rw--- 1 cyrus cyrus  1064 Mar 13 10:05 cyrus.expunge
> -rw--- 1 cyrus cyrus   189 Mar 13 10:03 cyrus.header
> -rw--- 1 cyrus cyrus  2824 Mar 13 10:08 cyrus.index
>
> [cy...@student2 Testmail]$ cat cyrus.cache |grep -a Prec|wc -l
> 31
>
>
> Run cyr_expire and corruption occurs:
>
> [cy...@student2 Testmail]$ /usr/local/cyrus/bin/cyr_expire -E 333 -X 7 -p
> user.boutilpj.Testmail -v
> Expunging deleted messages in mailboxes older than 7 days
>
> Expunged 0 out of 33 messages from 1 mailboxes
> [cy...@student2 Testmail]$ ll
> total 96
> -rw--- 1 cyrus cyrus 36652 Mar 13 10:08 cyrus.cache
> -rw--- 1 cyrus cyrus 37852 Mar 13 10:15 cyrus.cache.NEW
> -rw--- 1 cyrus cyrus  1064 Mar 13 10:05 cyrus.expunge
> -rw--- 1 cyrus cyrus   272 Mar 13 10:15 cyrus.expunge.NEW
> -rw--- 1 cyrus cyrus   189 Mar 13 10:03 cyrus.header
> -rw--- 1 cyrus cyrus  2824 Mar 13 10:08 cyrus.index
> -rw--- 1 cyrus cyrus  2824 Mar 13 10:15 cyrus.index.NEW
>
>
> Mar 13 10:15:40 student2 cyr_expire[8725]: IOERROR: reading cache record
> for user.boutilpj.Testmail: item 1 has bogus offset 576450680 of 36652
> for 2/11; mailbox needs a reconstruct
>
>
>
>
>>
>>> Bron.
>>
>> 
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: sync_server crashing..

[David R Bosso]

--On Monday, May 19, 2008 8:07 AM +1000 Bron Gondwana <[EMAIL PROTECTED]> 
wrote:

>
> On Sun, 18 May 2008 21:44:45 + (GMT), "Andy Fiddaman"
> <[EMAIL PROTECTED]> said:
>> On Sun, 18 May 2008, Bron Gondwana wrote:
>>
>> ; You have a corrupted cache file.  Various things could have caused
>> this,
>> ; it isn´t easy to know what it was.
>>
>> Thanks.
>>
>> I can't find the corrupted mailbox so I've run reconstruct on everything,
>> rsyncd the master to replica again and I'll see if the problem recurs
>> (you
>> can tell it isn't a massive mailstore!)
>>
>> I tried to find the mailbox with the problem by writing a quick program
>> to
>> scan through each cache file and it didn't detect any errors. I also ran
>> mbexamine on every mailbox with no problems so I don't know where the
>> corruption, if any, was.
>>
>> Keeping my fingers crossed anyway,
>
> Hmm.. by corrupted cache file it could actually be the cache base pointers
> from the cyrus.index that are corrupted.  One cause was delayed expunge
> and reconstruct, but David Carter wrote some patches which got into 2.3.12
> to fix that, so new reconstructs will be fine.
>

FWIW, ipurge is corrupting cache files for me.  I'll hopefully have some 
time to track it down soon unless someone has already looked at it.

-David


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

cyr_expire -E ?

[David R Bosso]

Any idea why I'd see this?

sudo -u cyrus /usr/lib/cyrus/cyr_expire -E 2 -a -v
expunging deleted messages in mailboxes older than 0 days

It then appears to be doing exactly that.

I don't specify a -X, I just want to prune the duplicate db.  What am I 
doing wrong?

This is version 2.3.11 with some of the fastmail patches.

Thanks.

-David

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

RENAME not working?

[David R Bosso]

Hi,

We're running 2.3.11 on amd64 Gentoo Linux with some fastmail skiplist 
patches.  Delayed delete and expunge are on, and we are replicating to our 
backup server.  We just found out that a RENAME causes the associated IMAPD 
to die:

Apr  1 16:11:57 zoe imap[6521]: Deleted mailbox user.test123
Apr  1 16:11:57 zoe master[9383]: process 6521 exited, signaled to death by 
6
Apr  1 16:11:57 zoe master[9383]: service imap pid 6521 in BUSY state: 
terminatd abnormally

It appears that the RENAME operation completes, but the connection is gone, 
so one of our scripts bails out at that point.

Before I start digging further, can someone verify that RENAME works for 
them normally with delayed delete and expunge on 2.3.11?

Thanks.

-David

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: delayed expunge/delete with replication?

[David R Bosso]

--On March 11, 2008 8:48:35 AM +1100 Bron Gondwana <[EMAIL PROTECTED]> 
wrote:

> This is a source of occasional frustration to me, because it means if
> you do anything remotely funky (like a restore) on the master, then
> the replica will have the same record in both the .index and .expunge
> files and it all goes to pot.

Ouch, that's a fairly common occurrence.  What's the best way to handle 
this now?

-David

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

delayed expunge/delete with replication?

[David R Bosso]

Hello,

I've got a few questions about how delayed expunge works with replication 
in 2.3.11.

1.  If I want delayed expunge & delete on both the replica and master 
(replicated delayed expunge & delete), do I need them turned on in both 
master and replica imapd.conf, or is it sufficient that they be on in just 
the master?

2.  Is it sufficient to run cyr_expire (-D -X) the master - will it be 
replicated, or does it need to be run on the replica also?

Thanks!

-David

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Exchange's handling of Sieve Reject

[David R Bosso]

--On March 14, 2007 9:27:03 AM -0400 Joseph Brennan <[EMAIL PROTECTED]> 
wrote:




Users on two separate Exchange servers here have reported that they
don't see the reason part of messages rejected by sieve.


I've seen this and got the recipient to fix their server.  See:


-David



The Cyrus user has a reject rule.  I can reproduce it simply as:


## INGO
# sieve filter generated by Ingo (March 14, 2007, 8:51 am)

require "reject";

# Sieve Reject Test
if header :comparator "i;ascii-casemap" :contains "Subject" "please
reject this message"  {
reject "You want it rejected, you get it rejected.";
stop;
}

-
To see precisely what is returned, send mail to [EMAIL PROTECTED] with
the subject "please reject this message".  The mime message looks
syntactically correct to me, as follows:

main message is multipart/report
part 1 is text/plain
part 2 is message/disposition-notification
part 3 is message/rfc822

The Exchange messages were viewed with Outlook.  Outlook users did not
see any of the message sent by Sieve, but only a new text generated by
Exchange or Outlook that looks like this:
-

From: Mail Sieve Subsystem [mailto:[EMAIL PROTECTED]
Sent: Tuesday, March 13, 2007 5:20 PM
To: [EMAIL PROTECTED]
Subject: Automatically rejected mail


Your message

  To:   [EMAIL PROTECTED]

  Subject:  test

  Sent: 3/13/2007 5:19 PM


was deleted without being read on 3/13/2007 5:20 PM.

-
One of our staff looked at one of the message also with Evolution, and
reported a *variant* form of the above message, making me wonder what
data Exchange is sending to the client.  It looks like this:
-

Your message

  To:  [EMAIL PROTECTED]
  Subject: test attachment
  Sent:Tue, 13 Mar 2007 17:18:41 -0400

was not readTue, 13 Mar 2007 17:20:06 -0400?



mail disposition
report attachment

Content-Type: message/disposition-notification
Content-Transfer-Encoding: 7bit

Final-Recipient: RFC822; [EMAIL PROTECTED]
Disposition: automatic-action/MDN-sent-automatically; deleted
Original-Message-ID:
<[EMAIL PROTECTED]>

-
Notice the changes in the line spacing, the Sent: line, the "was" line,
and the inclusion here of the text from mime part 2.  Evolution also
indicated the presence of a dat attachment after this, which the Outlook
users did not see.


We did not yet test what Outlook shows when it reads as an imap client
off the Cyrus server.  All the above was read off an Exchange server.

Possible fixes would be to format the rejection like a reply or a
forwarded message, or plain text, but it would be pretty dumb.  Has
anyone else dealt with this at all?  Any bright ideas?

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology













Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: pop3 slow respond

[David R Bosso]

--On Thursday, May 11, 2006 11:16 AM +0400 Andrey Kolbasenko <[EMAIL PROTECTED]> 
wrote:



Hi all!

I have installed Gentoo Linux with cyrus-imapd-2.3.3+postfix+virtual
domains+mysql. When I connect to pop3 5 or more times, or about 10 or
more  client receive his mail, cyrus answer only after 10-30 sec, and
when number  of pop3 clients reach 20-30, cyrus completely not respond:


The classic reason I've seen for behavior like this is lack of entropy 
leading to blocking reading /dev/random.  The easy way to check is strace. 
The fix is to use something like rng-tools.


-David



telnet 10.26.1.4 110
Trying 10.26.1.4...
Connected to 10.26.1.4.
Escape character is '^]'.
+OK ns.stv.stav Cyrus POP3 v2.3.3-Gentoo server ready
<[EMAIL PROTECTED]>
quit

telnet 10.26.1.4 110
Trying 10.26.1.4...
Connected to 10.26.1.4.
Escape character is '^]'.
+OK ns.stv.stav Cyrus POP3 v2.3.3-Gentoo server ready
<[EMAIL PROTECTED]>
quit



telnet 10.26.1.4 110
Trying 10.26.1.4...
Connected to 10.26.1.4.
Escape character is '^]'.

top command:

top - 10:53:42 up 28 days,  2:52,  1 user,  load average: 0.00, 0.02, 0.37
Tasks: 123 total,   2 running, 121 sleeping,   0 stopped,   0 zombie
Cpu(s):  0.3% us,  0.3% sy,  0.0% ni, 99.3% id,  0.0% wa,  0.0% hi,  0.0%
si Mem:906064k total,   836212k used,69852k free,82320k
buffers Swap:   506036k total,   92k used,   505944k free,   541628k
cached

29434 cyrus 16   0 30188 2624 2024 S  0.3  0.3   0:00.04 pop3d

netstat -an

tcp0  0 10.26.1.4:110   10.26.5.128:1330
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.224:2120
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.130.71:3230
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.4.105:2317
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.4.105:2319
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.172:1588
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.206:1367
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.72.11:3117
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.238:3453
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.238:3455
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.104:2579
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.228:1691
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.38:4004
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.166:2525
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.38:4002
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.166:2527
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.38:4000
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.197.2:1355
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.75.2:1220
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.52:1211
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.71.154:1449
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.5.220:1457
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.197.2:1371
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.132.5:2333
TIME_WAIT tcp0  0 10.26.1.4:110   10.26.132.5:2329
TIME_WAIT

I need your suggestions..


Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html




Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: plus addressing with postfix

[David R Bosso]

--On Friday, March 17, 2006 11:57 AM -0500 Steve Huston 
<[EMAIL PROTECTED]> wrote:



On 03/17/2006 11:51 AM, Joseph Brennan wrote:

Stefano Santoro <[EMAIL PROTECTED]> wrote:

... and if you plan to deliver to subfolders DO make sure that the
subfolder names are all lowercase.
INBOX.junk not INBOX.Junk

What makes this necessary?


I would guess that's only true if you have the lmtp_downcase_recipient
option turned on; but that's just a guess.


It's a postfix limitation at least in some cases:

<http://groups.google.com/group/mailing.postfix.users/browse_thread/thread/17e4053313f7a357/>

I'm not sure if this has changed with Postfix >2.1.  My staff and I never 
spent any time trying to create a patch.


-David

--
David R Bosso <[EMAIL PROTECTED]>
Systems & Network Manager, Letters and Science IT
UC Santa Barbara - 1054 North Hall 805 451-7160


--
Steve Huston - W2SRH - Unix Sysadmin, Dept. of Astrophysical Sciences
  Princeton University  |ICBM Address: 40.346525   -74.651285
126 Peyton Hall |"On my ship, the Rocinante, wheeling through
  Princeton, NJ   08544 | the galaxies; headed for the heart of Cygnus,
(609) 258-7375  | headlong into mystery."  -Rush, 'Cygnus X-1'

Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html




Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

cyrus store on an iscsi san?

[David R Bosso]

Howdy,

Is anyone running their cyrus mail store on an iSCSI SAN?  Can you comment 
on performance, problems, gotchas?


Thanks!

-David

Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus Postfix Spamassassin

[David R Bosso]

--On February 6, 2006 9:25:29 PM +0100 Sven Mueller <[EMAIL PROTECTED]> wrote:


but unlike
amavisd-new (which uses spamc/spamd unless I'm mistaken), it uses
SpamAssassin's perl modules directly.


You're mistaken there.  Amavisd-new has the option to use the SA pearl 
libs, that's how we run it here.  See:




-David

Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: backslash in addresses?

[David R Bosso]

--On July 13, 2005 9:49:34 AM -0500 [EMAIL PROTECTED] wrote:


I haven't really checked RFCs to see if "\" is allowed charcter in an
email
address.  It might be that it is, or that it isn't, or it might be that
RFCs
simply discourage its use.


It doesn't appear to be allowed by RFC2822 in local-part as it appears in 
"specials" and not "atext".




-David

---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Email case problem

[David R Bosso]

--On June 8, 2005 2:45:40 PM -0600 Sun Advocate Webmaster 
<[EMAIL PROTECTED]> wrote:



Is there a workaround? Is there a setting for Cyrus that tells it to
ignore case? I'm also going to post to the postfix list also.


Check out the lmtp_downcase_rcpt option in "man imapd.conf"

-David
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: "losing" email after delivery to cyrus

[David R Bosso]

--On May 26, 2005 11:58:11 AM +0800 Justin <[EMAIL PROTECTED]> 
wrote:



Hi List

Having a small issue with a user not receiving some mail from a couple
of internal users (that we know of). Mail may be getting "lost" when
sent from other users to this person but I don't know about them.

I can see (at least I think I can!) the delivery to cyrus from postfix
in the logs;


[snip]


...yet the message does not seem to arrive in the users' directory for
retrieval by the MUA (POP3). I have done the following to try and
resolve this:


Those were Postfix logs, are you using LMTP to deliver to Cyrus?  What do 
Cyrus logs show?


-David

---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Shared Mailboxes and Postfix

[David R Bosso]

--On May 20, 2005 11:03:55 AM -0500 Josh Whitver 
<[EMAIL PROTECTED]> wrote:

David R Bosso <[EMAIL PROTECTED]> on Friday, May 20, 2005 at 9:42 AM
-0600 wrote:
Postfix lowercases the mailbox name.  Your destination must be all
lowercase for plus addressing to work, try changing it to "news" from
"News".  The plus above is the correct syntax.
Thanks for replying, but that wasn't it, either.  Mail addressed to
"conference+news" and "Conference+news" both got bounced.
Any other ideas?  I'm (obviously) stumped!
Can you deliver to conference@ without the plus addressing?
-David
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Shared Mailboxes and Postfix

[David R Bosso]

--On Friday, May 20, 2005 9:03 AM -0500 Josh Whitver 
<[EMAIL PROTECTED]> wrote:

I had some tips that because I had unixheirarchysep turned on in
imapd.conf, I needed to address my mail to "Conference/News" instead of
"Conference+News" but that, unfortunately, hasn't worked either.  Are
there any other tips out there I could be following?  Thanks for your
time!
Postfix lowercases the mailbox name.  Your destination must be all 
lowercase for plus addressing to work, try changing it to "news" from 
"News".  The plus above is the correct syntax.

-David
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Address Recipient Delimiter downcasing after the +

[David R Bosso]

--On May 12, 2005 9:09:12 AM -0600 Spencer Tuttle 
<[EMAIL PROTECTED]> wrote:

Hello All,
I am having the following problem, if I address email to
[EMAIL PROTECTED] and I have a folder called test and it has the
acl of "anyone p" on it the mail gets delivered successfully to the
folder.
But if I address an email to [EMAIL PROTECTED] and I have a
folder called Junk and it has the acl of "anyone p" on it the mail goes
to the INBOX. Looking in the logs I see that lmtp has downcased the
entire email address so that when I send to [EMAIL PROTECTED] it
shows like this...
[snip]
This would probably be better addressed on the Postfix list.  This is a 
feature of Postfix, see:


I never made a patch, and I haven't heard of anything changing.
-David
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Question about cyrus quotas - how it behaves

[David R Bosso]

--On May 4, 2005 4:19:51 PM -0600 Sun Advocate Webmaster 
<[EMAIL PROTECTED]> wrote:

Just a question for all of you about quotas on cyrus imap.
As far as I see, there is no "grace" quota or warning system. Users not
watching the size of their mailboxes won't know they're near full until
they're actually full. Is this the case?
Check out quotawarn: and quotawarnkb: in man imapd.conf.  They result in 
IMAP ALERT messages being generated.

Lets say a user has a 20 MB quota on their mailbox. Lets say it currently
sits at 19 MB (usage). Then, assume postfix hands over a 1.5 MB email
(uncommon, but if there are attachments...). Does Cyrus accept this
message but no further emails, or does it flat-out deny it?
The former.  Mail isn't rejected until the box is over quota.
If it does deny this 1.5 MB email, does it accept a 3k email from postfix
that arrives moments later?
I assume once the quota has been exceeded, users won't be able to receive
new email until they delete old ones. Is the quota restriction/ban
"lifted" immediately after the offending user deletes enough of their
emails?
Yep.  It's also a non-fatal delivery failure, at least on my setup.  So 
mail will continue to be retried until a hard fail, 5 days or so.

Most of my IMAP users (local subnet) will be using Mozilla Thunderbird.
The remaining users will be mostly POP on Outlook (remote users).
POP is a problem because it doesn't provide any feedback like IMAP ALERT.
In addition to the IMAP ALERTs provided by the quotawarn settings, we do a 
weekly cron script that sends an email to users approaching quota.

-David
--
David R Bosso <[EMAIL PROTECTED]>
Systems & Network Manager, Letters and Science IT
UC Santa Barbara - 1054 North Hall 805 451-7160
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Message contains NUL characters ...

[David R Bosso]

--On Thursday, April 28, 2005 4:13 PM -0400 Joseph Brennan 
<[EMAIL PROTECTED]> wrote:


--On Thursday, April 28, 2005 16:22 -0300 "Marc G. Fournier"
<[EMAIL PROTECTED]> wrote:

Someone mentioned that this was, in fact, not forbid'd in the RFCs ...
could you point to the relevant RFC where it is?  Considering how
'strict' postfix seems to be, having an RFC to back that up might show
some changes over in that camp, at least ...

RFC 2822, section 4.1, makes null an obsolete character.
But same, section 2.3, does not explicitly forbid them in bodies.  It
does say the body must be US-ASCII characters, and following that
appears to get to section 4.1 defining what characters are.
It's not allowed unless you're talking about the obsolete section as 
mentioned in my previous email.

See the following that defines the syntax:
3.1
|In some of the definitions, there will be nonterminals whose names
|start with "obs-".  These "obs-" elements refer to tokens defined in
|the obsolete syntax in section 4.  In all cases, these productions
|are to be ignored for the purposes of generating legal Internet
|messages and MUST NOT be used as part of such a message.  However,
|when interpreting messages, these tokens MUST be honored as part of
|the legal syntax.  In this sense, section 3 defines a grammar for
|generation of messages, with "obs-" elements that are to be ignored,
|while section 4 adds grammar for interpretation of messages.
3.2.1
| text=   %d1-9 / ; Characters excluding CR and LF
| %d11 /
| %d12 /
| %d14-127 /
| obs-text
3.5
| body=   *(*998text CRLF) *998text
No NUL allowed.
So as before, it's illegal to send them.
-David
--
David R Bosso <[EMAIL PROTECTED]|
Systems & Network Manager, Letters and Science IT
UC Santa Barbara - 1054 North Hall 805 451-7160

---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Message contains NUL characters ...

[David R Bosso]

--On Thursday, April 28, 2005 4:22 PM -0300 "Marc G. Fournier" 
<[EMAIL PROTECTED]> wrote:

Someone mentioned that this was, in fact, not forbid'd in the RFCs ...
could you point to the relevant RFC where it is?  Considering how
'strict' postfix seems to be, having an RFC to back that up might show
some changes over in that camp, at least ...

From my reading of RFC 2822 <http://www.faqs.org/rfcs/rfc2822.html> section 
4, since the NUL character has been obsoleted, it can no longer be 
generated, so the senders are out of compliance.

Section 4 does say:
Though some of these
syntactic forms MUST NOT be generated according to the grammar in
section 3, they MUST be accepted and parsed by a conformant receiver.
and
To repeat an example, though this document requires
   lines in messages to be no longer than 998 characters, silently
   discarding the 999th and subsequent characters in a line without
   warning would still be bad behavior for an implementation.  It is up
   to the implementation to deal with messages robustly.
and specifically about the NUL:
   Finally, certain characters that were formerly allowed in messages
   appear in this section.  The NUL character (ASCII value 0) was once
   allowed, but is no longer for compatibility reasons.  CR and LF were
   allowed to appear in messages other than as CRLF; this use is also
   shown here.
I highly suggest reading sections 3 and 4.
-David
--
David R Bosso <[EMAIL PROTECTED]>
Systems & Network Manager, Letters and Science IT
UC Santa Barbara - 1054 North Hall 805 451-7160
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Hardware RAID Level & Performance

[David R Bosso]

--On Thursday, February 17, 2005 10:56 PM +0100 Jure Pe ar 
<[EMAIL PROTECTED]> wrote:

Because of that (and because I already have FC infrastructure in place)
I'm mostly interested in standalone disk enclosures doing their own raid
with cheap sata drives and big caches with batteries.
I just ran across these today:

No experience with them, but they're the best specs I've seen for SATA 
external RAID - decent processor and NCQ support.

We've had good luck with the LSI Megaraid 320-2X and 320-4X SCSI cards. 
The older, non "X" cards don't use the newer Intel xscale chips and really 
can't keep up for RAID-5 based on the testing I did.

I've seen pretty poor RAID-5 performance from an LSI SATA card, the 150-6. 
It uses one of the older Intel i960 based IOP chips.

-David
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: serious over quota problem

[David R Bosso]

See:

Cyrus IMAP uses a 32bit int to store quota in bytes internally, this causes 
problems with large quotas.  While the bug says 2GB, from what I saw in the 
code a while back it's an unsigned long which should max out at 4GB.

Can one of the developers clarify 2/4GB as the maximum?

-David

--On Tuesday, February 10, 2004 4:36 PM -0800 Joao Pedras 
<[EMAIL PROTECTED]> wrote:

Hello Ken,

Ken Murchison wrote:

Joao Pedras wrote:

Hi all!

I have this user's box which is NOT over quota but Cyrus insists on
saying that it is to sendmail. Also
I am not able to drag messages into it.
I have ran 'reconstruct' on the the folder with '-r -f' and 'cyrquota
-f' also. I have increased/decreased the quota...
The problem does not go away.

Could someone please provide some insight on this issue?


How do you know for a fact that the user is not over quota?


Well... the a 'du' on the filesystem shows the usage around 2Gb. The
quota root was
set to 5,000,000. Plus 'cyrquota' would report around 40% usage which
agrees with
the number I just gave you.
Keep in mind that a quotaroot includes ALL submailboxes.
And that is the reason why I check 'du' on filesystem folder.

  Are there \Deleted messages which have not been expunged?
Not quite sure. Wouldn't these count?

  Is the MUA using a Trash folder?


In the user's inbox? Yes, but that one is empty. Wouldn't that also add
up to the
quota root?
Two additional details:
1) it's cyrus 2.0.17
2)  I attempted to set the quota to 50,000,000 and the problem went away.
With that
quota value the usage is down to 4%.
Thanks Ken!!!
---
Home Page: http://asg.web.cmu.edu/cyrus
Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


---
Home Page: http://asg.web.cmu.edu/cyrus
Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Recommended Berkeley DB version for 2.2.3?

[David R Bosso]

Hi all,

What is the current feeling on the best Berkeley DB version to use with 
Cyrus IMAP 2.2.3?  In the past there had been some problems with 4.x, but 
it appears that many (most) people are using 4.1.x, and there is now 
support for 4.2.

What is CMU using?

Thanks.

-David

David R Bosso <[EMAIL PROTECTED]>
Network Manager, College of Letters and Science
UC Santa Barbara - 1054 North Hall 805 893-8494
---
Home Page: http://asg.web.cmu.edu/cyrus
Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Is Reiserfs better than ext3

[David R Bosso]

FWIW:

We've been running our ~1200 user server on reiserfs/RedHat for 2 years or 
so now with no filesystem problems.  In fact everyone I know that uses 
linux for any purpose uses reiser as their standard fs.  It's been fast and 
reliable for us.

We'll be migrating to a new box running 2.2.2 on Gentoo with reiser in 
couple of months.

-David

--On Friday, January 9, 2004 3:46 PM + mb  
wrote:

At 17:54 +0530 Ramprasad A Padmanabhan wrote:

I am having around 2000 users on my cyrus server ( redhat 9.0 )
someone told be I should reformat my partition in Reiserfs rather that
ext3 and I will get a great perlformance improvement
...until you get a hardware failure and your entire mail store is toast.

reiserfs is brilliant for some applications (Squid boxes, desktops..), but
ext3 is reliable (the best fsck in town alone makes it worth it), and for
your mail server that is surely the most important thing. If you want to
speed up ext3 look at Linux 2.6.
I switched my IMAP store from Debian to Fedora Core on December 26th--it's
now ready for Linux 2.6 as soon as someone (other than myself) says it's
too slow..
HTH,

Matt

PS I know some people say XFS, JFS etc are brilliant but my local
experience is that although they may be faster in Linux 2.4, they are more
prone to corruption.. (haven't tried either in the last 6 months tho')

RE: SASL & db help please?

[David R Bosso]

Thany you very much.  That did the trick.

-David

--On Thursday, February 22, 2001 4:39 PM -0500 "Ramineni, Kiran" 
<[EMAIL PROTECTED]> wrote:

>
>
> rm config.cache
>
> /usr/lib/libdb-3.a -> /usr/local/BerkeleyDB.3.1/lib/libdb.a
>
>
> -Original Message-
> From: David R Bosso
> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> Sent: 2/22/01 12:34 PM
> Subject: SASL & db help please?
>
> I'm trying the below instructions on redhat 6.2 system with no joy.
> I've
> got berkeley db 3.2.9 in /usr/local/BerkeleyDB.3.2/
>
> /usr/local/BerkeleyDB.3.2/lib is in ld.so.conf and /sbin/ldconfig has
> been
> run.
>
> I used:
> CPPFLAGS="-I/usr/local/BerkeleyDB.3.2/include"
> LDFLAGS="-L/usr/local/BerkeleyDB.3.2/lib"
> ./configure --disable-krb4 --enable-login --with-dblib=berkeley
>
> as per your instructions below, and configure can't find db.h.  If I
> symlink db.h to /usr/include/ configure finds it, but I get:
>
> checking for db.h... yes
> checking for db_create in -ldb-3... no
> checking for db_create in -ldb... no
> checking for db_open in -ldb... no
> checking DB library to use... no
> configure: warning: Disabling SASL authentication database support
>
> ???  How the heck do you get SASL to use the new db?  It'd be nice if it
>
> had a --with-dbdir= configure option like IMAP.
>
> Thanks for any help.
>
> -David
>
>
> --On Wednesday, February 14, 2001 6:52 PM -0600 Paul Wiechman
> <[EMAIL PROTECTED]> wrote:
>
>>
>> As far as the BerkeleyDB's, it has been on this list before. When
>> compiling SASL...
>>
>> CPPFLAGS="-I" LDFLAGS="-L> libs>" ./configure --
>>
>> Also, make sure you add the lib directory of the new Berkeley install
> to
>> your ld.so.conf and run ldconfig.
>

SASL & db help please?

[David R Bosso]

I'm trying the below instructions on redhat 6.2 system with no joy.  I've 
got berkeley db 3.2.9 in /usr/local/BerkeleyDB.3.2/

/usr/local/BerkeleyDB.3.2/lib is in ld.so.conf and /sbin/ldconfig has been 
run.

I used:
CPPFLAGS="-I/usr/local/BerkeleyDB.3.2/include"
LDFLAGS="-L/usr/local/BerkeleyDB.3.2/lib"
./configure --disable-krb4 --enable-login --with-dblib=berkeley

as per your instructions below, and configure can't find db.h.  If I 
symlink db.h to /usr/include/ configure finds it, but I get:

checking for db.h... yes
checking for db_create in -ldb-3... no
checking for db_create in -ldb... no
checking for db_open in -ldb... no
checking DB library to use... no
configure: warning: Disabling SASL authentication database support

???  How the heck do you get SASL to use the new db?  It'd be nice if it 
had a --with-dbdir= configure option like IMAP.

Thanks for any help.

-David


--On Wednesday, February 14, 2001 6:52 PM -0600 Paul Wiechman 
<[EMAIL PROTECTED]> wrote:

>
> As far as the BerkeleyDB's, it has been on this list before. When
> compiling SASL...
>
> CPPFLAGS="-I" LDFLAGS="-L libs>" ./configure --
>
> Also, make sure you add the lib directory of the new Berkeley install to
> your ld.so.conf and run ldconfig.

Postfix and Cyrus single instance message store?

[David R Bosso]

This may need to go to the postfix list, but I'll try here first because of 
the recent related traffic...

OK, I'm trying to get Cyrus IMAP 2.0.11 single instance message store 
working with Postfix (latest snapshot).

I have postfix set up using lmtp via a transport table as per the postfix 
lmtp instructions, and I've got the following in my main.cf:

max_use = 300
lmtp_destination_recipient_limit = 1000
lmtp_destination_concurrency_limit = 1000

I've noticed that postconf doesn't know about these last two, which is 
troubling.

lmtp delivery works fine, but I'm not getting the single instance store, as 
verified by ls -i on the message files.

Here's what a delivery looks like in maillog:

Feb 12 11:20:14 paradigm postfix/smtpd[22910]: connect from 
ltsc.ucsb.edu[128.111.224.224]
Feb 12 11:20:14 paradigm postfix/smtpd[22910]: 5055E22E16: 
client=ltsc.ucsb.edu[128.111.224.224]
Feb 12 11:20:14 paradigm postfix/cleanup[22911]: 5055E22E16: 
message-id=<[EMAIL PROTECTED]>
Feb 12 11:20:14 paradigm postfix/qmgr[22854]: 5055E22E16: 
from=<[EMAIL PROTECTED]>, size=518362, nrcpt=3 (queue active)
Feb 12 11:20:14 paradigm postfix/smtpd[22910]: disconnect from 
ltsc.ucsb.edu[128.111.224.224]
Feb 12 11:20:14 paradigm postfix/lmtp[22913]: 5055E22E16: 
to=<[EMAIL PROTECTED]>, 
relay=/var/imap/socket/lmtp[/var/imap/socket/lmtp], delay=0, status=sent 
(250 2.1.5 Ok)
Feb 12 11:20:14 paradigm postfix/lmtp[22914]: 5055E22E16: 
to=<[EMAIL PROTECTED]>, 
relay=/var/imap/socket/lmtp[/var/imap/socket/lmtp], delay=0, status=sent 
(250 2.1.5 Ok)
Feb 12 11:20:14 paradigm postfix/lmtp[22913]: 5055E22E16: 
to=<[EMAIL PROTECTED]>, 
relay=/var/imap/socket/lmtp[/var/imap/socket/lmtp], delay=0, status=sent 
(250 2.1.5 Ok)

So it looks like it's using a new lmtp process each time, which is not what 
I'd expect.

Any suggestions?

Thanks.

-David