Re: multiple messages per second to a single mailbox

2015-08-18 Thread Christian Schmidt
On 14.08.2015 23:20, Andrzej A. Filip wrote: > As I understand: > * maildir is designed for allowing fast "lockless" parallel deliveries > * dovecot's LDA updates some dovecot specific index/cache files even for >deliveries to maildir > => making postfix deliver to maildir without updating do

Re: multiple messages per second to a single mailbox

2015-08-17 Thread Chad M Stewart
On Aug 17, 2015, at 9:30 AM, Gregory Finch wrote: <..snip..> > With that many messages, it may be the index updates that are slowing > things down. Depending on your needs or how you use this folder (it > sounds automated to me), you may not need the indexes on disk at all. If > you set the ind

Re: multiple messages per second to a single mailbox

2015-08-17 Thread Gregory Finch
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 2015-08-14 7:52 AM, Chad M Stewart wrote: > > The problem happened again this morning. Removing fsync calls helped, but I'm not sure about leaving that enabled long term. > > I still believe the problem is multiple dovecot processes trying to w

Re: multiple messages per second to a single mailbox

2015-08-14 Thread Andrzej A. Filip
Chad M Stewart wrote: > On Aug 14, 2015, at 1:01 PM, Andrzej A. Filip wrote: > >> >> >> Are docecot and postfix located on the same server? >> Can postfix access (deliver) directly maildir file directory dovecot uses? >> > > For the moment yes they are on the same server. I designed it to be

Re: multiple messages per second to a single mailbox

2015-08-14 Thread Chad M Stewart
On Aug 14, 2015, at 1:01 PM, Andrzej A. Filip wrote: > > > Are docecot and postfix located on the same server? > Can postfix access (deliver) directly maildir file directory dovecot uses? > For the moment yes they are on the same server. I designed it to be modular, the various components

Re: multiple messages per second to a single mailbox

2015-08-14 Thread Andrzej A. Filip
Chad M Stewart wrote: > On Aug 12, 2015, at 11:04 AM, Andrzej A. Filip > wrote: >> >> > > <..snip..> > >> Could you provide the following info: >> a) mailbox type (maildir/mbox/dbox/...) > > maildir > >> [mail_location in dovecot's config] > > /srv/mail/// > >> b) file system type (ext2/ext3/e

Re: multiple messages per second to a single mailbox

2015-08-14 Thread Chad M Stewart
The problem happened again this morning. Removing fsync calls helped, but I'm not sure about leaving that enabled long term. I still believe the problem is multiple dovecot processes trying to write to a single folder at the same time. (If I could run dtrace I might be able to cobble togethe

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
On Aug 12, 2015, at 11:58 AM, Daniel Tröder wrote: > On 08/12/2015 17:19, Chad M Stewart wrote: >> What I'm seeing is very high load on the system (40) and queues building on >> the Postfix side. > High load means, that there are a lot of processes waiting to run. The > most likely cause for th

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Daniel Tröder
On 08/12/2015 17:19, Chad M Stewart wrote: > What I'm seeing is very high load on the system (40) and queues building on > the Postfix side. High load means, that there are a lot of processes waiting to run. The most likely cause for this is not CPU consumption, but I/O wait. Please run vmstat an

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
On Aug 12, 2015, at 11:25 AM, Chad M Stewart wrote: > <..snip..> > Since I posted I've changed a couple of things: ulimit -n 8192, and disabled > fsync as in mail_fsync = never. I'm not sure if I'll put it back in the LMTP > section or not. Given all the hardware abstraction layers. I f

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
On Aug 12, 2015, at 11:04 AM, Andrzej A. Filip wrote: > > <..snip..> > Could you provide the following info: > a) mailbox type (maildir/mbox/dbox/...) maildir > [mail_location in dovecot's config] /srv/mail/// > b) file system type (ext2/ext3/ext4/fat32/...) > [provided by "df -T" command

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Andrzej A. Filip
Chad M Stewart wrote: > Dovecot 2.2.18 on CentOS 6 > > I have a pair of servers setup with MySQL, Postfix, and Dovecot. Replication > is setup and working between the two dovecot instances. > > The problem I'm running into is that a single mailbox receives a lot > of messages, at times the rate

multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
Dovecot 2.2.18 on CentOS 6 I have a pair of servers setup with MySQL, Postfix, and Dovecot. Replication is setup and working between the two dovecot instances. The problem I'm running into is that a single mailbox receives a lot of messages, at times the rate is multiple messages per second.