Re: [Dovecot] Dovecot over NFS

2012-06-11 Thread Timo Sirainen 
On 7.6.2012, at 1.07, James Devine wrote:

 I'm playing with running dovecot over NFS and I am running into some
 issues.  I have followed the guide at  http://wiki2.dovecot.org/NFS and my
 setup includes 1 nfs server and 1 client running postfix/dovecot.

Which NFS server? Which NFS client (Linux)?

  In
 testing I am running postal via the command:
 
 postal -t 10 -c 10 localhost users399
 
 The test file has a list of 399 users to deliver to.  I've provided a
 sample of the errors I'm receiving and my configuration below, I am running
 dovecot 2.0.19.  Any idea what I might be doing wrong and what I might do
 to resolve it?  My ultimate goal is to setup multiple clients with director
 so each user is still handled on a single machine, however with a single
 machine I still seem to be having issues.
..
 Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130):
 Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
 dbox header size: 0

Yeah, something's broken. I'd try:

1. Try Dovecot v2.1.7. I don't think v2.0.19 had these problems anymore but 
wouldn't hurt to try.

2. Try if you can reproduce the same problem with local filesystem.

3. Try another NFS server or client..

Re: [Dovecot] Dovecot over NFS

2012-06-10 Thread James Devine 
On Sat, Jun 9, 2012 at 12:40 PM, Daniel Parthey 
daniel.part...@informatik.tu-chemnitz.de wrote:

 James Devine wrote:
  I'm playing with running dovecot over NFS and I am running into some
  issues.  I have followed the guide at  http://wiki2.dovecot.org/NFS and
 my
  setup includes 1 nfs server and 1 client running postfix/dovecot.  In
  testing I am running postal via the command:
 
  postal -t 10 -c 10 localhost users399
 
  The test file has a list of 399 users to deliver to.  I've provided a
  sample of the errors I'm receiving and my configuration below, I am
 running
  dovecot 2.0.19.  Any idea what I might be doing wrong and what I might do
  to resolve it?  My ultimate goal is to setup multiple clients with
 director
  so each user is still handled on a single machine, however with a single
  machine I still seem to be having issues.

 Have a look at
 http://wiki2.dovecot.org/Director

  Here is a sample of some of the errors I'm seeing:
 
  Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130):
  Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
  dbox header size: 0
  Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(11999, testuser99):
  Error: Log synchronization error at seq=2,offset=556 for
  /mnt/testuser99/mdbox/storage/dovecot.map.index: Append with UID 2, but
  next_uid = 3

 mdbox format requires a correct index and you will lose flags,
 if you lose the index file. The index will be automatically tried
 to restore from mails in the storage.

 You should avoid accessing the same user directory from different
 NFS clients, since this often leads to corruptions or invalid files.

 You need a director which ensures that one directory is only accessed
 from one host at the same time. This applies to IMAP, POP3, LMTP etc,
 which are all writing to the mailbox.

 Then you should access all mailboxes only via the director listener ports.

  My dovecot config is:

 You posted only the configuration of your mailbox instance
 and might have a look your director configuration too:

 doveconf -c /etc/dovecot-director/dovecot-director.conf -n

 (or wherever your director configuration is located)

 Regards
 Daniel


Right now there is no director, I am only trying to get a single client
running postfix/dovecot talking to a single nfs server without error and
that's where I am having trouble

Re: [Dovecot] Dovecot over NFS

2012-06-10 Thread James Devine 
By client I meant NFS client running postfix/dovecot servers

On Sun, Jun 10, 2012 at 9:38 PM, James Devine fxmul...@gmail.com wrote:


 On Sat, Jun 9, 2012 at 12:40 PM, Daniel Parthey 
 daniel.part...@informatik.tu-chemnitz.de wrote:

 James Devine wrote:
  I'm playing with running dovecot over NFS and I am running into some
  issues.  I have followed the guide at  http://wiki2.dovecot.org/NFSand my
  setup includes 1 nfs server and 1 client running postfix/dovecot.  In
  testing I am running postal via the command:
 
  postal -t 10 -c 10 localhost users399
 
  The test file has a list of 399 users to deliver to.  I've provided a
  sample of the errors I'm receiving and my configuration below, I am
 running
  dovecot 2.0.19.  Any idea what I might be doing wrong and what I might
 do
  to resolve it?  My ultimate goal is to setup multiple clients with
 director
  so each user is still handled on a single machine, however with a single
  machine I still seem to be having issues.

 Have a look at
 http://wiki2.dovecot.org/Director

  Here is a sample of some of the errors I'm seeing:
 
  Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130):
  Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
  dbox header size: 0
  Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(11999, testuser99):
  Error: Log synchronization error at seq=2,offset=556 for
  /mnt/testuser99/mdbox/storage/dovecot.map.index: Append with UID 2, but
  next_uid = 3

 mdbox format requires a correct index and you will lose flags,
 if you lose the index file. The index will be automatically tried
 to restore from mails in the storage.

 You should avoid accessing the same user directory from different
 NFS clients, since this often leads to corruptions or invalid files.

 You need a director which ensures that one directory is only accessed
 from one host at the same time. This applies to IMAP, POP3, LMTP etc,
 which are all writing to the mailbox.

 Then you should access all mailboxes only via the director listener ports.

  My dovecot config is:

 You posted only the configuration of your mailbox instance
 and might have a look your director configuration too:

 doveconf -c /etc/dovecot-director/dovecot-director.conf -n

 (or wherever your director configuration is located)

 Regards
 Daniel


 Right now there is no director, I am only trying to get a single client
 running postfix/dovecot talking to a single nfs server without error and
 that's where I am having trouble

Re: [Dovecot] Dovecot over NFS

2012-06-09 Thread Daniel Parthey 
James Devine wrote:
 I'm playing with running dovecot over NFS and I am running into some
 issues.  I have followed the guide at  http://wiki2.dovecot.org/NFS and my
 setup includes 1 nfs server and 1 client running postfix/dovecot.  In
 testing I am running postal via the command:
 
 postal -t 10 -c 10 localhost users399
 
 The test file has a list of 399 users to deliver to.  I've provided a
 sample of the errors I'm receiving and my configuration below, I am running
 dovecot 2.0.19.  Any idea what I might be doing wrong and what I might do
 to resolve it?  My ultimate goal is to setup multiple clients with director
 so each user is still handled on a single machine, however with a single
 machine I still seem to be having issues.

Have a look at
http://wiki2.dovecot.org/Director

 Here is a sample of some of the errors I'm seeing:
 
 Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130):
 Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
 dbox header size: 0
 Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(11999, testuser99):
 Error: Log synchronization error at seq=2,offset=556 for
 /mnt/testuser99/mdbox/storage/dovecot.map.index: Append with UID 2, but
 next_uid = 3

mdbox format requires a correct index and you will lose flags,
if you lose the index file. The index will be automatically tried
to restore from mails in the storage.

You should avoid accessing the same user directory from different
NFS clients, since this often leads to corruptions or invalid files.

You need a director which ensures that one directory is only accessed
from one host at the same time. This applies to IMAP, POP3, LMTP etc,
which are all writing to the mailbox.

Then you should access all mailboxes only via the director listener ports.

 My dovecot config is:

You posted only the configuration of your mailbox instance
and might have a look your director configuration too:

doveconf -c /etc/dovecot-director/dovecot-director.conf -n

(or wherever your director configuration is located)

Regards
Daniel

[Dovecot] Dovecot over NFS

2012-06-06 Thread James Devine 
I'm playing with running dovecot over NFS and I am running into some
issues.  I have followed the guide at  http://wiki2.dovecot.org/NFS and my
setup includes 1 nfs server and 1 client running postfix/dovecot.  In
testing I am running postal via the command:

postal -t 10 -c 10 localhost users399

The test file has a list of 399 users to deliver to.  I've provided a
sample of the errors I'm receiving and my configuration below, I am running
dovecot 2.0.19.  Any idea what I might be doing wrong and what I might do
to resolve it?  My ultimate goal is to setup multiple clients with director
so each user is still handled on a single machine, however with a single
machine I still seem to be having issues.





Here is a sample of some of the errors I'm seeing:

Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130):
Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:12 test-gluster-client1 dovecot: lmtp(11999, testuser99):
Error: Log synchronization error at seq=2,offset=556 for
/mnt/testuser99/mdbox/storage/dovecot.map.index: Append with UID 2, but
next_uid = 3
Jun  6 15:55:14 test-gluster-client1 dovecot: lmtp(12047, testuser41):
Error: mdbox /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox
header size: 0
Jun  6 15:55:18 test-gluster-client1 dovecot: lmtp(12133, testuser138):
Error: Log synchronization error at seq=2,offset=556 for
/mnt/testuser138/mdbox/storage/dovecot.map.index: Append with UID 2, but
next_uid = 3
Jun  6 15:55:19 test-gluster-client1 dovecot: lmtp(12076, testuser217):
Error: mdbox /mnt/testuser217/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:19 test-gluster-client1 dovecot: lmtp(12047, testuser41):
Error: mdbox /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox
header size: 0
Jun  6 15:55:23 test-gluster-client1 dovecot: lmtp(11985, testuser166):
Error: mdbox /mnt/testuser166/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:23 test-gluster-client1 dovecot: lmtp(12072, testuser130):
Error: Log synchronization error at seq=2,offset=204 for
/mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index:
uid_validity updated unexpectedly: 1339019655 - 1339019656
Jun  6 15:55:23 test-gluster-client1 dovecot: lmtp(11928, testuser130):
Error: Log synchronization error at seq=2,offset=204 for
/mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index:
uid_validity updated unexpectedly: 1339019655 - 1339019656
Jun  6 15:55:24 test-gluster-client1 dovecot: lmtp(11954, testuser192):
Error: mdbox /mnt/testuser192/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:24 test-gluster-client1 dovecot: lmtp(12130, testuser128):
Error: mdbox /mnt/testuser128/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:27 test-gluster-client1 dovecot: lmtp(12076, testuser217):
Error: mdbox /mnt/testuser217/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:27 test-gluster-client1 dovecot: lmtp(12211, testuser60):
Error: mdbox /mnt/testuser60/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox
header size: 0
Jun  6 15:55:27 test-gluster-client1 dovecot: lmtp(12112, testuser190):
Error: mdbox /mnt/testuser190/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:27 test-gluster-client1 dovecot: lmtp(12047, testuser41):
Error: Log synchronization error at seq=2,offset=204 for
/mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index:
uid_validity updated unexpectedly: 1339019658 - 1339019659
Jun  6 15:55:27 test-gluster-client1 dovecot: lmtp(11937, testuser41):
Error: Log synchronization error at seq=2,offset=204 for
/mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index:
uid_validity updated unexpectedly: 1339019658 - 1339019659
Jun  6 15:55:28 test-gluster-client1 dovecot: lmtp(11985, testuser166):
Error: mdbox /mnt/testuser166/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0
Jun  6 15:55:30 test-gluster-client1 dovecot: lmtp(12130, testuser128):
Error: mdbox /mnt/testuser128/mdbox/mailboxes/INBOX/dbox-Mails: Invalid
dbox header size: 0






My dovecot config is:

auth_debug = yes
auth_debug_passwords = yes
auth_username_format = %Ln
auth_verbose = yes
base_dir = /var/run/dovecot-service/
disable_plaintext_auth = no
instance_name = dovecot-service
mail_debug = yes
mail_fsync = always
mail_location = mdbox:~/mdbox
mail_nfs_index = yes
mail_nfs_storage = yes
mail_plugins = quota
mdbox_rotate_size = 16 M
mmap_disable = yes
passdb {
  driver = pam
}
plugin {
  quota = dict:User quota::file:%h/mdbox/dovecot-quota
}
protocols =  imap lmtp pop3
service auth {
  unix_listener auth-userdb {
group = postfix
mode = 0666
user = postfix
  }
}
service imap-login {
  inet_listener imap {
port = 10143
  }
}
service lmtp {
  inet_listener lmtp {
port = 10024
  }
}
service pop3-login {
  inet_listener pop3 {
port = 10110
  }
}
ssl = no
ssl_cert =