Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Hi Timo,

Am 20.09.17 um 02:06 schrieb Timo Sirainen:
> On 19 Sep 2017, at 1.03, Ralf Becker  > wrote:
>>
>> doveadm(@): Info: Mailbox INBOX/AA is NOT visible in LIST
>>
>> How to fix that situation?
>>
>> Is there a way to reset acl of all folders of a user to all rights for
>> the owner?
>>
>> root@fra-nfs-mail:/var/dovecot/imap//# find -name
>> "dovecot-acl*"
>> ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl
>> ./mdbox/mailboxes/AA/dbox-Mails/dovecot-acl
>> ./mdbox/dovecot-acl-list
>
> Did you try deleting dovecot-acl-list to see if it makes a difference?
> What do these two dovecot-acl files contain?

root@fra-nfs-mail:/var/dovecot/imap//# find -name
dovecot-acl\*
./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl
./mdbox/dovecot-acl-list
root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann#
cat mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl
owner akxeilprwts
user=@ akxeilprwts

This are the ACLs I set before.

> If you delete those, it should reset all the ACLs.

root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann#
find -name dovecot-acl\*
./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl
./mdbox/dovecot-acl-list
root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann#
cat mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl
owner akxeilprwts
user=christopher.poschm...@gruene-berlin.de akxeilprwts
root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann#
rm mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl mdbox/dovecot-acl-list
root@fra-nfs-mail:/var/dovecot/imap/gruene-berlin.de/Christopher.Poschmann#
doveadm mailbox list -u christopher.poschm...@gruene-berlin.de
user
INBOX
root@fra-nfs-mail:/var/dovecot/imap//# doveadm acl debug
-u @ INBOX
doveadm(@): Info: Mailbox 'INBOX' is in namespace 'INBOX/'
doveadm(@): Info: Mailbox path:
/var/dovecot/imap///mdbox/mailboxes/INBOX/dbox-Mails
doveadm(@): Info: All message flags are shared across
users in mailbox
doveadm(@): Info: User @ has no rights for
mailbox
doveadm(@): Error: User @ is missing
'lookup' right
doveadm(@): Info: Mailbox INBOX is NOT visible in LIST

Problem still exists, after deleting the dovecot-acl* files :(

I believe it's some kind of corruption in the mdbox files.
I tried to move the mailbox away and import it again from the moved
location, which so far fixed most of the problems we had in the past,
but in case of that mailbox, it failed with a fatal error (see my first
post in this thread).

Ralf

-- 
Ralf Becker
EGroupware GmbH [www.egroupware.org]
Handelsregister HRB Kaiserslautern 3587
Geschäftsführer Birgit und Ralf Becker
Leibnizstr. 17, 67663 Kaiserslautern, Germany
Telefon +49 631 31657-0




signature.asc
Description: OpenPGP digital signature

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Timo Sirainen]

On 19 Sep 2017, at 1.03, Ralf Becker mailto:r...@egroupware.org>> wrote:
> 
> doveadm(@): Info: Mailbox INBOX/AA is NOT visible in LIST
> 
> How to fix that situation?
> 
> Is there a way to reset acl of all folders of a user to all rights for
> the owner?
> 
> root@fra-nfs-mail:/var/dovecot/imap//# find -name
> "dovecot-acl*"
> ./mdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl
> ./mdbox/mailboxes/AA/dbox-Mails/dovecot-acl
> ./mdbox/dovecot-acl-list

Did you try deleting dovecot-acl-list to see if it makes a difference? What do 
these two dovecot-acl files contain? If you delete those, it should reset all 
the ACLs.

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Am 19.09.17 um 00:03 schrieb Ralf Becker:
> Hi Timo,
>
> update to 2.2.32 (suggested by Aki) did not change the situation ...
>
> Am 18.09.17 um 20:49 schrieb Timo Sirainen:
>> On 18 Sep 2017, at 20.12, Ralf Becker > > wrote:
>>> Hi Timo,
>>>
>>> Am 18.09.17 um 12:03 schrieb Timo Sirainen:
 On 18 Sep 2017, at 12.10, Ralf Becker >>> 
 > wrote:
> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
>> On 7 Sep 2017, at 17.42, Ralf Becker > 
>> > wrote:
>>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>>
>>> Since a couple of days some mailboxes have the problem, that sieve
>>> rules
>>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>>
>>> sieve: info: started log at Sep 07 13:57:17.
>>> error:
>>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de
>>> 
>>> >:
>>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>>> INBOX/Munser.
>>>
>>> When I do a doveadm mailbox list -s -u @ I get all
>>> folders
>>> incl. the one mentioned above, while doveadm mailbox list without -s
>>> shows just
>>> user
>>> INBOX
>> Subscriptions are stored independently from the actual folders. So
>> it looks like the subscription file exists and is correct, but
>> somehow you've lost all the folders. Do you see the folders in the
>> filesystem under user/mailboxes/ directory? 
> Yes, the folders exist under
> /var/dovecot/imap///mdbox/mailboxes/.
> Just doveadm mailbox list -u @ (without -s) does only
> show
> INBOX and user.
> (I can send you the list of folders via private mail, but I can not
> post
> them on the list.)
>
> Anything I can do to get Dovecot to eg. rescan the folders from the
> filesystem or any other way to fix that problem?
> I have it with a couple of mailboxes, so I believe it's some kind of
> systematic problem, nothing the users did.
 I can't really think of any reason why it wouldn't simply work.
 Especially since you're not using v2.2.32, the folder listing is
 always performed by listing the directories in filesystem, so there's
 nothing really to resync. What's your doveconf -n? You could try with
 mailbox_list_index=no if that happens to make any difference, but it
 shouldn't.

 You could also try what "strace -o log -s 100 doveadm mailbox list -u
 user@domain" shows. Is it opening the correct mailboxes/ directory?
 Maybe the path is just wrong for some reason (some typo added
 somewhere)?
>>>
>>> Nope it lstats the correct directories, but does not show them.
>>>
>>> I send you the strace / sysdig output per private mail, as it contains
>>> private information of that user.
>> Looks like you have some dovecot-acl and dovecot-acl-list files, so it
>> has to be because Dovecot thinks the ACLs are preventing access to the
>> user. Try deleting dovecot-acl-list to see if the problem is with
>> that. If not, look at the dovecot-acl files and/or "doveadm acl debug
>> -u user@domain " to figure out what's
>> wrong.
>
> root@fra-nfs-mail:~# doveadm acl debug -u @ INBOX/AA
> doveadm(@): Info: Mailbox 'AA' is in namespace 'INBOX/'
> doveadm(@): Info: Mailbox path:
> /var/dovecot/imap///mdbox/mailboxes/AA/dbox-Mails
> doveadm(@): Info: All message flags are shared across
> users in mailbox
> doveadm(@): Info: User @ has no rights for
> mailbox
> doveadm(@): Error: User @ is missing
> 'lookup' right
> doveadm(@): Info: Mailbox INBOX/AA is NOT visible in LIST
>
> Ok, but when I try to fix it:
>
> root@fra-nfs-mail:~# doveadm acl add -u @ INBOX/AA
> user=@ admin create delete expunge insert lookup post read
> write write-deleted write-seen
>
> root@fra-nfs-mail:~# doveadm acl add -u @ INBOX/AA owner
> admin create delete expunge insert lookup post read write write-deleted
> write-seen
>
> root@fra-nfs-mail:~# doveadm acl get -u @ INBOX/AA
> ID  Global Rights
> owner  admin create delete
> expunge insert lookup post read write write-deleted write-seen
> user=@    admin create delete expunge insert lookup
> post read write write-deleted write-seen
>
> Nothing has changed :(
>
> root@fra-nfs-mail:~# doveadm acl debug -u @ INBOX/AA
> doveadm(@): Info: Mailbox 'AA' is in namespace 'INBOX/'
> doveadm(@): Info: Mailbox path:
> /var/dovecot/imap///mdbox/mailboxes/AA/dbox-Mails
> doveadm(@): Info: All message flags are shared across
> users in mailbox
> doveadm(@): Info: User @ has no rights for
> mailbox
> doveadm(@): Error: User @ is missing
> 'lookup' right

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Hi Timo,

update to 2.2.32 (suggested by Aki) did not change the situation ...

Am 18.09.17 um 20:49 schrieb Timo Sirainen:
> On 18 Sep 2017, at 20.12, Ralf Becker  > wrote:
>>
>> Hi Timo,
>>
>> Am 18.09.17 um 12:03 schrieb Timo Sirainen:
>>> On 18 Sep 2017, at 12.10, Ralf Becker >> 
>>> > wrote:

 Am 14.09.17 um 01:07 schrieb Timo Sirainen:
> On 7 Sep 2017, at 17.42, Ralf Becker  
> > wrote:
>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>
>> Since a couple of days some mailboxes have the problem, that sieve
>> rules
>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>
>> sieve: info: started log at Sep 07 13:57:17.
>> error:
>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de
>> 
>> >:
>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>> INBOX/Munser.
>>
>> When I do a doveadm mailbox list -s -u @ I get all
>> folders
>> incl. the one mentioned above, while doveadm mailbox list without -s
>> shows just
>> user
>> INBOX
> Subscriptions are stored independently from the actual folders. So
> it looks like the subscription file exists and is correct, but
> somehow you've lost all the folders. Do you see the folders in the
> filesystem under user/mailboxes/ directory? 

 Yes, the folders exist under
 /var/dovecot/imap///mdbox/mailboxes/.
 Just doveadm mailbox list -u @ (without -s) does only
 show
 INBOX and user.
 (I can send you the list of folders via private mail, but I can not
 post
 them on the list.)

 Anything I can do to get Dovecot to eg. rescan the folders from the
 filesystem or any other way to fix that problem?
 I have it with a couple of mailboxes, so I believe it's some kind of
 systematic problem, nothing the users did.
>>>
>>> I can't really think of any reason why it wouldn't simply work.
>>> Especially since you're not using v2.2.32, the folder listing is
>>> always performed by listing the directories in filesystem, so there's
>>> nothing really to resync. What's your doveconf -n? You could try with
>>> mailbox_list_index=no if that happens to make any difference, but it
>>> shouldn't.
>>>
>>> You could also try what "strace -o log -s 100 doveadm mailbox list -u
>>> user@domain" shows. Is it opening the correct mailboxes/ directory?
>>> Maybe the path is just wrong for some reason (some typo added
>>> somewhere)?
>>
>>
>> Nope it lstats the correct directories, but does not show them.
>>
>> I send you the strace / sysdig output per private mail, as it contains
>> private information of that user.
>
> Looks like you have some dovecot-acl and dovecot-acl-list files, so it
> has to be because Dovecot thinks the ACLs are preventing access to the
> user. Try deleting dovecot-acl-list to see if the problem is with
> that. If not, look at the dovecot-acl files and/or "doveadm acl debug
> -u user@domain " to figure out what's
> wrong.


root@fra-nfs-mail:~# doveadm acl debug -u @ INBOX/AA
doveadm(@): Info: Mailbox 'AA' is in namespace 'INBOX/'
doveadm(@): Info: Mailbox path:
/var/dovecot/imap///mdbox/mailboxes/AA/dbox-Mails
doveadm(@): Info: All message flags are shared across
users in mailbox
doveadm(@): Info: User @ has no rights for
mailbox
doveadm(@): Error: User @ is missing
'lookup' right
doveadm(@): Info: Mailbox INBOX/AA is NOT visible in LIST

Ok, but when I try to fix it:

root@fra-nfs-mail:~# doveadm acl add -u @ INBOX/AA
user=@ admin create delete expunge insert lookup post read
write write-deleted write-seen

root@fra-nfs-mail:~# doveadm acl add -u @ INBOX/AA owner
admin create delete expunge insert lookup post read write write-deleted
write-seen

root@fra-nfs-mail:~# doveadm acl get -u @ INBOX/AA
ID  Global Rights
owner  admin create delete
expunge insert lookup post read write write-deleted write-seen
user=@    admin create delete expunge insert lookup
post read write write-deleted write-seen

Nothing has changed :(

root@fra-nfs-mail:~# doveadm acl debug -u @ INBOX/AA
doveadm(@): Info: Mailbox 'AA' is in namespace 'INBOX/'
doveadm(@): Info: Mailbox path:
/var/dovecot/imap///mdbox/mailboxes/AA/dbox-Mails
doveadm(@): Info: All message flags are shared across
users in mailbox
doveadm(@): Info: User @ has no rights for
mailbox
doveadm(@): Error: User @ is missing
'lookup' right
doveadm(@): Info: Mailbox INBOX/AA is NOT visible in LIST

How to fix that situation?

Is there a way to reset acl of all folders of a user to all rights for
the owner?

root@

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Am 18.09.17 um 11:34 schrieb Ralf Becker:
> Hi Aki,
>
> Am 18.09.17 um 11:22 schrieb Aki Tuomi:
>> On 18.09.2017 12:20, Ralf Becker wrote:
>>> Hi Aki,
>>>
>>> Am 18.09.17 um 11:13 schrieb Aki Tuomi:
 On 18.09.2017 12:10, Ralf Becker wrote:
> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
>> On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
>>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>>
>>> Since a couple of days some mailboxes have the problem, that sieve rules
>>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>>
>>> sieve: info: started log at Sep 07 13:57:17.
>>> error:
>>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
>>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>>> INBOX/Munser.
>>>
>>> When I do a doveadm mailbox list -s -u @ I get all folders
>>> incl. the one mentioned above, while doveadm mailbox list without -s
>>> shows just
>>> user
>>> INBOX
>> Subscriptions are stored independently from the actual folders. So it 
>> looks like the subscription file exists and is correct, but somehow 
>> you've lost all the folders. Do you see the folders in the filesystem 
>> under user/mailboxes/ directory? 
> Yes, the folders exist under
> /var/dovecot/imap///mdbox/mailboxes/.
> Just doveadm mailbox list -u @ (without -s) does only show
> INBOX and user.
> (I can send you the list of folders via private mail, but I can not post
> them on the list.)
>
> Anything I can do to get Dovecot to eg. rescan the folders from the
> filesystem or any other way to fix that problem?
> I have it with a couple of mailboxes, so I believe it's some kind of
> systematic problem, nothing the users did.
>
> Ralf
>
>> My guess is that it only has INBOX, which means the folders were deleted 
>> by something (Dovecot corruption can't lose entire folders - something 
>> must explicitly delete them).
 You can always try doveadm force-resync -u victim "*"

 You should run it twice, I guess.
>>> Tried that before and just tried it again, no luck :(
>>>
>>> root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
>>> @ "*"
>>> doveadm(@): Warning: fscking index file
>>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>>> doveadm(@): Warning: mdbox
>>> /var/dovecot/imap///mdbox/storage: rebuilding indexes
>>> doveadm(@): Warning: Transaction log file
>>> /var/dovecot/imap///mdbox/storage/dovecot.map.index.log
>>> was locked for 72 seconds (mdbox storage rebuild)
>>> doveadm(@): Warning: fscking index file
>>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>>>
>>> root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
>>> @ "*"
>>> doveadm(@): Warning: fscking index file
>>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>>> doveadm(@): Warning: mdbox
>>> /var/dovecot/imap///mdbox/storage: rebuilding indexes
>>> doveadm(@): Warning: fscking index file
>>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>>>
>>> root@fra-nfs-mail:/var/dovecot/imap/# doveadm mailbox list -u
>>> @
>>> user
>>> INBOX
>>>
>>> What else can I do to analyse the problem?
>>>
>>> Ralf
>>>
>> It seems you are running into
>> https://github.com/dovecot/core/commit/c8be39472a93a5de2cc1051bdbd4468bea0ca7ba#diff-664ea8e9082f57f29f8a284ced77d165
> That commit is part of 2.2.32, as far as I can see on Github, so I
> *only* need to update?
>
> I'm a bit reluctant to update, after all the problems in the version
> bitween 2.2.27 and 2.2.31 ...
>
> You recon the update 2.2.31 to .32 has no know problems so far?
>
> Ralf

Did the update to 2.2.32 now, but no change, after 2 force-resync
doveadm mailbox list still only reports INBOX and user.

Trying Timos ACL stuff now ...

Ralf

-- 
Ralf Becker
EGroupware GmbH [www.egroupware.org]
Handelsregister HRB Kaiserslautern 3587
Geschäftsführer Birgit und Ralf Becker
Leibnizstr. 17, 67663 Kaiserslautern, Germany
Telefon +49 631 31657-0




signature.asc
Description: OpenPGP digital signature

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Timo Sirainen]

On 18 Sep 2017, at 20.12, Ralf Becker mailto:r...@egroupware.org>> wrote:
> 
> Hi Timo,
> 
> Am 18.09.17 um 12:03 schrieb Timo Sirainen:
>> On 18 Sep 2017, at 12.10, Ralf Becker > 
>> >> wrote:
>>> 
>>> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
 On 7 Sep 2017, at 17.42, Ralf Becker >>> 
 >> wrote:
> Dovecot 2.2.31 with mailboxes in mdbox format.
> 
> Since a couple of days some mailboxes have the problem, that sieve
> rules
> moving mails to folders stop working and .sieve.log in mailbox shows:
> 
> sieve: info: started log at Sep 07 13:57:17.
> error:
> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de
>  
> 
>   
> >>:
> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
> INBOX/Munser.
> 
> When I do a doveadm mailbox list -s -u @ I get all
> folders
> incl. the one mentioned above, while doveadm mailbox list without -s
> shows just
> user
> INBOX
 Subscriptions are stored independently from the actual folders. So
 it looks like the subscription file exists and is correct, but
 somehow you've lost all the folders. Do you see the folders in the
 filesystem under user/mailboxes/ directory? 
>>> 
>>> Yes, the folders exist under
>>> /var/dovecot/imap///mdbox/mailboxes/.
>>> Just doveadm mailbox list -u @ (without -s) does only show
>>> INBOX and user.
>>> (I can send you the list of folders via private mail, but I can not post
>>> them on the list.)
>>> 
>>> Anything I can do to get Dovecot to eg. rescan the folders from the
>>> filesystem or any other way to fix that problem?
>>> I have it with a couple of mailboxes, so I believe it's some kind of
>>> systematic problem, nothing the users did.
>> 
>> I can't really think of any reason why it wouldn't simply work.
>> Especially since you're not using v2.2.32, the folder listing is
>> always performed by listing the directories in filesystem, so there's
>> nothing really to resync. What's your doveconf -n? You could try with
>> mailbox_list_index=no if that happens to make any difference, but it
>> shouldn't.
>> 
>> You could also try what "strace -o log -s 100 doveadm mailbox list -u
>> user@domain" shows. Is it opening the correct mailboxes/ directory?
>> Maybe the path is just wrong for some reason (some typo added somewhere)?
> 
> 
> Nope it lstats the correct directories, but does not show them.
> 
> I send you the strace / sysdig output per private mail, as it contains
> private information of that user.

Looks like you have some dovecot-acl and dovecot-acl-list files, so it has to 
be because Dovecot thinks the ACLs are preventing access to the user. Try 
deleting dovecot-acl-list to see if the problem is with that. If not, look at 
the dovecot-acl files and/or "doveadm acl debug -u user@domain " to figure out what's wrong.

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Hi Timo,

Am 18.09.17 um 12:03 schrieb Timo Sirainen:
> On 18 Sep 2017, at 12.10, Ralf Becker  > wrote:
>>
>> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
>>> On 7 Sep 2017, at 17.42, Ralf Becker >> > wrote:
 Dovecot 2.2.31 with mailboxes in mdbox format.

 Since a couple of days some mailboxes have the problem, that sieve
 rules
 moving mails to folders stop working and .sieve.log in mailbox shows:

 sieve: info: started log at Sep 07 13:57:17.
 error:
 msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de
 >:
 failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
 INBOX/Munser.

 When I do a doveadm mailbox list -s -u @ I get all
 folders
 incl. the one mentioned above, while doveadm mailbox list without -s
 shows just
 user
 INBOX
>>> Subscriptions are stored independently from the actual folders. So
>>> it looks like the subscription file exists and is correct, but
>>> somehow you've lost all the folders. Do you see the folders in the
>>> filesystem under user/mailboxes/ directory? 
>>
>> Yes, the folders exist under
>> /var/dovecot/imap///mdbox/mailboxes/.
>> Just doveadm mailbox list -u @ (without -s) does only show
>> INBOX and user.
>> (I can send you the list of folders via private mail, but I can not post
>> them on the list.)
>>
>> Anything I can do to get Dovecot to eg. rescan the folders from the
>> filesystem or any other way to fix that problem?
>> I have it with a couple of mailboxes, so I believe it's some kind of
>> systematic problem, nothing the users did.
>
> I can't really think of any reason why it wouldn't simply work.
> Especially since you're not using v2.2.32, the folder listing is
> always performed by listing the directories in filesystem, so there's
> nothing really to resync. What's your doveconf -n? You could try with
> mailbox_list_index=no if that happens to make any difference, but it
> shouldn't.
>
> You could also try what "strace -o log -s 100 doveadm mailbox list -u
> user@domain" shows. Is it opening the correct mailboxes/ directory?
> Maybe the path is just wrong for some reason (some typo added somewhere)?


Nope it lstats the correct directories, but does not show them.

I send you the strace / sysdig output per private mail, as it contains
private information of that user.

Ralf

-- 
Ralf Becker
EGroupware GmbH [www.egroupware.org]
Handelsregister HRB Kaiserslautern 3587
Geschäftsführer Birgit und Ralf Becker
Leibnizstr. 17, 67663 Kaiserslautern, Germany
Telefon +49 631 31657-0




signature.asc
Description: OpenPGP digital signature

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Timo Sirainen]

On 18 Sep 2017, at 12.10, Ralf Becker mailto:r...@egroupware.org>> wrote:
> 
> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
>> On 7 Sep 2017, at 17.42, Ralf Becker > > wrote:
>>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>> 
>>> Since a couple of days some mailboxes have the problem, that sieve rules
>>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>> 
>>> sieve: info: started log at Sep 07 13:57:17.
>>> error:
>>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de
>>>  
>>> >:
>>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>>> INBOX/Munser.
>>> 
>>> When I do a doveadm mailbox list -s -u @ I get all folders
>>> incl. the one mentioned above, while doveadm mailbox list without -s
>>> shows just
>>> user
>>> INBOX
>> Subscriptions are stored independently from the actual folders. So it looks 
>> like the subscription file exists and is correct, but somehow you've lost 
>> all the folders. Do you see the folders in the filesystem under 
>> user/mailboxes/ directory? 
> 
> Yes, the folders exist under
> /var/dovecot/imap///mdbox/mailboxes/.
> Just doveadm mailbox list -u @ (without -s) does only show
> INBOX and user.
> (I can send you the list of folders via private mail, but I can not post
> them on the list.)
> 
> Anything I can do to get Dovecot to eg. rescan the folders from the
> filesystem or any other way to fix that problem?
> I have it with a couple of mailboxes, so I believe it's some kind of
> systematic problem, nothing the users did.

I can't really think of any reason why it wouldn't simply work. Especially 
since you're not using v2.2.32, the folder listing is always performed by 
listing the directories in filesystem, so there's nothing really to resync. 
What's your doveconf -n? You could try with mailbox_list_index=no if that 
happens to make any difference, but it shouldn't.

You could also try what "strace -o log -s 100 doveadm mailbox list -u 
user@domain" shows. Is it opening the correct mailboxes/ directory? Maybe the 
path is just wrong for some reason (some typo added somewhere)?

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Hi Aki,

Am 18.09.17 um 11:22 schrieb Aki Tuomi:
> On 18.09.2017 12:20, Ralf Becker wrote:
>> Hi Aki,
>>
>> Am 18.09.17 um 11:13 schrieb Aki Tuomi:
>>> On 18.09.2017 12:10, Ralf Becker wrote:
 Am 14.09.17 um 01:07 schrieb Timo Sirainen:
> On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>
>> Since a couple of days some mailboxes have the problem, that sieve rules
>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>
>> sieve: info: started log at Sep 07 13:57:17.
>> error:
>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>> INBOX/Munser.
>>
>> When I do a doveadm mailbox list -s -u @ I get all folders
>> incl. the one mentioned above, while doveadm mailbox list without -s
>> shows just
>> user
>> INBOX
> Subscriptions are stored independently from the actual folders. So it 
> looks like the subscription file exists and is correct, but somehow 
> you've lost all the folders. Do you see the folders in the filesystem 
> under user/mailboxes/ directory? 
 Yes, the folders exist under
 /var/dovecot/imap///mdbox/mailboxes/.
 Just doveadm mailbox list -u @ (without -s) does only show
 INBOX and user.
 (I can send you the list of folders via private mail, but I can not post
 them on the list.)

 Anything I can do to get Dovecot to eg. rescan the folders from the
 filesystem or any other way to fix that problem?
 I have it with a couple of mailboxes, so I believe it's some kind of
 systematic problem, nothing the users did.

 Ralf

> My guess is that it only has INBOX, which means the folders were deleted 
> by something (Dovecot corruption can't lose entire folders - something 
> must explicitly delete them).
>>> You can always try doveadm force-resync -u victim "*"
>>>
>>> You should run it twice, I guess.
>> Tried that before and just tried it again, no luck :(
>>
>> root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
>> @ "*"
>> doveadm(@): Warning: fscking index file
>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>> doveadm(@): Warning: mdbox
>> /var/dovecot/imap///mdbox/storage: rebuilding indexes
>> doveadm(@): Warning: Transaction log file
>> /var/dovecot/imap///mdbox/storage/dovecot.map.index.log
>> was locked for 72 seconds (mdbox storage rebuild)
>> doveadm(@): Warning: fscking index file
>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>>
>> root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
>> @ "*"
>> doveadm(@): Warning: fscking index file
>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>> doveadm(@): Warning: mdbox
>> /var/dovecot/imap///mdbox/storage: rebuilding indexes
>> doveadm(@): Warning: fscking index file
>> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>>
>> root@fra-nfs-mail:/var/dovecot/imap/# doveadm mailbox list -u
>> @
>> user
>> INBOX
>>
>> What else can I do to analyse the problem?
>>
>> Ralf
>>
> It seems you are running into
> https://github.com/dovecot/core/commit/c8be39472a93a5de2cc1051bdbd4468bea0ca7ba#diff-664ea8e9082f57f29f8a284ced77d165

That commit is part of 2.2.32, as far as I can see on Github, so I
*only* need to update?

I'm a bit reluctant to update, after all the problems in the version
bitween 2.2.27 and 2.2.31 ...

You recon the update 2.2.31 to .32 has no know problems so far?

Ralf

-- 
Ralf Becker
EGroupware GmbH [www.egroupware.org]
Handelsregister HRB Kaiserslautern 3587
Geschäftsführer Birgit und Ralf Becker
Leibnizstr. 17, 67663 Kaiserslautern, Germany
Telefon +49 631 31657-0




signature.asc
Description: OpenPGP digital signature

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Aki Tuomi]

On 18.09.2017 12:20, Ralf Becker wrote:
> Hi Aki,
>
> Am 18.09.17 um 11:13 schrieb Aki Tuomi:
>> On 18.09.2017 12:10, Ralf Becker wrote:
>>> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
 On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
> Dovecot 2.2.31 with mailboxes in mdbox format.
>
> Since a couple of days some mailboxes have the problem, that sieve rules
> moving mails to folders stop working and .sieve.log in mailbox shows:
>
> sieve: info: started log at Sep 07 13:57:17.
> error:
> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
> INBOX/Munser.
>
> When I do a doveadm mailbox list -s -u @ I get all folders
> incl. the one mentioned above, while doveadm mailbox list without -s
> shows just
> user
> INBOX
 Subscriptions are stored independently from the actual folders. So it 
 looks like the subscription file exists and is correct, but somehow you've 
 lost all the folders. Do you see the folders in the filesystem under 
 user/mailboxes/ directory? 
>>> Yes, the folders exist under
>>> /var/dovecot/imap///mdbox/mailboxes/.
>>> Just doveadm mailbox list -u @ (without -s) does only show
>>> INBOX and user.
>>> (I can send you the list of folders via private mail, but I can not post
>>> them on the list.)
>>>
>>> Anything I can do to get Dovecot to eg. rescan the folders from the
>>> filesystem or any other way to fix that problem?
>>> I have it with a couple of mailboxes, so I believe it's some kind of
>>> systematic problem, nothing the users did.
>>>
>>> Ralf
>>>
 My guess is that it only has INBOX, which means the folders were deleted 
 by something (Dovecot corruption can't lose entire folders - something 
 must explicitly delete them).
>> You can always try doveadm force-resync -u victim "*"
>>
>> You should run it twice, I guess.
> Tried that before and just tried it again, no luck :(
>
> root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
> @ "*"
> doveadm(@): Warning: fscking index file
> /var/dovecot/imap///mdbox/storage/dovecot.map.index
> doveadm(@): Warning: mdbox
> /var/dovecot/imap///mdbox/storage: rebuilding indexes
> doveadm(@): Warning: Transaction log file
> /var/dovecot/imap///mdbox/storage/dovecot.map.index.log
> was locked for 72 seconds (mdbox storage rebuild)
> doveadm(@): Warning: fscking index file
> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>
> root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
> @ "*"
> doveadm(@): Warning: fscking index file
> /var/dovecot/imap///mdbox/storage/dovecot.map.index
> doveadm(@): Warning: mdbox
> /var/dovecot/imap///mdbox/storage: rebuilding indexes
> doveadm(@): Warning: fscking index file
> /var/dovecot/imap///mdbox/storage/dovecot.map.index
>
> root@fra-nfs-mail:/var/dovecot/imap/# doveadm mailbox list -u
> @
> user
> INBOX
>
> What else can I do to analyse the problem?
>
> Ralf
>

It seems you are running into
https://github.com/dovecot/core/commit/c8be39472a93a5de2cc1051bdbd4468bea0ca7ba#diff-664ea8e9082f57f29f8a284ced77d165

Aki

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Hi Aki,

Am 18.09.17 um 11:13 schrieb Aki Tuomi:
> On 18.09.2017 12:10, Ralf Becker wrote:
>> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
>>> On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
 Dovecot 2.2.31 with mailboxes in mdbox format.

 Since a couple of days some mailboxes have the problem, that sieve rules
 moving mails to folders stop working and .sieve.log in mailbox shows:

 sieve: info: started log at Sep 07 13:57:17.
 error:
 msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
 failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
 INBOX/Munser.

 When I do a doveadm mailbox list -s -u @ I get all folders
 incl. the one mentioned above, while doveadm mailbox list without -s
 shows just
 user
 INBOX
>>> Subscriptions are stored independently from the actual folders. So it looks 
>>> like the subscription file exists and is correct, but somehow you've lost 
>>> all the folders. Do you see the folders in the filesystem under 
>>> user/mailboxes/ directory? 
>> Yes, the folders exist under
>> /var/dovecot/imap///mdbox/mailboxes/.
>> Just doveadm mailbox list -u @ (without -s) does only show
>> INBOX and user.
>> (I can send you the list of folders via private mail, but I can not post
>> them on the list.)
>>
>> Anything I can do to get Dovecot to eg. rescan the folders from the
>> filesystem or any other way to fix that problem?
>> I have it with a couple of mailboxes, so I believe it's some kind of
>> systematic problem, nothing the users did.
>>
>> Ralf
>>
>>> My guess is that it only has INBOX, which means the folders were deleted by 
>>> something (Dovecot corruption can't lose entire folders - something must 
>>> explicitly delete them).
> You can always try doveadm force-resync -u victim "*"
>
> You should run it twice, I guess.

Tried that before and just tried it again, no luck :(

root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
@ "*"
doveadm(@): Warning: fscking index file
/var/dovecot/imap///mdbox/storage/dovecot.map.index
doveadm(@): Warning: mdbox
/var/dovecot/imap///mdbox/storage: rebuilding indexes
doveadm(@): Warning: Transaction log file
/var/dovecot/imap///mdbox/storage/dovecot.map.index.log
was locked for 72 seconds (mdbox storage rebuild)
doveadm(@): Warning: fscking index file
/var/dovecot/imap///mdbox/storage/dovecot.map.index

root@fra-nfs-mail:/var/dovecot/imap/# doveadm force-resync -u
@ "*"
doveadm(@): Warning: fscking index file
/var/dovecot/imap///mdbox/storage/dovecot.map.index
doveadm(@): Warning: mdbox
/var/dovecot/imap///mdbox/storage: rebuilding indexes
doveadm(@): Warning: fscking index file
/var/dovecot/imap///mdbox/storage/dovecot.map.index

root@fra-nfs-mail:/var/dovecot/imap/# doveadm mailbox list -u
@
user
INBOX

What else can I do to analyse the problem?

Ralf

-- 
Ralf Becker
EGroupware GmbH [www.egroupware.org]
Handelsregister HRB Kaiserslautern 3587
Geschäftsführer Birgit und Ralf Becker
Leibnizstr. 17, 67663 Kaiserslautern, Germany
Telefon +49 631 31657-0




signature.asc
Description: OpenPGP digital signature

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Aki Tuomi]

On 18.09.2017 12:10, Ralf Becker wrote:
> Am 14.09.17 um 01:07 schrieb Timo Sirainen:
>> On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
>>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>>
>>> Since a couple of days some mailboxes have the problem, that sieve rules
>>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>>
>>> sieve: info: started log at Sep 07 13:57:17.
>>> error:
>>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
>>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>>> INBOX/Munser.
>>>
>>> When I do a doveadm mailbox list -s -u @ I get all folders
>>> incl. the one mentioned above, while doveadm mailbox list without -s
>>> shows just
>>> user
>>> INBOX
>> Subscriptions are stored independently from the actual folders. So it looks 
>> like the subscription file exists and is correct, but somehow you've lost 
>> all the folders. Do you see the folders in the filesystem under 
>> user/mailboxes/ directory? 
> Yes, the folders exist under
> /var/dovecot/imap///mdbox/mailboxes/.
> Just doveadm mailbox list -u @ (without -s) does only show
> INBOX and user.
> (I can send you the list of folders via private mail, but I can not post
> them on the list.)
>
> Anything I can do to get Dovecot to eg. rescan the folders from the
> filesystem or any other way to fix that problem?
> I have it with a couple of mailboxes, so I believe it's some kind of
> systematic problem, nothing the users did.
>
> Ralf
>
>> My guess is that it only has INBOX, which means the folders were deleted by 
>> something (Dovecot corruption can't lose entire folders - something must 
>> explicitly delete them).

You can always try doveadm force-resync -u victim "*"

You should run it twice, I guess.

Aki

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Am 14.09.17 um 01:07 schrieb Timo Sirainen:
> On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
>> Dovecot 2.2.31 with mailboxes in mdbox format.
>>
>> Since a couple of days some mailboxes have the problem, that sieve rules
>> moving mails to folders stop working and .sieve.log in mailbox shows:
>>
>> sieve: info: started log at Sep 07 13:57:17.
>> error:
>> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
>> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
>> INBOX/Munser.
>>
>> When I do a doveadm mailbox list -s -u @ I get all folders
>> incl. the one mentioned above, while doveadm mailbox list without -s
>> shows just
>> user
>> INBOX
> Subscriptions are stored independently from the actual folders. So it looks 
> like the subscription file exists and is correct, but somehow you've lost all 
> the folders. Do you see the folders in the filesystem under user/mailboxes/ 
> directory? 

Yes, the folders exist under
/var/dovecot/imap///mdbox/mailboxes/.
Just doveadm mailbox list -u @ (without -s) does only show
INBOX and user.
(I can send you the list of folders via private mail, but I can not post
them on the list.)

Anything I can do to get Dovecot to eg. rescan the folders from the
filesystem or any other way to fix that problem?
I have it with a couple of mailboxes, so I believe it's some kind of
systematic problem, nothing the users did.

Ralf

> My guess is that it only has INBOX, which means the folders were deleted by 
> something (Dovecot corruption can't lose entire folders - something must 
> explicitly delete them).

-- 
Ralf Becker
EGroupware GmbH [www.egroupware.org]
Handelsregister HRB Kaiserslautern 3587
Geschäftsführer Birgit und Ralf Becker
Leibnizstr. 17, 67663 Kaiserslautern, Germany
Telefon +49 631 31657-0




signature.asc
Description: OpenPGP digital signature

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Timo Sirainen]

On 7 Sep 2017, at 17.42, Ralf Becker  wrote:
> 
> Dovecot 2.2.31 with mailboxes in mdbox format.
> 
> Since a couple of days some mailboxes have the problem, that sieve rules
> moving mails to folders stop working and .sieve.log in mailbox shows:
> 
> sieve: info: started log at Sep 07 13:57:17.
> error:
> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
> INBOX/Munser.
> 
> When I do a doveadm mailbox list -s -u @ I get all folders
> incl. the one mentioned above, while doveadm mailbox list without -s
> shows just
> user
> INBOX

Subscriptions are stored independently from the actual folders. So it looks 
like the subscription file exists and is correct, but somehow you've lost all 
the folders. Do you see the folders in the filesystem under user/mailboxes/ 
directory? My guess is that it only has INBOX, which means the folders were 
deleted by something (Dovecot corruption can't lose entire folders - something 
must explicitly delete them).

Re: sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Noone an idea how it can be that subscribed folders are more then all
folders and how to repair that situation?

Ralf

Am 07.09.17 um 16:42 schrieb Ralf Becker:
> Dovecot 2.2.31 with mailboxes in mdbox format.
>
> Since a couple of days some mailboxes have the problem, that sieve rules
> moving mails to folders stop working and .sieve.log in mailbox shows:
>
> sieve: info: started log at Sep 07 13:57:17.
> error:
> msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
> failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
> INBOX/Munser.
>
> When I do a doveadm mailbox list -s -u @ I get all folders
> incl. the one mentioned above, while doveadm mailbox list without -s
> shows just
> user
> INBOX
>
> I already tried doveadm force-resync -u @ INBOX, but it
> did not change anything.
>
> I also moved the mailbox in filesystem to an other name and tried to
> restore it from there, which helped with most broken mailbox problems in
> the pre 2.2.31 aftermath, but that failed completly:
>
> /var/dovecot/imap/ # mv  .broken
>
> /var/dovecot/imap/ # doveadm force-resync -u @ INBOX
>
> /var/dovecot/imap/ # sudo -u dovecot doveadm -Dv import -u
> @ -s mdbox:$(pwd)/.broken/mdbox
> INBOX all
> Debug: Loading modules from directory: /usr/lib/dovecot
> Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so
> Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so
> Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so
> Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so
> Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so
> Debug: Loading modules from directory: /usr/lib/dovecot/doveadm
> Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so
> Debug: Skipping module doveadm_expire_plugin, because dlopen() failed:
> Error relocating
> /usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so:
> expire_set_lookup: symbol not found (this is usually intentional, so
> just ignore this message)
> Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so
> Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
> Debug: Skipping module doveadm_fts_plugin, because dlopen() failed:
> Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so:
> fts_backend_rescan: symbol not found (this is usually intentional, so
> just ignore this message)
> Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen()
> failed: Error relocating
> /usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so:
> mail_crypt_box_get_public_key: symbol not found (this is usually
> intentional, so just ignore this message)
> doveadm(@ 54303): Debug: Added userdb setting:
> plugin/master_user=@
> doveadm(@ 54303): Debug: Added userdb setting:
> plugin/userdb_acl_groups=admins@,hts büro@,hts@
> doveadm(@ 54303): Debug: Added userdb setting:
> plugin/userdb_quota_rule=*:bytes=1048576
> doveadm(@): Debug: Effective uid=90, gid=101,
> home=/var/dovecot/imap//
> doveadm(@): Debug: Quota root: name=User quota
> backend=dict
> args=:ns=INBOX/:file:/var/dovecot/imap///dovecot-quota
> doveadm(@): Debug: Quota rule: root=User quota mailbox=*
> bytes=107374182400 messages=0
> doveadm(@): Debug: Quota grace: root=User quota
> bytes=10737418240 (10%)
> doveadm(@): Debug: dict quota: user=@,
> uri=file:/var/dovecot/imap///dovecot-quota, noenforcing=0
> doveadm(@): Debug: Namespace inboxes: type=private,
> prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no
> location=mdbox:~/mdbox
> doveadm(@): Debug: fs:
> root=/var/dovecot/imap///mdbox, index=, indexpvt=,
> control=, inbox=, alt=
> doveadm(@): Debug: acl: initializing backend with data: vfile
> doveadm(@): Debug: acl: acl username = @
> doveadm(@): Debug: acl: owner = 0
> doveadm(@): Debug: acl vfile: Global ACLs disabled
> doveadm(@): Debug: Namespace users: type=shared,
> prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no
> location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u
> doveadm(@): Debug: shared: root=/run/dovecot, index=,
> indexpvt=, control=, inbox=, alt=
> doveadm(@): Debug: acl: initializing backend with data: vfile
> doveadm(@): Debug: acl: acl username = @
> doveadm(@): Debug: acl: owner = 0
> doveadm(@): Debug: acl vfile: Global ACLs disabled
> doveadm(@): Debug: Namespace subs: type=private, prefix=,
> sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes
> location=mdbox:~/mdbox
> doveadm(@): Debug: fs:
> root=/var/dovecot/imap///mdbox, index=, indexpvt=,
> control=, inbox=, alt=
> doveadm(@): Debug: acl: initializing backend with data: vfile
> doveadm(@): Debug: acl: acl username = @
> doveadm(@): Debug: acl: owner = 0
> doveadm(@): Debug: acl vfile: Global ACLs disabled
> doveadm(@): Debug: quota: quota_over_flag check:
> quota_over_script unset - skipping
> doveadm(@): user-lookup(@)Debug: Added
> userdb setting: plugin/master_user=@
> doveadm(@): user-lookup(@)Debug: Added
> userdb setting: pl

sieve stopped working and doveadm mailbox list without -s shows less folders then with

[Ralf Becker]

Dovecot 2.2.31 with mailboxes in mdbox format.

Since a couple of days some mailboxes have the problem, that sieve rules
moving mails to folders stop working and .sieve.log in mailbox shows:

sieve: info: started log at Sep 07 13:57:17.
error:
msgid=<20170907155704.egroupware.s4ythvjrr12wsijlpkbk...@somedomain.egroupware.de>:
failed to store into mailbox 'INBOX/Munser': Mailbox doesn't exist:
INBOX/Munser.

When I do a doveadm mailbox list -s -u @ I get all folders
incl. the one mentioned above, while doveadm mailbox list without -s
shows just
user
INBOX

I already tried doveadm force-resync -u @ INBOX, but it
did not change anything.

I also moved the mailbox in filesystem to an other name and tried to
restore it from there, which helped with most broken mailbox problems in
the pre 2.2.31 aftermath, but that failed completly:

/var/dovecot/imap/ # mv  .broken

/var/dovecot/imap/ # doveadm force-resync -u @ INBOX

/var/dovecot/imap/ # sudo -u dovecot doveadm -Dv import -u
@ -s mdbox:$(pwd)/.broken/mdbox
INBOX all
Debug: Loading modules from directory: /usr/lib/dovecot
Debug: Module loaded: /usr/lib/dovecot/lib01_acl_plugin.so
Debug: Module loaded: /usr/lib/dovecot/lib10_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/lib15_notify_plugin.so
Debug: Module loaded: /usr/lib/dovecot/lib20_mail_log_plugin.so
Debug: Module loaded: /usr/lib/dovecot/lib20_replication_plugin.so
Debug: Loading modules from directory: /usr/lib/dovecot/doveadm
Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so
Debug: Skipping module doveadm_expire_plugin, because dlopen() failed:
Error relocating
/usr/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so:
expire_set_lookup: symbol not found (this is usually intentional, so
just ignore this message)
Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_plugin, because dlopen() failed:
Error relocating /usr/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so:
fts_backend_rescan: symbol not found (this is usually intentional, so
just ignore this message)
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen()
failed: Error relocating
/usr/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so:
mail_crypt_box_get_public_key: symbol not found (this is usually
intentional, so just ignore this message)
doveadm(@ 54303): Debug: Added userdb setting:
plugin/master_user=@
doveadm(@ 54303): Debug: Added userdb setting:
plugin/userdb_acl_groups=admins@,hts büro@,hts@
doveadm(@ 54303): Debug: Added userdb setting:
plugin/userdb_quota_rule=*:bytes=1048576
doveadm(@): Debug: Effective uid=90, gid=101,
home=/var/dovecot/imap//
doveadm(@): Debug: Quota root: name=User quota
backend=dict
args=:ns=INBOX/:file:/var/dovecot/imap///dovecot-quota
doveadm(@): Debug: Quota rule: root=User quota mailbox=*
bytes=107374182400 messages=0
doveadm(@): Debug: Quota grace: root=User quota
bytes=10737418240 (10%)
doveadm(@): Debug: dict quota: user=@,
uri=file:/var/dovecot/imap///dovecot-quota, noenforcing=0
doveadm(@): Debug: Namespace inboxes: type=private,
prefix=INBOX/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=no
location=mdbox:~/mdbox
doveadm(@): Debug: fs:
root=/var/dovecot/imap///mdbox, index=, indexpvt=,
control=, inbox=, alt=
doveadm(@): Debug: acl: initializing backend with data: vfile
doveadm(@): Debug: acl: acl username = @
doveadm(@): Debug: acl: owner = 0
doveadm(@): Debug: acl vfile: Global ACLs disabled
doveadm(@): Debug: Namespace users: type=shared,
prefix=user/%n/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no
location=mdbox:%h/mdbox:INDEXPVT=~/shared/%u
doveadm(@): Debug: shared: root=/run/dovecot, index=,
indexpvt=, control=, inbox=, alt=
doveadm(@): Debug: acl: initializing backend with data: vfile
doveadm(@): Debug: acl: acl username = @
doveadm(@): Debug: acl: owner = 0
doveadm(@): Debug: acl vfile: Global ACLs disabled
doveadm(@): Debug: Namespace subs: type=private, prefix=,
sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes
location=mdbox:~/mdbox
doveadm(@): Debug: fs:
root=/var/dovecot/imap///mdbox, index=, indexpvt=,
control=, inbox=, alt=
doveadm(@): Debug: acl: initializing backend with data: vfile
doveadm(@): Debug: acl: acl username = @
doveadm(@): Debug: acl: owner = 0
doveadm(@): Debug: acl vfile: Global ACLs disabled
doveadm(@): Debug: quota: quota_over_flag check:
quota_over_script unset - skipping
doveadm(@): user-lookup(@)Debug: Added
userdb setting: plugin/master_user=@
doveadm(@): user-lookup(@)Debug: Added
userdb setting: plugin/userdb_acl_groups=admins@,hts
büro@,hts@
doveadm(@): user-lookup(@)Debug: Added
userdb setting: plugin/userdb_quota_rule=*:bytes=1048576
doveadm(@): Debug: Effective uid=90, gid=101,
home=/var/dovecot/imap//
doveadm(@): Debug: Quota root: name=User quota
backend=dict
args=:ns=INBOX/:file:/var/dovecot/imap///dovecot-quota
doveadm(@): Debug: Quota rule: root