Re: Using dsync for a single mailbox?

2020-01-21 Thread Wim Lewis

On Tue, 21 Jan 2020, Sami Ketola wrote:
how does dsync fail? How have you tried? Something like this on the new 
server:


doveadm -o imapc_server=remote_ip -o imapc_port=remote_port -o imapc_user= 
-o imapc_password= backup -u  -R imapc:


The best I can do is get it to complete without any errors but without 
transferrig any mail. I've added the imapc config to local.conf,

and I run it like this:

  doveadm -Dv sync -1 -R -u local_user -m mailbox_name imapc:

(or variations on that, e.g. with -n namespace). It successfully logs in 
to the remote imapd, but doesn't decide to transfer anything. If I leave 
off the "-m mailbox_name" it does start traversing the remote maibox 
hierarchy, but I really don't want it to transfer everything --- just some 
specific mailboxes.


One thing that's unclear to me is exactly what strings I should pass to 
the -n and -m flags. Do I specify a namespace by its local prefix, or its 
remote prefix, or its name in the config file, or ... ? And mailbox names?

How does dsync map remote to local names?



Re: Cached message size smaller than expected

2020-01-21 Thread Asai

Thanks, Sami,

The version is 2.3.7.2

On 1/21/2020 2:18 PM, Sami Ketola wrote:

Hi,

what dovecot version is this? This looks a lot like bug that was fixed in 
2.2.25.5

Sami


On 21 Jan 2020, at 17.59, Asai  wrote:

Greetings,

Can anyone help me to solve this problem?

When doveadm sync is running nightly, we have a certain user's mailbox that 
will not properly sync and the logs give me this error (user private info 
redacted):

Error: Mailbox USER/MAILBOX: UID=79: 
read(/vmail/domain.org/user/.MAILBOX/cur/1575914253.M611834P7822.triata4,S=41893,W=42718:2,Sc)
 failed: Cached message size smaller than expected (41893 < 41897, 
box=USER/MAILBOX, UID=79) (read reason=mail stream)

I have deleted the dovecot indexes in the synced backup of this mailbox, as 
well as in the actual user's mailbox itself and I'm still getting this error.

What am I missing?

Thank you for your help here.

-Asai


--
Asai
520.260.6887



Re: Cached message size smaller than expected

2020-01-21 Thread Sami Ketola
Hi,

what dovecot version is this? This looks a lot like bug that was fixed in 
2.2.25.5

Sami

> On 21 Jan 2020, at 17.59, Asai  wrote:
> 
> Greetings,
> 
> Can anyone help me to solve this problem?
> 
> When doveadm sync is running nightly, we have a certain user's mailbox that 
> will not properly sync and the logs give me this error (user private info 
> redacted):
> 
> Error: Mailbox USER/MAILBOX: UID=79: 
> read(/vmail/domain.org/user/.MAILBOX/cur/1575914253.M611834P7822.triata4,S=41893,W=42718:2,Sc)
>  failed: Cached message size smaller than expected (41893 < 41897, 
> box=USER/MAILBOX, UID=79) (read reason=mail stream)
> 
> I have deleted the dovecot indexes in the synced backup of this mailbox, as 
> well as in the actual user's mailbox itself and I'm still getting this error.
> 
> What am I missing?
> 
> Thank you for your help here.
> 
> -Asai
> 



Cached message size smaller than expected

2020-01-21 Thread Asai

Greetings,

Can anyone help me to solve this problem?

When doveadm sync is running nightly, we have a certain user's mailbox 
that will not properly sync and the logs give me this error (user 
private info redacted):


Error: Mailbox USER/MAILBOX: UID=79: 
read(/vmail/domain.org/user/.MAILBOX/cur/1575914253.M611834P7822.triata4,S=41893,W=42718:2,Sc)
 failed: Cached message size smaller than expected (41893 < 41897, 
box=USER/MAILBOX, UID=79) (read reason=mail stream)

I have deleted the dovecot indexes in the synced backup of this mailbox, 
as well as in the actual user's mailbox itself and I'm still getting 
this error.


What am I missing?

Thank you for your help here.

-Asai



Re: Dovecot and archived compressed folder

2020-01-21 Thread filbar
Hello,
yes I know about this plugin. But I don't know how to implement to have
normal e-mails without compression and mail archive compressed by this
zlib plugin.

Thank's
Filip Bartmann

On Mon, 20 Jan 2020 22:50:20 -0800
Wim Lewis  wrote:

> I haven't used it, but it sounds like the zlib plugin would do
> what you want:
> 
> https://doc.dovecot.org/configuration_manual/zlib_plugin/


imap panic: file array.c: line 10 (array_idx_modifiable_i)

2020-01-21 Thread mabi
Hello,

I just migrated a few dovecot IMAP mailbox (Maildir format) from a Dovecot 
2.1.7 (Debian 7) mailbox server to a Dovecot 2.3.4 (Debian 10) mailbox server 
and one particular mailbox does not work properly and generates the following 
error log entries:

Jan 21 09:39:21 Panic: 
imap(EMAIL_ADDRESS)<7741>: file array.c: line 
10 (array_idx_modifiable_i): assertion failed: (idx * array->element_size < 
array->buffer->used)

Jan 21 09:39:21 Error: 
imap(EMAIL_ADDRESS)<7741>: Raw backtrace: 
/usr/lib/dovecot/libdovecot.so.0(+0xdb15b) [0x7fa18def215b] -> 
/usr/lib/dovecot/libdovecot.so.0(+0xdb1f1) [0x7fa18def21f1] -> 
/usr/lib/dovecot/libdovecot.so.0(+0x4a001) [0x7fa18de61001] -> 
/usr/lib/dovecot/libdovecot.so.0(+0x493bf) [0x7fa18de603bf] -> 
/usr/lib/dovecot/libdovecot-storage.so.0(+0xde920) [0x7fa18e084920] -> 
/usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_commit+0x22f) 
[0x7fa18e096a3f] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x85b4b) 
[0x7fa18e02bb4b] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x8862a) 
[0x7fa18e02e62a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x88937) 
[0x7fa18e02e937] -> 
/usr/lib/dovecot/libdovecot-storage.so.0(maildir_storage_sync_init+0xa3) 
[0x7fa18e02ece3] -> 
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x57) 
[0x7fa18e002497] -> dovecot/imap [EMAIL_ADDRESS ::1 UID 
STORE](imap_sync_init+0x91) [0x563d342e16e1] -> dovecot/imap [EMAIL_ADDRESS ::1 
UID STORE](cmd_sync_delayed+0x236) [0x563d342e25f6] -> dovecot/imap 
[EMAIL_ADDRESS ::1 UID STORE](client_handle_input+0x268) [0x563d342d58f8] -> 
dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](client_input+0x7e) [0x563d342d5d6e] 
-> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7fa18df0860f] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x136) 
[0x7fa18df09c06] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) 
[0x7fa18df086ac] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) 
[0x7fa18df08810] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) 
[0x7fa18de88fd3] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](main+0x325) 
[0x563d342c7bf5] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) 
[0x7fa18dc7309b] -> dovecot/imap [EMAIL_ADDRESS ::1 UID STORE](_start+0x2a) 
[0x563d342c7d8a]
Jan 21 09:39:21 Fatal: 
imap(EMAIL_ADDRESS)<7741>: master: 
service(imap): child 7741 killed with signal 6 (core dumps disabled - 
https://dovecot.org/bugreport.html#coredumps)

Does anyone have any idea what could be going wrong here?

Maybe I need to run some kind of conversion or re-generate some indexes?

Best regards,
Mabi


Re: Using dsync for a single mailbox?

2020-01-21 Thread Sami Ketola



> On 21 Jan 2020, at 2.02, Wim Lewis  wrote:
> 
> Is it possble to use `doveadm sync` to migrate a single mailbox? I'm 
> migrating accounts from another IMAP server,and most of the mailboxes 
> are in mbox or maildir format, but a few are in MBX. As far as I can tell
> the only recommended way to "convert" an MBX mailbox is to sync it via
> imap. But dsync fails in inscrutable ways, and the documentation is kind
> of scant on how to control what it does.
> 
> Even just an example command line showing how to copy remote mailbox FOO 
> into dovecot mailbox BAR would be extremely helpful.
> 

Hi,

how does dsync fail? How have you tried? Something like this on the new server:

doveadm -o imapc_server=remote_ip -o imapc_port=remote_port -o 
imapc_user= -o imapc_password= backup -u 
 -R imapc:

Sami