Re: [Dovecot] 2.0.17: Index lost -> SAVEDON lost as well?

2012-01-28 Thread Timo Sirainen
On 9.1.2012, at 16.57, Timo Sirainen wrote:

>> After that, the SAVEDON date for all mails was reset to today:
> 
> Yeah. The "save date" is stored only in index. And index rebuild drops all 
> those fields. I guess this could/should be fixed in index rebuild.

Fixed: http://hg.dovecot.org/dovecot-2.0/rev/c30ea8aec902



Re: [Dovecot] 2.0.17: Index lost -> SAVEDON lost as well?

2012-01-10 Thread Ralf Hildebrandt
* Ralf Hildebrandt :
> * Timo Sirainen :
> > On 9.1.2012, at 9.40, Ralf Hildebrandt wrote:
> > 
> > > Today I encoundered these errors:
> > > 
> > > Jan  9 08:30:06 mail dovecot: lmtp(31174, backup@backup.invalid): Error: 
> > > Log synchronization error at seq=858,offset=44672 for
> > > /home/mailboxname/mdbox/storage/dovecot.map.index: Append with UID 
> > > 282388, but next_uid = 282389
> > 
> > Any idea why this happened?
> 
> I was running those commands:
> 
> # new style (dovecot)
> vorgestern=`date -d "-2 day" +"%Y-%m-%d"`
> doveadm expunge -u backup@backup.invalid mailbox INBOX SAVEDBEFORE $vorgestern
> doveadm purge   -u backup@backup.invalid

So today:

# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 2012-01-08 | wc 
-l
0
# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 2012-01-09 | wc 
-l
0
# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 2012-01-10 | wc 
-l
45724
# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 2012-01-11 | wc 
-l
0

Then:

doveadm expunge -u backup@backup.invalid mailbox INBOX SAVEDBEFORE 2012-01-08 
&& \
doveadm purge   -u backup@backup.invalid

resulted in:

doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/3f/4d/3f4d8043d87e248a2e97f87be1f604301573be49-72e4a90683d70a4fc47e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/3f/4d/3f4d8043d87e248a2e97f87be1f604301573be49-afef6f1bf1d40a4f677363bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/32/7f/327f6d37aceb42da69ee7f3baea3267d631f-f4f5b90703d10a4f8d6863bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/21/f4/21f48fad649f1b7249f9aab98b7c079b6ac19b5b-9a4fcb1e83d70a4fcd7e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
rmdir(/path/to/attachments/21/f4) failed: No such file or
directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/9a/fd/9afd968e9524449a151f64bd2fb1610dcf81da95-fe508a2195d30a4fb86f63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/9a/fd/9afd968e9524449a151f64bd2fb1610dcf81da95-a04fcb1e83d70a4fcd7e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/9a/fd/9afd968e9524449a151f64bd2fb1610dcf81da95-beba543b03cf0a4fe06263bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/9a/fd/9afd968e9524449a151f64bd2fb1610dcf81da95-52c15a0f03d10a4f9b6863bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/9a/fd/9afd968e9524449a151f64bd2fb1610dcf81da95-c4ba543b03cf0a4fe06263bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/00/04/00048d4ec98f654ad681a97b07d2e806a09c1641-22a9531683d70a4fc97e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
rmdir(/path/to/attachments/00/04) failed: No such file or
directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/c4/ae/c4aebf70927db7997eb8755c61a490581aff94a6-27bb543b03cf0a4fe06263bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/bb/91/bb913960266ce20c2fea64ceaed1fb29eab868ce-4ba9531683d70a4fc97e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/34/0b/340b8ae1e2c6ccbfba161475440b172caaff92b3-1d518a2195d30a4fb86f63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/4c/1e/4c1e264df5d168ed4e676267a4dcf38cd82e9797-1e518a2195d30a4fb86f63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
rmdir(/path/to/attachments/4c/1e) failed: No such file or
directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/ca/a7/caa75263442d125e08493b237c332351604b651a-1f518a2195d30a4fb86f63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
rmdir(/path/to/attachments/ca/a7) failed: No such file or
directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/c7/75/c775a5736e1800e3c654291b42f942ebebc6e343-c2327907cad70a4fd47e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
rmdir(/path/to/attachments/c7/75) failed: No such file or
directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/1b/da/1bdaede5f6b4175e577fa4148a1d2c75b6291047-c3327907cad70a4fd47e63bdf393)
failed: No such file or directory
doveadm(backup@backup.invalid): Error:
rmdir(/path/to/attachments/1b/da) failed: No such file or
directory
doveadm(backup@backup.invalid): Error:
unlink(/path/to/attachments/e4/83/e4838792800058921c4dce

Re: [Dovecot] 2.0.17: Index lost -> SAVEDON lost as well?

2012-01-09 Thread Ralf Hildebrandt
* Timo Sirainen :
> On 9.1.2012, at 9.40, Ralf Hildebrandt wrote:
> 
> > Today I encoundered these errors:
> > 
> > Jan  9 08:30:06 mail dovecot: lmtp(31174, backup@backup.invalid): Error: 
> > Log synchronization error at seq=858,offset=44672 for
> > /home/mailboxname/mdbox/storage/dovecot.map.index: Append with UID 282388, 
> > but next_uid = 282389
> 
> Any idea why this happened?

I was running those commands:

# new style (dovecot)
vorgestern=`date -d "-2 day" +"%Y-%m-%d"`
doveadm expunge -u backup@backup.invalid mailbox INBOX SAVEDBEFORE $vorgestern
doveadm purge   -u backup@backup.invalid

> > After that, the SAVEDON date for all mails was reset to today:
> 
> Yeah. The "save date" is stored only in index. And index rebuild drops
> all those fields. I guess this could/should be fixed in index rebuild.

It's ok. Right now it only affects my expiry method.

-- 
Ralf Hildebrandt
  Geschäftsbereich IT | Abteilung Netzwerk
  Charité - Universitätsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12203 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  ralf.hildebra...@charite.de | http://www.charite.de



Re: [Dovecot] 2.0.17: Index lost -> SAVEDON lost as well?

2012-01-09 Thread Timo Sirainen
On 9.1.2012, at 9.40, Ralf Hildebrandt wrote:

> Today I encoundered these errors:
> 
> Jan  9 08:30:06 mail dovecot: lmtp(31174, backup@backup.invalid): Error: Log 
> synchronization error at seq=858,offset=44672 for
> /home/mailboxname/mdbox/storage/dovecot.map.index: Append with UID 282388, 
> but next_uid = 282389

Any idea why this happened?

> After that, the SAVEDON date for all mails was reset to today:

Yeah. The "save date" is stored only in index. And index rebuild drops all 
those fields. I guess this could/should be fixed in index rebuild.

> Is there a way of restoring the SAVEDON info?

Not currently without extra code (and even then you could only restore it to 
e.g. its received date).



[Dovecot] 2.0.17: Index lost -> SAVEDON lost as well?

2012-01-08 Thread Ralf Hildebrandt
Today I encoundered these errors:

Jan  9 08:30:06 mail dovecot: lmtp(31174, backup@backup.invalid): Error: Log 
synchronization error at seq=858,offset=44672 for
/home/mailboxname/mdbox/storage/dovecot.map.index: Append with UID 282388, but 
next_uid = 282389
Jan  9 08:30:06 mail dovecot: lmtp(31819, backup@backup.invalid): Error: Log 
synchronization error at seq=858,offset=44672 for
/home/mailboxname/mdbox/storage/dovecot.map.index: Append with UID 282388, but 
next_uid = 282389
Jan  9 08:30:06 mail dovecot: lmtp(32148, backup@backup.invalid): Error: Log 
synchronization error at seq=858,offset=44672 for
/home/mailboxname/mdbox/storage/dovecot.map.index: Append with UID 282388, but 
next_uid = 282389

After that, the SAVEDON date for all mails was reset to today:

mail:~# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 
2012-01-09 | wc -l
75650
mail:~# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 
2012-01-08 | wc -l
0
mail:~# doveadm search -u backup@backup.invalid mailbox INBOX SAVEDON 
2012-01-07 | wc -l
0

Before, I was running this:
vorgestern=`date -d "-2 day" +"%Y-%m-%d"`
doveadm expunge -u backup@backup.invalid mailbox INBOX SAVEDBEFORE $vorgestern
doveadm purge   -u backup@backup.invalid

Is there a way of restoring the SAVEDON info?

-- 
Ralf Hildebrandt
  Geschäftsbereich IT | Abteilung Netzwerk
  Charité - Universitätsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12203 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  ralf.hildebra...@charite.de | http://www.charite.de