[Dovecot] courier-dovecot-migrate.pl destroyed my indices... still recovering...

2007-08-09 Thread Ralf Hildebrandt
I tried to disable courier-pop3 today in favour of dovecot pop3.
Prior to that I ran:

find /home -maxdepth 1 -type d  | xargs --replace 
/usr/local/scripts/courier-dovecot-migrate.pl --overwrite --recursive --convert 
{}

( /home is hashed two levels deep: /home/a/a/aanton/Maildir/ )

After that, I got lots of errors like:

Aug  9 13:02:40 postamt dovecot: IMAP(azenclu): Maildir 
/home/a/z/azenclu/Maildir sync: UIDVALIDITY changed (1167827929 - 1058881980)
Aug  9 13:03:46 postamt dovecot: POP3(bbuhse): Couldn't init INBOX: BUG: 
Unknown internal error
Aug  9 13:03:46 postamt dovecot: POP3(bbuhse): Mailbox init failed top=0/0, 
retr=0/0, del=0/0, size=0
Aug  9 13:04:14 postamt dovecot: IMAP(bkusma): Maildir /home/b/k/bkusma/Maildir 
sync: UIDVALIDITY changed (1179153053 - 1174292827)
Aug  9 13:04:19 postamt dovecot: IMAP(am02): Corrupted index cache file 
/home/a/m/am02/Maildir/dovecot.index.cache: indexid changed
Aug  9 13:04:28 postamt deliver(avolz): Corrupted index cache file 
/home/a/v/avolz/Maildir/dovecot.index.cache: indexid changed
Aug  9 13:04:51 postamt dovecot: IMAP(ck05): Maildir /home/c/k/ck05/Maildir 
sync: UIDVALIDITY changed (1167893115 - 1094733247)
Aug  9 13:05:11 postamt deliver(agundlfi): Corrupted index cache file 
/home/a/g/agundlfi/Maildir/dovecot.index.cache: indexid changed
Aug  9 13:05:50 postamt dovecot: IMAP(asorigue): Corrupted index cache file 
/home/a/s/asorigue/Maildir/dovecot.index.cache: indexid changed
Aug  9 13:06:04 postamt dovecot: IMAP(azenclu): Corrupted index cache file 
/home/a/z/azenclu/Maildir/dovecot.index.cache: indexid changed
Aug  9 13:06:08 postamt dovecot: IMAP(coneck): Maildir /home/c/o/coneck/Maildir 
sync: UIDVALIDITY changed (1164189070 - 1058892719)

Dovecot would recover from that (deliver would deliver the mail on the
next queue run) -- but why is that?
-- 
Ralf Hildebrandt ([EMAIL PROTECTED]) [EMAIL PROTECTED]
Postfix - Einrichtung, Betrieb und Wartung   Tel. +49 (0)30-450 570-155
http://www.arschkrebs.de
This message represents the official view of the voices in my head


Re: [Dovecot] courier-dovecot-migrate.pl destroyed my indices... still recovering...

2007-08-09 Thread Timo Sirainen
On Thu, 2007-08-09 at 15:19 +0200, Ralf Hildebrandt wrote:
 I tried to disable courier-pop3 today in favour of dovecot pop3.
 Prior to that I ran:
 
 find /home -maxdepth 1 -type d  | xargs --replace 
 /usr/local/scripts/courier-dovecot-migrate.pl --overwrite --recursive 
 --convert {}
 
 ( /home is hashed two levels deep: /home/a/a/aanton/Maildir/ )
 
 After that, I got lots of errors like:
 
 Aug  9 13:02:40 postamt dovecot: IMAP(azenclu): Maildir 
 /home/a/z/azenclu/Maildir sync: UIDVALIDITY changed (1167827929 - 1058881980)
..

If you had run Dovecot as IMAP server, then it wasn't such a great idea
to run the migration, because it recreates dovecot-uidlist files trying
to make them compatible with Courier's POP3 uidlist file.

Creating dovecot-uidlist then caused the UIDVALIDITY to change, which
causes IMAP clients to redownload all messages, and as you can see
Dovecot doesn't handle UIDVALIDITY changes all that nicely. v1.1 does a
better job with it though.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] courier-dovecot-migrate.pl destroyed my indices... still recovering...

2007-08-09 Thread Ralf Hildebrandt
* Timo Sirainen [EMAIL PROTECTED]:

 If you had run Dovecot as IMAP server, then it wasn't such a great idea
 to run the migration, because it recreates dovecot-uidlist files trying
 to make them compatible with Courier's POP3 uidlist file.

Oops.
 
 Creating dovecot-uidlist then caused the UIDVALIDITY to change, which
 causes IMAP clients to redownload all messages, and as you can see
 Dovecot doesn't handle UIDVALIDITY changes all that nicely. v1.1 does a
 better job with it though.

So, is there a way to migrate WITHOUT all my pop3 users re-downloading
everything?

-- 
Ralf Hildebrandt ([EMAIL PROTECTED]) [EMAIL PROTECTED]
Postfix - Einrichtung, Betrieb und Wartung   Tel. +49 (0)30-450 570-155
http://www.arschkrebs.de
Now that we know Microsoft's plan for world domination isn't superman
suppost to come out and kick some ass? 


Re: [Dovecot] courier-dovecot-migrate.pl destroyed my indices... still recovering...

2007-08-09 Thread Timo Sirainen
On Thu, 2007-08-09 at 15:35 +0200, Ralf Hildebrandt wrote:
  Creating dovecot-uidlist then caused the UIDVALIDITY to change, which
  causes IMAP clients to redownload all messages, and as you can see
  Dovecot doesn't handle UIDVALIDITY changes all that nicely. v1.1 does a
  better job with it though.
 
 So, is there a way to migrate WITHOUT all my pop3 users re-downloading
 everything?

Well, what you just did probably did that. It just caused IMAP users to
download the mails again, but that's more transparent to users because
it doesn't create duplicates.

I did think about adding the possibility of storing POP3 UIDLs to a
separate field in dovecot-uidlist for v1.1, but I haven't managed to
write that code yet.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] courier-dovecot-migrate.pl destroyed my indices... still recovering...

2007-08-09 Thread Ralf Hildebrandt
* Timo Sirainen [EMAIL PROTECTED]:

 Well, what you just did probably did that. It just caused IMAP users to
 download the mails again, but that's more transparent to users because
 it doesn't create duplicates.

OK
 
 I did think about adding the possibility of storing POP3 UIDLs to a
 separate field in dovecot-uidlist for v1.1, but I haven't managed to
 write that code yet.

:)

-- 
Ralf Hildebrandt ([EMAIL PROTECTED]) [EMAIL PROTECTED]
Postfix - Einrichtung, Betrieb und Wartung   Tel. +49 (0)30-450 570-155
http://www.arschkrebs.de
All the features in the world only do more to make me believe that
Sendmail is hopelessly baroque, like some huge construction with
chrome and tailfins sticking out in every direction -- like some
monstrocity sculpted by people not the least bit interested in
correctness.