Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Adam Tauno Williams
On Wed, 2012-02-29 at 11:36 +0100, Stefan G. Weichinger wrote:
> Hello, cyrus-imap-users (and -devs?),
> I subscribed to this list today because I am searching for some
> information around upgrading/migrating my cyrus-imap-server
> Unfortunately I waited very long, hopefully not too lo ...
> The old server runs Suse Linux 10.1 with these versions:
> # rpm -qa | grep cyrus
> cyrus-sasl-2.1.21-3
> cyrus-sasl-devel-2.1.21-3
> cyrus-imapd-2.2.12-13
> I have a few hundred accounts within web-cyradm, which means their
> passwords are stored encrypted (so the imapsync-approach is problematic).

Why?  Create a 'master account'.  Just add a pam_allow sufficient prior
to the pam_passdb/pam_unix module and you can authenticate as anyone
with any password;  or create a master password using pam_userlist.  At
the same time the user's can authenticate with their own passwords.
This lets you do simple authentication [saslauthd] for the duration of
the migration.  If you want create a separate imap service that only
listens on 127.0.0.1 to use this 'broken' authentication setup.

> My goal is to migrate things over to a newer server running gentoo
> linux, the maintained version of cyrus-imapd there is 2.4.12 (the older
> 2.2.13 from a separate gentoo-overlay didn't compile for me).
> Moving the mysql-DB shouldn't be much of a problem, the web-cyradm tool
> runs on gentoo already
> So my question is: how to move things in the most stress-free way
> Could I simply copy over /var/spool/imap etc, and start the newer version?

Possibly, I'd rsync it, give it a try and see what happens.  I've moved
from 2.3 -> 2.4 but haven't uses 2.2 in ages.

> Do I have to somehow convert things? If yes, is it problematic?

2.3 -> 2.4 was pretty simple; worst part was the database upgrades
[which took place automatically in-place]. They really grind the drives.

> I am thinking about just trying it for a test, but I would really feel
> much better with some competent feedback from the cyrus-imap-community.



signature.asc
Description: This is a digitally signed message part

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Bron Gondwana


On Wed, Feb 29, 2012, at 06:37 AM, Adam Tauno Williams wrote:

> > My goal is to migrate things over to a newer server running gentoo
> > linux, the maintained version of cyrus-imapd there is 2.4.12 (the older
> > 2.2.13 from a separate gentoo-overlay didn't compile for me).
> > Moving the mysql-DB shouldn't be much of a problem, the web-cyradm tool
> > runs on gentoo already
> > So my question is: how to move things in the most stress-free way
> > Could I simply copy over /var/spool/imap etc, and start the newer version?
> 
> Possibly, I'd rsync it, give it a try and see what happens.  I've moved
> from 2.3 -> 2.4 but haven't uses 2.2 in ages.

Make sure you get /var/imap or wherever the DB files are stored as well,
/var/spool/imap is just the emails - you want to keep the indexes!

> > Do I have to somehow convert things? If yes, is it problematic?
> 
> 2.3 -> 2.4 was pretty simple; worst part was the database upgrades
> [which took place automatically in-place]. They really grind the drives.

Your biggest risk is berkeley DB files.  If you are using berkeley,
either convert to skiplist first, or dump and restore.

Beware of mailbox sort order issues if you change that config.

> > I am thinking about just trying it for a test, but I would really feel
> > much better with some competent feedback from the cyrus-imap-community.

Trying is good :)  The upgrade itself should be clean, if slow - lots of
re-parsing of emails.  I looked into avoiding that, but it just made the
code really, really ugly as it tried to deal with different versions of the
index - so we decided to force the upgrade on first access.

Bron.
-- 
  Bron Gondwana
  br...@fastmail.fm


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


RE: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Manel Gimeno Zaragozá

Hello,

I'm doing almost same migration, from old cyrus (2.2.12) to new version 
(2.4.13) and I'm using "imapsync" utility in Centos6 to "copy" all data. After 
some reading and attempts I have a "fast" sync method to copy the data from old 
server to new one.

Regards.

Manel Gimeno Zaragoza
magiz...@hotmail.com


> Date: Wed, 29 Feb 2012 11:36:26 +0100
> From: li...@xunil.at
> To: info-cyrus@lists.andrew.cmu.edu
> Subject: Questions around moving from 2.2.12 to 2.4.12
> 
> 
> Hello, cyrus-imap-users (and -devs?),
> 
> I subscribed to this list today because I am searching for some
> information around upgrading/migrating my cyrus-imap-server.
> 
> Unfortunately I waited very long, hopefully not too long ...
> 
> The old server runs Suse Linux 10.1 with these versions:
> 
> # rpm -qa | grep cyrus
> cyrus-sasl-2.1.21-3
> cyrus-sasl-devel-2.1.21-3
> cyrus-imapd-2.2.12-13
> 
> I have a few hundred accounts within web-cyradm, which means their
> passwords are stored encrypted (so the imapsync-approach is problematic).
> 
> My goal is to migrate things over to a newer server running gentoo
> linux, the maintained version of cyrus-imapd there is 2.4.12 (the older
> 2.2.13 from a separate gentoo-overlay didn't compile for me).
> 
> Moving the mysql-DB shouldn't be much of a problem, the web-cyradm tool
> runs on gentoo already.
> 
> So my question is: how to move things in the most stress-free way?
> 
> Could I simply copy over /var/spool/imap etc, and start the newer version?
> 
> Do I have to somehow convert things? If yes, is it problematic?
> 
> I am thinking about just trying it for a test, but I would really feel
> much better with some competent feedback from the cyrus-imap-community.
> 
> Thanks a lot in advance, Stefan.
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
  
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 12:37, schrieb Adam Tauno Williams:
> On Wed, 2012-02-29 at 11:36 +0100, Stefan G. Weichinger wrote:
>> their passwords are stored encrypted (so
>> the imapsync-approach is problematic).
> 
> Why?  Create a 'master account'.  Just add a pam_allow sufficient
> prior to the pam_passdb/pam_unix module and you can authenticate as
> anyone with any password;  or create a master password using
> pam_userlist.  At the same time the user's can authenticate with
> their own passwords. This lets you do simple authentication
> [saslauthd] for the duration of the migration.  If you want create a
> separate imap service that only listens on 127.0.0.1 to use this
> 'broken' authentication setup.

I thought of some master account, but didn't think of how to get that. I
will consider this, thanks!

It sounds like it is even more elegant than copying
/var/[lib,spool]/imap as it avoids rebuilding and converting stuff, correct?

>> My goal is to migrate things over to a newer server running gentoo 
>> linux, the maintained version of cyrus-imapd there is 2.4.12 (the
>> older 2.2.13 from a separate gentoo-overlay didn't compile for
>> me). Moving the mysql-DB shouldn't be much of a problem, the
>> web-cyradm tool runs on gentoo already So my question is: how to
>> move things in the most stress-free way Could I simply copy over
>> /var/spool/imap etc, and start the newer version?
> 
> Possibly, I'd rsync it, give it a try and see what happens.  I've
> moved from 2.3 -> 2.4 but haven't uses 2.2 in ages.

Could do, yes.

>> Do I have to somehow convert things? If yes, is it problematic?
> 
> 2.3 -> 2.4 was pretty simple; worst part was the database upgrades 
> [which took place automatically in-place]. They really grind the
> drives.

Fortunately the overall size isn't too big here.

Thanks, Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 12:47, schrieb Bron Gondwana:

> Make sure you get /var/imap or wherever the DB files are stored as
> well, /var/spool/imap is just the emails - you want to keep the
> indexes!

Afai understand this would mean these 3 dirs:

configdirectory: /var/lib/imap
partition-default: /var/spool/imap
sievedir: /var/lib/sieve

?

> Your biggest risk is berkeley DB files.  If you are using berkeley, 
> either convert to skiplist first, or dump and restore.

sigh ... I don't even *know* if I use berkeley.

I suspect, yes, I see db-files in /var/lib/imap:

# ls /var/lib/imap
annotations.db
db
db.backup2
deliverdb
mailboxes.db
[...]

Is the conversion hard to do?
What do you recommend?

> Beware of mailbox sort order issues if you change that config.

You talk of the sort order in the mail-clients view?

>>> I am thinking about just trying it for a test, but I would really
>>> feel much better with some competent feedback from the
>>> cyrus-imap-community.
> 
> Trying is good :)  The upgrade itself should be clean, if slow - lots
> of re-parsing of emails.  I looked into avoiding that, but it just
> made the code really, really ugly as it tried to deal with different
> versions of the index - so we decided to force the upgrade on first
> access.

If things work out, I don't have a problem with some time spent.
I prefer slow over flaky ...

Thanks for helping, Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 13:17, schrieb Stefan G. Weichinger:
> Am 29.02.2012 12:47, schrieb Bron Gondwana:

>> Your biggest risk is berkeley DB files.  If you are using berkeley, 
>> either convert to skiplist first, or dump and restore.
> 
> sigh ... I don't even *know* if I use berkeley.

addon:

I assume to use skiplist from doing this:

# grep berk /etc/cyr*
# grep skip /etc/cyr*
/etc/cyrus-imapd.conf:duplicate_db: skiplist
/etc/cyrus-imapd.conf:tlscache_db: skiplist
/etc/cyrus-popd.conf:duplicate_db: skiplist
/etc/cyrus-popd.conf:tlscache_db: skiplist
/etc/cyrus-timsieved.conf:duplicate_db: skiplist
/etc/cyrus-timsieved.conf:tlscache_db: skiplist

OK?

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Adam Tauno Williams
On Wed, 2012-02-29 at 13:17 +0100, Stefan G. Weichinger wrote:
> Am 29.02.2012 12:47, schrieb Bron Gondwana:
> > Make sure you get /var/imap or wherever the DB files are stored as
> > well, /var/spool/imap is just the emails - you want to keep the
> > indexes!
> Afai understand this would mean these 3 dirs:
> configdirectory: /var/lib/imap
> partition-default: /var/spool/imap
> sievedir: /var/lib/sieve

Yes.

> > Your biggest risk is berkeley DB files.  If you are using berkeley, 
> > either convert to skiplist first, or dump and restore.
> sigh ... I don't even *know* if I use berkeley.
> I suspect, yes, I see db-files in /var/lib/imap
> # ls /var/lib/imap
> annotations.db
> db
> db.backup2
> deliverdb
> mailboxes.db
> [...]

"file {filename}" should tell you what they are. With 2.2.x it is likely
they are Berkeley.   Berkeley is an administrator's nightmare.  If they
Berkelely convert them and make sure the server still works *BEFORE*
migrating if you are using a rsync method.

> Is the conversion hard to do?
> What do you recommend?

cvt_cyrusdb  [I think this was around in 2.2x?]


see page 97

You'll probably need to change the database type in imapd.conf as well.
> > Beware of mailbox sort order issues if you change that config.
> You talk of the sort order in the mail-clients view

No, it is sorting order in the database.  It is much easier to convert
everything before migrating.


signature.asc
Description: This is a digitally signed message part

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 13:38, schrieb Adam Tauno Williams:
> On Wed, 2012-02-29 at 13:17 +0100, Stefan G. Weichinger wrote:
>> Am 29.02.2012 12:47, schrieb Bron Gondwana:
>>> Make sure you get /var/imap or wherever the DB files are stored
>>> as well, /var/spool/imap is just the emails - you want to keep
>>> the indexes!
>> Afai understand this would mean these 3 dirs: configdirectory:
>> /var/lib/imap partition-default: /var/spool/imap sievedir:
>> /var/lib/sieve
> 
> Yes.

ok. I rsync /var/spool/imap/user now.

Does it matter:

new server has one subdir per character:

a
b
c
d
...

while old server has:

auser1
auser2
auser5
...

?


>>> Your biggest risk is berkeley DB files.  If you are using
>>> berkeley, either convert to skiplist first, or dump and restore.
>> sigh ... I don't even *know* if I use berkeley. I suspect, yes, I
>> see db-files in /var/lib/imap # ls /var/lib/imap annotations.db db 
>> db.backup2 deliverdb mailboxes.db [...]
> 
> "file {filename}" should tell you what they are. With 2.2.x it is
> likely they are Berkeley.   Berkeley is an administrator's nightmare.
> If they Berkelely convert them and make sure the server still works
> *BEFORE* migrating if you are using a rsync method.
> 
>> Is the conversion hard to do? What do you recommend?
> 
> cvt_cyrusdb  [I think this was around in 2.2x?]
> 
> 
> 
> see page 97

Ah, I see.

Yes, the binary is here and is able to:

# su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb
Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]
Usable Backends:  berkeley, berkeley-nosync, flat, skiplist, quotalegacy

> You'll probably need to change the database type in imapd.conf as
> well.

I will give it a try in the evening when I can stop the server for a moment.

Forgive me my questions, but which files do I have to convert:

/var/lib/imap # ls -l
total 202180
drwxr-x---  13 cyrus mail  4096 Feb 29 13:44 .
drwxr-xr-x  28 root  root  4096 Feb 29 06:56 ..
-rw---   1 cyrus mail  5480 Feb  4 08:09 annotations.db
drwx--   2 cyrus mail 98304 Feb 29 06:45 backup
drwxr-x---   2 cyrus mail  4096 Feb 24 01:13 db
drwx--   2 cyrus mail  4096 Feb 29 13:44 db.backup1
drwx--   2 cyrus mail  4096 Feb 29 13:14 db.backup2
-rw---   1 cyrus mail  10817536 Feb 29 13:44 deliver.db
drwxr-x---   3 cyrus mail  4096 Feb 18  2005 deliverdb
drwxr-x---   2 cyrus mail  4096 Feb 18  2005 log
-rw---   1 cyrus mail102600 Feb 29 13:48 mailboxes.db
-rw-r--r--   1 cyrus mail 18101 Nov 23  2006 mailboxes.txt
drwxr-x---   2 cyrus mail  4096 Feb 18  2005 msg
drwxr-x---   2 cyrus mail  8192 Feb 29 13:51 proc
drwxr-x---  28 cyrus mail  4096 Feb 18  2005 quota
drwxr-x---   2 cyrus mail  4096 Feb  4 08:09 socket
-rw-r--r--   1 cyrus mail 18101 Nov 23  2006 testexport
-rw---   1 cyrus mail 195685416 Feb 29 13:51 tls_sessions.db
drwxr-x---  28 cyrus mail  4096 Feb 18  2005 user


only *.db ?


>>> Beware of mailbox sort order issues if you change that config.
>> You talk of the sort order in the mail-clients view
> 
> No, it is sorting order in the database.  It is much easier to
> convert everything before migrating.

So the initial conversion on the old box takes care of the sorting
issue, do I understand correct?

Thanks for your help, Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 13:53, schrieb Stefan G. Weichinger:
> Does it matter:
> 
> new server has one subdir per character:
> 
> a
> b
> c
> d
> ...
> 
> while old server has:
> 
> auser1
> auser2
> auser5
> ...
> 
> ?

sorry for the noise, mixed up config- and datadir ...

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 13:53, schrieb Stefan G. Weichinger:

> only *.db ?

copied the db-files aside and tried to convert.
unfortunately I get stuck.

pls see and advise:


# file *.db
annotations.db:  Apple QuickTime movie (modified)
deliver.db:  Berkeley DB (Btree, version 9, native byte-order)
mailboxes.db:Apple QuickTime movie (modified)
tls_sessions.db: Apple QuickTime movie (modified)


# su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb deliver.db berkeley-nosync
delNEW.db skiplist
Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]
Usable Backends:  berkeley, berkeley-nosync, flat, skiplist, quotalegacy

# su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb deliver.db berkeley
delNEW.db skiplist
Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]
Usable Backends:  berkeley, berkeley-nosync, flat, skiplist, quotalegacy

I don't get it ... what is wrong with my commands?

tia, S

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Eric Luyten
On Wed, February 29, 2012 3:22 pm, Stefan G. Weichinger wrote:
> Am 29.02.2012 13:53, schrieb Stefan G. Weichinger:
>
>
>> only *.db ?
>
> copied the db-files aside and tried to convert. unfortunately I get stuck.
>
> pls see and advise:
>
>
> # file *.db
> annotations.db:  Apple QuickTime movie (modified)
> deliver.db:  Berkeley DB (Btree, version 9, native byte-order)
> mailboxes.db:Apple QuickTime movie (modified)
> tls_sessions.db: Apple QuickTime movie (modified)
>
>
>
> # su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb deliver.db berkeley-nosync
> delNEW.db skiplist Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]  db>Usable Backends:  berkeley,
> berkeley-nosync, flat, skiplist, quotalegacy
>
> # su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb deliver.db berkeley
> delNEW.db skiplist Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]  db>Usable Backends:  berkeley,
> berkeley-nosync, flat, skiplist, quotalegacy
>
> I don't get it ... what is wrong with my commands?


Stefan,


Use the absolute pathnames of the DB files.


Eric Luyten, Computing Centre VUB/ULB.




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 15:32, schrieb Eric Luyten:

> Use the absolute pathnames of the DB files.

Same result:

# su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb /tmp/cytest/deliver.db
berkeley /tmp/cytest/delnew.db skiplist
Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]
Usable Backends:  berkeley, berkeley-nosync, flat, skiplist, quotalegacy





Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 15:35, schrieb Stefan G. Weichinger:
> Am 29.02.2012 15:32, schrieb Eric Luyten:
> 
>> Use the absolute pathnames of the DB files.
> 
> Same result:
> 
> # su cyrus -c /usr/lib/cyrus/bin/cvt_cyrusdb /tmp/cytest/deliver.db
> berkeley /tmp/cytest/delnew.db skiplist
> Usage: /usr/lib/cyrus/bin/cvt_cyrusdb [-C altconfig]   backend>  
> Usable Backends:  berkeley, berkeley-nosync, flat, skiplist, quotalegacy

It works now.

Instead of "su cyrus -c " I su-ed to cyrus ... in there it worked for
deliver.db now.

# file delnew.db
delnew.db: Apple QuickTime movie (modified)

So the other 3 dbs seem to be already skiplist, right?

# file /var/lib/imap/*.db
/var/lib/imap/annotations.db:  Apple QuickTime movie (modified)
/var/lib/imap/deliver.db:  Berkeley DB (Btree, version 9, native
byte-order)
/var/lib/imap/mailboxes.db:Apple QuickTime movie (modified)
/var/lib/imap/tls_sessions.db: Apple QuickTime movie (modified)

If these four dbs are all I have to look at, I assume I could stop
cyrus, replace deliver.db and try starting over?

Thanks so far, sorry for my detailled approach, I just want to do it
right ...

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 15:53, schrieb Stefan G. Weichinger:

> If these four dbs are all I have to look at, I assume I could stop
> cyrus, replace deliver.db and try starting over?

I am nearly there and it makes me happy!

cyrus 2.4.12 runs with the slightly adapted config from the older
server, it indexed all the mailboxes ... and I was already able to
contact via thunderbird and a webmailer.

That is great!

So far only sieve doesn't work yet, although something listens on port
2000 there is no timsieved process ... hmm, gotta dig further.

And:

imaps[18096]: IOERROR: opening /var/imap/user_deny.db: No such file or
directory

Important?

-

Right now old/productive and new/test server drift apart.

May I just rsync over the mailboxes changes when I want to switch?

Or should I start over with clean and fresh directories on the new server?

Thanks a lot!

Migrating this server was something stressing me a lot when thinking
about it. Now I see it will be done soon!

Thanks!

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Reinaldo de Carvalho
Migration from imap will grow used space because will ignore single instance 
store (hard links) and should be avoided.

[]'s

Reinaldo


Em 29/02/2012, às 08:48, Manel Gimeno Zaragozá  escreveu:

> Hello,
> 
> I'm doing almost same migration, from old cyrus (2.2.12) to new version 
> (2.4.13) and I'm using "imapsync" utility in Centos6 to "copy" all data. 
> After some reading and attempts I have a "fast" sync method to copy the data 
> from old server to new one.
> 
> Regards.
> 
> Manel Gimeno Zaragoza
> magiz...@hotmail.com
> 
> 
> > Date: Wed, 29 Feb 2012 11:36:26 +0100
> > From: li...@xunil.at
> > To: info-cyrus@lists.andrew.cmu.edu
> > Subject: Questions around moving from 2.2.12 to 2.4.12
> > 
> > 
> > Hello, cyrus-imap-users (and -devs?),
> > 
> > I subscribed to this list today because I am searching for some
> > information around upgrading/migrating my cyrus-imap-server.
> > 
> > Unfortunately I waited very long, hopefully not too long ...
> > 
> > The old server runs Suse Linux 10.1 with these versions:
> > 
> > # rpm -qa | grep cyrus
> > cyrus-sasl-2.1.21-3
> > cyrus-sasl-devel-2.1.21-3
> > cyrus-imapd-2.2.12-13
> > 
> > I have a few hundred accounts within web-cyradm, which means their
> > passwords are stored encrypted (so the imapsync-approach is problematic).
> > 
> > My goal is to migrate things over to a newer server running gentoo
> > linux, the maintained version of cyrus-imapd there is 2.4.12 (the older
> > 2.2.13 from a separate gentoo-overlay didn't compile for me).
> > 
> > Moving the mysql-DB shouldn't be much of a problem, the web-cyradm tool
> > runs on gentoo already.
> > 
> > So my question is: how to move things in the most stress-free way?
> > 
> > Could I simply copy over /var/spool/imap etc, and start the newer version?
> > 
> > Do I have to somehow convert things? If yes, is it problematic?
> > 
> > I am thinking about just trying it for a test, but I would really feel
> > much better with some competent feedback from the cyrus-imap-community.
> > 
> > Thanks a lot in advance, Stefan.
> > 
> > Cyrus Home Page: http://www.cyrusimap.org/
> > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Adam Tauno Williams
On Wed, 2012-02-29 at 16:45 +0100, Stefan G. Weichinger wrote:
> Am 29.02.2012 15:53, schrieb Stefan G. Weichinger:
> > If these four dbs are all I have to look at, I assume I could stop
> > cyrus, replace deliver.db and try starting over?
> I am nearly there and it makes me happy!
> cyrus 2.4.12 runs with the slightly adapted config from the older
> server, it indexed all the mailboxes ... and I was already able to
> contact via thunderbird and a webmailer.
> So far only sieve doesn't work yet, although something listens on port
> 2000 there is no timsieved process ... hmm, gotta dig further.

"netstat --listen --tcp --numeric --program"

Somewhere along the line some distributions changed the SIEVE port.

> imaps[18096]: IOERROR: opening /var/imap/user_deny.db: No such file or
> directory
> 
> Important?

No.

> Right now old/productive and new/test server drift apart.
> May I just rsync over the mailboxes changes when I want to switch?

Stop the new server
Rsync from the old server
Start the new server 
Make sure everything is working on new server
Stop the new server.
Stop the old server.
Rsync again.
Start the new server.

You need to perform the last rsync from a cold server. But it should be
pretty quick as it will only grab the few changed items.

> Or should I start over with clean and fresh directories on the new server?
> Migrating this server was something stressing me a lot when thinking
> about it. Now I see it will be done soon!

-- 
System & Network Administrator [ LPI & NCLA ]

OpenGroupware Developer 
Adam Tauno Williams


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 18:06, schrieb Adam Tauno Williams:

> "netstat --listen --tcp --numeric --program"
> 
> Somewhere along the line some distributions changed the SIEVE port.

Solved already, thanks.
missing pam.d entry.

> 
>> imaps[18096]: IOERROR: opening /var/imap/user_deny.db: No such file
>> or directory
>> 
>> Important?
> 
> No.

Solved. Touched file as mentioned in old posting here.

>> Right now old/productive and new/test server drift apart. May I
>> just rsync over the mailboxes changes when I want to switch?
> 
> Stop the new server Rsync from the old server Start the new server 
> Make sure everything is working on new server Stop the new server. 
> Stop the old server. Rsync again. Start the new server.
> 
> You need to perform the last rsync from a cold server. But it should
> be pretty quick as it will only grab the few changed items.

Wouldn't that mean that I overwrite stuff with older files?

rsync -av   without "--delete", correct?

And I would have to convert the deliver.db once more, correct?

I will retest that later as I saw a minor issue with some index-file.
Overall it looks very promising right now.

Thanks to all of you for your support (so far) ;-)

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Patrick Boutilier

On 02/29/2012 01:25 PM, Stefan G. Weichinger wrote:

Am 29.02.2012 18:06, schrieb Adam Tauno Williams:


"netstat --listen --tcp --numeric --program"

Somewhere along the line some distributions changed the SIEVE port.


Solved already, thanks.
missing pam.d entry.




imaps[18096]: IOERROR: opening /var/imap/user_deny.db: No such file
or directory

Important?


No.


Solved. Touched file as mentioned in old posting here.


Right now old/productive and new/test server drift apart. May I
just rsync over the mailboxes changes when I want to switch?


Stop the new server Rsync from the old server Start the new server
Make sure everything is working on new server Stop the new server.
Stop the old server. Rsync again. Start the new server.

You need to perform the last rsync from a cold server. But it should
be pretty quick as it will only grab the few changed items.


Wouldn't that mean that I overwrite stuff with older files?




rsync will only sync over newer files and files that have changed. I 
would use --delete as you don't want mails that have been deleted on the 
live server to remain on the new server.






rsync -av   without "--delete", correct?

And I would have to convert the deliver.db once more, correct?



Or just ignore it and let Cyrus create a new one when it starts.








I will retest that later as I saw a minor issue with some index-file.
Overall it looks very promising right now.

Thanks to all of you for your support (so far) ;-)

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


<>
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 17:39, schrieb Reinaldo de Carvalho:
> Migration from imap will grow used space because will ignore single
> instance store (hard links) and should be avoided.

I accept that just to get to the new hardware asap.
I don't have that much data so it doesn't matter that much right now.

Stefan


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 18:48, schrieb Patrick Boutilier:

> rsync will only sync over newer files and files that have changed. I 
> would use --delete as you don't want mails that have been deleted on
> the live server to remain on the new server.

Yes, sure, will do.

>> And I would have to convert the deliver.db once more, correct?
> 
> Or just ignore it and let Cyrus create a new one when it starts.

OK, so I will skip that one.

-

My current problem is configuring saslauthd.

Both servers are configured to use pam_mysql (for imap/pop/smtp) and
talk successfully to the db on the new server.

IMAP works fine on both.

Also both Postfixes talk to the new db.

Only saslauthd on the new server is still pointing at the old db on the
old server.

I have

 /usr/sbin/saslauthd -a rimap -O 10.1.0.3

which works successfully.

(10.1.0.3 is the VPN-IP of the old box, .4 the new one)

While

/usr/sbin/saslauthd -a rimap -O 10.1.0.4

or

/usr/sbin/saslauthd -a rimap -O 127.0.0.1

or

/usr/sbin/saslauthd -a pam (-r)

don't work.

Any new behavior in the newer cyrus-sasl?


# smtpd.conf

mech_list: PLAIN LOGIN
pwcheck_method: saslauthd

same as on the old box ... hmm.
cyrus-imapd.conf was also copied and contains:

sasl_pwcheck_method: saslauthd
sasl_mech_list: plain login
sasl_log_level: 1

---

logs say

Feb 29 20:34:01 postler imap[27651]: accepted connection
Feb 29 20:34:01 Feb 29 20:34:01 postler imap[27651]: accepted connection
Feb 29 20:34:01 postler saslauthd[27647]: do_auth : auth
failure: [user=oop4xxy] [service=imap] [realm=] [mech=rimap]
[reason=remote server rejected your credentials]
Feb 29 20:34:01 postler imaps[26301]: badlogin: mail.oops.co.at
[213.129.238.225] plain [SASL(-13): authentication failure: Password
verification failed]postler saslauthd[27647]: do_auth : auth
failure: [user=oop4xxy] [service=imap] [realm=] [mech=rimap]
[reason=remote server rejected your credentials]
Feb 29 20:34:01 postler imaps[26301]: badlogin: mail.oops.co.at
[213.129.238.225] plain [SASL(-13): authentication failure: Password
verification failed]

exactly the same pw works when I point saslauthd against the old
imap-server.

Is some encryption my problem?

pam_mysql package on new server has (gentoo-style) USEflags "openssl
sasl ssl"  sounds promising ...


Now this is the last single thing needing the old DB ...

Thanks all, Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-02-29 Thread Stefan G. Weichinger
Am 29.02.2012 20:55, schrieb Stefan G. Weichinger:

> Is some encryption my problem?
> 
> pam_mysql package on new server has (gentoo-style) USEflags "openssl
> sasl ssl"  sounds promising ...

yep, that was it. way shorter than writing this mail ... ;-)

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger


squatter stops working as it hits an index of a user with a trailing
space in its name.

seems like a typo ...

within web-cyradm I don't see that user.

Should I remove it with cyradm? May I simply delete its files/indexes?

thx, S

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Nikos Gatsis

On 29/2/2012 7:48 ??, Patrick Boutilier wrote:

On 02/29/2012 01:25 PM, Stefan G. Weichinger wrote:

Am 29.02.2012 18:06, schrieb Adam Tauno Williams:


"netstat --listen --tcp --numeric --program"

Somewhere along the line some distributions changed the SIEVE port.


Solved already, thanks.
missing pam.d entry.




imaps[18096]: IOERROR: opening /var/imap/user_deny.db: No such file
or directory

Important?


No.


Solved. Touched file as mentioned in old posting here.


Right now old/productive and new/test server drift apart. May I
just rsync over the mailboxes changes when I want to switch?


Stop the new server Rsync from the old server Start the new server
Make sure everything is working on new server Stop the new server.
Stop the old server. Rsync again. Start the new server.

You need to perform the last rsync from a cold server. But it should
be pretty quick as it will only grab the few changed items.


Wouldn't that mean that I overwrite stuff with older files?




rsync will only sync over newer files and files that have changed. I 
would use --delete as you don't want mails that have been deleted on 
the live server to remain on the new server.






rsync -av   without "--delete", correct?

And I would have to convert the deliver.db once more, correct?



Or just ignore it and let Cyrus create a new one when it starts.








I will retest that later as I saw a minor issue with some index-file.
Overall it looks very promising right now.

Thanks to all of you for your support (so far) ;-)

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/





Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

A good tutorial is here:
http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/
I test it and my new mailserver works fine after 10 min of migration.
Nikos


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 01.03.2012 10:49, schrieb Nikos Gatsis:

> A good tutorial is here:
> http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/
> I test it and my new mailserver works fine after 10 min of migration.

wow, looks promising. Cleans up things as well, correct?
Thanks!


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Nikos Gatsis
On 1/3/2012 11:57 πμ, Stefan G. Weichinger wrote:
> Am 01.03.2012 10:49, schrieb Nikos Gatsis:
>
>> A good tutorial is here:
>> http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/
>> I test it and my new mailserver works fine after 10 min of migration.
> wow, looks promising. Cleans up things as well, correct?
> Thanks!
>
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Yup!
I migrate from fedora 8 to fedora 16, I cant recall the cyrus versions, 
without problem.
I love cyrus, never had I problem!

Nikos



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 01.03.2012 11:01, schrieb Nikos Gatsis:

> Yup!
> I migrate from fedora 8 to fedora 16, I cant recall the cyrus versions, 
> without problem.
> I love cyrus, never had I problem!

I saw no problems yesterday with only copying stuff over.

But cleaning up things and somehow regenerating structures might be good
at this point, yes.



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 01.03.2012 11:11, schrieb Stefan G. Weichinger:
> Am 01.03.2012 11:01, schrieb Nikos Gatsis:
> 
>> Yup!
>> I migrate from fedora 8 to fedora 16, I cant recall the cyrus versions, 
>> without problem.
>> I love cyrus, never had I problem!
> 
> I saw no problems yesterday with only copying stuff over.
> 
> But cleaning up things and somehow regenerating structures might be good
> at this point, yes.

Sigh, another thing:

I can't connect to cyrus via cyradm:


$ cyradm --user cyrus localhost
verify error:num=19:self signed certificate in certificate chain
IMAP Password:
  Login failed: authentication failure at
/usr/lib64/perl5/vendor_perl/5.12.4/x86_64-linux/Cyrus/IMAP/Admin.pm
line 120
cyradm: cannot authenticate to server with  as cyrus

I assume it might have to do with saslauthd?

I don't want to try around right now as stuff authenticates OK against it.

Why does it ask "IMAP Password" ? It should read from sasldb, correct?

Please advise, thank you.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Nikos Gatsis
On 1/3/2012 12:50 μμ, Stefan G. Weichinger wrote:
> Am 01.03.2012 11:11, schrieb Stefan G. Weichinger:
>> Am 01.03.2012 11:01, schrieb Nikos Gatsis:
>>
>>> Yup!
>>> I migrate from fedora 8 to fedora 16, I cant recall the cyrus versions,
>>> without problem.
>>> I love cyrus, never had I problem!
>> I saw no problems yesterday with only copying stuff over.
>>
>> But cleaning up things and somehow regenerating structures might be good
>> at this point, yes.
> Sigh, another thing:
>
> I can't connect to cyrus via cyradm:
>
>
> $ cyradm --user cyrus localhost
> verify error:num=19:self signed certificate in certificate chain
> IMAP Password:
>Login failed: authentication failure at
> /usr/lib64/perl5/vendor_perl/5.12.4/x86_64-linux/Cyrus/IMAP/Admin.pm
> line 120
> cyradm: cannot authenticate to server with  as cyrus
>
> I assume it might have to do with saslauthd?
>
> I don't want to try around right now as stuff authenticates OK against it.
>
> Why does it ask "IMAP Password" ? It should read from sasldb, correct?
>
> Please advise, thank you.
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
There is a package named cyrus-imapd-sasl something.
Have you installed it?
Nikos

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger

more info:

saslauthd -a pam

...

# cat smtpd.conf
mech_list: PLAIN LOGIN
pwcheck_method: auxprop
auxprop_plugin: sasldb
log_level: 3

reset pw for the user with saslpasswd2, no change

# sasldblistusers2
cy...@matrix.lichtfels.com: userPassword

Mar  1 12:05:06 postler imap[28843]: starttls: TLSv1 with cipher
DHE-RSA-AES256-SHA (256/256 bits new) no authentication
Mar  1 12:05:12 postler saslauthd[28582]: DEBUG: auth_pam:
pam_authenticate failed: Permission denied
Mar  1 12:05:12 postler saslauthd[28582]: do_auth : auth
failure: [user=cyrus] [service=imap] [realm=matrix.lichtfels.com]
[mech=pam] [reason=PAM auth error]
Mar  1 12:05:12 postler imap[28843]: badlogin: localhost [127.0.0.1]
plaintext cy...@matrix.lichtfels.com SASL(-13): authentication failure:
checkpass failed

The pam.d-file imap contains only the 2 pam_mysql-lines ...


thanks ...

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 01.03.2012 12:06, schrieb Nikos Gatsis:

> There is a package named cyrus-imapd-sasl something.
> Have you installed it?

dev-libs/cyrus-sasl

sure. otherwise I wouldn't have saslauthd, I assume.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Adam Tauno Williams
On Thu, 2012-03-01 at 12:21 +0100, Stefan G. Weichinger wrote:
> Am 01.03.2012 12:06, schrieb Nikos Gatsis:
> > There is a package named cyrus-imapd-sasl something.
> > Have you installed it?
> dev-libs/cyrus-sasl
> sure. otherwise I wouldn't have saslauthd, I assume.

No, there is a split.  On CentOS6 [at least] /usr/sbin/saslauthd [the
*service*] is provided as part of the cyrus-sasl package.  The SASL
plugin/library needed to *other services* to *USE* authentication via
saslauthd is provided by the cyrus-sasl-plain package.  Installing one
does not, by dependency, install the other.


signature.asc
Description: This is a digitally signed message part

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 01.03.2012 12:12, schrieb Stefan G. Weichinger:

> The pam.d-file imap contains only the 2 pam_mysql-lines ...

I assume it has to do with the pam-file. It should somehow read sasldb
as well.

I am not sure which way to go with all this sasldb/saslauthd stuff.

For SMTP-Auth things work, it reads mysql-entries via saslauthd right now:

# cat /etc/sasl2/smtpd.conf
mech_list: PLAIN LOGIN
pwcheck_method: saslauthd
log_level: 3

and saslauthd uses pam and pam for imap uses pam_mysql only ...

Will dig further this evening if I have to add lines to the pam-file.

Afai understand I only need sasldb for managing cyrus via cyradm?

Would it be possible to use my IMAP-user (from the mysql-query via
pam_mysql) for cyradm-work?

Stefan


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Patrick Boutilier

On 03/01/2012 07:53 AM, Stefan G. Weichinger wrote:

Am 01.03.2012 12:12, schrieb Stefan G. Weichinger:


The pam.d-file imap contains only the 2 pam_mysql-lines ...


I assume it has to do with the pam-file. It should somehow read sasldb
as well.

I am not sure which way to go with all this sasldb/saslauthd stuff.

For SMTP-Auth things work, it reads mysql-entries via saslauthd right now:

# cat /etc/sasl2/smtpd.conf
mech_list: PLAIN LOGIN
pwcheck_method: saslauthd
log_level: 3

and saslauthd uses pam and pam for imap uses pam_mysql only ...

Will dig further this evening if I have to add lines to the pam-file.

Afai understand I only need sasldb for managing cyrus via cyradm?

Would it be possible to use my IMAP-user (from the mysql-query via
pam_mysql) for cyradm-work?



Yes, that is how we do it.







Stefan


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


<>
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 2012-03-01 14:12, schrieb Patrick Boutilier:
> On 03/01/2012 07:53 AM, Stefan G. Weichinger wrote:
>> Am 01.03.2012 12:12, schrieb Stefan G. Weichinger:
>>
>>> The pam.d-file imap contains only the 2 pam_mysql-lines ...
>>
>> I assume it has to do with the pam-file. It should somehow read sasldb
>> as well.
>>
>> I am not sure which way to go with all this sasldb/saslauthd stuff.
>>
>> For SMTP-Auth things work, it reads mysql-entries via saslauthd right
>> now:
>>
>> # cat /etc/sasl2/smtpd.conf
>> mech_list: PLAIN LOGIN
>> pwcheck_method: saslauthd
>> log_level: 3
>>
>> and saslauthd uses pam and pam for imap uses pam_mysql only ...
>>
>> Will dig further this evening if I have to add lines to the pam-file.
>>
>> Afai understand I only need sasldb for managing cyrus via cyradm?
>>
>> Would it be possible to use my IMAP-user (from the mysql-query via
>> pam_mysql) for cyradm-work?
> 
> 
> Yes, that is how we do it.

Just add my email-user to imapd.conf, as admin?
Yeah, works! Great.

Will look to use that way with web-cyradm then, tomorrow.

Thanks, greets, Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-01 Thread Stefan G. Weichinger
Am 2012-03-01 22:22, schrieb Stefan G. Weichinger:

> Just add my email-user to imapd.conf, as admin?
> Yeah, works! Great.

Although I only get normal user-rights so far ... hmmm ...
More tomorrow ...

Stefan


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-02 Thread Stefan G. Weichinger
Am 01.03.2012 22:27, schrieb Stefan G. Weichinger:
> Am 2012-03-01 22:22, schrieb Stefan G. Weichinger:
> 
>> Just add my email-user to imapd.conf, as admin?
>> Yeah, works! Great.
> 
> Although I only get normal user-rights so far ... hmmm ...
> More tomorrow ...

oh slowly slowly

After setting a UNIX-pw for (admin-user) cyrus, I am able to use cyradm
from the shell.

But: web-cyradm does not open/use cyradm somehow.
Stuff is created in the DB, but there are no mailboxes created.

The conf.php looks fine but there is no login to cyradm logged at all.

Any ideas someone?

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-05 Thread Stefan G. Weichinger
Am 02.03.2012 20:53, schrieb Stefan G. Weichinger:

> But: web-cyradm does not open/use cyradm somehow.
> Stuff is created in the DB, but there are no mailboxes created.
> 
> The conf.php looks fine but there is no login to cyradm logged at all.

solved. my fault. typo 


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-05 Thread Stefan G. Weichinger
Am 2012-03-01 10:49, schrieb Nikos Gatsis:
> A good tutorial is here:
> http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/
> I test it and my new mailserver works fine after 10 min of migration.

I am near to switching servers now, and I just tested the instructions
mentioned there.

The procedure even helped to skip the mentioned mailbox with the
trailing space in its name (it crashed squatter before).

Everything is indexed now ... looking forward to actually move over soon.

Thanks all, Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Reinaldo de Carvalho
On Wed, Feb 29, 2012 at 2:25 PM, Stefan G. Weichinger  wrote:
>
> Wouldn't that mean that I overwrite stuff with older files?
>
> rsync -av   without "--delete", correct?
>

Don't forget -H to keep hard links from single instance store. Else
destination disk usage will increase.


-- 
Reinaldo de Carvalho
http://korreio.sf.net
http://python-cyrus.sf.net

"While not fully understand a software, don't try to adapt this
software to the way you work, but rather yourself to the way the
software works" (myself)

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Stefan G. Weichinger
Am 06.03.2012 15:06, schrieb Reinaldo de Carvalho:
> On Wed, Feb 29, 2012 at 2:25 PM, Stefan G. Weichinger  wrote:
>>
>> Wouldn't that mean that I overwrite stuff with older files?
>>
>> rsync -av   without "--delete", correct?
>>
> 
> Don't forget -H to keep hard links from single instance store. Else
> destination disk usage will increase.

The mentioned howto

http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/

uses "-aP" ...   so you recommend "-aPH" ?

I don't care much about disk usage, and my tests didn't show significant
increase. I haven't set any hard links there by myself, does cyrus
itself use them?

Thanks, Stefan (ps: in 2hrs I will switch over things ... *sigh* )

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Patrick Boutilier

On 03/06/2012 11:43 AM, Stefan G. Weichinger wrote:

Am 06.03.2012 15:06, schrieb Reinaldo de Carvalho:

On Wed, Feb 29, 2012 at 2:25 PM, Stefan G. Weichinger  wrote:


Wouldn't that mean that I overwrite stuff with older files?

rsync -av   without "--delete", correct?



Don't forget -H to keep hard links from single instance store. Else
destination disk usage will increase.


The mentioned howto

http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/

uses "-aP" ...   so you recommend "-aPH" ?

I don't care much about disk usage, and my tests didn't show significant
increase. I haven't set any hard links there by myself, does cyrus
itself use them?



Yes. With single instance store if 10 people receive the same e-mail it 
is only stored once on the filesystem and the other 9 are hardlinked to 
the file.










Thanks, Stefan (ps: in 2hrs I will switch over things ... *sigh* )

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


<>
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Adam Tauno Williams
On Tue, 2012-03-06 at 16:43 +0100, Stefan G. Weichinger wrote:
> Am 06.03.2012 15:06, schrieb Reinaldo de Carvalho:
> > On Wed, Feb 29, 2012 at 2:25 PM, Stefan G. Weichinger  
> > wrote:
> >> Wouldn't that mean that I overwrite stuff with older files?
> >> rsync -av   without "--delete", correct?
> > Don't forget -H to keep hard links from single instance store. Else
> > destination disk usage will increase.
> The mentioned howto
> http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/
> uses "-aP" ...   so you recommend "-aPH" ?
> I don't care much about disk usage, and my tests didn't show significant
> increase. I haven't set any hard links there by myself, does cyrus
> itself use them?

Yes, singeinstancestore uses hard links to keep a copy of the same
message in multiple mailboxes.

-- 
System & Network Administrator [ LPI & NCLA ]

OpenGroupware Developer 
Adam Tauno Williams


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Stefan G. Weichinger
Am 06.03.2012 16:44, schrieb Adam Tauno Williams:

> Yes, singeinstancestore uses hard links to keep a copy of the same
> message in multiple mailboxes.

ah, ok  so I should start over syncing completely?
Or does adding "-H" to my commands and re-running also do the trick?

Thanks, Stefan


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Stefan G. Weichinger
Am 06.03.2012 16:44, schrieb Adam Tauno Williams:
> On Tue, 2012-03-06 at 16:43 +0100, Stefan G. Weichinger wrote:
>> Am 06.03.2012 15:06, schrieb Reinaldo de Carvalho:
>>> On Wed, Feb 29, 2012 at 2:25 PM, Stefan G. Weichinger  
>>> wrote:
 Wouldn't that mean that I overwrite stuff with older files?
 rsync -av   without "--delete", correct?
>>> Don't forget -H to keep hard links from single instance store. Else
>>> destination disk usage will increase.
>> The mentioned howto
>> http://cynici.wordpress.com/2010/12/06/how-to-migrate-32-bit-cyrus-imapd-mailboxes-to-64-bit/
>> uses "-aP" ...   so you recommend "-aPH" ?
>> I don't care much about disk usage, and my tests didn't show significant
>> increase. I haven't set any hard links there by myself, does cyrus
>> itself use them?
> 
> Yes, singeinstancestore uses hard links to keep a copy of the same
> message in multiple mailboxes.

ok, did that-

I am UP and running on the new system.

Only issue: the SEEN-flags didn't quite come over correctly, at least
for my accounts  (does it correspond w/ the client?).

I assume my users will have to live with it. period.
System is up and users access mailboxes already, so ...

Could I somehow get rid of these lines in /var/log/messages :

fetching user_deny.db entry .

Reduce log level?

Thank you all for your support!

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-06 Thread Stefan G. Weichinger
Am 06.03.2012 20:01, schrieb Stefan G. Weichinger:

> Only issue: the SEEN-flags didn't quite come over correctly, at
> least for my accounts  (does it correspond w/ the client?).
> 
> I assume my users will have to live with it. period. System is up and
> users access mailboxes already, so ...

As mentioned, it is just an issue I would like to understand.

> Could I somehow get rid of these lines in /var/log/messages :
> 
> fetching user_deny.db entry .
> 
> Reduce log level?

ok, when noone replies it's an FAQ and in the docs ... so I figured out
that syslog-ng-filter by myself. Would it be so uncool to have an
example in the docs?

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/


Re: Questions around moving from 2.2.12 to 2.4.12

2012-03-12 Thread Stefan G. Weichinger

So far I am happy with the migration ... works fine!

Are there any obvious parameters to change or get rid of after such a
big leap (2.2.x to 2.4.x) ?

I hesitate to post all my conf-files as I have one for
imapd/lmtpd/popd/timsieved/cyrus 

Stefan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/