Re: mdbox vs. maildir format

2022-10-19 Thread Doug
ot;$MAILBOX" -P "$LOCATION2" done Do you think the preceding shellscript will work if I store my Dovecot messages in the Maildir form? Thanks, SteveT Yes it will. The source format is your current format (maildir) and the target format is whatever you specify (mdbox: or maildir:

Re: mdbox vs. maildir format

2022-10-18 Thread Gedalya
On 10/19/22 07:46, Steve Litt wrote: >> for MAILBOX in $USERS; do >> doveadm expunge -u "$MAILBOX" mailbox Trash savedbefore 7d >> doveadm expunge -u "$MAILBOX" mailbox Spam savedbefore 30d >> doveadm purge -u "$MAILBOX" >> >>

Re: mdbox vs. maildir format

2022-10-18 Thread Steve Litt
On Tue, 2022-10-18 at 16:48 +0200, Bernardo Reino wrote: > On 18/10/2022 12:17, Michael wrote: >  > >  > [...] > > so, raid is mandatory, which is already the case, but what about backup? > > how can i achieve a backup/snapshot of both, the mdbox (nfs share) and > > the index files (local raid)

Re: mdbox vs. maildir format

2022-10-18 Thread Bernardo Reino
On 18/10/2022 12:17, Michael wrote: > > [...] so, raid is mandatory, which is already the case, but what about backup? how can i achieve a backup/snapshot of both, the mdbox (nfs share) and the index files (local raid) and assure they are consistent? You can use doveadm to backup the

RE: mdbox vs. maildir format

2022-10-18 Thread Aki Tuomi
> On 18/10/2022 14:09 EEST Marc wrote: > > > > > > "Note that with dbox the Index files contain significant data which is > > held nowhere else. Index files for both sdbox and mdbox contain message > > flags and keywords. For mdbox, the index file also contains the map_uids > > which link

RE: mdbox vs. maildir format

2022-10-18 Thread Marc
> > "Note that with dbox the Index files contain significant data which is > held nowhere else. Index files for both sdbox and mdbox contain message > flags and keywords. For mdbox, the index file also contains the map_uids > which link (via the “map index”) to the actual message data. This data

Re: mdbox vs. maildir format

2022-10-18 Thread Gedalya
On 10/18/22 18:46, Marc wrote: >> you must not lose the dbox index files, as they can’t be >> regenerated without data loss. > I have read this also, and was also worried about this, but when I look at > the flat m.988 file, I still have quite a lot of useful data there. "Note that with

Re: mdbox vs. maildir format

2022-10-18 Thread Gedalya
On 10/18/22 18:17, Michael wrote: > what about backup? how can i achieve a backup/snapshot of both, the mdbox > (nfs share) and the index files (local raid) and assure they are consistent? If you do your backups using doveadm backup, then the result should be consistent, at least in the sense

RE: mdbox vs. maildir format

2022-10-18 Thread Marc
> > i am considering changing my mailbox format from maildir to mdbox. the > reason for this is mainly, b/c i have (a) multiple large mailboxes with > tens of thousands of mail files, and (b) most of these mails files have > a > size significantly smaller than the secto

mdbox vs. maildir format

2022-10-18 Thread Michael
hey, i am considering changing my mailbox format from maildir to mdbox. the reason for this is mainly, b/c i have (a) multiple large mailboxes with tens of thousands of mail files, and (b) most of these mails files have a size significantly smaller than the sector size of the disk. so

Re: convert mdbox to maildir

2022-08-14 Thread Michael Grimm
2nd idea (see below) > On 14. Aug 2022, at 21:15, Michael Grimm wrote: > > lutz.niede...@gmx.net wrote: > >> Yes, you are right. The problems are not of technical nature. The reason >> seems to be some sort of fear (and "admins"). >> We have all we need. We have the old dovecot config, we

Re: convert mdbox to maildir

2022-08-14 Thread Michael Grimm
lutz.niede...@gmx.net wrote: > Yes, you are right. The problems are not of technical nature. The reason > seems to be some sort of fear (and "admins"). > We have all we need. We have the old dovecot config, we have the mdbox files > and the complete directory structure. We are simply not

Re: convert mdbox to maildir

2022-08-14 Thread justina colmena ~biz
On August 14, 2022 9:46:54 AM AKDT, lutz.niede...@gmx.net wrote: >Yes, you are right. The problems are not of technical nature. >... >We do what the customer wants us to do. And yes, they pay pretty well for >working on weekends. >... I'm sure there are more than enough professional mental

Aw: Re: convert mdbox to maildir

2022-08-14 Thread lutz . niederer
ot;. > Gesendet: Sonntag, 14. August 2022 um 18:24 Uhr > Von: "Steve Litt" > An: dovecot@dovecot.org > Betreff: Re: convert mdbox to maildir > > On Sat, 2022-08-13 at 18:36 +0200, lutz.niede...@gmx.net wrote: > > > > The real problem is that we must not use

Re: convert mdbox to maildir

2022-08-14 Thread Steve Litt
On Sat, 2022-08-13 at 18:36 +0200, lutz.niede...@gmx.net wrote: > > The real problem is that we must not use the running, old dovecot > installation.  > So we are not able to connect to the old server, pull all folders and mails > and > create a new maildir structure.  Currently, we can't do

Re: convert mdbox to maildir

2022-08-14 Thread spi
Am 14.08.22 um 13:05 schrieb Peter: but most people will be fine with Maildir. I had to switch from Maildir to something else and chose sdbox (one file per mail) and don't remember exactly what issues I had with Maildir but I think it was somehow IMAP keywords related like moving mails from

Re: convert mdbox to maildir

2022-08-14 Thread Peter
On 14/08/22 21:47, Marc wrote: So? that is why you have this lmtp not? Afaik was mdbox created to solve the (performance) issues with mbox and maildir etc. So I just wonder what the logics is behind chosing maildir current day. maildir is probably what most people use and should continue to

Aw: RE: convert mdbox to maildir

2022-08-14 Thread lutz . niederer
er one had about 3k users (with mdbox), they all have branch offices that are connected to their "home" via some sort of vpn or direct connect by the ISP. We did not see a real difference between maildir and mdbox, maybe because of the surrounding conditions. And I believe mdbox may b

RE: convert mdbox to maildir

2022-08-14 Thread Marc
So? that is why you have this lmtp not? Afaik was mdbox created to solve the (performance) issues with mbox and maildir etc. So I just wonder what the logics is behind chosing maildir current day. > Not sure what this had to do with the question asked. > You're using mbox, but he is using

Re: convert mdbox to maildir

2022-08-13 Thread Patrick Domack
Not sure what this had to do with the question asked. You're using mbox, but he is using mdbox. Postfix is unable to write to mdbox itself. Quoting justina colmena ~biz : *My* inbox gets filled with thousands of emails, more or less commercial content and trivial notifications from shopping

RE: RE: convert mdbox to maildir

2022-08-13 Thread Marc
t; > Gesendet: Samstag, 13. August 2022 um 21:08 Uhr > Von: "justina colmena ~biz" > An: dovecot@dovecot.org > Betreff: RE: convert mdbox to maildir > *My* inbox gets filled with thousands of emails, more or less commercial > content and trivial notifications from sho

Aw: Re: convert mdbox to maildir

2022-08-13 Thread lutz . niederer
Thank you.   Do you means two servers?  One as source and one as destination?  As I understood, destination does not need an imap server... Description of dsync says: ... All of these can be used within the same server ... Adapted it says: mdbox -> maildir migration. Set mail_locat

Aw: RE: convert mdbox to maildir

2022-08-13 Thread lutz . niederer
.)     Gesendet: Samstag, 13. August 2022 um 21:08 Uhr Von: "justina colmena ~biz" An: dovecot@dovecot.org Betreff: RE: convert mdbox to maildir *My* inbox gets filled with thousands of emails, more or less commercial content and trivial notifications from shopping online, and postf

RE: convert mdbox to maildir

2022-08-13 Thread justina colmena ~biz
*My* inbox gets filled with thousands of emails, more or less commercial content and trivial notifications from shopping online, and postfix crashes and will not accept new messages if the file "/var/mail/justina" becomes too large. Configuring postfix to deliver the mail to "~/Maildir" solved

RE: convert mdbox to maildir

2022-08-13 Thread Marc
> > We need to move all users from one (pretty old) installation of dovecot > to a new one. > The old one uses mdbox for users' mailboxes and maildir for > shared/public mailboxes. > The new one must be maildir only. why did you decide to move to maildir?

convert mdbox to maildir

2022-08-13 Thread lutz . niederer
Hi! We need to move all users from one (pretty old) installation of dovecot to a new one. The old one uses mdbox for users' mailboxes and maildir for shared/public mailboxes. The new one must be maildir only. I believe that I can just copy the shared/public maildir structure to the new

Re: Problem with converting mdbox to MailDir

2019-10-03 Thread Adam Raszkiewicz via dovecot
, October 2, 2019 at 5:05 PM To: Asai via dovecot Subject: Re: Problem with converting mdbox to MailDir And /bin/doveconf namespace namespace { disabled = no hidden = no ignore_on_failure = no inbox = no list = children location = mdbox:/var/mailboxes/%%2Mu/%%2.2Mu/%%u order = 0 prefix

Re: Problem with converting mdbox to MailDir

2019-10-02 Thread Adam Raszkiewicz via dovecot
medallies>Follow us on Twitter @MedAllies<https://twitter.com/medallies> From: dovecot on behalf of Adam Raszkiewicz via dovecot Reply-To: Adam Raszkiewicz Date: Wednesday, October 2, 2019 at 4:50 PM To: Asai via dovecot Subject: Problem with converting mdbox to MailDir I hav

Problem with converting mdbox to MailDir

2019-10-02 Thread Adam Raszkiewicz via dovecot
I have a problem to convert mdbox to MailDir. Log from that process looks like: /bin/dsync -Dv -u u...@domian.com mirror maildir:/tmp/destination/mailboxes/u...@domian.com Debug: Loading modules from directory: /lib/dovecot Debug: Module loaded: /lib/dovecot/lib01_acl_plugin.so Debug: Loading

Re: mdbox to Maildir

2019-06-20 Thread Adam Raszkiewicz via dovecot
aildir -> mdbox but not mdbox -> maildir Did I have missed anything there? There is no direct example on how to do just that but you can use your brain and modify the mbox -> maildir example a bit. Sami

Re: mdbox to Maildir

2019-06-19 Thread Sami Ketola via dovecot
> On 19 Jun 2019, at 5.05, Adam Raszkiewicz wrote: > > I saw that before but there is only maildir -> mdbox but not mdbox -> maildir > Did I have missed anything there? There is no direct example on how to do just that but you can use your brain and modify the mbox ->

Re: mdbox to Maildir

2019-06-18 Thread Adam Raszkiewicz via dovecot
I saw that before but there is only maildir -> mdbox but not mdbox -> maildir Did I have missed anything there? From: dovecot on behalf of Sami Ketola via dovecot Reply-To: Sami Ketola Date: Tuesday, June 18, 2019 at 9:58 PM To: Dovecot Mailing List Cc: Ralph Seichter , Odhiambo Wash

Re: mdbox to Maildir

2019-06-18 Thread Sami Ketola via dovecot
> On 18 Jun 2019, at 16.59, Odhiambo Washington via dovecot > wrote: > > > > On Tue, 18 Jun 2019 at 01:35, Ralph Seichter via dovecot > wrote: > * Odhiambo Washington via dovecot: > > > Is it possible? How do I do it for ALL mailboxes? > > This has been asked

Re: mdbox to Maildir

2019-06-18 Thread Odhiambo Washington via dovecot
On Tue, 18 Jun 2019 at 01:35, Ralph Seichter via dovecot < dovecot@dovecot.org> wrote: > * Odhiambo Washington via dovecot: > > > Is it possible? How do I do it for ALL mailboxes? > > This has been asked (and answered) recently; see the Dovecot Wiki. > > -Ralph > Could you kindly point me to the

Re: mdbox to Maildir

2019-06-17 Thread Ralph Seichter via dovecot
* Odhiambo Washington via dovecot: > Is it possible? How do I do it for ALL mailboxes? This has been asked (and answered) recently; see the Dovecot Wiki. -Ralph

mdbox to Maildir

2019-06-17 Thread Odhiambo Washington via dovecot
I'd like a way to convert all my mailboxes from mdbox to Maildir. Is it possible? How do I do it for ALL mailboxes? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

Re: [Dovecot] Migration to mdbox from Maildir, missing folders!

2012-02-11 Thread Timo Sirainen
On 10.2.2012, at 16.36, Giles Coochey wrote: So I went and migrated a mailbox from mdbox from maildir format. All seemed ok, but I've found that I now have some missing folders. The mailbox in maildir format had some folders which contained an '' sign, these appear to have been omitted

[Dovecot] Migration to mdbox from Maildir, missing folders!

2012-02-10 Thread Giles Coochey
So I went and migrated a mailbox from mdbox from maildir format. All seemed ok, but I've found that I now have some missing folders. The mailbox in maildir format had some folders which contained an '' sign, these appear to have been omitted... What can be done? (I have a backup

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Jan-Frode Myklebust
understanding how we will ever be able to make the transition. Too many files -- too many users.. How long did it take to convert from maildir to mdbox, how much downtime ? Do you have a clustered setup, or single node? I'm wondering how safe mdbox will be on a clusterfs (GPFS), as we've had a bit

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Javier Miguel Rodríguez
in another ESX. Regards Javier How long did it take to convert from maildir to mdbox, how much downtime ? Do you have a clustered setup, or single node? I'm wondering how safe mdbox will be on a clusterfs (GPFS), as we've had a bit of trouble with the index-files when they're accessed from

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Timo Sirainen
switching to mdbox, the backup time is under 12 hours ! Instead of backing 17 millions files, with mdbox our backup is only of 1 million files, and that speeds up a lot the backup operation. Hmm. I guess if you were doing backups 24h/day, then you can't really say how much faster mdbox performs than

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Javier de Miguel Rodríguez
Hello Hmm. I guess if you were doing backups 24h/day, then you can't really say how much faster mdbox performs than maildir (outside backups)? No, 24 hours is for a FULL backup in the weekend. An incremental backup is only 2-3 hours in the night every day. About performance... I

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Timo Sirainen
On 9.2.2011, at 0.28, Javier de Miguel Rodríguez wrote: Hello Hmm. I guess if you were doing backups 24h/day, then you can't really say how much faster mdbox performs than maildir (outside backups)? No, 24 hours is for a FULL backup in the weekend. An incremental backup is only 2-3

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Javier Miguel Rodríguez
So with mdbox disk I/O usage increased compared to maildir+ramdisk indexes? That is a tricky question to ask. It depends on usage, I think the following: - LDA delivery: load is a bit lower (on disk) in Maildir vs mdbox: in both cases the message has to be written, indexes

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Timo Sirainen
On 9.2.2011, at 9.21, Javier Miguel Rodríguez wrote: That is a tricky question to ask. It depends on usage, I think the following: - LDA delivery: load is a bit lower (on disk) in Maildir vs mdbox: in both cases the message has to be written, indexes are updated, in Maildir

Re: [Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-08 Thread Javier Miguel Rodríguez
The stats in the SAN after the change maildir-mdbox do not help, we have zlib enabled in lda imap with mdbox, so our # of real IOPs is lower than Maildir (we did not have zlib enabled) I wonder how large a write can be before it is split to two iops.. With NFS probably smaller I'd guess

[Dovecot] Great time savings backing a mdbox versus Maildir

2011-02-07 Thread Javier Miguel Rodríguez
Hello I am writing to this mailing list to thanks Timo for dovecot 2 mdbox. We have almost 30.000 active users and our life was sad with Maildir backup: 24 hours for a full backup with bacula (zlib enabled maildirs, 1.4 TB). After switching to mdbox, the backup time is under 12