questions for a unusual master/slave like mail-server setup

2015-12-20 Thread Christoph Anton Mitterer
Hey folks. I was planning since a long time for some more advanced mail server setup (described below), which basically has some weird ;) master/slave ideas behind. It's probably a bit more complicated (and maybe also a bit more insane) than the usual mail server setup, so I'd be happy about any a

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Sat, 2013-05-25 at 02:43 +0200, Christoph Anton Mitterer wrote: > And I may have found one further issue: > > I set: > separator = '\\' > maildir with _not_ using LAYOUT=fs > the list encode plugin is on > listescape_char is left to default > > >

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
And I may have found one further issue: I set: separator = '\\' maildir with _not_ using LAYOUT=fs the list encode plugin is on listescape_char is left to default When I now create a folder "foo.bar" it seemingly works (the client shows it as "a.a"), but what comes out is: .a.2ea how can this wo

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Sat, 2013-05-25 at 02:33 +0300, Timo Sirainen wrote: > > And the virtual separator cannot be used, regardless what one does... > > Is this just an IMAP issue or also a POP issue? > > > > And how are other unicode chars encoded in POP? I ask cause then I'd > > update the wiki a bit. > > POP3 ha

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Sat, 2013-05-25 at 02:12 +0300, Timo Sirainen wrote: > IMAP protocol requires that one character is reserved for being > hierarchy separator. There's no way around that. But with listescape > plugin you can use any other character. Okay... than IMAP really sucks in that matter ^^... why not allo

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Sat, 2013-05-25 at 01:19 +0300, Timo Sirainen wrote: > That is pretty much standard IMAP mUTF-7. Wonder why that's not > mentioned in there. > But yeah, looks like it also suggests encoding the '.' and '/' using > the mUTF-7 format. That is forbidden by IMAP. So having such names in > the maildi

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Fri, 2013-05-24 at 16:14 +0300, Timo Sirainen wrote: > There is no standard escaping. btw... When I create a folder with unicode chars ... e.g. via Evolution or TB.. then the maildirs created on the dovecot side use the encoding schema as described here http://www.courier-mta.org/maildir.html I

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Fri, 2013-05-24 at 06:57 -0400, Charles Marcus wrote: > And for some reason, the Parent folder is created as a folder that > cannot contain files, only folders. I think the reason for this is that the folder is not really created, i.e. when you create "folder.subfolder" with TB, Dovcote will cr

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
Well... I thought courier was defining maildir++ which we use an they also defined an escaping Cheers, Chris. Timo Sirainen schrieb: >On 24.5.2013, at 15.31, Christoph Anton Mitterer > wrote: > >> On Fri, 2013-05-24 at 08:32 +0200, Robert Schetterer wrote: >>>

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Fri, 2013-05-24 at 06:57 -0400, Charles Marcus wrote: > And for some reason, the Parent folder is created as a folder that > cannot contain files, only folders. I'll try that out.. > This is why I'll be implementing a different character for the separator > on my new box - something much les

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Fri, 2013-05-24 at 08:32 +0200, Robert Schetterer wrote: > http://wiki2.dovecot.org/Plugins/Listescape That sounds interesting... and I'll have a look at it.. but it also seems to use an standard-incompliant encoding (\NN)... might become a problem when one uses other tools on such maildirs (mai

Re: [Dovecot] . (dot) in maildir folder names

2013-05-24 Thread Christoph Anton Mitterer
On Thu, 2013-05-23 at 19:58 -0700, Darren Pilgrim wrote: > Does adding LAYOUT=fs to mail_location, which makes Dovecot use a dir > hierarchy instead of dot-prefixing, make this possible? I would expect that one then runs into the same troubles when using "/" in a foldername... Moreover one has the

Re: [Dovecot] . (dot) in maildir folder names

2013-05-23 Thread Christoph Anton Mitterer
Maybe the whole thing IS actually also a dovecot issue... When trying to create a folder with a dot with thunderbird (which doesn't simply forbid this)... it actually transmits the folder name to dovecote (e.g. "kernel.org")... but dovecot then literally takes this over and creates .kernel.org, i.e

[Dovecot] . (dot) in maildir folder names

2013-05-23 Thread Christoph Anton Mitterer
Hi. Uhm... yeah as the topic implies I want to have . (dots) in my folder names... Unfortunately dovecot's maildirmake hasn't a -f switch as the one from courier/maildrop, but that one in turn is buggy[0] and doesn't encode any characters at all. In principle, maildir++ should allow[1] having (en

Re: [Dovecot] should dovecot store maildir files with CRLF or LF?

2013-05-22 Thread Christoph Anton Mitterer
On Wed, 2013-05-22 at 20:06 +0300, Timo Sirainen wrote: > mail_save_crlf setting controls if mails are saved as CRLF or LF to storage. I see... hmm that seems to be missing from the documentation?! Can it be added? What values can it have? What exactly happens there? Any LF or CRLF converted to th

Re: [Dovecot] should dovecot store maildir files with CRLF or LF?

2013-05-21 Thread Christoph Anton Mitterer
On Wed, 2013-05-22 at 02:54 +0100, Ben Morrow wrote: > Mail sent by SMTP has to have CRLF line endings. (Unless you're using > BINARYMIME, but I don't think that's at all widely implemented yet.) If > your mailserver accepts LF-only line endings it ought to translate them > into CRLF before sending

[Dovecot] should dovecot store maildir files with CRLF or LF?

2013-05-21 Thread Christoph Anton Mitterer
Hi. I've made a strange observation. When having Dovecot (at least) with maildir and moving (via IMAP) mail received by some client (Evolution 3.4) into it the following happens: Regardless of whether the mail was originally(!) set with CRLF or LF (i.e. when I use netcat to submit the plain SMTP

Re: [Dovecot] mbox vs. maildir storage block waste

2012-11-11 Thread Christoph Anton Mitterer
On Thu, 2012-11-08 at 17:54 -0800, Robin wrote: > The performance is surprisingly bad ... doing almost everything. > Searches through IMAP, bulk importation of mail folders, large > numbers of simultaneous mail deliveries, you name it. Have you made systematic tests? I.e. compared times for all o

Re: [Dovecot] mbox vs. maildir storage block waste

2012-11-08 Thread Christoph Anton Mitterer
On Wed, 2012-11-07 at 17:30 +0200, Timo Sirainen wrote: > On 30.10.2012, at 2.16, Christoph Anton Mitterer wrote: > > Have you ever thought about adding a "real" DB backend? Nothing against > > dbox... :) ... and I have no performance comparison of dbox with what >

Re: [Dovecot] maildir and end-of-line encoding

2012-11-07 Thread Christoph Anton Mitterer
On Wed, 2012-11-07 at 17:33 +0200, Timo Sirainen wrote: > Dovecot automatically adds CRs where necessary. Even within the same file > there can be mixed LF/CRLF lines. Can you detail this a bit, or point me to the specific code areas? 1) Is only CR added? Or also LF? 2) What happens e.g. when LF

Re: [Dovecot] maildir S= and W=

2012-11-04 Thread Christoph Anton Mitterer
FYI: On Wed, 2012-10-31 at 15:09 +0100, Alessio Cecchi wrote: > Yes, W= is not set by maildrop I had some conversation with Sam (the maildrop upstream), who said he would accept a patch adding ,W= support to maildrop. He may even look at it himself, when he should ever find some time being very bo

Re: [Dovecot] maildir S= and W=

2012-10-31 Thread Christoph Anton Mitterer
On Wed, 2012-10-31 at 13:04 +0100, Alessio Cecchi wrote: > maildrop (2.4) Ah thanks... yeah I had an old version.. > add S= by > default. > http://www.inter7.com/courierimap/README.maildirquota.html AFAIU that... ,W= is however not set, right? :( thanks, Chris. smime.p7s Description: S/MIME

Re: [Dovecot] maildir S= and W=

2012-10-31 Thread Christoph Anton Mitterer
On Wed, 2012-10-31 at 08:20 +0100, Alessio Cecchi wrote: > The MDA should calculate and set this, dovecot always add these > informations, as you can see when upload file via IMAP. Ah thanks,... do you know whether it's possible to have them set by maildrop? I couldn't find anything on this. Ch

[Dovecot] maildir and end-of-line encoding

2012-10-30 Thread Christoph Anton Mitterer
Hi. I just wondered, the following: My MDA may get mails that use LF or CR/LF end of line encodings and deliver them into maildirs. I couldn't find any information about, whether one should or must convert all into one format, cause AFAIK at least on the IMAP side, CR/LF is always used? How d

[Dovecot] maildir S= and W=

2012-10-30 Thread Christoph Anton Mitterer
Hi. Even new mails delivered by my MDA don't get the ,S= and ,W= fields set... (but when I "upload" a mail via IMAP to dovecot, they are set) Is there some place in dovecot where I need to enable this? Or would it be the MDA that has to calculate and set this already when placing a file in ./new

Re: [Dovecot] mbox vs. maildir storage block waste

2012-10-30 Thread Christoph Anton Mitterer
On Tue, 2012-10-30 at 07:03 -0400, Charles Marcus wrote: > What makes the most sense for me is to use mbox (or mdbox) for longer > term storage that you may be offloading to slower storage systems, and > use maildir (or sdbox) for the new mails... Was also something I thought about... still the m

Re: [Dovecot] mbox vs. maildir storage block waste

2012-10-30 Thread Christoph Anton Mitterer
On Tue, 2012-10-30 at 07:00 -0400, Charles Marcus wrote: > So... what are the disadvantages? I (but I'm no expert) would guess that it's a dovecot-only format. No support from most other tools,... I'd guess you cannot use e.g. maildrop with it, or can you? I personally was always a bit worried,

Re: [Dovecot] mbox2mdir... what about UIDs/etc? (was: how to best import Evolution/Thunderbird mail into dovecot?)

2012-10-29 Thread Christoph Anton Mitterer
Hi again :) In the meantime I made some checks[0] on how much storage one looses by using maildir (compared to mbox)... and decided that it's much but I can live with it. This of course doesn't solve my problems that I have a possibly a mix of different mbox subformats, a mix of different mail st

Re: [Dovecot] mbox vs. maildir storage block waste

2012-10-29 Thread Christoph Anton Mitterer
On Tue, 2012-10-30 at 00:05 +0200, Timo Sirainen wrote: > > And I guess the interior of the files is the same? I.e. just the plain > > mail without any changes or quoting? > Yes, but it's in dbox format so it contains also some extra metadata (not in > the mail headers). Yeah of course... but the

Re: [Dovecot] does dovecot interpret any mail headers specially with maildir?

2012-10-29 Thread Christoph Anton Mitterer
Please have a look at: http://master.wiki2.dovecot.org/MailboxFormat/mbox?action=diff&rev2=17&rev1=16 http://master.wiki2.dovecot.org/MailboxFormat/Maildir?action=diff&rev2=45&rev1=44 whether it's correct. Oh and... I'd assume that everything I've added for maildir also applies to the dbox forma

Re: [Dovecot] POLL: v2.2 to allow one mail over quota?

2012-10-29 Thread Christoph Anton Mitterer
I think it should be configurable by how much (either a fixed space or relative to the quota) the last mail may be larger than the quota but then... +1 as well :) Cheers, Chris. smime.p7s Description: S/MIME cryptographic signature

Re: [Dovecot] does dovecot interpret any mail headers specially with maildir?

2012-10-29 Thread Christoph Anton Mitterer
On Tue, 2012-10-30 at 00:08 +0200, Timo Sirainen wrote: > > Great... I think it would worth adding all this to: > > http://wiki2.dovecot.org/MailboxFormat/Maildir > > Well, that isn't really maildir-specific. It's pop3 specific that is > done with all mailbox formats. pop3_reuse_xuidl setting's co

Re: [Dovecot] mbox vs. maildir storage block waste

2012-10-29 Thread Christoph Anton Mitterer
On Mon, 2012-10-29 at 23:42 +0200, Timo Sirainen wrote: > > btw: What are the actual advantages of sdbox over maildir? > > * Not moving files from new/ to cur/ directory > * Not renaming files when changing message flags > * Not readdir()ing directories (although maildir_very_dirty_syncs=yes he

Re: [Dovecot] does dovecot interpret any mail headers specially with maildir?

2012-10-29 Thread Christoph Anton Mitterer
On Mon, 2012-10-29 at 23:39 +0200, Timo Sirainen wrote: > Right. The only special case is X-UIDL: header, which is used for POP3 UIDLs > but only if pop3_reuse_xuidl=yes (which isn't really recommended nowadays as > there are other ways to do it). Great... I think it would worth adding all this

Re: [Dovecot] does dovecot interpret any mail headers specially with maildir?

2012-10-29 Thread Christoph Anton Mitterer
On Mon, 2012-10-29 at 23:13 +0200, Timo Sirainen wrote: > > Great... and I expect that this ("no headers from the maildir files > are > > interpreted") applies also, when one "imports" mails the first time. > > > > With import I don't mean via IMAP, but plainly moving e.g. a maildir > ++ > > tree

Re: [Dovecot] mbox vs. maildir storage block waste

2012-10-29 Thread Christoph Anton Mitterer
On Mon, 2012-10-29 at 23:06 +0200, Timo Sirainen wrote: > There is of course mdbox also, which gives the best of both mbox and maildir > (and some of its own new annoyances). Thanks, Timo,... I forgot to mention that. For me _personally_ two things speak against using it: a) To be honest, "you m

Re: [Dovecot] does dovecot interpret any mail headers specially with maildir?

2012-10-29 Thread Christoph Anton Mitterer
Hi Timo. On Mon, 2012-10-29 at 22:40 +0200, Timo Sirainen wrote: > > I wondered, when using maildir, are there any headers that dovecote > > would treat specially, too? > > And which I therefore should strip? > > No. Maildir metadata is stored elsewhere. Great... and I expect that this ("no head

[Dovecot] mbox vs. maildir storage block waste

2012-10-29 Thread Christoph Anton Mitterer
Hi. I recently mentioned in several posts, that I'd tended to use mbox rather than maildir, because you don't loose so much space (due to always allocating full blocks per maildir file and thus per mail). I made some tests of my archive, which consists of some 3,4 million mails at a total of 42G

[Dovecot] does dovecot interpret any mail headers specially with maildir?

2012-10-29 Thread Christoph Anton Mitterer
Hi. For mbox, http://wiki2.dovecot.org/MailboxFormat/mbox#Dovecot.27s_Metadata lists a numer of mail headers: - X-IMAPbase - X-IMAP - X-UID - Status - X-Status - X-Keywords - Content-Length that are treated specially by dovecot. It also suggests, that these should be stripped by the LDA (I guess

Re: [Dovecot] how to best import Evolution/Thunderbird mail into dovecot?

2012-10-18 Thread Christoph Anton Mitterer
On Thu, 2012-10-18 at 14:34 +0200, Dennis Guhl wrote: > [move through Evolution to IMAP] Seriously... I can just suggest anyone to never trust this piece of crap ;) Don't know which daemons led me to using it... > I think, like Rob suggested, you are in need of some serious > scripting. Yeah... g

Re: [Dovecot] how to best import Evolution/Thunderbird mail into dovecot?

2012-10-18 Thread Christoph Anton Mitterer
Hi Rick and Robert. Thanks for the tools... I'll have a look over them. :) On Wed, 2012-10-17 at 15:53 +, Rick Sanders wrote: > Your best bet for a clean migration is to use an IMAP migration tool (assuming > both of your servers support IMAP). It avoids all of the issues surrounding > the

Re: [Dovecot] how to best import Evolution/Thunderbird mail into dovecot?

2012-10-17 Thread Christoph Anton Mitterer
On Wed, 2012-10-17 at 13:12 -0500, /dev/rob0 wrote: > > Well as I've mentioned... on looses the info in the From_ lines > > (that is the RCPT TO address and the date of arrival) because > > Evolution does not correctly migrated them (actually I'm not sure > > whether IMAP would allow that). > Pe

Re: [Dovecot] how to best import Evolution/Thunderbird mail into dovecot?

2012-10-17 Thread Christoph Anton Mitterer
On Wed, 2012-10-17 at 16:51 +0200, Dennis Guhl wrote: > > First thing I tried was to simply copy mail within Evolution (i.e. > > dragging&dropping it from the local folders to the IMAP folders from > > dovecot). > This seems to be the smartest idea. Well as I've mentioned... on looses the info in t

Re: [Dovecot] how to best import Evolution/Thunderbird mail into dovecot?

2012-10-16 Thread Christoph Anton Mitterer
Hi again... Things are even much much worse... (oh how I hate Evolution right now). I found a bug in Evolution, where it apparently corrupts all mail by incorrectly (not) quoting From_ lines in headers/bodies... It quotes lines matching "^From (.*)$" as ">From \1" but it does not quote at all al

[Dovecot] how to best import Evolution/Thunderbird mail into dovecot?

2012-10-16 Thread Christoph Anton Mitterer
Hi. I'm migrating all my mail archive (some 60 GB) from Evolution (which is really a broken piece of software) into dovecot. Now I face the problem how to do this best... Evolution (which is still a old 2.32.x version) itself uses mbox files, in a special hierarchical structure to allow subfolde

Re: [Dovecot] some questions on AOX or rather a mail system setup

2012-10-11 Thread Christoph Anton Mitterer
Hi. Sorry folks for the stupid postings... At first I posted what should go to the AOX list accidentally here and then our institute's MTA hat some issues yesterday, so the mail[0] where I already tried to explain the wrong posting, came much earlier than the wrong post itself. Guess you see why

[Dovecot] some questions on AOX or rather a mail system setup

2012-10-11 Thread Christoph Anton Mitterer
Hi folks. Perhaps you find some time to look into this,... I'm trying to plan my mail system and would have some questions. The overall idea is about the following: - There is a (internet) server, which is the MTA (which will be postfix) and imap and/or pop3 server (which shall be, guess, dove

Re: [Dovecot] some questions on AOX or rather a mail system setup (ignore)

2012-10-11 Thread Christoph Anton Mitterer
Oops... that was obivously not intended for dovecot but AOX mailing list,... where I ask around similar questions. Sorry for the noise =) Cheers, Chris. smime.p7s Description: S/MIME cryptographic signature

[Dovecot] some questions on dovecot or rather a mail system setup

2012-10-08 Thread Christoph Anton Mitterer
Hi folks. Perhaps you find some time to look into this,... if you think I should better direct this do some dovecot mailing list,.. just tell :) I'm trying to plan my mail system and would have some questions. The overall idea is about the following: - There is a (internet) server, which is th