Re: [Dovecot] mdbox-files over 2 MB

2014-10-01 Thread Jesus Cea
I keep the quoted message complete because the original thread was
posted six months ago. I am top-posting, no comments inside the quoted text.

I plan to write a blog about mdbox oddities but in the meantime I can
tell you that if you store attachments detached in your mdbox storage
the issue is this:

1. You have a 200Kbytes MB m.* file you are currently targeting.

2. You have a new email to store. Lets say it has a 3MB attachment.

3. You have a 2MB mdbox max file size .

4. Dovecot notices that 0.2+3  2, so it will create a new m.* file.

5. When storing the message, it will store the attachment outside of the
mbox, so the new m.* file will be, lets say, 5Kbytes only.

6. Now you have 2 m.* files: one of 200 Kbytes and other of 5Kbytes.

7. Dovecot tries to reuse undersized m.* files, but it is quite
forgiving. I have some private patches to increase its agressiveness.

If you don't detach attachment, you probably have the same issue: when a
new message makes a m.* file to oversize, dovecot creates a new m.* file
and leave the old one alone, so it will be undersized.



On 06/05/14 03:05, Stan Hoeppner wrote:
 On 5/5/2014 2:23 PM, Patrick Domack wrote:
 Quoting Reindl Harald h.rei...@thelounge.net:

 Am 05.05.2014 16:10, schrieb Hardy Flor:
 Is there really no one with this problem?

 next time quote the problem instead demand
 others to seek for you in the archives

 Even searching for him in the archives, I have no idea what he thinks is
 a problem.

 I know I have no issues using mdbox, with 2mb or 50mb rotate sizes.
 
 
 He's wondering why many of his mdbox files are much smaller than 2 MB.
 His original post:
 
 
 On 3/17/2014 1:29 AM, Hardy Flor wrote:
 Hello,

 there are copies with different size in 3 mailboxes of the user
 sequentially about 3800 emails.
 why not something 2MB files?

 After the big file m.0034 with 14MB follow very many small ...

 - doveconf:

 # 2.2.12: /etc/dovecot/dovecot.conf
 # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4
 mail_attachment_dir = /var/mail/attachments
 mail_attachment_hash = %{md5}
 mail_attachment_min_size = 16 k
 mail_location = mdbox:/var/mail/user/%n
 mdbox_rotate_interval = 1 weeks
 mdbox_rotate_size = 2 M

 - directory:

 root@xxx:/var/mail/user/xxx/storage# ls -al
 insgesamt 76532
 drwx--S--- 2 vmail mail 4096 Mär 16 13:52 .
 drwx--S--- 6 vmail mail 4096 Mär 16 12:10 ..
 -rw--- 1 vmail mail74360 Mär 16 12:39 dovecot.map.index
 -rw--- 1 vmail mail25204 Mär 16 13:52 dovecot.map.index.log
 -rw--- 1 vmail mail63544 Mär 16 12:39 dovecot.map.index.log.2
 -rw--- 1 vmail mail  2092921 Mär 16 12:15 m.0001
 -rw--- 1 vmail mail  2086746 Mär 16 12:15 m.0002
 -rw--- 1 vmail mail  2084182 Mär 16 12:15 m.0003
 -rw--- 1 vmail mail  2096826 Mär 16 12:15 m.0004
 -rw--- 1 vmail mail  1882666 Mär 16 12:15 m.0005
 -rw--- 1 vmail mail  1903965 Mär 16 12:15 m.0006
 -rw--- 1 vmail mail  2091169 Mär 16 12:15 m.0007
 -rw--- 1 vmail mail  2086396 Mär 16 12:15 m.0008
 -rw--- 1 vmail mail   507205 Mär 16 12:16 m.0009
 -rw--- 1 vmail mail  2031456 Mär 16 12:17 m.0010
 -rw--- 1 vmail mail  2095697 Mär 16 12:17 m.0011
 -rw--- 1 vmail mail  1689071 Mär 16 12:17 m.0012
 -rw--- 1 vmail mail  2092124 Mär 16 12:17 m.0013
 -rw--- 1 vmail mail  1950602 Mär 16 12:17 m.0014
 -rw--- 1 vmail mail  2092215 Mär 16 12:17 m.0015
 -rw--- 1 vmail mail  2087463 Mär 16 12:17 m.0016
 -rw--- 1 vmail mail  2079795 Mär 16 12:17 m.0017
 -rw--- 1 vmail mail  2014121 Mär 16 12:17 m.0018
 -rw--- 1 vmail mail  2081893 Mär 16 12:17 m.0019
 -rw--- 1 vmail mail  2092088 Mär 16 12:17 m.0020
 -rw--- 1 vmail mail  2090508 Mär 16 12:17 m.0021
 -rw--- 1 vmail mail  1929296 Mär 16 12:17 m.0022
 -rw--- 1 vmail mail  2067685 Mär 16 12:17 m.0023
 -rw--- 1 vmail mail  1745743 Mär 16 12:20 m.0024
 -rw--- 1 vmail mail   866452 Mär 16 12:20 m.0025
 -rw--- 1 vmail mail   296379 Mär 16 12:20 m.0026
 -rw--- 1 vmail mail   433541 Mär 16 12:39 m.0027
 -rw--- 1 vmail mail92526 Mär 16 12:39 m.0028
 -rw--- 1 vmail mail19094 Mär 16 12:39 m.0029
 -rw--- 1 vmail mail   106837 Mär 16 12:39 m.0030
 -rw--- 1 vmail mail   162012 Mär 16 12:39 m.0031
 -rw--- 1 vmail mail   412080 Mär 16 13:51 m.0032
 -rw--- 1 vmail mail  1715868 Mär 16 13:51 m.0033
 -rw--- 1 vmail mail 14433784 Mär 16 13:51 m.0034
 -rw--- 1 vmail mail 3280 Mär 16 13:51 m.0035
 -rw--- 1 vmail mail 6308 Mär 16 13:51 m.0036
 -rw--- 1 vmail mail   534274 Mär 16 13:51 m.0037
 -rw--- 1 vmail mail   378719 Mär 16 13:51 m.0038
 -rw--- 1 vmail mail   458528 Mär 16 13:51 m.0039
 -rw--- 1 vmail mail   192504 Mär 16 13:51 m.0040
 -rw--- 1 

Re: [Dovecot] mdbox-files over 2 MB

2014-07-12 Thread Hardy Flor

Am 17.03.2014 07:38, schrieb Hardy Flor:

Hello,

I received an e-mail, this includes 9 forwarding, each with a file. 
These files are not removed from the e-mail and stored in the 
attachments-directory, although they are larger than 16 KB. For all 
files the Content-Transfer-Encoding: base64 is set.

The email is stored in completely in m.0034

- doveconf:

# 2.2.12: /etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4
mail_attachment_dir = /var/mail/attachments
mail_attachment_hash = %{md5}
mail_attachment_min_size = 16 k
mail_location = mdbox:/var/mail/user/%n
mdbox_rotate_interval = 1 weeks
mdbox_rotate_size = 2 M

- directory:

root@xxx:/var/mail/user/xxx/storage# ls -al
...
-rw--- 1 vmail mail 14433784 Mär 16 13:51 m.0034
...
Has this really not a solution? I've found some e-mails where the 
attachments are not stored separately.


Re: [Dovecot] mdbox-files over 2 MB

2014-05-05 Thread Hardy Flor

Is there really no one with this problem?


Re: [Dovecot] mdbox-files over 2 MB

2014-05-05 Thread Reindl Harald

Am 05.05.2014 16:10, schrieb Hardy Flor:
 Is there really no one with this problem?

next time quote the problem instead demand
others to seek for you in the archives



signature.asc
Description: OpenPGP digital signature