Re: [Dovecot] mdbox-files over 2 MB
I keep the quoted message complete because the original thread was
posted six months ago. I am top-posting, no comments inside the quoted text.
I plan to write a blog about mdbox oddities but in the meantime I can
tell you that if you store attachments "detached" in your mdbox storage
the issue is this:
1. You have a 200Kbytes MB m.* file you are currently targeting.
2. You have a new email to store. Lets say it has a 3MB attachment.
3. You have a 2MB mdbox max file size .
4. Dovecot notices that 0.2+3 > 2, so it will create a new m.* file.
5. When storing the message, it will store the attachment outside of the
mbox, so the new m.* file will be, lets say, 5Kbytes only.
6. Now you have 2 m.* files: one of 200 Kbytes and other of 5Kbytes.
7. Dovecot tries to reuse undersized m.* files, but it is quite
forgiving. I have some private patches to increase its agressiveness.
If you don't detach attachment, you probably have the same issue: when a
new message makes a m.* file to oversize, dovecot creates a new m.* file
and leave the old one alone, so it will be undersized.
On 06/05/14 03:05, Stan Hoeppner wrote:
> On 5/5/2014 2:23 PM, Patrick Domack wrote:
>> Quoting Reindl Harald :
>>
>>> Am 05.05.2014 16:10, schrieb Hardy Flor:
Is there really no one with this problem?
>>>
>>> next time quote the problem instead demand
>>> others to seek for you in the archives
>>
>> Even searching for him in the archives, I have no idea what he thinks is
>> a problem.
>>
>> I know I have no issues using mdbox, with 2mb or 50mb rotate sizes.
>
>
> He's wondering why many of his mdbox files are much smaller than 2 MB.
> His original post:
>
>
> On 3/17/2014 1:29 AM, Hardy Flor wrote:
>> Hello,
>>
>> there are copies with different size in 3 mailboxes of the user
>> sequentially about 3800 emails.
>> why not something 2MB files?
>>
>> After the big file "m.0034" with 14MB follow very many small ...
>>
>> - doveconf:
>>
>> # 2.2.12: /etc/dovecot/dovecot.conf
>> # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4
>> mail_attachment_dir = /var/mail/attachments
>> mail_attachment_hash = %{md5}
>> mail_attachment_min_size = 16 k
>> mail_location = mdbox:/var/mail/user/%n
>> mdbox_rotate_interval = 1 weeks
>> mdbox_rotate_size = 2 M
>>
>> - directory:
>>
>> root@xxx:/var/mail/user/xxx/storage# ls -al
>> insgesamt 76532
>> drwx--S--- 2 vmail mail 4096 Mär 16 13:52 .
>> drwx--S--- 6 vmail mail 4096 Mär 16 12:10 ..
>> -rw--- 1 vmail mail74360 Mär 16 12:39 dovecot.map.index
>> -rw--- 1 vmail mail25204 Mär 16 13:52 dovecot.map.index.log
>> -rw--- 1 vmail mail63544 Mär 16 12:39 dovecot.map.index.log.2
>> -rw--- 1 vmail mail 2092921 Mär 16 12:15 m.0001
>> -rw--- 1 vmail mail 2086746 Mär 16 12:15 m.0002
>> -rw--- 1 vmail mail 2084182 Mär 16 12:15 m.0003
>> -rw--- 1 vmail mail 2096826 Mär 16 12:15 m.0004
>> -rw--- 1 vmail mail 1882666 Mär 16 12:15 m.0005
>> -rw--- 1 vmail mail 1903965 Mär 16 12:15 m.0006
>> -rw--- 1 vmail mail 2091169 Mär 16 12:15 m.0007
>> -rw--- 1 vmail mail 2086396 Mär 16 12:15 m.0008
>> -rw--- 1 vmail mail 507205 Mär 16 12:16 m.0009
>> -rw--- 1 vmail mail 2031456 Mär 16 12:17 m.0010
>> -rw--- 1 vmail mail 2095697 Mär 16 12:17 m.0011
>> -rw--- 1 vmail mail 1689071 Mär 16 12:17 m.0012
>> -rw--- 1 vmail mail 2092124 Mär 16 12:17 m.0013
>> -rw--- 1 vmail mail 1950602 Mär 16 12:17 m.0014
>> -rw--- 1 vmail mail 2092215 Mär 16 12:17 m.0015
>> -rw--- 1 vmail mail 2087463 Mär 16 12:17 m.0016
>> -rw--- 1 vmail mail 2079795 Mär 16 12:17 m.0017
>> -rw--- 1 vmail mail 2014121 Mär 16 12:17 m.0018
>> -rw--- 1 vmail mail 2081893 Mär 16 12:17 m.0019
>> -rw--- 1 vmail mail 2092088 Mär 16 12:17 m.0020
>> -rw--- 1 vmail mail 2090508 Mär 16 12:17 m.0021
>> -rw--- 1 vmail mail 1929296 Mär 16 12:17 m.0022
>> -rw--- 1 vmail mail 2067685 Mär 16 12:17 m.0023
>> -rw--- 1 vmail mail 1745743 Mär 16 12:20 m.0024
>> -rw--- 1 vmail mail 866452 Mär 16 12:20 m.0025
>> -rw--- 1 vmail mail 296379 Mär 16 12:20 m.0026
>> -rw--- 1 vmail mail 433541 Mär 16 12:39 m.0027
>> -rw--- 1 vmail mail92526 Mär 16 12:39 m.0028
>> -rw--- 1 vmail mail19094 Mär 16 12:39 m.0029
>> -rw--- 1 vmail mail 106837 Mär 16 12:39 m.0030
>> -rw--- 1 vmail mail 162012 Mär 16 12:39 m.0031
>> -rw--- 1 vmail mail 412080 Mär 16 13:51 m.0032
>> -rw--- 1 vmail mail 1715868 Mär 16 13:51 m.0033
>> -rw--- 1 vmail mail 14433784 Mär 16 13:51 m.0034
>> -rw--- 1 vmail mail 3280 Mär 16 13:51 m.0035
>> -rw--- 1 vmail mail 6308 Mär 16 13:51 m.0036
>> -rw--- 1 vmail mail 534274 Mär 16 13:51 m.0037
>> -rw--- 1 vmail mail 378719 Mär
Re: [Dovecot] mdbox-files over 2 MB
Am 17.03.2014 07:38, schrieb Hardy Flor:
Hello,
I received an e-mail, this includes 9 forwarding, each with a file.
These files are not removed from the e-mail and stored in the
attachments-directory, although they are larger than 16 KB. For all
files the "Content-Transfer-Encoding: base64" is set.
The email is stored in completely in "m.0034"
- doveconf:
# 2.2.12: /etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4
mail_attachment_dir = /var/mail/attachments
mail_attachment_hash = %{md5}
mail_attachment_min_size = 16 k
mail_location = mdbox:/var/mail/user/%n
mdbox_rotate_interval = 1 weeks
mdbox_rotate_size = 2 M
- directory:
root@xxx:/var/mail/user/xxx/storage# ls -al
...
-rw--- 1 vmail mail 14433784 Mär 16 13:51 m.0034
...
Has this really not a solution? I've found some e-mails where the
attachments are not stored separately.
Re: [Dovecot] mdbox-files over 2 MB
On May 6, 2014, at 5:17 AM, Hardy Flor wrote: > Sorry, I thought the tree display of threads is sufficient. I did not want to > quote much. Believe it or not, not all of us save every message or have the same MUA capabilities. Don’t assume how you read is the same way everyone does. Sometimes, what starts as something uninteresting and deleted immediately turns interesting. Therefore, quoting the relevant text from previous message is needed. -- Larry Stone lston...@stonejongleux.com http://www.stonejongleux.com/ smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] mdbox-files over 2 MB
Sorry, I thought the tree display of threads is sufficient. I did not want to quote much. Am 05.05.2014 16:16, schrieb Reindl Harald: Am 05.05.2014 16:10, schrieb Hardy Flor: Is there really no one with this problem? next time quote the problem instead demand others to seek for you in the archives
Re: [Dovecot] mdbox-files over 2 MB
On 5/5/2014 2:23 PM, Patrick Domack wrote:
> Quoting Reindl Harald :
>
>> Am 05.05.2014 16:10, schrieb Hardy Flor:
>>> Is there really no one with this problem?
>>
>> next time quote the problem instead demand
>> others to seek for you in the archives
>
> Even searching for him in the archives, I have no idea what he thinks is
> a problem.
>
> I know I have no issues using mdbox, with 2mb or 50mb rotate sizes.
He's wondering why many of his mdbox files are much smaller than 2 MB.
His original post:
On 3/17/2014 1:29 AM, Hardy Flor wrote:
> Hello,
>
> there are copies with different size in 3 mailboxes of the user
> sequentially about 3800 emails.
> why not something 2MB files?
>
> After the big file "m.0034" with 14MB follow very many small ...
>
> - doveconf:
>
> # 2.2.12: /etc/dovecot/dovecot.conf
> # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4
> mail_attachment_dir = /var/mail/attachments
> mail_attachment_hash = %{md5}
> mail_attachment_min_size = 16 k
> mail_location = mdbox:/var/mail/user/%n
> mdbox_rotate_interval = 1 weeks
> mdbox_rotate_size = 2 M
>
> - directory:
>
> root@xxx:/var/mail/user/xxx/storage# ls -al
> insgesamt 76532
> drwx--S--- 2 vmail mail 4096 Mär 16 13:52 .
> drwx--S--- 6 vmail mail 4096 Mär 16 12:10 ..
> -rw--- 1 vmail mail74360 Mär 16 12:39 dovecot.map.index
> -rw--- 1 vmail mail25204 Mär 16 13:52 dovecot.map.index.log
> -rw--- 1 vmail mail63544 Mär 16 12:39 dovecot.map.index.log.2
> -rw--- 1 vmail mail 2092921 Mär 16 12:15 m.0001
> -rw--- 1 vmail mail 2086746 Mär 16 12:15 m.0002
> -rw--- 1 vmail mail 2084182 Mär 16 12:15 m.0003
> -rw--- 1 vmail mail 2096826 Mär 16 12:15 m.0004
> -rw--- 1 vmail mail 1882666 Mär 16 12:15 m.0005
> -rw--- 1 vmail mail 1903965 Mär 16 12:15 m.0006
> -rw--- 1 vmail mail 2091169 Mär 16 12:15 m.0007
> -rw--- 1 vmail mail 2086396 Mär 16 12:15 m.0008
> -rw--- 1 vmail mail 507205 Mär 16 12:16 m.0009
> -rw--- 1 vmail mail 2031456 Mär 16 12:17 m.0010
> -rw--- 1 vmail mail 2095697 Mär 16 12:17 m.0011
> -rw--- 1 vmail mail 1689071 Mär 16 12:17 m.0012
> -rw--- 1 vmail mail 2092124 Mär 16 12:17 m.0013
> -rw--- 1 vmail mail 1950602 Mär 16 12:17 m.0014
> -rw--- 1 vmail mail 2092215 Mär 16 12:17 m.0015
> -rw--- 1 vmail mail 2087463 Mär 16 12:17 m.0016
> -rw--- 1 vmail mail 2079795 Mär 16 12:17 m.0017
> -rw--- 1 vmail mail 2014121 Mär 16 12:17 m.0018
> -rw--- 1 vmail mail 2081893 Mär 16 12:17 m.0019
> -rw--- 1 vmail mail 2092088 Mär 16 12:17 m.0020
> -rw--- 1 vmail mail 2090508 Mär 16 12:17 m.0021
> -rw--- 1 vmail mail 1929296 Mär 16 12:17 m.0022
> -rw--- 1 vmail mail 2067685 Mär 16 12:17 m.0023
> -rw--- 1 vmail mail 1745743 Mär 16 12:20 m.0024
> -rw--- 1 vmail mail 866452 Mär 16 12:20 m.0025
> -rw--- 1 vmail mail 296379 Mär 16 12:20 m.0026
> -rw--- 1 vmail mail 433541 Mär 16 12:39 m.0027
> -rw--- 1 vmail mail92526 Mär 16 12:39 m.0028
> -rw--- 1 vmail mail19094 Mär 16 12:39 m.0029
> -rw--- 1 vmail mail 106837 Mär 16 12:39 m.0030
> -rw--- 1 vmail mail 162012 Mär 16 12:39 m.0031
> -rw--- 1 vmail mail 412080 Mär 16 13:51 m.0032
> -rw--- 1 vmail mail 1715868 Mär 16 13:51 m.0033
> -rw--- 1 vmail mail 14433784 Mär 16 13:51 m.0034
> -rw--- 1 vmail mail 3280 Mär 16 13:51 m.0035
> -rw--- 1 vmail mail 6308 Mär 16 13:51 m.0036
> -rw--- 1 vmail mail 534274 Mär 16 13:51 m.0037
> -rw--- 1 vmail mail 378719 Mär 16 13:51 m.0038
> -rw--- 1 vmail mail 458528 Mär 16 13:51 m.0039
> -rw--- 1 vmail mail 192504 Mär 16 13:51 m.0040
> -rw--- 1 vmail mail 1277766 Mär 16 13:51 m.0041
> -rw--- 1 vmail mail33417 Mär 16 13:51 m.0042
> -rw--- 1 vmail mail 142866 Mär 16 13:51 m.0043
> -rw--- 1 vmail mail 113529 Mär 16 13:51 m.0044
> -rw--- 1 vmail mail55888 Mär 16 13:51 m.0045
> -rw--- 1 vmail mail 673504 Mär 16 13:51 m.0046
> -rw--- 1 vmail mail 430738 Mär 16 13:51 m.0047
> -rw--- 1 vmail mail 218494 Mär 16 13:51 m.0048
> -rw--- 1 vmail mail96165 Mär 16 13:51 m.0049
> -rw--- 1 vmail mail 8370 Mär 16 13:51 m.0050
> -rw--- 1 vmail mail29251 Mär 16 13:51 m.0051
> -rw--- 1 vmail mail 394680 Mär 16 13:51 m.0052
> -rw--- 1 vmail mail 674892 Mär 16 13:51 m.0053
> -rw--- 1 vmail mail 1076919 Mär 16 13:51 m.0054
> -rw--- 1 vmail mail 258806 Mär 16 13:51 m.0055
> -rw--- 1 vmail mail60069 Mär 16 13:51 m.0056
> -rw--- 1 vmail mail 297891 Mär 16 13:51 m.0057
> -rw--- 1 vmail mail92772 Mär 16 13:51 m.0058
> -rw--- 1 vmail mail
Re: [Dovecot] mdbox-files over 2 MB
Quoting Reindl Harald : Am 05.05.2014 16:10, schrieb Hardy Flor: Is there really no one with this problem? next time quote the problem instead demand others to seek for you in the archives Even searching for him in the archives, I have no idea what he thinks is a problem. I know I have no issues using mdbox, with 2mb or 50mb rotate sizes.
Re: [Dovecot] mdbox-files over 2 MB
Am 05.05.2014 16:10, schrieb Hardy Flor: > Is there really no one with this problem? next time quote the problem instead demand others to seek for you in the archives signature.asc Description: OpenPGP digital signature
Re: [Dovecot] mdbox-files over 2 MB
Is there really no one with this problem?
[Dovecot] mdbox-files over 2 MB
Hello,
I received an e-mail, this includes 9 forwarding, each with a file.
These files are not removed from the e-mail and stored in the
attachments-directory, although they are larger than 16 KB. For all
files the "Content-Transfer-Encoding: base64" is set.
The email is stored in completely in "m.0034"
- doveconf:
# 2.2.12: /etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.4 ext4
mail_attachment_dir = /var/mail/attachments
mail_attachment_hash = %{md5}
mail_attachment_min_size = 16 k
mail_location = mdbox:/var/mail/user/%n
mdbox_rotate_interval = 1 weeks
mdbox_rotate_size = 2 M
- directory:
root@xxx:/var/mail/user/xxx/storage# ls -al
...
-rw--- 1 vmail mail 14433784 Mär 16 13:51 m.0034
...
