Re: [Dovecot] Make a whole mailbox read-only
Thanks for the hint for the first 2 points of the howto are false on our system: * we use docevot 2 * we have mailbox in maildir format Regards, Sandro On 07/12/2012 11:04 AM, Robert Schetterer wrote: Am 12.07.2012 10:05, schrieb Sandro Tosi: Could someone please give it a look? Timo? :) perhaps try ideas from http://wiki2.dovecot.org/HowTo/ReadOnlyArchive?highlight=%28read%29|%28only%29 Cheers, Sandro On 07/10/2012 05:54 PM, Sandro Tosi wrote: Hello, i've found an old thread [1] where it was stated that a whole mailbox can be made read-only only setting the according permissions on the filesystem side. [1] http://www.mailinglistarchive.com/html/dovecot@dovecot.org/2011-12/msg00300.html i'd like to check if it's still the only option we have with dovecot v2.0.18 . Regards, -- Sandro Tosi Product Engineer Shared Hosting Products RD | Dada.pro eml sandro.t...@register.it
Re: [Dovecot] Make a whole mailbox read-only
Am 13.07.2012 08:46, schrieb Sandro Tosi: Thanks for the hint for the first 2 points of the howto are false on our system: * we use docevot 2 * we have mailbox in maildir format i wrote about ,take ideas, from there, for sure you have to fit stuff to your needs ,ever Regards, Sandro On 07/12/2012 11:04 AM, Robert Schetterer wrote: Am 12.07.2012 10:05, schrieb Sandro Tosi: Could someone please give it a look? Timo? :) perhaps try ideas from http://wiki2.dovecot.org/HowTo/ReadOnlyArchive?highlight=%28read%29|%28only%29 Cheers, Sandro On 07/10/2012 05:54 PM, Sandro Tosi wrote: Hello, i've found an old thread [1] where it was stated that a whole mailbox can be made read-only only setting the according permissions on the filesystem side. [1] http://www.mailinglistarchive.com/html/dovecot@dovecot.org/2011-12/msg00300.html i'd like to check if it's still the only option we have with dovecot v2.0.18 . Regards, -- Best Regards MfG Robert Schetterer
Re: [Dovecot] ot: execute a script via email?
On 07/13/2012 03:42 AM, Ken Anderson wrote: Voytek Eymont voy...@sbt.net.au wrote: anyone has any tips what's best way to execute a script via email ? I have a wget script that fetches some pages, and, emails me the output, there is no paramters passed, it's all in the script I'll like to email in and action the script to get the results email -- Voytek Old school - in /etc/aliases you can set: user |/home/user/script And read the mail from stdin. Ken There is available dovecot specific sieve extension (vnd.dovecot.pipe http://hg.rename-it.nl/pigeonhole-0.3-sieve-extprograms/raw-file/tip/doc/rfc/spec-bosch-sieve-extprograms.txt) to pipe messages to a pre-defined set of external programs. http://wiki2.dovecot.org/Pigeonhole/Sieve
[Dovecot] Difference between proxy_refresh and proxy_timeout in director
Hello, I know proxy_timeout is the timeout for the director operation. But what is the purpose for proxy_refresh? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica_(___V Tfo: 868887590 Fax: 86337
Re: [Dovecot] Maildir messages
specifically from a filesystem IO perspective: 1. new mail delivery not much difference. 2. searching a mailbox folder if you do linear search then yes 3. mass deletion of emails from one mailbox folder 3 is not true. maildir is more IO efficient when reading and deleting individual emails. and making backups. deleting from maildir means just delete a file, not shuffle data. Everyone needs to make backups while it is unlinkely that anyone like every backup to be effectively full backup. mbox puts the load on the mail server application and on memory. and on I/O too - often quite a bit maildir puts the load on the IO subsysetem. Which is precisely why Timo created the mdbox mail storage format, attempting to get the best of both worlds. And this is great idea and actually works :) mbox may make sense for archive storage. you create archive folder once and never modify anything
Re: [Dovecot] ot: execute a script via email?
anyone has any tips what's best way to execute a script via email ? use procmail - it's easy and actually works. you can do basically everything with procmail. This question is off topic, dovecot is not SMTP agent. I have a wget script that fetches some pages, and, emails me the output, there is no paramters passed, it's all in the script I'll like to email in and action the script to get the results email use procmail and possibly formail to execute anything and optionally reply the result man procmailrc man procmailex man formail make sure procmail is actually executed on your mail system. depends of your MTA.
Re: [Dovecot] ot: execute a script via email?
Old school - in /etc/aliases you can set: user|/home/user/script And read the mail from stdin. Ken works great but requires root to do this Voytek Eymont voy...@sbt.net.au wrote: anyone has any tips what's best way to execute a script via email ? I have a wget script that fetches some pages, and, emails me the output, there is no paramters passed, it's all in the script I'll like to email in and action the script to get the results email -- Voytek Pacific.net
Re: [Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument
El 09/07/12 14:37, Robert Schetterer escribió: guess this is latest for 12.04 http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.4-precise/ I have check this 3.4 kernel and it seems there is no problem with it -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica_(___V Tfo: 868887590 Fax: 86337
Re: [Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument
Am 13.07.2012 11:37, schrieb Angel L. Mateo: El 09/07/12 14:37, Robert Schetterer escribió: guess this is latest for 12.04 http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.4-precise/ I have check this 3.4 kernel and it seems there is no problem with it cool, thx for info -- Best Regards MfG Robert Schetterer
Re: [Dovecot] managesieve segfault with gold linker
On 7/12/2012 10:27 PM, Eray Aslan wrote: dovecot-2.1.8 sieve-0.3.1 binutils-2.22 When dovecot and sieve is linked with ld.gold I get a segfault in checkscript command: $ telnet localhost 4190 [some output] authenticate PLAIN base64_username_password [some more output] checkscript foobarscript connection closed Logs: 2012-07-12T19:30:23.624158+00:00 bob dovecot: master: Dovecot v2.1.8 starting up 2012-07-12T19:31:22.548913+00:00 bob dovecot: managesieve-login: Login: user=username, method=PLAIN, rip=192.168.122.1, lip=192.168.122.64, mpid=12169, session=YGo2AqfEcwDAqHoB 2012-07-12T19:31:34.636747+00:00 bob dovecot: managesieve(username): Fatal: master: service(managesieve): child 12169 killed with signal 11 (core dumped) Based on your excellent bug report, I fixed this one yesterday: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6ceeb6421231 make check also fails (thank you for that): [...] Test case: ./tests/execute/errors.svtest: 1: Test 'Action conflicts: reject - fileinto' SUCCEEDED 2: Test 'Action conflicts: reject - keep' SUCCEEDED 3: Test 'Action conflicts: reject - redirect' SUCCEEDED 4: Test 'Action limit' SUCCEEDED 5: Test 'Redirect limit' SUCCEEDED /tmp/work/dovecot-2.1-pigeonhole-0.3.1/src/testsuite/.libs/lt-testsuite: symbol lookup error: /tmp/work/dovecot-2.1-pigeonhole-0.3.1/src/lib-sieve/.libs/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table make: *** [tests/execute/errors.svtest] Error 127 I can't reproduce this (on Debian stable). How exactly did you configure dovecot sources to use ld.gold? I just installed the binutils-gold package, but I get the impression that ld.gold may not actually be used. Also, perhaps this is caused by a version difference (mine is GNU gold (GNU Binutils for Debian 2.20.1-system.20100303) 1.9). I get the impression that this is an LD bug, but I do like to be sure. Regards, Stephan.
Re: [Dovecot] ot: execute a script via email?
If you don't have root, you are probably going to be restricted from other methods by the security policy of a shared host. In that case, just use fetchmail or other means of checking mail for your 'trigger' message, then run your process where you DO have permission. Ken Wojciech Puchar woj...@wojtek.tensor.gdynia.pl wrote: Old school - in /etc/aliases you can set: user |/home/user/script And read the mail from stdin. Ken works great but requires root to do this Voytek Eymont voy...@sbt.net.au wrote: anyone has any tips what's best way to execute a script via email ? I have a wget script that fetches some pages, and, emails me the output, there is no paramters passed, it's all in the script I'll like to email in and action the script to get the results email -- Voytek Pacific.net Pacific.net
Re: [Dovecot] Maildir messages
On 7/13/2012 4:09 AM, Wojciech Puchar wrote: specifically from a filesystem IO perspective: 1. new mail delivery not much difference. maildir requires 3 (or is it 4?) metadata operations and a file write op mbox requires a single file append operation. 2. searching a mailbox folder if you do linear search then yes I'm referring to full text body search. In which case every single file in a maildir directory must be opened and searched in succession, serially, as Dovecot doesn't create a search thread for each maildir file and perform them in parallel across multiple cores. With mbox, you open a single file and search it. CPU/RAM bandwidth is many orders of magnitude faster and cheaper than disk IOPS. Thus mbox is faster at full text search than any other mailbox storage format, period. Full text indexes can help greatly with both formats, but often the indexes are old, and a full search is necessary, making mbox much faster. 3. mass deletion of emails from one mailbox folder 3 is not true. It most certainly is true. You need to read up on how email deletes are performed on mbox files, or mdbox files for that matter. maildir is more IO efficient when reading and deleting individual emails. and making backups. Wrong again. Streaming a single file to D2D or tape is much faster than random reading hundreds or thousands of maildir files. deleting from maildir means just delete a file, not shuffle data. For a single email delete operation maildir is faster, as it requires a single metadata IO. When deleting many emails, say hundreds to thousands, as in deleting a very large folder, mbox is *much* faster. This is because CPU/mem are many orders of magnitude faster than disk, and deleting hundreds or thousands of maildir files requires hundreds or thousands of random metadata IOPS to the filesystem directory. When Qmail hit the scene with maildir format, everyone loved it. That is, until their mailbox counts skyrocketed, and their systems slow to a crawl because their disk arrays simply couldn't keep up with all the IOPS. Everyone needs to make backups while it is unlinkely that anyone like every backup to be effectively full backup. See: rdiff-backup, et al mbox puts the load on the mail server application and on memory. and on I/O too - often quite a bit Sure, if it's a busy server. But the IOPS load will always be much less than maildir given the same workload. maildir puts the load on the IO subsysetem. Which is precisely why Timo created the mdbox mail storage format, attempting to get the best of both worlds. And this is great idea and actually works :) Yep. mbox may make sense for archive storage. you create archive folder once and never modify anything Many of us still use mbox for IMAP and POP user accounts, and it still works great. And many maildir converts switched back to mbox when the storage hardware required to satisfy their ever increasing maildir IOPS load began draining their entire IT budgets. mbox is a pretty smart email storage format especially given its age. It can do more with lesser storage hardware. Many simply don't give it the credit it deserves. -- Stan
Re: [Dovecot] Maildir messages
On 2012-07-13 8:07 AM, Stan Hoeppner s...@hardwarefreak.com wrote: mbox is a pretty smart email storage format especially given its age. It can do more with lesser storage hardware. Many simply don't give it the credit it deserves. The ideal is a hybrid - maildir for new mail, mbox (or mdbox) for longer term storage... -- Best regards, Charles
Re: [Dovecot] Maildir messages
not much difference. maildir requires 3 (or is it 4?) metadata operations and a file write op your remarks are mostly true, except concentrates too much on uncommon situations and uncommon strange case of probably tens of thousands of mail accounts that must be very limited. From my practice mail accounts are at least 1GB large, often 10GB. more often than not other user data is on the same disk. i've never had more than 50 users on single disk set (which is always 2 disks in mirror), And I/O was never ever a problem except first index build etc. in dovecot 2 you can do this in controller way using doveadm. Mail I/O doesn't make that much part of I/O for me, still i found a bit speedup by moving dovecot indexes to SSD if it exist. while disks get larger user data amount get larger too. Today tape backups are hardly used because it is plain uneconomic today. most do backups by copying differences to other disk, preferably in other place. Adventages of pure Maildir format outweights everything else as you have one file - one mail. mdbox is something in between.
Re: [Dovecot] Maildir messages
Am 13.07.2012 14:19, schrieb Charles Marcus: On 2012-07-13 8:07 AM, Stan Hoeppner s...@hardwarefreak.com wrote: mbox is a pretty smart email storage format especially given its age. It can do more with lesser storage hardware. Many simply don't give it the credit it deserves. The ideal is a hybrid - maildir for new mail, mbox (or mdbox) for longer term storage... may I ask how you do archivate maildirs? With mbox I used mhonarc but with maildir I do not really have a soluton yet. Andreas
Re: [Dovecot] Maildir messages
the credit it deserves. The ideal is a hybrid - maildir for new mail, mbox (or mdbox) for longer term storage... True. Not did this as never got I/O problems because of mail. For larger installations in may be adventageous to use mbox based archives on RAID5 (this would be mostly write-once) and RAID1 for rest.
Re: [Dovecot] Maildir messages
longer term storage... may I ask how you do archivate maildirs? With mbox I used mhonarc but with maildir I do not really have a soluton yet. mhonarc is mail to HTML converter. We meant just converting format to mbox.
[Dovecot] imapc: Restrict the number of connections
Hi,
I have managed to get an imapc connection to another server and bind its
contents to only one account (via global ACL).
The namespace itself is created as public, though it does not seem to
make a difference for this use case (i.e., it does not matter, whether
its type is 'public', 'shared', or 'private').
namespace {
hidden = no
list = children
location = imapc:
prefix = Gemeinsam.
separator = .
subscriptions = no
type = public
}
One problem remains: Though there is only one account that is allowed to
use this imapc-connection, each imap-process opens a connection to the
imapc'd server.
Is this caused directly by the imapc_*-definitions in the config? Or is
there a way of restricting this to only the account which actually uses it.
Used dovecot version: 2.1.8
Thanks,
René
Re: [Dovecot] managesieve segfault with gold linker
On 07/13/2012 12:53 PM, Stephan Bosch wrote: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6ceeb6421231 Still no go with binutils-2.22. make check fails with the same error message. Telnetting and issuing checkscript gives not a segfault but some parser error. I can't reproduce this (on Debian stable). How exactly did you configure dovecot sources to use ld.gold? I just installed the binutils-gold package, but I get the impression that ld.gold may not actually be used. Make sure /usr/bin/ld is a symlink to /usr/bin/ld.gold and not to ld.bfd - which it should if you installed binutils-gold. Also, perhaps this is caused by a version difference (mine is GNU gold (GNU Binutils for Debian 2.20.1-system.20100303) 1.9). I can't check binutils-2.20 easily. I did check linking with gold with binutils-2.21, binutils-2.22 and binutils-2.22.52.0.4. All fail. I get the impression that this is an LD bug, but I do like to be sure. Aye, that's my impression as well. I'll try to find out more but I will be on vacation for a few days so it might not be quick. In the meantime, if you make any headway, please let me know. Thank you. -- Eray Aslan e...@gentoo.org
Re: [Dovecot] ot: execute a script via email? [procmail]
On 07/13/2012 11:14 AM, Wojciech Puchar wrote: anyone has any tips what's best way to execute a script via email ? use procmail - it's easy and actually works. you can do basically everything with procmail. This question is off topic, dovecot is not SMTP agent. I have a wget script that fetches some pages, and, emails me the output, there is no paramters passed, it's all in the script I'll like to email in and action the script to get the results email use procmail and possibly formail to execute anything and optionally reply the result man procmailrc man procmailex man formail make sure procmail is actually executed on your mail system. depends of your MTA. Are you willing to recommend procmail without any warnings/disclaimers whatsoever? quote src= http://en.wikipedia.org/wiki/Procmail Stable release http://en.wikipedia.org/wiki/Software_release_life_cycle 3.22 / September 10, 2001 [...] Procmail is widely used on Unix http://en.wikipedia.org/wiki/Unix-based systems and stable, but no longer maintained; users who wish to use a maintained program are advised to use an alternative MDA, /quote
Re: [Dovecot] Maildir messages
On 7/13/2012 7:28 AM, Wojciech Puchar wrote: not much difference. maildir requires 3 (or is it 4?) metadata operations and a file write op your remarks are mostly true, except concentrates too much on uncommon situations and uncommon strange case of probably tens of thousands of mail accounts that must be very limited. There are many folks on this list who ran out of IOPS due to maildir at one time or another. Nowhere near tens of thousands of accounts were not required. To solve the problem, they either purchased more spindles, added RAID cache, or converted to mbox, or mdbox, depending on when they ran into the problem (mdbox is very young). From my practice mail accounts are at least 1GB large, often 10GB. more often than not other user data is on the same disk. Typical SMB setup it seems. i've never had more than 50 users on single disk set (which is always 2 disks in mirror), And I/O was never ever a problem except first index build etc. in dovecot 2 you can do this in controller way using doveadm. Mail I/O doesn't make that much part of I/O for me, still i found a bit speedup by moving dovecot indexes to SSD if it exist. With only 50 users it's hard to saturate one disk with a mail workload. while disks get larger user data amount get larger too. Today tape backups are hardly used because it is plain uneconomic today. Tape is far more cost effective than a GbE MAN link to a hot site. most do backups by copying differences to other disk, preferably in other place. Again, those links are usually more costly than off site tape rotation services, and the backup window much larger. Adventages of pure Maildir format outweights everything else as you have one file - one mail. While that is maildir's greatest strength, it is also it's greatest weakness. -- Stan
Re: [Dovecot] Maildir messages
mail accounts that must be very limited. There are many folks on this list who ran out of IOPS due to maildir at one time or another. Nowhere near tens of thousands of accounts were not required. To solve the problem, they either purchased more did you actually monitored WHAT part of job generates I/O and how? Can you post details. On just one simple - how many mailboxes per disk head - what filesystem used - what OS - how data is laid out. spindles, added RAID cache, or converted to mbox, or mdbox, depending on when they ran into the problem (mdbox is very young). From my practice mail accounts are at least 1GB large, often 10GB. more often than not other user data is on the same disk. Typical SMB setup it seems. True. More - i always try to mix services. No separate file servers, mail servers, whatever servers but all on same. On large install divide by groups of people, not services. This way i really cannot get to high IOPS. Mail I/O doesn't make that much part of I/O for me, still i found a bit speedup by moving dovecot indexes to SSD if it exist. With only 50 users it's hard to saturate one disk with a mail workload. True! That is my point. With user taking few GBs of mail space (few tens not uncommon), as much or more documents or other data, you just will never have more than 50 of then on one disk. More users=more disks, same (small) amount of I/O per disk head. while disks get larger user data amount get larger too. Today tape backups are hardly used because it is plain uneconomic today. Tape is far more cost effective than a GbE MAN link to a hot site. I really cannot imagine a scale of operation that would require gigabit link to do backups over rsync that only moves changes! It would be like 1 users on like 100 disks. With that site i would think of tape. Of course - no I/O problem to backup such 100 disk setup to tape. Again, those links are usually more costly than off site tape rotation services, and the backup window much larger. my practice shows exactly opposite case. If you would be right i would already use tapes or even pseudo-tapes== few cheapers hard drives connected over eSATA. Adventages of pure Maildir format outweights everything else as you have one file - one mail. While that is maildir's greatest strength, it is also it's greatest weakness. For my needs strength is great and weakness is small. mdbox may help in your cases. Seems like you do same ill service like 1000 (or more) mail accounts per hard disks. My point was always never delete old data, disks are cheap.
Re: [Dovecot] ot: execute a script via email? [procmail]
Stable release http://en.wikipedia.org/wiki/Software_release_life_cycle 3.22 / September 10, 2001 [...] Procmail is widely used on Unix http://en.wikipedia.org/wiki/Unix-based systems and stable, but no longer maintained; users who wish to use a maintained program are advised to use an alternative MDA, /quote can you explain what is wrong in using greatly working program just because there are no new versions? What kind of external maintenance you need for it? Sorry but your warning is a pure nonsense. procmail is mature software and that's adventage.
Re: [Dovecot] Maildir messages
Am 13.07.2012 20:45, schrieb Wojciech Puchar: Typical SMB setup it seems. True. More - i always try to mix services. No separate file servers, mail servers, whatever servers but all on same. On large install divide by groups of people, not services. This way i really cannot get to high IOPS cannot is plain wrong, you are satisfied only by luck Seems like you do same ill service like 1000 (or more) mail accounts per hard disks there is nothing ill http://h18000.www1.hp.com/products/quickspecs/13551_na/13551_na.pdf 1 Gb Ethernet / iSCSI - 17200 Random IOPS with RAID10 1 Gb Ethernet / iSCSI - 9400 Random IOPS with RAID5 1 Gb Ethernet / iSCSI - 5600 Random IOPS with RAID6 and here ware are at a point where your local disks are outperformed because they give you typically 100-300 IOPS per disk which you refused over a complete thread believing you localSATA is the best thing whichs exists and yes, the dedicated storage-controllers and caches of a SAN storage are what is outperforming you at real load signature.asc Description: OpenPGP digital signature
Re: [Dovecot] ot: execute a script via email? [procmail]
Am 13.07.2012 20:46, schrieb Wojciech Puchar: Stable release http://en.wikipedia.org/wiki/Software_release_life_cycle 3.22 / September 10, 2001 [...] Procmail is widely used on Unix http://en.wikipedia.org/wiki/Unix-based systems and stable, but no longer maintained; users who wish to use a maintained program are advised to use an alternative MDA, /quote can you explain what is wrong in using greatly working program just because there are no new versions? What kind of external maintenance you need for it? Sorry but your warning is a pure nonsense. procmail is mature software and that's adventage http://www.cvedetails.com/product/392/Procmail-Procmail.html?vendor_id=225 hopefully there will be not found any new security problem now withut get fixed signature.asc Description: OpenPGP digital signature
Re: [Dovecot] ot: execute a script via email? [procmail]
On 07/13/2012 09:06 PM, Reindl Harald wrote: Am 13.07.2012 20:46, schrieb Wojciech Puchar: Stable release http://en.wikipedia.org/wiki/Software_release_life_cycle 3.22 / September 10, 2001 [...] Procmail is widely used on Unix http://en.wikipedia.org/wiki/Unix-based systems and stable, but no longer maintained; users who wish to use a maintained program are advised to use an alternative MDA, /quote can you explain what is wrong in using greatly working program just because there are no new versions? What kind of external maintenance you need for it? Sorry but your warning is a pure nonsense. procmail is mature software and that's adventage http://www.cvedetails.com/product/392/Procmail-Procmail.html?vendor_id=225 hopefully there will be not found any new security problem now withut get fixed 1) IMHO Stable stream of new versions usually indicate maintenance group ready to fix would be vulnerabilities. 2) I miss LMTP support in procmail. AFAIR it has been supported in some versions but current Debian version no longer mentions it in the man page. 10 years old version is something that IMHO must be mentioned when recommending procmail. For some people it is not important, for some people it is important information/hint.
