[Dovecot] Not receiving Local Mails
Hi, I have already set up DOVECOT + POSTFIX mail server and I can send and receive mails outside my Domain. The problem however is that LOCAL Mail is not working. When I send LOCAL mails, it leaves my system without error messages but it is not received by the recipient. How do I make LOCAL mails work? Regards Alexander
Re: [Dovecot] Not receiving Local Mails
El Jueves 10 Diciembre 2009 a las 11:02, Alexander escribió: Hi, I have already set up DOVECOT + POSTFIX mail server and I can send and receive mails outside my Domain. The problem however is that LOCAL Mail is not working. When I send LOCAL mails, it leaves my system without error messages but it is not received by the recipient. How do I make LOCAL mails work? With so many clues is difficult to say, but usually the problem is that the domain local mail uses is not a part of postfix's mydestination parameter. Anyway, look at postfix logs to see what's happening with local mail, and once you do it, you better ask in a postfix mailing list. HTH. -- Joseba Torre. Vicegerencia de TICs, área de Explotación
Re: [Dovecot] Lazyexpunge and Segmentation fault
On 09/12/2009 21:03, Timo Sirainen wrote: You still happen to have the core file? I'd like to know a few more things: #0 lazy_expunge_mail_expunge (_mail=0x9907ae8) at lazy-expunge-plugin.c:116 116 lt-expunge_box = p *lt p *deststorage p *_mail p *_mail.box Anyway there's something weird going on there. It shouldn't crash on that line. So either gcc optimizations confused gdb and it's actually crashing elsewhere (recompiling+reinstalling the plugin without -O2 parameter would help with this), Hello, I've recompiled dovecot with -O0 and here a new backtrace: GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type show copying and show warranty for details. This GDB was configured as i486-linux-gnu... warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/i686/nosegneg/libdl.so.2...done. Loaded symbols for /lib/i686/nosegneg/libdl.so.2 Reading symbols from /lib/i686/nosegneg/librt.so.1...done. Loaded symbols for /lib/i686/nosegneg/librt.so.1 Reading symbols from /lib/i686/nosegneg/libc.so.6...done. Loaded symbols for /lib/i686/nosegneg/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/i686/nosegneg/libpthread.so.0...done. Loaded symbols for /lib/i686/nosegneg/libpthread.so.0 Reading symbols from /usr/local/lib/dovecot/imap/lib02_lazy_expunge_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib02_lazy_expunge_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. [New process 14769] #0 0xb7fb45c9 in lazy_expunge_mail_expunge (_mail=0x844df58) at lazy-expunge-plugin.c:115 115 deststorage = luser-lazy_ns[LAZY_NAMESPACE_EXPUNGE]-storage; (gdb) bt full #0 0xb7fb45c9 in lazy_expunge_mail_expunge (_mail=0x844df58) at lazy-expunge-plugin.c:115 luser = (struct lazy_expunge_mail_user *) 0x841c060 lt = (struct lazy_expunge_transaction *) 0x844de28 deststorage = (struct mail_storage *) 0x844de40 #1 0x080c658f in mail_expunge (mail=0x844df58) at mail.c:207 p = (struct mail_private *) 0x844df58 #2 0x0806c294 in imap_expunge (box=0x8423538, next_search_arg=0x0) at imap-expunge.c:35 ctx = (struct mail_search_context *) 0x844de40 t = (struct mailbox_transaction_context *) 0x844ca58 mail = (struct mail *) 0x844df58 search_args = (struct mail_search_args *) 0x0 expunges = false #3 0x0806267e in cmd_expunge_finish (cmd=0x841e4d0, search_args=0x0) at cmd-expunge.c:27 client = (struct client *) 0x841e250 #4 0x0806283f in cmd_expunge (cmd=0x841e4d0) at cmd-expunge.c:78 No locals. #5 0x0806a3c7 in client_command_input (cmd=0x841e4d0) at client.c:612 client = (struct client *) 0x841e250 command = (struct command *) 0x2 __PRETTY_FUNCTION__ = client_command_input #6 0x0806a5f3 in client_command_input (cmd=0x841e4d0) at client.c:661 client = (struct client *) 0x841e250 command = (struct command *) 0x841a6a0 __PRETTY_FUNCTION__ = client_command_input #7 0x0806a6fe in client_handle_next_command (client=0x841e250, remove_io_r=0xbfb94035) at client.c:702 size = 11 #8 0x0806a783 in client_handle_input (client=0x841e250) at client.c:714 _data_stack_cur_id = 3 ret = 65 remove_io = false handled_commands = false __PRETTY_FUNCTION__ = client_handle_input #9 0x0806a8e1 in client_input (client=0x841e250) at client.c:753 cmd = (struct client_command_context *) 0xb7f2af78 output = (struct ostream *) 0x841e404 bytes = 11 __PRETTY_FUNCTION__ = client_input #10 0x08124721 in io_loop_handler_run (ioloop=0x84199b0) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x8419ab8 events = (struct epoll_event *) 0x8419af8 event = (const struct epoll_event *) 0x8419af8 list = (struct io_list *) 0x841c228 io = (struct io_file *) 0x841e460 tv = {tv_sec = 1799, tv_usec = 999144} events_count = 3 t_id = 2 msecs = 180 ret = 1 i = 0 j = 0 call = true #11 0x081239d8 in io_loop_run (ioloop=0x84199b0) at ioloop.c:335 No locals.
Re: [Dovecot] Developer Documentation
Hi Timo... There is a way to do this with a plugin ? or you pass the zlib-plugin for reference ? I can made this in the same monent the i_stream_create_fd() open the email in maildir, and make a extra i_stream_create_fd() to my file.. then put this 2 streams (email + myfile) in i_stream_create_concat()... I will see the zlib-plugin code tks 2009/12/9 Timo Sirainen t...@iki.fi On Wed, 2009-12-09 at 23:30 -0200, Alex Baule wrote: Let me explain to you i want to split the email in header and body...my smtp server do this for me but, to read again in dovecot, i need to point the email to this two files. This division in two parts is more like a test... and if the dovecot can join again this two files in read time is good for me So you're thinking maybe you get better performance that way, or something? I was first thinking you'd want to add some automatic signature that gets modified once in a while, that wouldn't have worked. But yeah, you could do this with Maildir in a similar way than zlib plugin works. Instead of using i_stream_create_zlib(), you'd open the other file with i_stream_create_fd() and then make i_stream_create_concat() use both of the streams. Should be pretty easy to implement based on the zlib plugin code. Also when messages get expunged, you'd also need to delete the other file yourself. You can do that the same way as quota plugin decreases quota when message gets deleted. See http://wiki.dovecot.org/Design for more information about istreams and some other Dovecot code docs.
[Dovecot] [dovecot] Compile problem on AIX with dovecot 1.2 rev 10449:a164075ea33a
+ exec /usr/vac/bin/xlc -g -qarch=pwr5x -DHAVE_CONFIG_H -I. -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-mail -q64 -c -M mail-index-transaction.c -DPIC ../../src/lib/bsearch-insert-pos.h, line 39.9: 1506-236 (W) Macro name array_bsearch has been redefined. ../../src/lib/bsearch-insert-pos.h, line 39.9: 1506-358 (I) array_bsearch is defined on line 285 of ../../src/lib/array.h. mail-index-transaction.c, line 34.16: 1506-045 (S) Undeclared identifier idx_r. gmake[3]: *** [mail-index-transaction.lo] Error 1 gmake[3]: Leaving directory `/usr/sadmin/src/imapservers/dovecothg/dovecot-2.0psu/src/lib-index' thanks, Jonathan smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] [dovecot] Compile problem on AIX with dovecot 1.2 rev 10449:a164075ea33a
On Dec 10, 2009, at 9:41 AM, Jonathan Siegle wrote: + exec /usr/vac/bin/xlc -g -qarch=pwr5x -DHAVE_CONFIG_H -I. -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-mail -q64 -c -M mail-index-transaction.c -DPIC ../../src/lib/bsearch-insert-pos.h, line 39.9: 1506-236 (W) Macro name array_bsearch has been redefined. ../../src/lib/bsearch-insert-pos.h, line 39.9: 1506-358 (I) array_bsearch is defined on line 285 of ../../src/lib/array.h. mail-index-transaction.c, line 34.16: 1506-045 (S) Undeclared identifier idx_r. Fixed.
Re: [Dovecot] Developer Documentation
On Dec 10, 2009, at 7:33 AM, Alex Baule wrote: Hi Timo... There is a way to do this with a plugin ? or you pass the zlib-plugin for reference ? You can do it with a plugin. I mention zlib plugin, because it works in a similar way by reading gzipped maildir files. I can made this in the same monent the i_stream_create_fd() open the email in maildir, and make a extra i_stream_create_fd() to my file.. then put this 2 streams (email + myfile) in i_stream_create_concat()... Right.
Re: [Dovecot] Developer Documentation
Ok ... i understand... this is the last one...lol in zib plugin i see a implementation of i_stream_create_zlib, this is a substitution to the i_stream_create_fd , right ? So, i need to do every think like in istream-zlib.c (close, destroy, read, seek, stat and sync) to swap the original functions ? I try to do a way to save some space in disc, spliting the head and body in 2 filesbecause sometimes the users have the same email (Cc/CCb). Doing this, i will use 1 body to various headers In delivery by SMTP is easy, split in 2 and write the files... but in IMAP is more complicated Tks again ! 2009/12/10 Timo Sirainen t...@iki.fi On Dec 10, 2009, at 7:33 AM, Alex Baule wrote: Hi Timo... There is a way to do this with a plugin ? or you pass the zlib-plugin for reference ? You can do it with a plugin. I mention zlib plugin, because it works in a similar way by reading gzipped maildir files. I can made this in the same monent the i_stream_create_fd() open the email in maildir, and make a extra i_stream_create_fd() to my file.. then put this 2 streams (email + myfile) in i_stream_create_concat()... Right.
Re: [Dovecot] Developer Documentation
On Dec 10, 2009, at 11:16 AM, Alex Baule wrote: Ok ... i understand... this is the last one...lol in zib plugin i see a implementation of i_stream_create_zlib, this is a substitution to the i_stream_create_fd , right ? So, i need to do every think like in istream-zlib.c (close, destroy, read, seek, stat and sync) to swap the original functions ? No, you don't need to implement a new istream, just ignore istream-zlib.c completely. Instead of the plugin calling i_stream_create_zlib, you just call i_stream_create_concat.
[Dovecot] dovecot.index
Hello, I can't locate the dovecot.index in my ~/Maildir [r...@fedora-p24 Maildir]# ls cur dovecot-uidlist new dovecot.index.cache dovecot-uidvalidity subscriptions dovecot.index.log dovecot-uidvalidity.4b1e77ef tmp Where is the dovecot.index ? This tutorial http://wiki.dovecot.org/IndexFiles tells that I should find it where the other indexes are by default under ~/Maildir I don't understand the IMAP UID mapping [r...@fedora-p24 cur]# ls cur 1260490526.M622249P1489.fedora-p24.local,W=582:2,S 1260491930.M172649P1524.fedora-p24.local,W=675:2,S 1260492827.M414655P1561.fedora-p24.local,W=3390476:2,S 1260539343.M690611P1736.fedora-p24.local,W=665:2,S 1260539406.M725730P1746.fedora-p24.local,W=655:2,S 1260539465.M446296P1750.fedora-p24.local,W=689:2,S The IMAP UIDVALIDITY is 4b1e77ef (in HEX) [r...@fedora-p24 Maildir]# cat dovecot-uidvalidity 4b1e77ef 4b1e77ef(HEX) = 1260287983 (DEC), I don't see in the filenames the IMAP UIDVALIDITY in HEX or DEC This tutorial tells me that I should http://wiki.dovecot.org/MailboxFormat/Maildir Please explain me why ? Here is my dovecot configuration: [r...@fedora-p24 Maildir]# dovecot -n # 1.2.6: /etc/dovecot.conf # OS: Linux 2.6.31.5-127.fc12.x86_64 x86_64 Fedora release 12 (Constantine) protocols: imap imaps login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir lda: postmaster_address: postmas...@eurobluelife.ro hostname: ns1.eurobluelife.ro deliver_log_format: msgid=%m: %$ sendmail_path: /usr/lib/sendmail auth_socket_path: /var/run/dovecot/auth-master auth default: passdb: driver: pam userdb: driver: passwd
Re: [Dovecot] dovecot.index
On Thu, 2009-12-10 at 09:47 -0800, Ermurachi Ion wrote: Hello, I can't locate the dovecot.index in my ~/Maildir [r...@fedora-p24 Maildir]# ls cur dovecot-uidlist new dovecot.index.cache dovecot-uidvalidity subscriptions dovecot.index.logdovecot-uidvalidity.4b1e77ef tmp Where is the dovecot.index ? dovecot.index is updated/created lazily from dovecot.index.log to reduce disk I/O. Your dovecot.index.log hasn't grown large enough yet. The IMAP UIDVALIDITY is 4b1e77ef (in HEX) [r...@fedora-p24 Maildir]# cat dovecot-uidvalidity 4b1e77ef UIDVALIDITY is stored in dovecot-uidlist file's header. The dovecot-uidvalidity file contains the last assigned UIDVALIDITY value (or maybe the next one, I can't remember), and it's used only when creating new mailboxes. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] PostgreSQL connection bug
Let me make myself clearer. Dovecot opens a postgres connection, Dovecot sends a SELECT query using the connection, The response can be a) One or more rows of data b) Zero rows of data (eg if the username doesn't exist) c) An error response (eg if the query contains a syntax error) If a) or b) happens, then dovecot accepts or denies the user, and closes the connection. If c) happens, dovecot denies the user, but leaves the connection open (stuck). Next time someone tries to log on dovecot opens a new connection. This leads to a gradual buildup of connections until the limit is reached and stuff breaks. In my situation, the query was sometimes failing because the data sent was the wrong type (a string, when it should have been an integer - my fault). Hope that makes sense now. I think dovecot needs a line of code inserted to check whether the query failed, and if it did, log the error, and close the connection gracefully. Cheers, Dan On Wed, 09 Dec 2009 15:24:45 -0500, Timo Sirainen t...@iki.fi wrote: On Sun, 2009-11-29 at 06:00 +, Daniel Howard wrote: In these cases, Dovecot would still fall back to PAM authentication, and the user would log in, but the postgres connection would remain stuck. Gradually the number of connections would increase until postgres failed. This sounds weird. You mean if password_query doesn't return any results Dovecot somehow completely hangs/leaks a PostgreSQL connection and creates a new one? Did it log any errors?
Re: [Dovecot] PostgreSQL connection bug
On Thu, 2009-12-10 at 18:06 +, Daniel Howard wrote: Let me make myself clearer. Dovecot opens a postgres connection, Dovecot sends a SELECT query using the connection, The response can be a) One or more rows of data b) Zero rows of data (eg if the username doesn't exist) c) An error response (eg if the query contains a syntax error) If a) or b) happens, then dovecot accepts or denies the user, and closes the connection. Except it doesn't, or at least it shouldn't.. It should keep using the same connection for all logins. If c) happens, dovecot denies the user, but leaves the connection open (stuck). Next time someone tries to log on dovecot opens a new connection. This leads to a gradual buildup of connections until the limit is reached and stuff breaks. I tested that this doesn't happen with v1.2. It may have bee a bug in v1.0. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Overriding Default Subscription Behavior
On Thu, 2009-12-10 at 10:15 -0500, Tony Rutherford wrote: The subscription files we're migrating from have a . for folder separation. We will be using Dovecot's maildir with LAYOUT=fs. It's looking for / as the separator in the subscription file. So, obviously we could simply write a script to swap the two characters. However, just curious if there are any options for doing this within a plugin (since we're already doing some things in a plugin) by overriding some of the subscription code.something like the next_line() in subscriptions.c. I don't see any vfuncs in this area, aside from set_subscribed() I believe.but maybe there's a better spot I'm not thinking of? One thing I've learned with Dovecot is that it somehow supports things I didn't believe it could/would, so I thought I'd ask. Once you've moved to '/' separator, it's possible that users create mailboxes with '.' characters. So you can't just always keep converting all '.' to '/', you need to do it only once for each user. You could create a plugin that simply: 1) Check if subscriptions.converted file exists, if not continue: 2) Convert '.' to '/' in subscriptions and recreate it 3) Create subscriptions.converted file Or something like that. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Lazyexpunge and Segmentation fault
On Thu, 2009-12-10 at 11:55 +0100, mail...@securitylabs.it wrote: #0 0xb7fb45c9 in lazy_expunge_mail_expunge (_mail=0x844df58) at lazy-expunge-plugin.c:115 115 deststorage = luser-lazy_ns[LAZY_NAMESPACE_EXPUNGE]-storage; OK, this makes more sense. Looks like it was a bug in quota plugin: http://hg.dovecot.org/dovecot-1.2/rev/5e2206e3c750 signature.asc Description: This is a digitally signed message part
Re: [Dovecot] irregular problem on outlook + imap
Timo Sirainen wrote: On Tue, 2009-12-01 at 16:19 +0100, Michele Petrazzo - Unipex wrote: First of all, thanks a lot for the reply. I had lost hope! * LSUB () . folder.with.dots and spaces and numbers This means it's in the subscriptions file. Ok lylu APPEND folder.with.dots and spaces and numbers (\Seen) 30-Nov-2009 10:34:00 +0100 {280844} lylu NO [TRYCREATE] Mailbox doesn't exist: folder.with.dots and spaces and numbers This means it doesn't really exist, even though it's subscribed. Do you know when/why this can happen? On the maildir home (maildir:~/mail/), it's present the folder.with.dots and spaces and numbers and the same into the subscriptions file Yes Are you sure it's really in the ~/mail/ directory exactly the same? You could try also talking IMAP directly: telnet localhost 143 a login user pass b list folder.with.dots* Is it listed? No! But since it's passed some days, my customer modify / rename and delete some folders and I don't know if because he touch that folders or because there is a problem. Tomorrow I'll call him and I'll let you know. Thanks a lot, Michele
[Dovecot] Sieve mails with decoded subject
Dear all, I accidently posted this message to dovecot-news and want to apologize for any trouble I may have caused. Here it is again to the correct mailing list: Recently I'm getting a ton of porn/viagra/diet/casino spam mails which I tried to filter with sieve: if header :contains Subject [ [SPAM], Bett, Schlafzimmer, Spielen, Luder, abhenmen, poppen, Casino, Bonus, abnehmen, Gewinn, Potenz ] { addflag \\seen; fileinto Spam; stop; } Sadly, this didn't work - taking a closer look upon one of the spam mails, it seems the spamming rats have encoded the subject: Subject: =?US-ASCII?B?RW5kbGljaCBtZWhyIGVuZ2FnZW1lbnQgaW0gQmV0dGNoZW4=?= (reads: Endlich mehr engagement im Bettchen) I'm thinking about filtering all such encoded subjects (as there's no reason to encode them US-ASCII), but suppose it were UTF-8 or something: how can I filter on the actual content, not the encoded subject? Surely someone has solved that problem already? Kind regards, Johannes
Re: [Dovecot] Sieve mails with decoded subject
On Thu, 2009-12-10 at 19:34 +0100, Johannes Bauer wrote: Dear all, I accidently posted this message to dovecot-news and want to apologize for any trouble I may have caused. Don't worry. All mails there from non-trusted addresses simply get discarded (or rejected?) Sadly, this didn't work - taking a closer look upon one of the spam mails, it seems the spamming rats have encoded the subject: Subject: =?US-ASCII?B?RW5kbGljaCBtZWhyIGVuZ2FnZW1lbnQgaW0gQmV0dGNoZW4=?= (reads: Endlich mehr engagement im Bettchen) They're decoded at least in v1.2 with the new Sieve plugin. I don't remember if CMU Sieve decoded them, I'm guessing not. So maybe it's time for an upgrade? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] [dovecot] Compile problem on AIX with dovecot 1.2 rev 10449:a164075ea33a
On Dec 10, 2009, at 10:56 AM, Timo Sirainen wrote: On Dec 10, 2009, at 9:41 AM, Jonathan Siegle wrote: + exec /usr/vac/bin/xlc -g -qarch=pwr5x -DHAVE_CONFIG_H -I. -I. -I../.. -I../../src/lib -I../../src/lib-test -I../../src/lib-mail -q64 -c -M mail-index-transaction.c -DPIC ../../src/lib/bsearch-insert-pos.h, line 39.9: 1506-236 (W) Macro name array_bsearch has been redefined. ../../src/lib/bsearch-insert-pos.h, line 39.9: 1506-358 (I) array_bsearch is defined on line 285 of ../../src/lib/array.h. mail-index-transaction.c, line 34.16: 1506-045 (S) Undeclared identifier idx_r. Fixed. I'm not making another thread at this point, just say something if I should. Haven't compiled this in weeks... Next: + exec /usr/vac/bin/xlc -g -qarch=pwr5x -I/usr/ladmin/include/ -q64 -bexpall -brtl -o test-dsync-brain test-dsync-brain.o test-dsync-worker.o test-dsync-common.o dsync-data.o dsync-brain.o dsync-worker.o -L/usr/ladmin/lib/ ../lib-test/.libs/libtest.a ../lib-mail/.libs/libmail.a ../lib-imap/.libs/libimap.a ../lib/.libs/liblib.a -lrt -bE:.libs/libtest.exp -bE:.libs/libmail.exp -bE:.libs/libimap.exp -bE:.libs/liblib.exp ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_begin ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_is_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_str smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] [dovecot] Compile problem on AIX with dovecot 1.2 rev 10449:a164075ea33a
On Thu, 2009-12-10 at 13:40 -0500, Jonathan Siegle wrote: I'm not making another thread at this point, just say something if I should. Haven't compiled this in weeks... That's fine. + exec /usr/vac/bin/xlc -g -qarch=pwr5x -I/usr/ladmin/include/ -q64 -bexpall -brtl -o test-dsync-brain test-dsync-brain.o test-dsync-worker.o test-dsync-common.o dsync-data.o dsync-brain.o dsync-worker.o -L/usr/ladmin/lib/ ../lib-test/.libs/libtest.a ../lib-mail/.libs/libmail.a ../lib-imap/.libs/libimap.a ../lib/.libs/liblib.a -lrt -bE:.libs/libtest.exp -bE:.libs/libmail.exp -bE:.libs/libimap.exp -bE:.libs/liblib.exp ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end Fixed now, I think? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Sieve mails with decoded subject
On Qui, 10 Dez 2009, Johannes Bauer wrote: I'm thinking about filtering all such encoded subjects (as there's no reason to encode them US-ASCII), but suppose it were UTF-8 or something: how can I filter on the actual content, not the encoded subject? Surely someone has solved that problem already? Yes, such as the guys behind SpamAssassin, or dspam, or any of the many spam filtering programs that exist. Actually, they make much more complicated decisions instead of only looking for bad words in the subject field. I'd suggest you try installing one of them. -- Eduardo M KALINOWSKI edua...@kalinowski.com.br
Re: [Dovecot] Lazyexpunge and Segmentation fault
Il 10/12/2009 19:28, Timo Sirainen ha scritto: On Thu, 2009-12-10 at 11:55 +0100, mail...@securitylabs.it wrote: #0 0xb7fb45c9 in lazy_expunge_mail_expunge (_mail=0x844df58) at lazy-expunge-plugin.c:115 115 deststorage = luser-lazy_ns[LAZY_NAMESPACE_EXPUNGE]-storage; OK, this makes more sense. Looks like it was a bug in quota plugin: http://hg.dovecot.org/dovecot-1.2/rev/5e2206e3c750 Hello Timo, thanks problem solved. Igor.
Re: [Dovecot] Sieve mails with decoded subject
Timo Sirainen schrieb: They're decoded at least in v1.2 with the new Sieve plugin. I don't remember if CMU Sieve decoded them, I'm guessing not. So maybe it's time for an upgrade? *sigh*, I guess it might be. brick [~]: dovecot --version 1.0.rc15 I'm still somewhat reluctant to change to 1.2, because that would mean that I cannot rely on my distros packages anymore (Etch that is for that server) but must maintain the packages myself. Well... Kind regards, Johannes
[Dovecot] mail_max_userip_connections
What is the appropriate setting for mail_max_userip_connections ? My POP3 connections seem to be mostly 1 at a time, but my IMAP connections are often 3 per user per IP. Is this appropriate? If I change the IMAP setting to mail_max_userip_connections=1 will it break things for the user? I am trying to improve this situation: ps auxwww | grep imap | wc 2373080 22400 TIA, - Richard
Re: [Dovecot] Sieve mails with decoded subject
Eduardo M KALINOWSKI schrieb: On Qui, 10 Dez 2009, Johannes Bauer wrote: I'm thinking about filtering all such encoded subjects (as there's no reason to encode them US-ASCII), but suppose it were UTF-8 or something: how can I filter on the actual content, not the encoded subject? Surely someone has solved that problem already? Yes, such as the guys behind SpamAssassin, or dspam, or any of the many spam filtering programs that exist. Actually, they make much more complicated decisions instead of only looking for bad words in the subject field. I'd suggest you try installing one of them. I had SpamAssassin running once and was pretty disappointed. All those complicated rules and scoring and smart bayesian filtering did not work very well, although I taught it in around 50k mails right from wrong. I had both lots of false-positives and lots of false-negatives, which was kind of annoying. However, analyzing 274 spam mails I deleted in the last 5 months I can conclude that by using that extremely simple filter list I'd catch 258 of them (that's 94%). So I'd like to stick to KISS in this case. Kind regards, Johannes
Re: [Dovecot] Sieve mails with decoded subject
On Thu, 2009-12-10 at 20:22 +0100, Johannes Bauer wrote: I'm still somewhat reluctant to change to 1.2, because that would mean that I cannot rely on my distros packages anymore (Etch that is for that server) but must maintain the packages myself. Well... How about using backports.org? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Sieve mails with decoded subject
Timo Sirainen t...@iki.fi writes: On Thu, 2009-12-10 at 20:22 +0100, Johannes Bauer wrote: I'm still somewhat reluctant to change to 1.2, because that would mean that I cannot rely on my distros packages anymore (Etch that is for that server) but must maintain the packages myself. Well... How about using backports.org? Well, for etch the backport is not enough for 1.2.x: http://packages.debian.org/etch-backports/dovecot-imapd BTW, according to http://wiki.debian.org/DebianEtch, on Feb 2010, Etch will be declared as EOLed, so, imho, an Etch-to-Lenny upgrade should be planned very soon there. -- Nicolas
Re: [Dovecot] [dovecot] Compile problem on AIX with dovecot 1.2 rev 10449:a164075ea33a
On Dec 10, 2009, at 1:44 PM, Timo Sirainen wrote: On Thu, 2009-12-10 at 13:40 -0500, Jonathan Siegle wrote: I'm not making another thread at this point, just say something if I should. Haven't compiled this in weeks... That's fine. + exec /usr/vac/bin/xlc -g -qarch=pwr5x -I/usr/ladmin/include/ -q64 -bexpall -brtl -o test-dsync-brain test-dsync-brain.o test-dsync-worker.o test-dsync-common.o dsync-data.o dsync-brain.o dsync-worker.o -L/usr/ladmin/lib/ ../lib-test/.libs/libtest.a ../lib-mail/.libs/libmail.a ../lib-imap/.libs/libimap.a ../lib/.libs/liblib.a -lrt -bE:.libs/libtest.exp -bE:.libs/libmail.exp -bE:.libs/libimap.exp -bE:.libs/liblib.exp ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end Fixed now, I think? No. I found my fix from http://www.mail-archive.com/dovecot@dovecot.org/msg18813.html and that fixed it. Here is the fix if you don't want to read the above page: I add this ../lib-charset/.libs/libcharset.a -liconv to the Makefile for src/dsync. I doubt I need -liconv at this point. I think I noticed it on the compile line. thanks for the fast commits.. -Jonathan smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] Developer Documentation
Hi Timo For tests i do it: In src/lib-storage/index/maildir/maildir-mail.c In the final of function maildir_open_mail i change the i_stream_create_fd to this: --- origin -- int fd = -1; . . . . . if (fd == -1) { *deleted_r = TRUE; return NULL; } input = i_stream_create_fd(fd, 0, TRUE); index_mail_set_read_buffer_size(mail, input); return input; -- my int fd = -1; int fd1 = -1; int fdp[2]; . . . . . . if (fd == -1) { *deleted_r = TRUE; return NULL; } do_open(mbox, /storage/emexis/ exemplo.com.br/messages/alex/Maildir/body_test, fd1); fdp[0] = fd; fdp[1] = fd1; input = i_stream_create_concat(fdp); index_mail_set_read_buffer_size(mail, input); return input; -- But the concat don't work. I Try too create 2 streams and put this 2 fds in concat, not work too -- my second int fd = -1; int fd1 = -1; int fdp[2]; . . . . . . if (fd == -1) { *deleted_r = TRUE; return NULL; } do_open(mbox, /storage/emexis/ exemplo.com.br/messages/alex/Maildir/body_test, fd1); fdp[0] = fd; fdp[1] = fd1; input = i_stream_create_fd(fd, 0, TRUE); input = i_stream_create_fd(fd1, 0, TRUE); input = i_stream_create_concat(fdp); 2009/12/10 Timo Sirainen t...@iki.fi On Dec 10, 2009, at 11:16 AM, Alex Baule wrote: Ok ... i understand... this is the last one...lol in zib plugin i see a implementation of i_stream_create_zlib, this is a substitution to the i_stream_create_fd , right ? So, i need to do every think like in istream-zlib.c (close, destroy, read, seek, stat and sync) to swap the original functions ? No, you don't need to implement a new istream, just ignore istream-zlib.c completely. Instead of the plugin calling i_stream_create_zlib, you just call i_stream_create_concat.
Re: [Dovecot] [dovecot] Compile problem on AIX with dovecot 1.2 rev 10449:a164075ea33a
On Thu, 2009-12-10 at 15:00 -0500, Jonathan Siegle wrote: + exec /usr/vac/bin/xlc -g -qarch=pwr5x -I/usr/ladmin/include/ -q64 -bexpall -brtl -o test-dsync-brain test-dsync-brain.o test-dsync-worker.o test-dsync-common.o dsync-data.o dsync-brain.o dsync-worker.o -L/usr/ladmin/lib/ ../lib-test/.libs/libtest.a ../lib-mail/.libs/libmail.a ../lib-imap/.libs/libimap.a ../lib/.libs/liblib.a -lrt -bE:.libs/libtest.exp -bE:.libs/libmail.exp -bE:.libs/libimap.exp -bE:.libs/liblib.exp ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end Fixed now, I think? No. I found my fix from http://www.mail-archive.com/dovecot@dovecot.org/msg18813.html and that fixed it. Here is the fix if you don't want to read the above page: I add this ../lib-charset/.libs/libcharset.a -liconv to the Makefile for src/dsync. I doubt I need -liconv at this point. How about now? :) signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Developer Documentation
On Thu, 2009-12-10 at 18:10 -0200, Alex Baule wrote: do_open(mbox, /storage/emexis/ exemplo.com.br/messages/alex/Maildir/body_test, fd1); fdp[0] = fd; fdp[1] = fd1; input = i_stream_create_fd(fd, 0, TRUE); input = i_stream_create_fd(fd1, 0, TRUE); input = i_stream_create_concat(fdp); struct istream *full_input[3]; full_input[0] = i_stream_create_fd(fd, 0, TRUE); full_input[1] = i_stream_create_fd(fd1, 0, TRUE); full_input[2] = NULL; input = i_stream_create_concat(full_input); signature.asc Description: This is a digitally signed message part
Re: [Dovecot] irregular problem on outlook + imap
Quoting Michele Petrazzo - Unipex michele.petra...@unipex.it: * LSUB () . folder.with.dots and spaces and numbers [snip] lylu APPEND folder.with.dots and spaces and numbers (\Seen) 30-Nov-2009 10:34:00 +0100 {280844} lylu NO [TRYCREATE] Mailbox doesn't exist: folder.with.dots and spaces and numbers This means it doesn't really exist, even though it's subscribed. Do you know when/why this can happen? The IMAP4rev1 spec specifically allows for a mailbox to be subscribed without existing. The list of subscribed mailboxes has nothing to do with the list of existing mailboxes (in other words, the results from LSUB are not a subset of the results from LIST). michael
Re: [Dovecot] Account Migration Tool
Patrick Ben Koetter wrote: * Stefan Onken supp...@stonki.de: Hello, goto http://www.linux-france.org/prj/imapsync/ and read the description in the README file. I've never tested this tool. But I think the description matches your 'requirements'. I used to tool to convert dozen of email account with up to 9GB each. No problem at all. Just do not forget to use the --subscribe option :) Definitely our preferred tool. The last time we used it, we migrated 25.000+ accounts and yes, we enabled --subscribe on the second run too... ;) We also disabled syncing shared folders from the Exchange Servers; they weren't needed on the new system. It's also nice to have a wrapper script that tracks exit codes and writes errors to a log, so you can attend them once the first run has passed through. p...@rick Thanks all. Sounds like something we should link to in the wiki along with some Dovecot specific examples. -- Daniel
Re: [Dovecot] Account Migration Tool
Daniel L. Miller wrote: Patrick Ben Koetter wrote: * Stefan Onken supp...@stonki.de: Hello, goto http://www.linux-france.org/prj/imapsync/ and read the description in the README file. I've never tested this tool. But I think the description matches your 'requirements'. I used to tool to convert dozen of email account with up to 9GB each. No problem at all. Just do not forget to use the --subscribe option :) Definitely our preferred tool. The last time we used it, we migrated 25.000+ accounts and yes, we enabled --subscribe on the second run too... ;) We also disabled syncing shared folders from the Exchange Servers; they weren't needed on the new system. It's also nice to have a wrapper script that tracks exit codes and writes errors to a log, so you can attend them once the first run has passed through. p...@rick Thanks all. Sounds like something we should link to in the wiki along with some Dovecot specific examples. And of course...it was already there!! Need to add a few more fireworks around it - looks like something every mail admin should have in his toolkit. -- Daniel
Re: [Dovecot] Problems with listescape and mutt
Hello Daniel, Daniel Spannbauer, 09.12.2009 (d.m.y): Hmmm, there is truely a small script, which lets mutt find the folders: mailboxes `echo -n + ; find ~/.maildir -maxdepth 1 -type d -name .* -printf +'%f' ` Hmm, I think this is the error With find you are doing a *file system*-based search... Gruss/Regards, Christian Schmidt -- You may be recognized soon. Hide.
[Dovecot] Spam filtering (was: Re: Sieve mails with decoded subject)
Hi, On Thu, 10 Dec 2009 20:28:27 +0100, Johannes Bauer wrote: Eduardo M KALINOWSKI schrieb: On Qui, 10 Dez 2009, Johannes Bauer wrote: I'm thinking about filtering all such encoded subjects (as there's no reason to encode them US-ASCII), but suppose it were UTF-8 or something: how can I filter on the actual content, not the encoded subject? Surely someone has solved that problem already? Yes, such as the guys behind SpamAssassin, or dspam, or any of the many spam filtering programs that exist. Actually, they make much more complicated decisions instead of only looking for bad words in the subject field. I'd suggest you try installing one of them. I had SpamAssassin running once and was pretty disappointed. All those complicated rules and scoring and smart bayesian filtering did not work very well, although I taught it in around 50k mails right from wrong. I had both lots of false-positives and lots of false-negatives, which was kind of annoying. However, analyzing 274 spam mails I deleted in the last 5 months I can conclude that by using that extremely simple filter list I'd catch 258 of them (that's 94%). So I'd like to stick to KISS in this case. That must have been a configuration issue - SpamAssassin works pretty well, if configured correctly - but I admit, it's a monster (both in terms of configuration and resource usage). You could go for bogofilter (purely Bayesian). I'm using it for years on my private mail server with very good results. I like to use the tri-state filtering, where there is not only one threshold value, but two. A certainty of a mail being spam (bogosity) of 0.35 and below goes into my inbox, mails with a bogosity value between 0.35 and 0.65 go into Spam/Unsure, and everything above 0.65 goes directly into Spam. That way I have something like 10-20 mails per week in Spam/Unsure that are usually false negatives, rarely false positives (currently around 1000 mails per week end up in Spam). To my knowledge there has never been a false positive in Spam. Of course initial training is necessary. For ongoing training / feedback I have set up a Spam/Learn-Spam and Spam/Learn-Ham mailbox into which I move false negatives/positives. A cron script then runs the mails found in those (maildir) mailboxes through bogofilter again, with the command line option for classifying the mail as Spam/Ham and moves them to the correct mailbox (Spam/inbox) afterwards. This works well in all MUAs, because it only requires IMAP functionality to train the filter. The solution was inspired by a Gentoo Wiki article (http://www.gentoo-wiki.info/Bogofilter). Patrick. -- STAR Software (Shanghai) Co., Ltd.http://www.star-group.net/ Phone:+86 (21) 3462 7688 x 826 Fax: +86 (21) 3462 7779 PGP key E883A005 https://stshacom1.star-china.net/keys/patrick_nagel.asc Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005
Re: [Dovecot] Spam filtering (was: Re: Sieve mails with decoded subject)
On Dec 10, 2009, at 11:51 PM, Patrick Nagel wrote: Of course initial training is necessary. For ongoing training / feedback I have set up a Spam/Learn-Spam and Spam/Learn-Ham mailbox into which I move false negatives/positives. Then again there are people like me who get mostly english mails, and a couple of legitimate finnish ones per month. And all of those finnish ones get 99% bayesian spamness from SpamAssassin so I can't rely on just that.. But anyway, SA works pretty nicely. Just today I looked through several months of my Spam mailbox and there was just one false positive (someone wanted urgent Dovecot support a month ago, seemed like a bad idea to reply to it).
Re: [Dovecot] Spam filtering
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2009-12-11 13:14, Timo Sirainen wrote: On Dec 10, 2009, at 11:51 PM, Patrick Nagel wrote: Of course initial training is necessary. For ongoing training / feedback I have set up a Spam/Learn-Spam and Spam/Learn-Ham mailbox into which I move false negatives/positives. Then again there are people like me who get mostly english mails, and a couple of legitimate finnish ones per month. And all of those finnish ones get 99% bayesian spamness from SpamAssassin so I can't rely on just that.. But anyway, SA works pretty nicely. Just today I looked through several months of my Spam mailbox and there was just one false positive (someone wanted urgent Dovecot support a month ago, seemed like a bad idea to reply to it). I think if you trained a couple hundred (non-Spam) Finnish mails as ham, the Bayesian filter would work fine for you. But yes, having that kind of imbalance between two (or more) classes of mails certainly makes Bayesian filtering less reliable. Patrick. - -- STAR Software (Shanghai) Co., Ltd.http://www.star-group.net/ Phone:+86 (21) 3462 7688 x 826 Fax: +86 (21) 3462 7779 PGP key E883A005 https://stshacom1.star-china.net/keys/patrick_nagel.asc Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005 -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org/ iEYEARECAAYFAksh39UACgkQ7yMg/OiDoAVSAwCgn01AXOzflATD3JMOW3lkh5H0 nskAn1In2byYL430qM9oHP7Cgyz0yj9g =yB61 -END PGP SIGNATURE-
Re: [Dovecot] Spam filtering (was: Re: Sieve mails with decoded subject)
On 12/10/2009 2:28 PM, Johannes Bauer wrote: Eduardo M KALINOWSKI schrieb: On Qui, 10 Dez 2009, Johannes Bauer wrote: I'm thinking about filtering all such encoded subjects (as there's no reason to encode them US-ASCII), but suppose it were UTF-8 or something: how can I filter on the actual content, not the encoded subject? Surely someone has solved that problem already? Yes, such as the guys behind SpamAssassin, or dspam, or any of the many spam filtering programs that exist. Actually, they make much more complicated decisions instead of only looking for bad words in the subject field. I'd suggest you try installing one of them. I had SpamAssassin running once and was pretty disappointed. All those complicated rules and scoring and smart bayesian filtering did not work very well, although I taught it in around 50k mails right from wrong. I had both lots of false-positives and lots of false-negatives, which was kind of annoying. However, analyzing 274 spam mails I deleted in the last 5 months I can conclude that by using that extremely simple filter list I'd catch 258 of them (that's 94%). So I'd like to stick to KISS in this case. From what I've seen, SA has been extremely good and accurate for us. We use amavisd-new to interface, but SA is at the end of a long chain of checks. Between the (3) HELO checks, clamav-milter, and a SPF policy daemon, we're killing ~60% of all connections at SMTP time. (I analyzed that in November, instead of 65/day hitting my inbox I would've seen 6x that amount if it wasn't for those checks. So ~80% of all spam was getting blocked at SMTP time.) If we were to pay for the Spamhaus Zen list, we could probably boost that percentage to 90%. All of the domains we do business with get a -2 or -4 score using amavisd-new. Specific addresses get a larger negative score. I ran a few thousand spam ham messages at the SA bayes filter, then turned it on. We tag messages with a [spam] flag at 5.0 and quarantine at 9.0. Tagged messages go to the user's Inbox, quarantined messages get sieve'd into a sub-folder in the user's mailbox. So far (in a month), no false positives. Or at least none that people have complained were quarantined when they should not have been. I'm considering lowering the quarantine threshold next month. It's been nice to have my Inbox back, without 65 spams/day cluttering it up. Now I might see 2-5 per day that slip through without getting tagged as borderline spam (at 5.0 or higher). Those are mostly zero-day spam that haven't made it to the URIBLs or DNSBLs yet. I'm still debating grey-listing, Razor, DCC or paying for the Spamhaus Zen list. Compared to another, commercial, product that we were using a few years ago, SA is very very good. Not perfect, but really does a good job of classifying things with decent accuracy.