[Dovecot] Core Dump upon IMAP Login with latest HG (2.1) c067025026ed

2011-12-03 Thread Thomas Leuxner

Dec  4 07:27:41 spectre dovecot: imap-login: Login: user=, 
method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30987, TLS
Dec  4 07:27:42 spectre dovecot: imap-login: Login: user=, 
method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30990, TLS
Dec  4 07:27:42 spectre dovecot: master: Error: service(imap): child 30990 
killed with signal 11 (core dumped)
Dec  4 07:27:48 spectre dovecot: imap(t...@leuxner.net): Connection closed 
in=142 out=410
Dec  4 07:27:48 spectre dovecot: imap-login: Login: user=, 
method=PLAIN, rip=84.58.184.122, lip=1.2.3.4, mpid=30992, TLS
Dec  4 07:27:48 spectre dovecot: master: Warning: Killed with signal 15 (by 
pid=31013 uid=0 code=kill)

[ GDB Backtrace]

#0  0x7fa68d36f978 in mailbox_settings_find (user=0x22162f0, 
vname=0x21ec318 "INBOX") at mail-storage.c:610
   box_set__foreach_end = 
   box_set = 
#1  0x7fa68d371003 in mailbox_alloc (list=, 
vname=0x21ec318 "INBOX", flags=MAILBOX_FLAG_DROP_RECENT) at mail-storage.c:643
   _data_stack_cur_id = 4
   new_list = 0x22149b0
   storage = 0x221b760
   box = 0x222a9f0
   __FUNCTION__ = "mailbox_alloc"
#2  0x0040d8de in select_open (cmd=0x22259c0, readonly=false) at 
cmd-select.c:285
   client = 0x2224e30
   status = {messages = 2808, recent = 0, unseen = 0, uidvalidity = 0, 
uidnext = 0, first_unseen_seq = 0, first_recent_uid = 0, last_cached_seq = 0, 
highest_modseq = 834, keywords = 0x0, 
 permanent_flags = 0, nonpermanent_modseqs = 0, permanent_keywords = 0, 
allow_new_keywords = 0}
   flags = 8
   ret = 
#3  cmd_select_full (cmd=0x22259c0, readonly=false) at cmd-select.c:419
   client = 0x2224e30
   ctx = 
   args = 0x2228218
   list_args = 0x7fffbe1e9a58
   mailbox = 0x21ec318 "INBOX"
   ret = 
   __FUNCTION__ = "cmd_select_full"
#4  0x0041134d in command_exec (cmd=0x22259c0) at imap-commands.c:147
   hook = 0x21f5b40
   ret = 
#5  0x0041031e in client_command_input (cmd=0x22259c0) at 
imap-client.c:673
   client = 0x2224e30
   command = 
   __FUNCTION__ = "client_command_input"
#6  0x004103fd in client_command_input (cmd=0x22259c0) at 
imap-client.c:724
   client = 0x2224e30
   command = 0x0
   __FUNCTION__ = "client_command_input"
#7  0x00410625 in client_handle_next_command (client=0x2224e30) at 
imap-client.c:765
   size = 18
#8  client_handle_input (client=0x2224e30) at imap-client.c:777
   _data_stack_cur_id = 3
   ret = false
   remove_io = 
   handled_commands = false
   __FUNCTION__ = "client_handle_input"
#9  0x00410f4f in client_input (client=0x2224e30) at imap-client.c:816
   cmd = 
   output = 0x2225828
   bytes = 
   __FUNCTION__ = "client_input"
#10 0x7fa68d0fbf36 in io_loop_call_io (io=0x22258d0) at ioloop.c:377
   ioloop = 0x21f4630
   t_id = 2
#11 0x7fa68d0fcf6f in io_loop_handler_run (ioloop=) at 
ioloop-epoll.c:213
   ctx = 0x21f4850
   event = 0x21f48c0
   list = 0x2225920
   io = 0x22162f0
   tv = {tv_sec = 29, tv_usec = 928551}
   msecs = 
   ret = 
   i = 0
   call = false
#12 0x7fa68d0fbed8 in io_loop_run (ioloop=0x21f4630) at ioloop.c:396
No locals.
#13 0x7fa68d0e9433 in master_service_run (service=0x21f44f0, 
callback=0x21ec318) at master-service.c:499
No locals.
#14 0x00419141 in main (argc=1, argv=0x21f4370) at main.c:375
   set_roots = {0x41c020, 0x0}
   service_flags = 
   storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT
   postlogin_socket_path = 0x0
   username = 0x0
   c = 

[ doveconf -n ]

# OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.3 
auth_cache_size = 16 k
auth_verbose = yes
mail_location = mdbox:~/mdbox
mail_plugins = acl quota stats
namespace {
 hidden = no
 inbox = yes
 location = 
 prefix = 
 separator = /
 type = private
}
namespace {
 list = yes
 location = mdbox:/var/vmail/public
 prefix = Public/
 separator = /
 subscriptions = no
 type = public
}
passdb {
 args = username_format=%u /var/vmail/auth.d/%d/passwd
 driver = passwd-file
}
plugin {
 acl = vfile:/var/vmail/conf.d/%d/acls:cache_secs=300
 mail_log_events = expunge mailbox_delete
 quota = dict:user::file:%h/mdbox/dovecot-quota
 quota_rule = *:storage=1GB
 quota_rule2 = Trash:storage=+10%%
 sieve = ~/.dovecot.sieve
 sieve_dir = ~/sieve
 sieve_global_dir = /var/vmail/conf.d/%d/sieve
 stats_refresh = 30s
 stats_track_cmds = yes
}
protocols = imap lmtp
quota_full_tempfail = yes
service auth-worker {
 user = doveauth
}
service auth {
 unix_listener /var/spool/postfix/private/auth {
   group = postfix
   mode = 0660
   user = postfix
 }
 user = doveauth
}
service imap-login {
 inet_listener imap {
   address = 1.2.3.4
   port = 143
 }
 inet_listener imaps {
   port = 0
 }
}
service lmtp {
 unix_listener /var/spool/postfix/private/dovecot-lmtp {
   group = postfix
   mode = 0660
   user = postfix
 }
}
service stats {
 fif

Re: [Dovecot] Questions about single intance storage

2011-12-03 Thread Timo Sirainen
On 3.12.2011, at 22.30, Maria Arrea wrote:

> We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single 
> Instance Storage) and I have 5 questions:
> 
> 1º Is possible to "dedup" existing mdboxes?

You can dsync the mailbox elsewhere and then replace the original with the new 
copy.

> 2º Are attachments compressed with zlib if mdboxes already use zlib?

Currently attachments don't support zlib at all.

> 3º I have plenty CPU to spare, should I use a low value of 
> mail_attachment_min_size , like 16KB ?

It wastes disk seeks since it now has to read mail from 2 (or more) places in 
filesystem, so probably not a good idea. So in any case SiS most likely 
increases your disk IOPS usage.

> 4º Can I "undo" SiS if I have problems?

dsync will help the other way around too.

> 5º We use bacula to save indexes & mdboxes, and we recover mailboxes using 
> doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If 
> we enable SiS I am not really sure how can we safely restore a user's INBOX 
> if that user has SiS attachments.

Hm. Yes, that is problematic.. Even if you knew what SIS files were used, 
there's no simple way to restore those with proper refcounts. I think what 
really should be done is writing a tool that can create/restore backups, 
possibly de-SISing the attachments..

[Dovecot] Questions about single intance storage

2011-12-03 Thread Maria Arrea
Hello

 We are using dovecot 2.0.16 with mdbox+zlib. We are now testing SiS (Single 
Instance Storage) and I have 5 questions:

 1º Is possible to "dedup" existing mdboxes?
 2º Are attachments compressed with zlib if mdboxes already use zlib?
 3º I have plenty CPU to spare, should I use a low value of 
mail_attachment_min_size , like 16KB ?
 4º Can I "undo" SiS if I have problems?
 5º We use bacula to save indexes & mdboxes, and we recover mailboxes using 
doveadm import when a user "makes a fatal mistake" wiping all her Inbox. If we 
enable SiS I am not really sure how can we safely restore a user's INBOX if 
that user has SiS attachments.

 Thank you for your (great) support.

 Maria


Re: [Dovecot] MS Exchange IMAP Proxy

2011-12-03 Thread Terry Carmen

It's working!

I'll post a writeup on the wiki on monday.

The last problem was it seems to need a writable home directory for  
mail_home even though all the mail is pass-through.This was included  
in Timo's original config, although I had accidentally removed it.


In any case many thanks to Timo and everybody else who helped!

Terry





[Dovecot] Panic when attempting index with Apache Solr : fts_solr plugin

2011-12-03 Thread A Dovecot User
Dovecot version: 2.1.rc1
Expat version: expat-2.0.1-10
Libcurl version: libcurl-7.21.0-10
OS: Fedora 14 i686

Configure command: ./configure --with-solr

Solr version: 1.4.1 (also tried 3.5.0)
Java version: java-1.6.0-openjdk-1.6.0.0-55.1.9.10 (also tried Oracle
Java 6u29)

[root@mymailserver ~]# doveadm -D index -u username mailbox inbox

doveadm(username): Info: INBOX: Caching mails seq=1..466
doveadm(username): Panic: file solr-connection.c: line 545
(solr_connection_post_more): assertion failed: (maxfd >= 0)
doveadm(username): Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0(+0x3b9b1) [0x14b9b1] ->
/usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x47)
[0x14bac7] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0)
[0x1211ae] ->
/usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x293)
[0xb1a7d3] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x2599)
[0xb16599] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_build_more+0x31)
[0x2273f1] ->
/usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x3b2)
[0x228272] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xa74e)
[0x22d74e] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0xf)
[0x937a6f] -> doveadm() [0x80520b6] -> doveadm() [0x804f4b5] ->
doveadm(doveadm_mail_single_user+0x5b) [0x804f8db] -> doveadm()
[0x804fd3f] -> doveadm(doveadm_mail_try_run+0x12e) [0x805019e] ->
doveadm(main+0x3a4) [0x8056444] ->
/lib/libc.so.6(__libc_start_main+0xe6) [0x729e36] -> doveadm() [0x804f2c1]

--
mail_plugins = acl antispam fts fts_solr

plugin {
  fts = solr
  fts_solr = break-imap-search debug url=http://127.0.0.1:8983/solr/
}






Re: [Dovecot] lda/sieve ignores quota from ldap

2011-12-03 Thread Jens Meißner
Am Fri, 2 Dec 2011 23:22:24 +0200
schrieb Timo Sirainen :

> On 30.11.2011, at 20.04, Jens Meißner wrote:
> 
>> I'm using Dovecot 2.0 with Sieve as MDA and Postfix as MTA. The
>> Postfix delivery command is /usr/lib/dovecot/dovecot-lda -f
>> "$SENDER" -a "$RECIPIENT". I have set a default quota with
>> quota_rule = *:storage=1G. Some users should have a larger quota.
>> This is defined in a ldap directory and I have set 
> ..
> 
> You need to use dovecot-lda's -d parameter or it doesn't do a userdb
> lookup, so it won't see the per-user quota from ldap.

Thanks, it works well.


signature.asc
Description: PGP signature