[Dovecot] virtual folder - crash while searching

2012-08-01 Thread Matthias Rieber
Hi,

I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in
a virtual folder dovecot crashes.

Here's the stacktrace:

http://pastebin.com/urSDDzku

Regards,
Matthias


[Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

hello

I see this message in the dovecot error log every time
a user connect to IMAP service.

imap(): Error: opendir(/user//.imap) failed: No such 
file or directory


In the server's config I've this

mail_location = 
mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u


As we can see INDEX files are not living in user's home directories but 
in  /var/spool/dovecot/index/%u

so why this error message ?

BTW : users access normally to their IMAP folders , I'm just curious 
about this message

  which is not marked as warning but error

Thank you



[Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox

2012-08-01 Thread Nikolai Schupbach
I'm seeing the following error in our logs when removing mailboxes (we are 
using mdbox and dovecot 2.1.8):

Aug  1 20:03:36 msgsrv dovecot: imap(t...@test.com): Error: 
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation 
not permitted
Aug  1 20:03:36 msgsrv dovecot: imap(t...@test.com): Mailbox deleted: Spam

When I run truss against the process it appears the error relates to attempted 
unlink of a directory, not a stat of it, as reported by the log. However the 
mailbox does appear to be deleted fine, so it appears to be an erroneous error. 

Here is the truss output from the 3 DELETE INBOX.Spam IMAP command:

gettimeofday({1343808204.962165 },0x0)   = 0 (0x0)
gettimeofday({1343808204.962351 },0x0)   = 0 (0x0)
kevent(9,0x0,0,{0xb,EVFILT_READ,0x0,0,0x15,0x21c17a40},6,{1786.679649000 }) = 1 
(0x1)
gettimeofday({1343808216.031493 },0x0)   = 0 (0x0)
gettimeofday({1343808216.031676 },0x0)   = 0 (0x0)
read(11,3 DELETE INBOX.Spam\r\n,8179)  = 21 (0x15)
getpid() = 6293 (0x1895)
__sysctl(0x7fffd850,0x4,0x0,0x0,0x21c8f000,0x2a) = 0 (0x0)
clock_gettime(13,{1343808216.0 })= 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails,{ 
mode=drwx-- ,inode=28761,size=3,blksize=131072 }) = 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails,{ 
mode=drwx-- ,inode=28761,size=3,blksize=131072 }) = 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam,{ mode=drwx-- 
,inode=28760,size=3,blksize=131072 }) = 0 (0x0)
open(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log,O_RDWR,03753160)
 = 10 (0xa)
fstat(10,{ mode=-rw--- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0)
pread(0xa,0x21c3,0x90,0x0,0x1000,0x0)= 144 (0x90)
open(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index,O_RDWR,03731760)
 ERR#2 'No such file or directory'
open(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2,O_RDWR,03731520)
 ERR#2 'No such file or directory'
fstat(10,{ mode=-rw--- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0)
unlink(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) ERR#1 
'Operation not permitted'
stat(/usr/share/nls/C/libc.cat,0x7fffd0a0) ERR#2 'No such file or 
directory'
stat(/usr/share/nls/libc/C,0x7fffd0a0) ERR#2 'No such file or 
directory'
stat(/usr/local/share/nls/C/libc.cat,0x7fffd0a0) ERR#2 'No such file or 
directory'
stat(/usr/local/share/nls/libc/C,0x7fffd0a0) ERR#2 'No such file or 
directory'
write(2,\^A\b6293 prefix=imap(test@test,36) = 36 (0x24)
write(2,\^A\^D6293 stat(/mailstore/domai...,99) = 99 (0x63)
access(/etc/localtime,4)   = 0 (0x0)
open(/etc/localtime,O_RDONLY,04160026530)  = 12 (0xc)
fstat(12,{ mode=-r--r--r-- ,inode=16454,size=2434,blksize=4096 }) = 0 (0x0)
read(12,TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0...,41448) = 2434 (0x982)
close(12)= 0 (0x0)
issetugid(0x20ee7fd1,0x21e72000,0x0,0xa7,0x4e,0xc) = 1 (0x1)
open(/usr/share/zoneinfo/posixrules,O_RDONLY,056) = 12 (0xc)
fstat(12,{ mode=-r--r--r-- ,inode=545,size=3519,blksize=4096 }) = 0 (0x0)
read(12,TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0...,41448) = 3519 (0xdbf)
close(12)= 0 (0x0)
madvise(0x21eba000,0xb000,0x5,0x2b9,0x17,0x1)= 0 (0x0)
madvise(0x21e72000,0x5000,0x5,0x271,0x17,0x1)= 0 (0x0)
madvise(0x21e63000,0xc000,0x5,0x262,0x7fffcbf0,0x7fffcbf0) = 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log,{
 mode=-rw--- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0)
fstat(10,{ mode=-rw--- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0)
gettimeofday({1343808216.048607 },0x0)   = 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2,0x7fffd600)
 ERR#2 'No such file or directory'
setitimer(0,{0.00, 180.00 },{0.00, 0.00 }) = 0 (0x0)
fcntl(10,F_SETLKW,0x7fffd520)= 0 (0x0)
setitimer(0,{0.00, 0.00 },{0.00, 180.00 }) = 0 (0x0)
clock_gettime(13,{1343808216.0 })= 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log,{
 mode=-rw--- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0)
fstat(10,{ mode=-rw--- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0)
pwrite(0xa,0x21c09000,0xc,0x90,0x10ab6b8,0x2)= 12 (0xc)
pwrite(0xa,0x7fffd69c,0x4,0x90,0x10ab6b8,0x2) = 4 (0x4)
clock_gettime(13,{1343808216.0 })= 0 (0x0)
fcntl(10,F_SETLK,0x7fffd5e0) = 0 (0x0)
stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log,{
 mode=-rw--- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0)
fstat(10,{ mode=-rw--- ,inode=28762,size=156,blksize=4096 }) = 0 

Re: [Dovecot] ntlm auth / usernames with white spaces

2012-08-01 Thread Matthias Lay
works the same way! at least for ntlm but should do the same for spnego.

thx. didnt see your strarray join function.


On Tue, 2012-07-31 at 22:10 +0300, Timo Sirainen wrote:
 On 27.7.2012, at 17.32, Matthias Lay wrote:
 
  we experienced some problems with white spaces in usernames (this was
  NOT our idea) authenticated bei dovecots ntlmhelper
  
  I wrote a little patch fixing this, if you would like.
  
  patch applies on 2.1.7 and 2.1.8 (tested those)
 
 Does this simpler patch also work?




Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Charles Marcus

On 2012-08-01 2:09 AM, Matthias Rieber ml-dove...@zu-con.org wrote:

I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in
a virtual folder dovecot crashes.


Sorry, our crystal ball is broken, although Timo can sometimes get his 
to work, how I don't know... ;)


doveconf -n output?

Logs (untrimmed) showing the events leading to the crash?


Here's the stacktrace:

http://pastebin.com/urSDDzku


Stack trace *may* be useful to Timo, but first, please provide bare 
minimum details of your system/config/errors as requested above - as you 
should do *always* when asking for support for any software on any mail 
support list...


--

Best regards,

Charles


Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Charles Marcus

Please help us help you.

Always provide bare minimum system/config/error details, like:

Full doveconf -n output
(don't 'describe' your config with a one line copy/paste from some 
random config file)


Full (untrimmed) logs exhibiting the problem

On 2012-08-01 3:19 AM, Frank Bonnet f.bon...@esiee.fr wrote:

hello

I see this message in the dovecot error log every time
a user connect to IMAP service.

imap(): Error: opendir(/user//.imap) failed: No such
file or directory

In the server's config I've this

mail_location =
mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u

As we can see INDEX files are not living in user's home directories but
in /var/spool/dovecot/index/%u
so why this error message ?

BTW : users access normally to their IMAP folders , I'm just curious
about this message
which is not marked as warning but error


--

Best regards,

Charles


Re: [Dovecot] doveadm director move behaviour

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 7.32, Daniel Parthey wrote:

 Do you see any errors in logs? Especially:
 
 director: Error: connect(ipc) failed: Permission denied
 
 Looks very familiar to me.
 
 I'm having the same problem as Angel with director move that I have to kick 
 the user logged into the proxy. Plus I'm also getting the ipc permission 
 denied errors you mentioned.

I added a note about it to http://wiki2.dovecot.org/Director#Other_settings



Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

Yes sorry I forgot :-(

See attached the doveconf -n output

Thanks




On 08/01/2012 12:56 PM, Charles Marcus wrote:

Please help us help you.

Always provide bare minimum system/config/error details, like:

Full doveconf -n output
(don't 'describe' your config with a one line copy/paste from some 
random config file)


Full (untrimmed) logs exhibiting the problem

On 2012-08-01 3:19 AM, Frank Bonnet f.bon...@esiee.fr wrote:

hello

I see this message in the dovecot error log every time
a user connect to IMAP service.

imap(): Error: opendir(/user//.imap) failed: No such
file or directory

In the server's config I've this

mail_location =
mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u

As we can see INDEX files are not living in user's home directories but
in /var/spool/dovecot/index/%u
so why this error message ?

BTW : users access normally to their IMAP folders , I'm just curious
about this message
which is not marked as warning but error





--
CYBERDROID Inc.

Frank BONNET

01.45.92.66.17

Service des Moyens Informatiques Generaux

ESIEE PARIS
Cité Descartes / BP 99
93162 NOISY-LE-GRAND Cedex
http://www.esiee.fr http://www.esiee.fr/

# 2.1.8: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 9.0-RELEASE-p3 amd64  
auth_verbose = yes
auth_verbose_passwords = plain
auth_worker_max_count = 100
debug_log_path = /var/log/dovecot/debug.log
default_client_limit = 6144
default_process_limit = 1024
default_vsz_limit = 1 G
disable_plaintext_auth = no
info_log_path = /var/log/dovecot/info.log
log_path = /var/log/dovecot/dovecot.log
mail_debug = yes
mail_fsync = always
mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u
mail_temp_dir = /var/tmp
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character 
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy 
include variables body enotify environment mailbox date ihave
mbox_lock_timeout = 3 mins
mbox_write_locks = fcntl
mmap_disable = yes
namespace {
  inbox = yes
  location = 
  prefix = 
  separator = /
  subscriptions = yes
  type = private
}
passdb {
  args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext
  driver = ldap
}
plugin {
  acl = vfile
  sieve = ~/.dovecot.sieve
  sieve_dir = ~/sieve
}
postmaster_address = postmas...@esiee.fr
protocols = imap pop3
sendmail_path = /usr/local/sbin/sendmail
service auth {
  client_limit = 7169
}
service imap-login {
  inet_listener imap {
port = 143
  }
  inet_listener imaps {
port = 993
ssl = yes
  }
  process_min_avail = 10
  service_count = 1
  vsz_limit = 3 G
}
service imap {
  process_limit = 2048
  vsz_limit = 3 G
}
service managesieve-login {
  inet_listener sieve {
port = 4190
  }
  inet_listener sieve_deprecated {
port = 2000
  }
}
service pop3-login {
  inet_listener pop3 {
port = 110
  }
  inet_listener pop3s {
port = 995
ssl = yes
  }
}
ssl_ca = [REMOVED INTENTIONALLY]
ssl_cert = [REMOVED INTENTIONALLY]
ssl_key = [REMOVED INTENTIONALLY]
userdb {
  args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext
  driver = ldap
}
verbose_proctitle = yes
protocol lda {
  info_log_path = /var/log/dovecot/dovecot-lda.log
  log_path = /var/log/dovecot/dovecot-lda-errors.log
  mail_plugins = sieve $mail_plugins
}
protocol imap {
  imap_client_workarounds = tb-extra-mailbox-sep
  mail_max_userip_connections = 30
}
protocol sieve {
  mail_max_userip_connections = 30
  managesieve_implementation_string = Dovecot Pigeonhole
}


Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Charles Marcus

On 2012-08-01 7:03 AM, Frank Bonnet f.bon...@esiee.fr wrote:

Yes sorry I forgot :-(

See attached the doveconf -n output


Logs?


On 08/01/2012 12:56 PM, Charles Marcus wrote:

Please help us help you.

Always provide bare minimum system/config/error details, like:

Full doveconf -n output
(don't 'describe' your config with a one line copy/paste from some
random config file)

Full (untrimmed) logs exhibiting the problem


--

Best regards,

Charles


[Dovecot] can't recieve emails to inbox

2012-08-01 Thread Rafael Nathan
Hi,

I am unable to send emails to virtual users I created. Here is my output
for dovecot -n

# 1.0.7: /etc/dovecot.conf
log_path: /var/log/dovecot.log
info_log_path: /var/log/dovecot-info.log
ssl_disable: yes
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
mail_location: maildir:~/Maildir
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_plugin_dir(default): /usr/lib64/dovecot/imap
mail_plugin_dir(imap): /usr/lib64/dovecot/imap
mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3
auth default:
  verbose: yes
  passdb:
driver: passwd-file
args: /etc/dovecot/passwd
  passdb:
driver: pam
  userdb:
driver: passwd
  userdb:
driver: static
args: uid=vmail gid=vmail home=/home/vmail/%u


== Contents of my passwd file located at /etc/dovecot/passwd
us...@mydomain.com
us...@mydomain.com

I sent an email to us...@mydomain.com from gmail.com but can view it
anywhere.
Please suggest.
Where am I going wrong?


Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Robert Schetterer
Am 01.08.2012 07:36, schrieb Robert Schetterer:
 Am 31.07.2012 23:44, schrieb Timo Sirainen:
 On 1.8.2012, at 0.29, Robert Schetterer wrote:

 Cached message size smaller than expected
 and
 Maildir filename has wrong S value
 and
 Corrupted index cache file

 in dove 2.1.8

 i can reproduce the problem with tb 14
 with 2 nat machines connected to the same server

 the problem relates with create new folder then copy
 some uncompressed and compressed mail to it, the i.e
 open it by other client

 sometime this happens at once , sometime after a few copy actions

 I can't reproduce this. Are you sure the problem isn't that the old mails 
 already have a wrong S value and the errors happen when Dovecot tries to 
 read them? 
 
 at my recent onwledge
 mixing  compressed new mails from my sent folder, and older uncompressed
 ones ( which are shown nice both in tb ), with some copy action in a new
 folder from another client leads to wrong S
 and tb does not display them any longer sometime, perhaps a double zip
 happens?
 
 It would help to know how to reproduce this on an entirely empty mail
 account.

 
 i will try to test, but first i have to deal with now broken maildirs
 i try disable zlip plugin now ,as workaround hopefully this does not
 lead to more problems on old maildirs , and fix the problem with new mail
 

hi Timo, rolled back all stuff you recommended offlist
so situation is a bit better now, however why, i had to handle
cause more mailldirs get broken

i guess iam dealing with equal
Problems described here

http://www.mail-archive.com/dovecot@dovecot.org/msg43986.html

conversation with ralf, looks like your patch wasnt enough

i have a few mailboxes and folders now i cant fix
compressed files stay unreadable after move copy

by Maildir filename has wrong S value

i need some kind of mass repair actions etc , or some new patch
-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

On 08/01/2012 01:16 PM, Charles Marcus wrote:

On 2012-08-01 7:03 AM, Frank Bonnet f.bon...@esiee.fr wrote:

Yes sorry I forgot :-(

See attached the doveconf -n output


Logs?




All lines are IDENTICALS except the user id
I put MY login but it happen for ALL users when they connect


Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) 
failed: No such file or directory



BTW : I use real unix users thru nss_ldap  pam_ldap auth, no virtual user


On 08/01/2012 12:56 PM, Charles Marcus wrote:

Please help us help you.

Always provide bare minimum system/config/error details, like:

Full doveconf -n output
(don't 'describe' your config with a one line copy/paste from some
random config file)

Full (untrimmed) logs exhibiting the problem





--
CYBERDROID Inc.

Frank BONNET

01.45.92.66.17

Service des Moyens Informatiques Generaux

ESIEE PARIS
Cité Descartes / BP 99
93162 NOISY-LE-GRAND Cedex
http://www.esiee.fr http://www.esiee.fr/



Re: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 11.13, Nikolai Schupbach wrote:

 I'm seeing the following error in our logs when removing mailboxes (we are 
 using mdbox and dovecot 2.1.8):
 
 Aug  1 20:03:36 msgsrv dovecot: imap(t...@test.com): Error: 
 stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation 
 not permitted
 Aug  1 20:03:36 msgsrv dovecot: imap(t...@test.com): Mailbox deleted: Spam
 
 When I run truss against the process it appears the error relates to 
 attempted unlink of a directory, not a stat of it, as reported by the log. 
 However the mailbox does appear to be deleted fine, so it appears to be an 
 erroneous error. 

Fixed: http://hg.dovecot.org/dovecot-2.1/rev/8029f1b4afd0



Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 14.21, Frank Bonnet wrote:

 Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No 
 such file or directory

I don't see any obvious way for this to happen. Can you reproduce it by running 
imap process directly and talking imap protocol? Something like this would be 
helpful:

chmod a+rw /var/run/dovecot/config
gdb /usr/local/lib/dovecot/imap
b i_error
run
make gdb stop
bt full

where the make gdb stop will probably work if you do something like:

a list  *
b lsub  *
c select inbox

if not, check what IMAP commands your IMAP client sends when it fails. 
http://wiki2.dovecot.org/Debugging/Rawlog



Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

On 08/01/2012 01:27 PM, Timo Sirainen wrote:

On 1.8.2012, at 14.21, Frank Bonnet wrote:


Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No 
such file or directory

I don't see any obvious way for this to happen. Can you reproduce it by running 
imap process directly and talking imap protocol? Something like this would be 
helpful:

chmod a+rw /var/run/dovecot/config
gdb /usr/local/lib/dovecot/imap


it starts badly

mail# gdb /usr/local/libexec/dovecot/imap
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain 
conditions.

Type show copying to see the conditions.
There is absolutely no warranty for GDB.  Type show warranty for details.
This GDB was configured as amd64-marcel-freebsd...(no debugging 
symbols found)...

(gdb) b i_error
Function i_error not defined.




b i_error
run
make gdb stop
bt full

where the make gdb stop will probably work if you do something like:

a list  *
b lsub  *
c select inbox

if not, check what IMAP commands your IMAP client sends when it fails. 
http://wiki2.dovecot.org/Debugging/Rawlog




--
CYBERDROID Inc.

Frank BONNET

01.45.92.66.17

Service des Moyens Informatiques Generaux

ESIEE PARIS
Cité Descartes / BP 99
93162 NOISY-LE-GRAND Cedex
http://www.esiee.fr http://www.esiee.fr/



Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

On 08/01/2012 01:27 PM, Timo Sirainen wrote:

On 1.8.2012, at 14.21, Frank Bonnet wrote:


Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No 
such file or directory

I don't see any obvious way for this to happen. Can you reproduce it by running 
imap process directly and talking imap protocol? Something like this would be 
helpful:

chmod a+rw /var/run/dovecot/config
gdb /usr/local/lib/dovecot/imap
b i_error
run
make gdb stop
bt full

where the make gdb stop will probably work if you do something like:

a list  *
b lsub  *
c select inbox

if not, check what IMAP commands your IMAP client sends when it fails. 
http://wiki2.dovecot.org/Debugging/Rawlog



I ran it anyway , the output is below


%gdb /usr/local/libexec/dovecot/imap
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain 
conditions.

Type show copying to see the conditions.
There is absolutely no warranty for GDB.  Type show warranty for details.
This GDB was configured as amd64-marcel-freebsd...(no debugging 
symbols found)...

(gdb)
(gdb) b i_error
Function i_error not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (i_error) pending.
(gdb) run
Starting program: /usr/local/libexec/dovecot/imap
(no debugging symbols found)...(no debugging symbols found)...(no 
debugging symbols found)...(no debugging symbols found)...(no debugging 
symbols found)...(no debugging symbols found)...(no debugging symbols 
found)...(no debugging symbols found)...[New LWP 102225]

(no debugging symbols found)...Breakpoint 2 at 0x800ba4430
Pending breakpoint i_error resolved
[New Thread 801c07400 (LWP 102225/imap)]
Debug: Effective uid=3003, gid=3010, home=/user/bonnetf
Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, 
list=yes, subscriptions=yes 
location=mbox:/user/bonnetf/:INBOX=/var/mail/bonnetf:INDEX=/var/spool/dovecot/index/bonnetf
Debug: fs: root=/user/bonnetf, index=/var/spool/dovecot/index/bonnetf, 
control=, inbox=/var/mail/bonnetf, alt=
* PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID 
ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND 
UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE 
QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS 
SPECIAL-USE] Logged in as bonnetf

a list  *
* LIST (\NoInferiors \UnMarked) / .dovecot.sieve
* LIST (\NoInferiors \UnMarked) / NetAPP
* LIST (\NoInferiors \Marked) / Admin
* LIST (\NoInferiors \UnMarked) / CCIP
* LIST (\NoInferiors \UnMarked) / Clement
* LIST (\Noselect \HasChildren) / sieve
* LIST (\Noselect \HasChildren) / sieve/tmp
* LIST (\NoInferiors \UnMarked) / sieve/roundcube.sieve
* LIST (\NoInferiors \UnMarked) / Drafts
* LIST (\NoInferiors \UnMarked) / ESIEE
* LIST (\NoInferiors \UnMarked) / .dovecot.sieve.log
* LIST (\NoInferiors \UnMarked) / .dovecot.svbin
* LIST (\NoInferiors \UnMarked) / FPS
* LIST (\NoInferiors \Marked) / PRIVE
* LIST (\NoInferiors \UnMarked) / Sent
* LIST (\NoInferiors \UnMarked) / .vacation.msg
* LIST (\NoInferiors \UnMarked) / Templates
* LIST (\NoInferiors \UnMarked) / Trash
* LIST (\NoInferiors \UnMarked) / UMLV
* LIST (\NoInferiors \UnMarked) / Caille
* LIST (\NoInferiors \UnMarked) / Postmaster
* LIST (\NoInferiors \UnMarked) / Junk
* LIST (\NoInferiors \UnMarked) / Archives
* LIST (\NoInferiors \UnMarked) / bkup-ldap
* LIST (\NoInferiors \UnMarked) / Deleted Messages
* LIST (\NoInferiors \UnMarked) / Apple
* LIST (\NoInferiors \UnMarked) / Notes
* LIST (\NoInferiors \UnMarked) / EmailStuff
* LIST (\NoInferiors \UnMarked) / LISTSERV
* LIST (\NoInferiors \UnMarked) / RENATER
* LIST (\NoInferiors \UnMarked) / Free
* LIST (\NoInferiors \UnMarked) / filers
* LIST (\NoInferiors \UnMarked) / PRIVE2
* LIST (\NoInferiors \UnMarked) / SUSE-NOVELL
* LIST (\NoInferiors \UnMarked) / SYBASE
* LIST (\NoInferiors \UnMarked) / Nono
* LIST (\NoInferiors \UnMarked) / NGINX
* LIST (\NoInferiors \UnMarked) / DIFFGEN
* LIST (\NoInferiors \UnMarked) / ADESOFT
* LIST (\NoInferiors \UnMarked) / RENATER-TCS
* LIST (\NoInferiors \UnMarked) / Forensic
* LIST (\NoInferiors \UnMarked) / EnCours
* LIST (\NoInferiors \UnMarked) / BSD
* LIST (\NoInferiors \UnMarked) / NYP
* LIST (\NoInferiors \UnMarked) / Sent Messages
* LIST (\NoInferiors \UnMarked) / .forward
* LIST (\HasNoChildren) / INBOX
a OK List completed.
b lsub  *
* LSUB () / Admin
* LSUB () / CCIP
* LSUB () / Clement
* LSUB () / Drafts
* LSUB () / ESIEE
* LSUB () / FPS
* LSUB () / PRIVE
* LSUB () / Sent
* LSUB () / Templates
* LSUB () / Trash
* LSUB () / UMLV
* LSUB () / Caille
* LSUB () / Postmaster
* LSUB () / Junk
* LSUB () / Archives
* LSUB () / bkup-ldap
* LSUB () / Apple
* LSUB () / Deleted Messages
* LSUB () / Sent Messages
* LSUB () / Notes
* LSUB () / EmailStuff
* LSUB () / LISTSERV
* LSUB () / RENATER
* LSUB () / Free
* 

Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Timo Sirainen
See what you get by running the maildir through:
http://dovecot.org/tools/maildir-size-check.sh




Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Timo Sirainen
On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote:
  where the make gdb stop will probably work if you do something like:
 
  a list  *
  b lsub  *
  c select inbox
 
  if not, check what IMAP commands your IMAP client sends when it fails. 
  http://wiki2.dovecot.org/Debugging/Rawlog
 
 
 I ran it anyway , the output is below

All good, except the error didn't happen. So you'd need to look at the
IMAP traffic to see which command generates the error.




Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

On 08/01/2012 02:07 PM, Timo Sirainen wrote:

On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote:

where the make gdb stop will probably work if you do something like:

a list  *
b lsub  *
c select inbox

if not, check what IMAP commands your IMAP client sends when it fails. 
http://wiki2.dovecot.org/Debugging/Rawlog


I ran it anyway , the output is below

All good, except the error didn't happen. So you'd need to look at the
IMAP traffic to see which command generates the error.



we use thunderbird, maybe trying with evolution give some way ?



Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Robert Schetterer
Am 01.08.2012 14:06, schrieb Timo Sirainen:
 See what you get by running the maildir through:
 http://dovecot.org/tools/maildir-size-check.sh
 
 

tons of i.e

Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong
S=2647728 value, should be S=3838835

-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 15.12, Robert Schetterer wrote:

 Am 01.08.2012 14:06, schrieb Timo Sirainen:
 See what you get by running the maildir through:
 http://dovecot.org/tools/maildir-size-check.sh
 
 
 
 tons of i.e
 
 Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong
 S=2647728 value, should be S=3838835

If you don't mind the messages' IMAP UIDs changing, you could give the -f 
parameter to fix those.

(There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course 
noticed only after writing the whole script. That perl script should preferably 
be modified to support compressed mails and do those other checks, since it 
updates the uidlists and doesn't cause UIDs to change.)



Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 15.10, Frank Bonnet wrote:

 On 08/01/2012 02:07 PM, Timo Sirainen wrote:
 On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote:
 where the make gdb stop will probably work if you do something like:
 
 a list  *
 b lsub  *
 c select inbox
 
 if not, check what IMAP commands your IMAP client sends when it fails. 
 http://wiki2.dovecot.org/Debugging/Rawlog
 
 I ran it anyway , the output is below
 All good, except the error didn't happen. So you'd need to look at the
 IMAP traffic to see which command generates the error.
 
 
 we use thunderbird, maybe trying with evolution give some way ?

Something is wrong in Dovecot since it's logging an error. I just can't fix it 
unless I know what IMAP command causes the error.



Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Robert Schetterer
Am 01.08.2012 14:17, schrieb Timo Sirainen:
 On 1.8.2012, at 15.12, Robert Schetterer wrote:
 
 Am 01.08.2012 14:06, schrieb Timo Sirainen:
 See what you get by running the maildir through:
 http://dovecot.org/tools/maildir-size-check.sh



 tons of i.e

 Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong
 S=2647728 value, should be S=3838835
 
 If you don't mind the messages' IMAP UIDs changing, you could give the -f 
 parameter to fix those.

i will try things couldn not get more worst
 
 (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course 
 noticed only after writing the whole script. That perl script should 
 preferably be modified to support compressed mails 

jep compressed is a must have

and do those other checks, since it updates the uidlists and doesn't
cause UIDs to change.)
 

i will report next using script

-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

On 08/01/2012 02:19 PM, Timo Sirainen wrote:

On 1.8.2012, at 15.10, Frank Bonnet wrote:


On 08/01/2012 02:07 PM, Timo Sirainen wrote:

On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote:

where the make gdb stop will probably work if you do something like:

a list  *
b lsub  *
c select inbox

if not, check what IMAP commands your IMAP client sends when it fails. 
http://wiki2.dovecot.org/Debugging/Rawlog

I ran it anyway , the output is below

All good, except the error didn't happen. So you'd need to look at the
IMAP traffic to see which command generates the error.



we use thunderbird, maybe trying with evolution give some way ?

Something is wrong in Dovecot since it's logging an error. I just can't fix it 
unless I know what IMAP command causes the error.

ok understood , I have looked carrefully in logs , it *seems* to happen 
ONLY at the first connection of the day ...

would it be possible ? would it be a caching problem ?




Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Robert Schetterer
Am 01.08.2012 14:25, schrieb Robert Schetterer:
 Am 01.08.2012 14:17, schrieb Timo Sirainen:
 On 1.8.2012, at 15.12, Robert Schetterer wrote:

 Am 01.08.2012 14:06, schrieb Timo Sirainen:
 See what you get by running the maildir through:
 http://dovecot.org/tools/maildir-size-check.sh



 tons of i.e

 Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong
 S=2647728 value, should be S=3838835

 If you don't mind the messages' IMAP UIDs changing, you could give the -f 
 parameter to fix those.
 
 i will try things couldn not get more worst

 (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of 
 course noticed only after writing the whole script. That perl script should 
 preferably be modified to support compressed mails 
 
 jep compressed is a must have
 
 and do those other checks, since it updates the uidlists and doesn't
 cause UIDs to change.)

 
 i will report next using script
 

 ./maildir-size-check.sh -f maildir is an unknown option...?

-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] can't recieve emails to inbox

2012-08-01 Thread Thomas Leuxner
On Wed, Aug 01, 2012 at 04:48:01PM +0530, Rafael Nathan wrote:
 I am unable to send emails to virtual users I created. Here is my output
 for dovecot -n
 
 I sent an email to us...@mydomain.com from gmail.com but can view it
 anywhere.

Your MTA logs will most likely show. Anyway this version is ages old and
you should update to a current supported branch.

Regards
Thomas


signature.asc
Description: Digital signature


Re: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected

2012-08-01 Thread Robert Schetterer
Am 01.08.2012 14:58, schrieb Timo Sirainen:
 On 1.8.2012, at 15.43, Robert Schetterer wrote:
 
 If you don't mind the messages' IMAP UIDs changing, you could give the -f 
 parameter to fix those.

 i will try things couldn not get more worst

 ./maildir-size-check.sh -f maildir is an unknown option...?
 
 Oh, looks like I forgot to re-upload it after adding that option. It's there 
 now.
 

looks like working fine, but it has some problems with pathnames with
special char and spaces

-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Frank Bonnet

On 08/01/2012 02:19 PM, Timo Sirainen wrote:

On 1.8.2012, at 15.10, Frank Bonnet wrote:


On 08/01/2012 02:07 PM, Timo Sirainen wrote:

On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote:

where the make gdb stop will probably work if you do something like:

a list  *
b lsub  *
c select inbox

if not, check what IMAP commands your IMAP client sends when it fails. 
http://wiki2.dovecot.org/Debugging/Rawlog

I ran it anyway , the output is below

All good, except the error didn't happen. So you'd need to look at the
IMAP traffic to see which command generates the error.



we use thunderbird, maybe trying with evolution give some way ?

Something is wrong in Dovecot since it's logging an error. I just can't fix it 
unless I know what IMAP command causes the error.



do you think imaptest could help ?



Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 9.09, Matthias Rieber wrote:

 I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in
 a virtual folder dovecot crashes.
 
 Here's the stacktrace:
 
 http://pastebin.com/urSDDzku

Looks like fts-squat isn't currently compatible with virtual folders. I'd 
suggest moving to fts-lucene. But I guess this also fixes it:
http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad



[Dovecot] v2.1.9 released

2012-08-01 Thread Timo Sirainen
http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz
http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig

I've again mostly finished reading and answering most of the mails in
Dovecot mailing list. There are a couple annoyingly difficult / time
consuming bugreport mails that I haven't replied to yet, but if anyone
thinks I should have replied to something already feel free to resend
the mail.

For the new Redis/memcached dict stuff see
http://master.wiki2.dovecot.org/AuthDatabase/Dict and
http://master.wiki2.dovecot.org/Quota/Dict

I'm thinking about removing the new quota_ignore_save_errors=yes setting
in v2.2 and just forcing it enabled always. Thoughts? (I didn't want to
change v2.1 behavior by doing this.)

The most important changes since v2.1.8:

* mail-log plugin: Log mailbox names with UTF-8 everywhere 
  (instead of mUTF-7 in some places and UTF-8 in other places)
* director: Changed director_username_hash setting's default from %u
  to %Lu (= lowercase usernames). This doesn't break any existing
  installations, but might fix some of them.

+ doveadm: Added auth cache flush [username] command.
+ Implemented dict passdb/userdb
+ Implemented Redis and memcached dict backends, which can be used as
  auth backends. Redis can also be used as dict-quota backend.
+ Added plugin { quota_ignore_save_errors=yes } setting to allow saving
  a mail when quota lookup fails with temporary failure.
- Full text search indexing might have failed for some messages,
  always causing indexer-worker process to run out of memory.
- fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC when
  the header wasn't lowercased.
- fts-squat: Fixed crash when searching a virtual mailbox.
- pop3: Fixed assert crash when doing UIDL on empty mailbox on some
  setups. 
- auth: GSSAPI RFC compliancy and error handling fixes.
- Various fixes related to handling shared namespaces




Re: [Dovecot] doveadm director move behaviour

2012-08-01 Thread Daniel Parthey
Timo Sirainen wrote:
 On 1.8.2012, at 7.32, Daniel Parthey wrote:
 
  Do you see any errors in logs? Especially:
  
  director: Error: connect(ipc) failed: Permission denied
  
  Looks very familiar to me.
  
  I'm having the same problem as Angel with director move that I have to kick 
  the user logged into the proxy. Plus I'm also getting the ipc permission 
  denied errors you mentioned.
 
 I added a note about it to http://wiki2.dovecot.org/Director#Other_settings

 doveadm director move needs to be able to connect to the ipc socket. Make 
 sure the director process can do it.

 service ipc {
   unix_listener ipc {
 user = dovecot
   }
 }

Thanks, Timo.

Does this apply to the mailbox config or the director config?
Which instance needs to access the ipc socket of which instance?

Regards
Daniel
-- 
https://plus.google.com/103021802792276734820


Re: [Dovecot] doveadm director move behaviour

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 21.09, Daniel Parthey wrote:

 I added a note about it to http://wiki2.dovecot.org/Director#Other_settings
 
 doveadm director move needs to be able to connect to the ipc socket. Make 
 sure the director process can do it.
 
 service ipc {
  unix_listener ipc {
user = dovecot
  }
 }
 
 Thanks, Timo.
 
 Does this apply to the mailbox config or the director config?
 Which instance needs to access the ipc socket of which instance?

director instance needs access to director instance.



Re: [Dovecot] v2.1.9 released

2012-08-01 Thread ml
the recurring problems of these minor errors that often appear 
timesmap. I almost successful make them disappear with an ultra clean 
install. they appearing more generally for L INBOX Trash




Le 2012-08-01 19:58, Timo Sirainen a écrit :

http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz
http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig

I've again mostly finished reading and answering most of the mails in
Dovecot mailing list. There are a couple annoyingly difficult / time
consuming bugreport mails that I haven't replied to yet, but if 
anyone

thinks I should have replied to something already feel free to resend
the mail.

For the new Redis/memcached dict stuff see
http://master.wiki2.dovecot.org/AuthDatabase/Dict and
http://master.wiki2.dovecot.org/Quota/Dict

I'm thinking about removing the new quota_ignore_save_errors=yes 
setting
in v2.2 and just forcing it enabled always. Thoughts? (I didn't want 
to

change v2.1 behavior by doing this.)

The most important changes since v2.1.8:

* mail-log plugin: Log mailbox names with UTF-8 everywhere
  (instead of mUTF-7 in some places and UTF-8 in other places)
* director: Changed director_username_hash setting's default from %u
  to %Lu (= lowercase usernames). This doesn't break any existing
  installations, but might fix some of them.

+ doveadm: Added auth cache flush [username] command.
+ Implemented dict passdb/userdb
	+ Implemented Redis and memcached dict backends, which can be used 
as

  auth backends. Redis can also be used as dict-quota backend.
	+ Added plugin { quota_ignore_save_errors=yes } setting to allow 
saving

  a mail when quota lookup fails with temporary failure.
- Full text search indexing might have failed for some messages,
  always causing indexer-worker process to run out of memory.
	- fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC 
when

  the header wasn't lowercased.
- fts-squat: Fixed crash when searching a virtual mailbox.
- pop3: Fixed assert crash when doing UIDL on empty mailbox on some
  setups.
- auth: GSSAPI RFC compliancy and error handling fixes.
- Various fixes related to handling shared namespaces


--
  http://pgp.mit.edu:11371/pks/lookup?op=getsearch=0xC2626742
  gpg --keyserver pgp.mit.edu --recv-key C2626742

  http://about.me/fakessh
  http://urlshort.eu fakessh @
  http://gplus.to/sshfake
  http://gplus.to/sshswilting
  http://gplus.to/john.swilting
  https://lists.fakessh.eu/mailman/
  This list is moderated by me, but all applications will be accepted
  provided they receive a note of presentation


Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Matthias Rieber

Hello,

Am 01.08.2012 19:24, schrieb Timo Sirainen:

On 1.8.2012, at 9.09, Matthias Rieber wrote:


I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in
a virtual folder dovecot crashes.

Here's the stacktrace:

http://pastebin.com/urSDDzku


Looks like fts-squat isn't currently compatible with virtual folders. I'd 
suggest moving to fts-lucene. But I guess this also fixes it:
http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad


thanks, but in the meanwhile I moved to Solr, but I've still some, maybe 
different, crashes. I'll send a report later after upgrading to v2.1.9 
(with config and log).


Is lucence the better choice? According to the wiki Solr seems to be the 
most preferred solution.


Regards,
Matthias



Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 21.13, Matthias Rieber wrote:

 Is lucence the better choice? According to the wiki Solr seems to be the most 
 preferred solution.

Solr and Lucene both work. Solr has a newer Lucene version, but it requires 
running a Solr server.



Re: [Dovecot] v2.1.9 released

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 21.12, ml wrote:

 the recurring problems of these minor errors that often appear timesmap. I 
 almost successful make them disappear with an ultra clean install. they 
 appearing more generally for L INBOX Trash

Sorry, but that doesn't make any sense. What errors?



Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Matthias Rieber

Hi,

Am 01.08.2012 19:24, schrieb Timo Sirainen:

On 1.8.2012, at 9.09, Matthias Rieber wrote:


I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in
a virtual folder dovecot crashes.

Here's the stacktrace:

http://pastebin.com/urSDDzku


Looks like fts-squat isn't currently compatible with virtual folders. I'd 
suggest moving to fts-lucene. But I guess this also fixes it:
http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad


here are the crashes with fts_solr:

Configuration
-
# 2.1.9: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.26-2-vserver-amd64 x86_64 Debian 5.0.10
auth_master_user_separator = *
disable_plaintext_auth = no
listen = *
mail_location = maildir:~/Maildir
mail_plugins = virtual fts fts_solr zlib acl
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope 
encoded-character vacation subaddress comparator-i;ascii-numeric 
relational regex imap4flags copy include variables body enotify 
environment mailbox date ihave

namespace {
  hidden = yes
  inbox = no
  list = no
  location =
  prefix = mail
  separator =
  type = private
}
namespace {
  hidden = no
  inbox = yes
  location =
  prefix =
  separator = .
  type = private
}
namespace {
  hidden = yes
  inbox = no
  list = no
  location =
  prefix = INBOX.
  separator = .
  type = private
}
namespace {
  location = maildir:/home/sharedbox/Maildir
  prefix = shared.
  separator = .
  type = public
}
namespace {
  list = yes
  location = maildir:/home/%%n/Maildir
  prefix = common.%%u.
  separator = .
  subscriptions = no
  type = shared
}
namespace {
  hidden = no
  list = yes
  location = virtual:~/Maildir/virtual
  prefix = virtual.
  separator = .
  subscriptions = yes
  type = private
}
passdb {
  args = /etc/dovecot/dovecot-ldap.conf.ext
  driver = ldap
}
passdb {
  args = /etc/dovecot/passwd.masterusers
  driver = passwd-file
  master = yes
}
plugin {
  acl = vfile:/etc/dovecot/acls:cache_secs=7200
  acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db
  fts = solr
  fts_solr = url=http://localhost:8983/solr/
  sieve_dir = ~/Maildir/sieve
}
protocols = imap pop3 sieve
service imap {
  executable = imap
  vsz_limit = 1 G
}
service managesieve-login {
  inet_listener sieve {
port = 4190
  }
}
ssl_cert = /etc/dovecot/imap.scheff32.de.pem
ssl_key = /etc/dovecot/imap.scheff32.de.key
userdb {
  driver = passwd
  override_fields = system_groups_user=%u blocking=yes
}
protocol lda {
  mail_plugins = fts fts_solr zlib acl virtual sieve
}
protocol imap {
  mail_max_userip_connections = 32
  mail_plugins = virtual fts fts_solr zlib acl imap_acl imap_zlib
}
protocol sieve {
  mail_plugins = virtual fts fts_solr zlib acl sieve
}

Crash 1
---

What I did:

a LOGIN matthias 
a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE 
IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND 
UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE 
QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS 
SPECIAL-USE SEARCH=FUZZY COMPRESS=DEFLATE ACL RIGHTS=texk] Logged in

a SELECT virtual.all
* FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk 
LearnedAsNonJunk $has_cal $MDNSent 2TDB 3TBD $Forwarded $label1 $DONE 
$WEB $Label4 $MAILING $PBS $WAA $CHRISTOPH receipt-handled $PART foo 
redirected Junk LearnedAsJunk 1done test)
* OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk 
LearnedAsNonJunk $has_cal $MDNSent 2TDB 3TBD $Forwarded $label1 $DONE 
$WEB $Label4 $MAILING $PBS $WAA $CHRISTOPH receipt-handled $PART foo 
redirected Junk LearnedAsJunk 1done test \*)] Flags permitted.

* 365142 EXISTS
* 1 RECENT
* OK [UNSEEN 1270] First unseen.
* OK [UIDVALIDITY 1312063141] UIDs valid
* OK [UIDNEXT 799982] Predicted next UID
* OK [HIGHESTMODSEQ 249937] Highest
a OK [READ-WRITE] Select completed.
a SEARCH HEADER FROM foobar
(server disconects)

Log:

Aug  1 21:04:01 smtp dovecot: imap-login: Login: user=matthias, 
method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=18561, TLS, 
session=O8w+9TjGCAAKAAED
Aug  1 21:05:37 smtp dovecot: imap(matthias): Disconnected: Logged out 
in=689 out=239091
Aug  1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup 
failed: 413 FULL head

Aug  1 21:05:45 smtp dovecot: imap(matthias): Panic: Leaked t_pop() call
Aug  1 21:05:45 smtp dovecot: imap(matthias): Error: Raw backtrace: 
/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] - 
/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] - 
/usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] - 
/usr/local/lib/dov]
Aug  1 21:05:45 smtp dovecot: imap(matthias): Fatal: master: 
service(imap): child 18507 killed with signal 6 (core dumped)


Backtrace:

Core was generated by `dovecot/imap'.
Program terminated with signal 6, Aborted.
[New process 18507]
#0  0xf74d6556 in raise () from /lib/libc.so.6
#0  0xf74d6556 in raise () from /lib/libc.so.6
No symbol table info available.
#1  0xf74d7d78 in abort () from 

[Dovecot] doveadm purge -A via doveadm-proxy director fails after some users

2012-08-01 Thread Daniel Parthey
Daniel Parthey wrote:
 Timo Sirainen wrote:
  On 29.6.2012, at 19.21, Daniel Parthey wrote:
  
   Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(use...@domain1.example.org):
   Error: user use...@domain1.example.org: Error reading configuration:
   net_connect_unix(/var/run/dovecot/config) failed: Permission denied
  
  I've noticed a similar problem happening somewhat randomly, but I still
  haven't looked into why exactly it happens. Anyway the attached patch should
  fix this specific error, but I'm not sure if there isn't another one. Try 
  and
  let me know? :)
 
 Unfortunately, the problem still persists with dovecot 2.1.8,
 which already contains the following code:
 
 enum master_service_flags service_flags =
 MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN;
 const char *error;
 master_service = master_service_init(doveadm, service_flags,
 argc, argv, NULL);
 if (master_getopt(master_service)  0)
 return FATAL_DEFAULT;
 
 The command
 /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A
 still generates the following errors after iterating some dozen users:
 
 doveadm(nag...@metaways.de): Error: doveadm server failure
 doveadm: Error: Failed to iterate through some users
 
 Which information should I provide to help debugging the problem?

The change in 2.1.8 didn't fix it and still does not iterate *all* users.
My current workaround is to list all users, run a for-loop over the userlist
and flush one mailbox after another via the director.

Any hints how to solve this?

Regards
Daniel
-- 
https://plus.google.com/103021802792276734820


Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 22.21, Matthias Rieber wrote:

 here are the crashes with fts_solr:
..
 Crash 1
 Aug  1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 
 413 FULL head

The crash happens because the Solr lookup failed. I don't know what this Solr 
error means. Anyway, the crash itself is fixed by: 
http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68

 Crash 2
 #0  fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) 
 at fts-search.c:125
 125 for (i = 0; result-box_results[i].box != NULL; i++) {

Fixed: http://hg.dovecot.org/dovecot-2.1/rev/323d6ce62567



Re: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 22.32, Daniel Parthey wrote:

 Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(use...@domain1.example.org):
 Error: user use...@domain1.example.org: Error reading configuration:
 net_connect_unix(/var/run/dovecot/config) failed: Permission denied
 The change in 2.1.8 didn't fix it and still does not iterate *all* users.
 My current workaround is to list all users, run a for-loop over the userlist
 and flush one mailbox after another via the director.
 
 Any hints how to solve this?

The error is still the same config permission denied shown above? I found 
that also from my server and added a debug patch, but it hasn't crashed yet. 
Could you try the attached patch and getting a gdb backtrace from the resulting 
core file? (Or at least the raw backtrace - getting a core file might be 
tricky.)


diff
Description: Binary data




Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Matthias Rieber

Hi,

Am 01.08.2012 21:45, schrieb Timo Sirainen:

On 1.8.2012, at 22.21, Matthias Rieber wrote:


here are the crashes with fts_solr:

..

Crash 1
Aug  1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 
413 FULL head


The crash happens because the Solr lookup failed. I don't know what this Solr 
error means. Anyway, the crash itself is fixed by: 
http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68


I thought non-fulltext searches were done by dovecot itself?

Matthias




Re: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 22.56, Timo Sirainen wrote:

 On 1.8.2012, at 22.32, Daniel Parthey wrote:
 
 Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(use...@domain1.example.org):
 Error: user use...@domain1.example.org: Error reading configuration:
 net_connect_unix(/var/run/dovecot/config) failed: Permission denied
 The change in 2.1.8 didn't fix it and still does not iterate *all* users.
 My current workaround is to list all users, run a for-loop over the userlist
 and flush one mailbox after another via the director.
 
 Any hints how to solve this?
 
 The error is still the same config permission denied shown above? I found 
 that also from my server and added a debug patch, but it hasn't crashed yet. 
 Could you try the attached patch and getting a gdb backtrace from the 
 resulting core file? (Or at least the raw backtrace - getting a core file 
 might be tricky.)

Also I wonder if this helps (at least it fixes a crash I managed to cause): 
http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7



Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 23.06, Matthias Rieber wrote:

 here are the crashes with fts_solr:
 ..
 Crash 1
 Aug  1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup 
 failed: 413 FULL head
 
 The crash happens because the Solr lookup failed. I don't know what this 
 Solr error means. Anyway, the crash itself is fixed by: 
 http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68
 
 I thought non-fulltext searches were done by dovecot itself?

They are, but header searches are part of full text search.



[Dovecot] Problem with preserving MIME format with Dovecot IMAP and Outlook

2012-08-01 Thread Peter Grimmond







  

Re: [Dovecot] virtual folder - crash while searching

2012-08-01 Thread Matthias Rieber

Am 01.08.2012 22:16, schrieb Timo Sirainen:

On 1.8.2012, at 23.06, Matthias Rieber wrote:


here are the crashes with fts_solr:

..

Crash 1
Aug  1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 
413 FULL head


The crash happens because the Solr lookup failed. I don't know what this Solr 
error means. Anyway, the crash itself is fixed by: 
http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68


I thought non-fulltext searches were done by dovecot itself?


They are, but header searches are part of full text search.


alright. Some resources say that 413 FULL head means request too 
large. Maybe that's caused by the pretty big folder virtual.all which 
contains more than 36 mails.


Matthias



Re: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users

2012-08-01 Thread Daniel Parthey
Timo Sirainen wrote:
 On 1.8.2012, at 22.32, Daniel Parthey wrote:
 
  Jun 29 15:40:31 10.129.3.249 dovecot: 
  doveadm(use...@domain1.example.org):
  Error: user use...@domain1.example.org: Error reading configuration:
  net_connect_unix(/var/run/dovecot/config) failed: Permission denied
  The change in 2.1.8 didn't fix it and still does not iterate *all* users.
  My current workaround is to list all users, run a for-loop over the userlist
  and flush one mailbox after another via the director.
  
  Any hints how to solve this?
 
 The error is still the same config permission denied shown above? I found 
 that also from my server and added a debug patch, but it hasn't crashed yet. 
 Could you try the attached patch and getting a gdb backtrace from the 
 resulting core file? (Or at least the raw backtrace - getting a core file 
 might be tricky.)

Running command on a four host setup with mailbox+director instance each:
/usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A

Output is:
doveadm(usern...@example.org): Error: doveadm server failure
doveadm: Error: Failed to iterate through some users

Log says:
dovecot: doveadm(usern...@example.org): Error: userdb lookup: 
connect(/var/run/dovecot/auth-userdb) failed: Permission denied 
(euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, 
we're not in group 122(dovecot), dir owned by 0:0 mode=0755)
dovecot: doveadm(usern...@example.org): Error: purge: User lookup failed: 
Internal error occurred. Refer to server log for more information.

Here are the directory permissions:

mail01:~# id vmail
uid=501(vmail) gid=123(vmail) groups=123(vmail)

mail01:~# id dovecot
uid=120(dovecot) gid=122(dovecot) groups=122(dovecot)

mail01:~# ls -ld /var/run/dovecot
drwxr-xr-x 4 root root 660 2012-07-11 18:35 /var/run/dovecot

mail01:~# ls -l /var/run/dovecot
total 8
srw--- 1 rootroot  0 2012-07-10 18:29 anvil
srw--- 1 rootroot  0 2012-07-10 18:29 anvil-auth-penalty
srw--- 1 rootroot  0 2012-07-11 18:35 auth-client
srw--- 1 dovecot root  0 2012-07-11 18:35 auth-login
srw--- 1 rootroot  0 2012-07-11 18:35 auth-master
srw-rw 1 dovecot dovecot   0 2012-07-11 18:35 auth-userdb
srw--- 1 dovecot root  0 2012-07-11 18:35 auth-worker
srw--- 1 rootroot  0 2012-07-11 18:35 config
srw-rw 1 rootvmail 0 2012-07-11 18:35 dict
srw--- 1 rootroot  0 2012-07-11 18:35 director-admin
srw--- 1 rootroot  0 2012-07-10 10:19 director-userdb
srw-rw-rw- 1 rootroot  0 2012-07-11 18:35 dns-client
srw--- 1 rootroot  0 2012-07-11 18:35 doveadm-server
lrwxrwxrwx 1 rootroot 25 2012-07-10 18:29 dovecot.conf - 
/etc/dovecot/dovecot.conf
drwxr-xr-x 2 rootroot 40 2012-07-10 10:19 empty
srw--- 1 rootroot  0 2012-07-11 18:35 imap-postlogin
srw-rw-rw- 1 rootroot  0 2012-07-11 18:35 indexer
srw--- 1 dovecot root  0 2012-07-11 18:35 indexer-worker
srw--- 1 rootroot  0 2012-07-11 18:35 ipc
srw-rw-rw- 1 rootroot  0 2012-07-11 18:35 lmtp
srw--- 1 rootroot  0 2012-07-11 18:35 log-errors
drwxr-x--- 2 rootnogroup 180 2012-07-11 18:35 login
-rw--- 1 rootroot  5 2012-07-10 18:29 master.pid
-rw-r--r-- 1 rootroot 71 2012-07-10 18:29 mounts
srw--- 1 rootroot  0 2012-07-11 18:35 pop3-postlogin
srw--- 1 vmail   root  0 2012-07-11 18:35 quota-warning
srw--- 1 rootroot  0 2012-07-11 18:35 replication-notify
prw--- 1 rootroot  0 2012-07-11 18:35 replication-notify-fifo
srw--- 1 dovecot root  0 2012-07-11 18:35 replicator
srw--- 1 rootroot  0 2012-07-11 18:35 stats
prw--- 1 vmail   root  0 2012-08-01 22:20 stats-mail

Please see mailbox and director config attached.

Any help is appreciated.

Regards
Daniel
-- 
https://plus.google.com/103021802792276734820
# 2.1.8: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS 
auth_cache_negative_ttl = 0
auth_cache_size = 10 M
auth_cache_ttl = 1 mins
auth_verbose = yes
auth_verbose_passwords = sha1
deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$
dict {
  quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext
}
disable_plaintext_auth = no
doveadm_password = xxx
imapc_features = rfc822.size
imapc_host = local-mailbox
imapc_port = 18143
instance_name = dovecot-mailbox
lda_mailbox_autocreate = yes
lda_mailbox_autosubscribe = yes
login_greeting = Mailbox
login_log_format = mailbox: login: %$: %s
login_trusted_networks = 10.129.3.0/24
mail_debug = yes
mail_fsync = always
mail_gid = vmail
mail_home = /mail/dovecot/%d/%n
mail_location = mdbox:~/mail
mail_log_prefix = mailbox: mail: %s(%u): 
mail_plugins = quota stats
mail_privileged_group = vmail
mail_uid = vmail
managesieve_implementation_string = Sieve
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope 

Re: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 23.25, Daniel Parthey wrote:

 The error is still the same config permission denied shown above? I found 
 that also from my server and added a debug patch, but it hasn't crashed yet. 
 Could you try the attached patch and getting a gdb backtrace from the 
 resulting core file? (Or at least the raw backtrace - getting a core file 
 might be tricky.)
 
 Running command on a four host setup with mailbox+director instance each:
 /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A
 
 dovecot: doveadm(usern...@example.org): Error: userdb lookup: 
 connect(/var/run/dovecot/auth-userdb) failed: Permission denied 
 (euid=501(vmail) egid=123(vmail) missing +r perm: 
 /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 
 0:0 mode=0755)

Ah, so the original patch helped! This is a different error.

 srw-rw 1 dovecot dovecot   0 2012-07-11 18:35 auth-userdb

Simplest solution now would be to make this world-rw, see the auth-userdb 
socket configuration in http://wiki2.dovecot.org/LDA#Virtual_users

But I guess this should also be fixed by doveadm-server. Although I don't think 
this should be happening by default anyway. Maybe this is also solved by the 
http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 patch?



Re: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and MS Outlook client

2012-08-01 Thread Timo Sirainen
On 1.8.2012, at 23.53, Peter Grimmond wrote:

 have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS.  I have set up a 
 very basic IMAP configuration.  I have two different laptops running MS 
 Outlook (one MacOS, one Windows 7) and I have configured both to connect
 to the Dovecot service.  My problem is, emails in MIME format that I 
 synchronise from one MS Outlook client are not being correctly decoded 
 as MIME messages on the other client.  Instead, the message is rendered 
 in plaintext, starting with the lines:

Have you tried other clients? Maybe the mails are actually broken? In any case 
it doesn't really look like a Dovecot problem.



Re: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory

2012-08-01 Thread Daniel Parthey
Timo Sirainen wrote:
 On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote:
   where the make gdb stop will probably work if you do something like:
  
   a list  *
   b lsub  *
   c select inbox
  
   if not, check what IMAP commands your IMAP client sends when it fails. 
   http://wiki2.dovecot.org/Debugging/Rawlog
  
  I ran it anyway , the output is below
 
 All good, except the error didn't happen. So you'd need to look at the
 IMAP traffic to see which command generates the error.

Frank, please do a plaintext connect on IMAP port 143 from your mail client
to dovecot with a changed test password and record your traffic using tcpdump
or wireshark, something like this:

tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143

Then view the file pcap.dat with wireshark[1], right click on the TCP connection
and select Follow TCP Stream from the context menu. Then you'll get the IMAP
commands and responses spoken between Thunderbird and Dovecot.

Regards
Daniel

[1] http://www.wireshark.org/
-- 
https://plus.google.com/103021802792276734820