Re: [Dovecot] windows imap clients

2009-09-21 Thread Timo Sirainen

On Sep 21, 2009, at 7:07 AM, Charles Sprickman wrote:

-searches across 2GB+ of mail are painfully slow, since it's all  
server-side


You could improve this with http://wiki.dovecot.org/Plugins/FTS



Re: [Dovecot] Problem with quota in maildir++

2009-09-21 Thread Timo Sirainen

On Sep 18, 2009, at 12:07 PM, Antonio Casado Rodríguez wrote:

Hi all. I have a problem with one user. His quota is upper of real  
quota.


# cd /var/mail/problemuser/
# find . -name 'dovecot*' -exec rm -f {} \;
# find . -name 'maildir*' -exec rm -f {} \;
# echo test | mail problemuser -s test

# more maildirsize
104857600S
104215602 1439
647 1

# du -h


Well, du -h doesn't necessarily match the quota. For example if the  
user has copied the same message multiple times, du counts its disk  
space only once. I'd guess that's the problem. Perhaps there's a 1 MB  
mail that's been copied 80 times or something?


Maybe use something like ls -l for each cur/ directory and count the  
total numbers together. That should give something closer to the  
Maildir++ quota.




Re: [Dovecot] Sieve not fast enough after upgrade?

2009-09-21 Thread Timo Sirainen

On Sep 15, 2009, at 7:27 PM, Nikolay Shopik wrote:

I've upgraded mine Dovecot 1.0.15 to 1.2.4 also moved to new Sieve.  
I have simple sieve rule:


if header :contains Delivered-To [b...@bcc.inblock.ru] {
   setflag \\Seen;
}

It basically mark my own messages which are saved to Sent folder.  
When I was on 1.0.15 I never seen unread count in Thunderbird, but  
suddenly after upgrade I seen unread message in Sent folder just  
after I've sent message. If I open Sent folder it already marked as  
read.
Me wonder if this is actually Dovecot much faster delivers and  
reports to MUA there is new unread message or Sieve not perform fast  
enough?


The \Seen flag is set before the message is visible, so I can't really  
think of why this would be happening. Getting a rawlog from when TB  
sees this might be helpful. http://wiki.dovecot.org/Debugging/Rawlog




Re: [Dovecot] windows imap clients

2009-09-21 Thread Patrick Nagel
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 2009-09-21 14:21, Timo Sirainen wrote:
 On Sep 21, 2009, at 7:07 AM, Charles Sprickman wrote:
 
 -searches across 2GB+ of mail are painfully slow, since it's all
 server-side
 
 You could improve this with http://wiki.dovecot.org/Plugins/FTS

... but note that FTS creates one index per mailbox (=folder), so with a huge
amount of folders (which seems to be the case in your setup), it won't help you
much.

Timo, wasn't there a way to get around this limitation via virtual folders?

Patrick.

- -- 
STAR Software (Shanghai) Co., Ltd.  http://www.star-group.net/
Phone:+86 (21) 3462 7688 x 826   Fax:   +86 (21) 3462 7779

PGP key:  E883A005 https://stshacom1.star-china.net/keys/patrick_nagel.asc
Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/

iEYEARECAAYFAkq3KIAACgkQ7yMg/OiDoAVgIACfS0BCmyBwDRdtdwxNpZ7Ii+Ir
MPgAni8quZlnwYlRgBB0sKiJC7x0rJne
=B0Xg
-END PGP SIGNATURE-


Re: [Dovecot] Disconnected: Too many invalid IMAP commands

2009-09-21 Thread Gabriele
I was never meant to start a flame, so forgive me if I didn't observe 
the list guidelines.


The issue is solved now, it was a simple firewall (anti-malware setting) 
issue…


This runs against distro vs distro arguments, version vs version, etc.

Before writing to this list I already Googled, contacted a couple of 
Ubuntu forums, a couple of independent lists, to no avail. I either had 
no reply, or have been told to upgrade, to change distro, to compile vs 
using binaries, to switch to gentoo, etc. etc.


old stable isn't always cause of issues, in general, although I might 
agree with many of your statements and observations.


Thanks for your time, guys! :-)
Gabriele



Re: [Dovecot] Email box as mulitples files

2009-09-21 Thread Christian Schmidt
Hello Ammad,

Ammad Shah, 20.09.2009 (d.m.y):

 i have configured Dovecot to save all emails (Sent/recieve) in
 multiple files (MailDir) but still  emails are stored in single file
 (POP3 account) also  a single file in /var/spool/mail.

What abut your MTA? Is it configured to use Maildir?

Gruss/Regards,
Christian Schmidt

-- 
Q:  What's the difference between Bell Labs and the Boy Scouts of America?
A:  The Boy Scouts have adult supervision.


Re: [Dovecot] Override quota rules based on mail's content

2009-09-21 Thread Steffen Kaiser

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Thu, 10 Sep 2009, Marty Anstey wrote:


Actually I just tried this and it doesn't appear to work:

Fatal: Error in config file /etc/dovecot-noquota.conf: deliver doesn't
support !include directive


I manage multiple copies of conf's using make and:

a) patch / apply a diff each time
b) use a preprocessor, such as GNU m4

m4 is pretty easy, if one understands the illogic ` ' quoting :) Actually, 
m4 is superceeding patch and sed nowadays.


Bye,

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iQEVAwUBSrc5d3WSIuGy1ktrAQImjAgAkPUXjYx5AaI+/68PBGGcctbY2b83sLvI
5UL65Sl/tURsKkfyqHldlumJTz7VaO5BuqMnd4AlR0clb+XoSmNHu/MU1EOOADS2
oE+xr+yCg3R0uRv9dYkPsVP4Ahcxej51CCvGLSv6VJNLNnlNlTd4KxD5C7uIxLfj
eF+Kwcm3abclNxPH/5X08PNKb1d1rr0rJhTigd2y3jFI1j23Z+F4A8IUnye05ZOH
5E4rRnROI+ulGysExeVzVVDFfdMH9eeJvnXG/34LeAMKujZtI4fuD0NrkdfqpQNN
7k0P6QFJcrYKEYXGjFuBrxhTx+9Gbvz/bkK7JbDT+sycLqJTGlAmUg==
=SyTc
-END PGP SIGNATURE-


Re: [Dovecot] plugin development guide for non-FS backing store

2009-09-21 Thread Chang Song

Hello, Timo. Wow. directly from the creator ;-)

Thanks for the reply.

This is something completely new.
We are connecting to our pre-existing custom-made mail server.
IMAP needs to be plugged into the infrastructure.

So basically we can simply use existing index_* since we need to have
index files (on local fs) no matter what.

I saw dbox source file there. Is the layer stable (as far as API goes)?
Tell me more about the abstraction layer.

Thanks a lot!!

Chang


On Sep 21, 2009, at 2:44 PM, Timo Sirainen wrote:


On Sep 20, 2009, at 4:42 AM, Chang Song wrote:

I was wondering if anyone has some sort of guide or reference on  
plugin development.

We are trying to develop a non-filesystem backing store.

So basically we do not store mailboxes for users in local  
filesystem. We do RPC call

to fetch from fileservers.


Well, the best there exists currently is http://dovecot.org/list/dovecot/2007-November/026632.html 
 but it's for an old Dovecot version. You really should start with  
Dovecot v1.2.


Do you need to use some existing mail database or is it something  
completely new? I'm just wondering if my upcoming dbox filesystem  
abstraction layer would help you.


Anyway, basically just go and look at lib-storage/mail-storage.h and  
mail-storage-private.h and mailbox-list.h and mailbox-list- 
private.h. Implement those using your RPC calls, using index_*()  
functions wherever possible, just like the filesystem backends. You  
can also make Dovecot use in-memory indexes only with your database,  
although it probably would be better to just create them on local  
disk and act as kind of a cache.






Re: [Dovecot] windows imap clients

2009-09-21 Thread Timo Sirainen

On Sep 21, 2009, at 10:17 AM, Patrick Nagel wrote:


On 2009-09-21 14:21, Timo Sirainen wrote:

On Sep 21, 2009, at 7:07 AM, Charles Sprickman wrote:


-searches across 2GB+ of mail are painfully slow, since it's all
server-side


You could improve this with http://wiki.dovecot.org/Plugins/FTS


... but note that FTS creates one index per mailbox (=folder), so  
with a huge
amount of folders (which seems to be the case in your setup), it  
won't help you

much.


With Squat, yes. With Solr everything is in the same index.

Timo, wasn't there a way to get around this limitation via virtual  
folders?


I think with a virtual mailbox containing all mailboxes Squat also  
creates a single index for it. Solr is also optimized for virtual  
mailboxes, it won't even duplicate indexes for them.


I'm not very happy with Squat in general. The index updating speed is  
way too slow. Needs a redesign some day.. Nowadays Cyrus can also do  
incremental Squat indexing, I guess I should see how they're doing  
it. :)


Re: [Dovecot] Maildir quota reporting

2009-09-21 Thread David Kmoch
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Thanks for a kick in the right direction ;)

command

echo 1 getquotaroot inbox | USER=foo dovecot --exec-mail imap

doesn't work as expected

( HOME=/home/foo; USER=foo; echo 1 getquotaroot inbox | dovecot
- --exec-mail imap )

works much better

Now, with
  quota_rule = ?:storage=0

and a test user with maildirsize content
  102400S:

the above command shows

* PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOG reportsIN-REFERRALS
ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE
CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC
ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in as foo
* QUOTAROOT inbox User quota
* QUOTA User quota (STORAGE 0 100)
1 OK Getquotaroot completed.

result of that command in dovecot log with mail_debug = yes

ubik IMAP(foo): : Loading modules from directory: /usr/lib/dovecot/imap
ubik IMAP(foo): : Module loaded: /usr/lib/dovecot/imap/lib10_quota_plugin.so
ubik IMAP(foo): : Module loaded:
/usr/lib/dovecot/imap/lib11_imap_quota_plugin.so
ubik IMAP(foo): : Effective uid=0, gid=0, home=/home/foo
ubik IMAP(foo): : Quota root: name=User quota backend=maildir args=
ubik IMAP(foo): : Quota rule: root=User quota mailbox=? bytes=0 messages=0
ubik IMAP(foo): : maildir: data=/home/foo/Maildir
ubik IMAP(foo): : maildir++: root=/home/foo/Maildir, index=, control=,
inbox=/home/foo/Maildir
ubik IMAP(foo): : Namespace : Using permissions from /home/foo/Maildir:
mode=0700 gid=-1
ubik IMAP(foo): : Connection closed bytes=21/383

Is it OK, that bytes=0 is reported?


Timo Sirainen napsal(a):
 On Thu, 2009-09-03 at 10:57 +0200, David Kmoch wrote:
 and start dovecot again. The same result - TB still reports 20GB quota
 for user foo, the above echo command still reports 20971520, but(!),
 quota is actually unlimited for anyone. When I set some limit in
 ~foo/Maildir/maildirsize now, same values 20971520) are reported,
 although the limit works!
 
 Something weird is going on. What does it log about quota with
 mail_debug=yes?
 
 Finally, the question ;-) Where does that value (20971520) come from? Is
 it a feature or a bug?
 
 It's not a hard coded value for sure. Maybe it's reading a different
 maildirsize file. Maybe you have quota_rule=*:storage=20G coming from
 somewhere else.
 

- --

David Kmoch
Technical University of Liberec
Department of Applied Informatics
Halkova 6, 461 17 Liberec

tel: +420 485 353 633
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkq3SPoACgkQsUUM+N2AWobH6QCcCj/nvlWidqmf6h+tyYNo90cN
EigAnjLMK82jF8ysCyQ0tlblVpRPH1DQ
=s1V3
-END PGP SIGNATURE-


smime.p7s
Description: S/MIME Cryptographic Signature


Re: [Dovecot] plugin development guide for non-FS backing store

2009-09-21 Thread Timo Sirainen

On Sep 21, 2009, at 12:32 PM, Chang Song wrote:


This is something completely new.
We are connecting to our pre-existing custom-made mail server.
IMAP needs to be plugged into the infrastructure.


OK, so you do have some existing mails that need to be accessed.


So basically we can simply use existing index_* since we need to have
index files (on local fs) no matter what.


Right. And even if you didn't use actual index files, the same  
index_*() functions will be useful for in-memory indexes.


I saw dbox source file there. Is the layer stable (as far as API  
goes)?

Tell me more about the abstraction layer.


It probably won't be useful then, because if you have existing mails  
they won't be in dbox format. I guess you could maybe do some kind of  
translation on the fly, but that could just be more trouble than  
implementing your own storage backend.


I'd probably start by implementing your own mailbox-list backend. Then  
you could see that IMAP's LIST, CREATE, DELETE, RENAME commands work.  
That should be somewhat easy to do. You could temporarily just use  
e.g. Maildir backend and:


mail_location = maildir:~/Maildir:LAYOUT=rpc

After that works, create rpc mail-storage as well. cydir might be a  
good an easy example. The biggest problem is the mailbox_sync part.  
It's easiest if you can just trust that the local index files are up- 
to-date, otherwise you somehow need to figure out what had changed in  
the mailbox and update the indexes.


Re: [Dovecot] Maildir quota reporting

2009-09-21 Thread Timo Sirainen

On Sep 21, 2009, at 12:35 PM, David Kmoch wrote:

ubik IMAP(foo): : Quota rule: root=User quota mailbox=? bytes=0  
messages=0

..

Is it OK, that bytes=0 is reported?


Yes, because it hasn't yet read maildirsize at that point.


Re: [Dovecot] windows imap clients

2009-09-21 Thread Nikolay Shopik

On 21.09.2009 8:07, Charles Sprickman wrote:

They've been using Thunderbird for some time and I'm finding the
following issues there:

-searches across 2GB+ of mail are painfully slow, since it's all
server-side


TB3 does solve this problem with gloda, which index everything locally.

-while the inbox is checked regularly and automatically, other folders
are not unless the user manually checks them. getting tbird to do this
involves a fairly non-intuitive process, and there's also the issue of
making sure everyone actually adds the folders they need to watch


TB3 by default doing this if I not mistaken. (I've changed lot things in 
my config when was on 2.0)



-the client does not deal well with large amounts of mail in general -
some operations give no feedback, like expanding large sub-folders or
doing large copy/move operations.

Activity manager in TB3 should help.


app and starting the whole process again. dovecot deals with this more
gracefully than the old server (Courier), but it's still an issue
-offline operation would be handy sometimes, but tbird has no hybrid
mode, and again, one must select every folder for offline access


TB3 have offline mode enabled by default. What is hybrid mode?



Re: [Dovecot] Disconnected: Too many invalid IMAP commands

2009-09-21 Thread Gábor Lénárt
On Fri, Sep 18, 2009 at 11:03:48PM +1000, Noel Butler wrote:
 The problem however is many people very dangerously and wrongly consider
 that their beloved favourite distro package, is in fact the current
 stable and the only one that exists. I'm horrified by the number of
 people responsible for servers that wont use anything but an rpm or a
 deb, they simply refuse to use the source, even though its current and
 stable, far more so than that rpm/deb file at like 3 years out of date,
 and they have the nerve to get narky at you for not helping them *sigh* 

Well I can agree otherwise, but I can understand them too: they use (or even
bought with support) a distribution to have a solution, otherwise they would
be able to use own distro, compiling everything from source (hmm, gentoo?).
The problem, that if they use many softwares and all of their makers say
use a newer one soon they would find themselves with compiling
_everything_ (the kernel itself too, soon, if it's based on an OS with open
source kernel at least) from source, and maybe they don't want this,
especially not with dozens of servers with their own managing tools, and so
on. But otherwise fully agreed, I'm using most server softwares compiled
from sources :) Just I tried to understand the other opinion too. Hopefully
it was not highly off-topic here to tell this. [but it's also true that if
they want the distributor's packages, they should ask for help from them
maybe, because developers are focusing on the up-to-date versions and also
next development ones, but not very old ones even patched by distributors
with custom and/or backported patches ...]


Re: [Dovecot] Disconnected: Too many invalid IMAP commands

2009-09-21 Thread Timo Sirainen
I guess I should mention that I don't really mind people asking  
questions when they're using an old version, but if it's a bug report  
there's a good chance the answer is then upgrade.




Re: [Dovecot] windows imap clients

2009-09-21 Thread Charles Marcus
On 9/21/2009, Charles Sprickman (sp...@bway.net) wrote:
 They've been using Thunderbird for some time and I'm finding the following 
 issues there: 

I highly recommend you try the new Thunderbird 3 builds (current is b3 I
believe)...

It has mucho, much IMAP improvements, too many to go into...

-- 

Best regards,

Charles


Re: [Dovecot] windows imap clients

2009-09-21 Thread Charles Marcus
On 9/21/2009, Nikolay Shopik (sho...@inblock.ru) wrote:
 app and starting the whole process again. dovecot deals with this more
 gracefully than the old server (Courier), but it's still an issue
 -offline operation would be handy sometimes, but tbird has no hybrid
 mode, and again, one must select every folder for offline access

 TB3 have offline mode enabled by default.

I hate this (because I have a LOT of mail and do NOT want to have to
wait for hours for it all to download the first time I set up my account
on a new PC), and have opened a Feature Request to NOT have this be the
new default when TB3 ships:

https://bugzilla.mozilla.org/show_bug.cgi?id=508276

Basically:

1. If an upgrade is performed, TB3 should honor the current offline
settings - ie, if certain Accounts are set to full offline mode, TB3
should also set that account to full offline mode - but should also
default to the new 'On Demand' mode, which may be the 'Hybrid' mode you
mentioned.

2. If it is a new/clean install, the default should be 'On Demand',
which means, messages are downloaded for offline use, but only when
clicked on/selected.

3. Any folder can be set to full offline mode, and all others are set to
'On-Demand' by default.

It appears the Devs have accepted this FR as 'will be done', but not
sure about #3 (if these settings can be set on a perf older basis)... I
sure hope they can, because I do have a few folders I really would like
full offline mode for, but most I do not...

-- 

Best regards,

Charles


[Dovecot] Managesieve displays folder name (dovecot/sieve)

2009-09-21 Thread Seba
Hi,

I'm using Dovecot 1.2.4 with ManageSieve 0.11.9 and Sieve. All works
fine but users can subscribe to the folder dovecot/sieve which is
also displayed in the folders list.

protocols = imap managesieve

protocol managesieve {
listen = ip_address:2000
managesieve_logout_format = bytes ( in=%i : out=%o )
}

plugin {
  sieve=~/Maildir/.dovecot.sieve
  sieve_dir=/home/vmail/%d/%n/Maildir
}

In the maildir of the user I see this folders and files:

.Drafts/
.Sent
cur/
new/
temp/
sieve/
@.dovecot.sieve
ingo.sieve

The file ingo.sieve comes from Horde Ingo because users manage their
scripts with ingo.The symlink dovecot.sieve is correct and point to
ingo.sieve.

When users browse their available IMAP folders they'll see a folder
dovecot/sieve.

Can this be turned off or restricted with acl's? Without an symlink
all folders are displayed normally without the dovecot sieve folder.

Thanks.


Re: [Dovecot] Disconnected: Too many invalid IMAP commands

2009-09-21 Thread Charles Marcus
On 9/21/2009, Timo Sirainen (t...@iki.fi) wrote:
 I guess I should mention that I don't really mind people asking
 questions when they're using an old version, but if it's a bug report
 there's a good chance the answer is then upgrade.

Yours is one of the most helpful and patient attitudes I've ever seen on
a support list.

That said, the biggest reason I see for upgrading often, especially for
things like dovecot, is to take advantage of the performance
improvements and new capabilities/options.

Of course, eventually I'm sure dovecot will hit a wall where performance
improvements will be negligible, but for now, the difference between the
1.0.x version and 1.2.x is so great that anyone who refuses to upgrade
is simply missing out.

Can't wait for full Single-Instance-Storage support in dbox!

-- 

Best regards,

Charles


Re: [Dovecot] shared/public mailbox doesn't exist

2009-09-21 Thread Eric Shubert

Eric Shubert wrote:

I have 3 servers running dovecot 1.0.10. 2 of them are configured with a
shared/public namespace, but I'm having trouble getting it to work on
the third, even with 2 working examples to go by. There's something I'm
missing, and I'm hoping that someone here can see/tell what it is.

I've created the maildir for sharing:
# cd /home/vpopmail/domains/mydomain.com
# maildirmake shared
# chown -R vpopmail:vchkpw shared

Then added the configuration to dovecot.conf:
# shared namespace
namespace shared {
   separator = .
   prefix = shared.
   location = maildir:/home/vpopmail/domains/mydomain.com/shared
}

Restarted dovecot:
# service dovecot restart

When I try to subscribe to the shared namespace though with Outlook, I 
get: Failed to subscribe the folder. Server responded: 'Mailbox doesn't
exist: shared'. When I try to subscribe with Squirrelmail I get: 
ERROR: Could not complete request.

Query: SUBSCRIBE shared
Reason Given: [TRYCREATE] Mailbox doesn't exist: shared

I've tried various combinations of permissions to no avail.

Suggestions welcome. I'm at my wits end.



So I created a few subfolders.
# cd /home/vpopmail/domains/mydomain.com/shared
# maildirmake .sub1
# maildirmake .sub2
# chown vpopmail:vchkpw sub*

Voila, sort of. The main folder named 'shared' cannot be subscribed to, 
however sub1 and sub2 can be subscribed to successfully.


Can someone explain why that is?
Thanks.
--
-Eric 'shubes'



Re: [Dovecot] Dovecot versions and index compatibility

2009-09-21 Thread Timo Sirainen

On Sep 22, 2009, at 3:37 AM, Steven F Siirila wrote:


I realize these are older versions, but I'd like to know specifically
whether dovecot 1.1.6 and dovecot 1.1.8 are compatible index-wise.
In particular, if we downgraded from 1.1.8 to 1.1.6 would there be any
issues with doing so?


I never break any compatibility between micro versions. So, no.