Re: [Dovecot] delivering with maildrop
I presume he wants to filter first with maildir, then actually deliver using the dovecot delivery agent? yes In answer to the OP: read the maildropex man pages, but you have several options, eg: Yes found that dovecot-lda -m will do it nicely. echo mail message Test | /usr/local/libexec/dovecot/dovecot-lda -m dovecot just user agents are not able to display message with 0 headers. That confused me.
[Dovecot] dovecot.log warning
Hi Guys, Just I installed dovecot-2.1.0 in centos 5.7. and did copy of all user data i.e home directory and mail data from previous server which was on dovecot 1.2.8 to new one. Every thing is working fine. Mails are going and coming. But in dovecot.log file I an getting like imap(u...@example.com):Warning: fscking index file /home/ example.com/user/mail/.imap/VISA/dovecot.index Can any one specify why its coming and how can I fix it ? -- * Thanks Regards * *Jitendra Kumar Bhaskar* Cell:- +91 7306311531 +91 8102997821
[Dovecot] dovecot-1.2.9: OK No messages copied
Hi, When I issue an IMAP copy command using the wrong UID, the server gives an OK No messages copied response. This seems like the wrong response to me. If the UID doesn't exist, then it should respond with a No response - maybe something like NO - copy error: bad UID I believe OK No messages copied would only be a suitable response if the email with the supplied UID had already been known to be copied successfully. I am using dovecot 1.2.9 - has this been fixed in newer versions of dovecot? Regards Attila Attila Sipos Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB
[Dovecot] fts-solr not indexing body content
This could easily be me missing something, but I can't seem to get the
fts-solr plugin to index message bodies. Tcpdump shows me the
following being sent from Dovecot to Solr as a messages is indexed:
adddocfield name=uid6549/fieldfield
name=boxfde08816e80d6b4f2665b5f0b4b2/fieldfield
name=useruser/fieldfield
name=id6549/fde08816e80d6b4f2665b5f0b4b2/user/fieldfield
name=body
/fieldfield name=hdrReturn-path: ...
As you can see, the field name=body/-node contains just an empty line.
The above is just a snippet to illustrate the problem. A full dump can
be found at the following URL:
http://db.org/temp/solr.xml.txt
Full text search is configures such:
plugin {
fts = solr
fts_solr = break-imap-search url=http://127.0.0.1:8080/solr/
}
So; am I missing something, or is this a Dovecot problem?
dovecot.conf:
http://db.org/temp/dovecot.conf
Regards,
Bård Johannessen
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
On Mon, 2012-03-26 at 14:28 +0100, Attila Sipos wrote: When I issue an IMAP copy command using the wrong UID, the server gives an OK No messages copied response. This seems like the wrong response to me. If the UID doesn't exist, then it should respond with a No response - maybe something like NO - copy error: bad UID I believe OK No messages copied would only be a suitable response if the email with the supplied UID had already been known to be copied successfully. I am using dovecot 1.2.9 - has this been fixed in newer versions of dovecot? Dovecot's behavior is correct. This (or things related to this) has been discussed in IMAP protocol mailing list. Basically it's not an error to use nonexistent UIDs. If you want details, ask in IMAP protocol ml and someone will probably explain.
Re: [Dovecot] dovecot.log warning
On Mon, 2012-03-26 at 15:21 +0530, Jitendra Bhaskar wrote: Hi Guys, Just I installed dovecot-2.1.0 in centos 5.7. and did copy of all user data i.e home directory and mail data from previous server which was on dovecot 1.2.8 to new one. Every thing is working fine. Mails are going and coming. But in dovecot.log file I an getting like imap(u...@example.com):Warning: fscking index file /home/ example.com/user/mail/.imap/VISA/dovecot.index Can any one specify why its coming and how can I fix it ? This warning should not exist alone. Isn't there anything else logged?
[Dovecot] Error: Couldn't create namespace 'Share/' Dovecot 2.1.3 ldap
Mar 26 16:38:58 cartman dovecot: imap(m...@example.com): Error: Couldn't create namespace 'Share/' for user miha-sh...@example.com: userdb didn't return a home directory, but location used it (%h): maildir:%%h/Maildir:INDEX=%h/index/Shared/%%u Where is the problem, the same config worked with Dovecot 1.2.x -- View this message in context: http://old.nabble.com/Error%3A-Couldn%27t-create-namespace-%27Share-%27-Dovecot-2.1.3-ldap-tp33544743p33544743.html Sent from the Dovecot mailing list archive at Nabble.com.
Re: [Dovecot] Many messages clustered around the same date.saved value
On Sun, 2012-03-25 at 00:46 -0700, Joseph Tam wrote: Subject: Different user messages clustered around the same date.saved value After updating dovecot to 2.1.3, I can now use doveadm expunge -A ... to iterate through all user trash folders and expunge old messages. However, I noticed a strange thing: querying what would have been deleted doveadm -ftab fetch -A date.saved mailbox Trash savedbefore 7d showed many date.saved values are clustered around the same timestamp, even among different user's Trash mailbox. One user's trash mailbox having the same date.saved is explained by a user deleting a lot of message at one time, but I can't explain why many different users would have messages with the same (or closeby) date.saved value. Which mailbox format? With Maildir the date.saved is taken from dovecot.index.cache file, and in some cases that might get dropped. If it does, then it fallbacks to using the file's ctime.
Re: [Dovecot] Error: Couldn't create namespace 'Share/' Dovecot 2.1.3 ldap
On Mon, 2012-03-26 at 07:48 -0700, Tomislav Mihalicek wrote: Mar 26 16:38:58 cartman dovecot: imap(m...@example.com): Error: Couldn't create namespace 'Share/' for user miha-sh...@example.com: userdb didn't return a home directory, but location used it (%h): maildir:%%h/Maildir:INDEX=%h/index/Shared/%%u Where is the problem, the same config worked with Dovecot 1.2.x I'm guessing it didn't work properly with v1.2. Anyway, these would help giving suggestions: 1. dovecot -n output 2. Logs with auth_debug=yes and mail_debug=yes enabled
Re: [Dovecot] fts-solr not indexing body content
On Mon, 2012-03-26 at 15:29 +0200, Bård Johannessen wrote: This could easily be me missing something, but I can't seem to get the fts-solr plugin to index message bodies. What Dovecot version?
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
I can understand that if using a set of UIDS or a UID range it would be complicated to return a fully-descriptive result and from what I can see, the IMAP RFC author was trying to avoid this complexity. However, it someone specifies JUST ONE UID and that UID is non-existent, then a NO response could be a more useful response. I know the spec allows a response of OK but it is possible that this was not the intention for a single non-existent UID. Regards Attila -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: 26 March 2012 15:46 To: Attila Sipos Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.2.9: OK No messages copied On Mon, 2012-03-26 at 14:28 +0100, Attila Sipos wrote: When I issue an IMAP copy command using the wrong UID, the server gives an OK No messages copied response. This seems like the wrong response to me. If the UID doesn't exist, then it should respond with a No response - maybe something like NO - copy error: bad UID I believe OK No messages copied would only be a suitable response if the email with the supplied UID had already been known to be copied successfully. I am using dovecot 1.2.9 - has this been fixed in newer versions of dovecot? Dovecot's behavior is correct. This (or things related to this) has been discussed in IMAP protocol mailing list. Basically it's not an error to use nonexistent UIDs. If you want details, ask in IMAP protocol ml and someone will probably explain. Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB
Re: [Dovecot] fts-solr not indexing body content
On Mon, 2012-03-26 at 18:06 +0300, Timo Sirainen wrote: On Mon, 2012-03-26 at 15:29 +0200, Bård Johannessen wrote: This could easily be me missing something, but I can't seem to get the fts-solr plugin to index message bodies. What Dovecot version? Yeah, looks no one has tried to use Solr with Dovecot v2.1 before. This should fix it: http://hg.dovecot.org/dovecot-2.1/rev/bcc5e71650b9
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
It might be more useful from your point of view, but it might not be from from someone else's point of view. If you want this changed, see if you can convince other people in imap-protocol list. All of the widely used IMAP servers behave the way Dovecot does. On Mon, 2012-03-26 at 16:13 +0100, Attila Sipos wrote: I can understand that if using a set of UIDS or a UID range it would be complicated to return a fully-descriptive result and from what I can see, the IMAP RFC author was trying to avoid this complexity. However, it someone specifies JUST ONE UID and that UID is non-existent, then a NO response could be a more useful response. I know the spec allows a response of OK but it is possible that this was not the intention for a single non-existent UID. Regards Attila -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: 26 March 2012 15:46 To: Attila Sipos Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.2.9: OK No messages copied On Mon, 2012-03-26 at 14:28 +0100, Attila Sipos wrote: When I issue an IMAP copy command using the wrong UID, the server gives an OK No messages copied response. This seems like the wrong response to me. If the UID doesn't exist, then it should respond with a No response - maybe something like NO - copy error: bad UID I believe OK No messages copied would only be a suitable response if the email with the supplied UID had already been known to be copied successfully. I am using dovecot 1.2.9 - has this been fixed in newer versions of dovecot? Dovecot's behavior is correct. This (or things related to this) has been discussed in IMAP protocol mailing list. Basically it's not an error to use nonexistent UIDs. If you want details, ask in IMAP protocol ml and someone will probably explain. Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB
Re: [Dovecot] Dovecot 1.2.9 Crash, NFS
Thanks for the quick answer. I realised, that the error didn't occur since quite a while, opposed to what our client suggested. Back then I activated the two workarounds (imap_client_workarounds = outlook-idle delay-newmail) and increased mail_max_userip_connections for IMAP. Is it possible that those could have improved the situation? For now I don't have a way of reproducing the problem, so I will have to wait for an error to happen. Until then I will consider the problem as Solved until happens again ;-) , since the last error occured a while back (as mentioned above). Mar 6 08:26:31 mail02 dovecot: IMAP(u...@example.com): fdatasync(/data/vmail/example.com/user/dovecot-uidlist) failed: Input/output error Mar 6 08:42:29 mail02 dovecot: IMAP(u...@example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1522, file=1326961561.V15I4d8562M567017.mail02:2,Sad) Mar 6 08:42:29 mail02 dovecot: IMAP(u...@example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1523, file=1326705103.V15I90105M613353.mail01:2,Sad) Mar 6 08:42:29 mail02 dovecot: IMAP(u...@example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 - 1598) .. My suspicion/speculation what happens is the following: Multiple users are accessing the Mailbox from their offices (all on the same server), one (or more) uses the Webmail or accesses the Mailbox from a different IP. Somehow this leads to problems with Locks on NFS, which leads to the crash. Yes, most likely this is what's happening. Although your errors are more severe than what normally happens. I guess your NFS server is also partially to blame (microsecond resolution timestamps are at least helpful). I had a quick look a tour NFS (NetApp), but didn't find anything useful. In case the problem persists, I will check with the coworker responsible for NetApp. I will check what sort of locking is used by postfix, since I'm not sure if postfix and dovecot are configured to use the same mechanisms. If not, I think it could be part of the Problem. I have no idea how to solve this problem and any help is greatly appreciated. The only way to fully fix this is: http://wiki2.dovecot.org/Director Unfortunately that is not an option right now, but I will keep it in mind. Thanks again.
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
OK, clearly I am not experienced enough in IMAP to argue. I am sure the imap-protocol people will tell me to get lost! Thanks for your time. If you could possibly tell me how to know if an IMAP UID COPY is successful, I would appreciate it. Basically I'm moving a message from one folder to another. I thought I could issue a COPY command, check for success, then delete the email from the source folder. Regards Attila -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: 26 March 2012 16:23 To: Attila Sipos Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.2.9: OK No messages copied It might be more useful from your point of view, but it might not be from from someone else's point of view. If you want this changed, see if you can convince other people in imap-protocol list. All of the widely used IMAP servers behave the way Dovecot does. On Mon, 2012-03-26 at 16:13 +0100, Attila Sipos wrote: I can understand that if using a set of UIDS or a UID range it would be complicated to return a fully-descriptive result and from what I can see, the IMAP RFC author was trying to avoid this complexity. However, it someone specifies JUST ONE UID and that UID is non-existent, then a NO response could be a more useful response. I know the spec allows a response of OK but it is possible that this was not the intention for a single non-existent UID. Regards Attila -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: 26 March 2012 15:46 To: Attila Sipos Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.2.9: OK No messages copied On Mon, 2012-03-26 at 14:28 +0100, Attila Sipos wrote: When I issue an IMAP copy command using the wrong UID, the server gives an OK No messages copied response. This seems like the wrong response to me. If the UID doesn't exist, then it should respond with a No response - maybe something like NO - copy error: bad UID I believe OK No messages copied would only be a suitable response if the email with the supplied UID had already been known to be copied successfully. I am using dovecot 1.2.9 - has this been fixed in newer versions of dovecot? Dovecot's behavior is correct. This (or things related to this) has been discussed in IMAP protocol mailing list. Basically it's not an error to use nonexistent UIDs. If you want details, ask in IMAP protocol ml and someone will probably explain. Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
On Mon, 2012-03-26 at 16:30 +0100, Attila Sipos wrote: Thanks for your time. If you could possibly tell me how to know if an IMAP UID COPY is successful, I would appreciate it. Basically I'm moving a message from one folder to another. I thought I could issue a COPY command, check for success, then delete the email from the source folder. What kind of an application are you building? Most IMAP clients would track the state of the mailbox, so they would already know if the UIDs exist or no before they do a COPY. And that's really the only solution for this. If the client sees that some UID exists, but another session deletes it, the COPY will fail: a fetch 1 uid * 1 FETCH (UID 820) a OK Fetch completed. b uid copy 820 Trash * 1 EXPUNGE b NO [EXPUNGEISSUED] Some of the requested messages no longer exist. c uid copy 820 Trash c OK No messages copied.
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
thanks. I find it odd that the 2nd copy attempt returns OK. I would've thought the expungeissued reason would still stand. For how long does the reason persist? I suppose it only persists for enough time to issue a NO response? Regards Attila -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: 26 March 2012 16:38 To: Attila Sipos Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.2.9: OK No messages copied On Mon, 2012-03-26 at 16:30 +0100, Attila Sipos wrote: Thanks for your time. If you could possibly tell me how to know if an IMAP UID COPY is successful, I would appreciate it. Basically I'm moving a message from one folder to another. I thought I could issue a COPY command, check for success, then delete the email from the source folder. What kind of an application are you building? Most IMAP clients would track the state of the mailbox, so they would already know if the UIDs exist or no before they do a COPY. And that's really the only solution for this. If the client sees that some UID exists, but another session deletes it, the COPY will fail: a fetch 1 uid * 1 FETCH (UID 820) a OK Fetch completed. b uid copy 820 Trash * 1 EXPUNGE b NO [EXPUNGEISSUED] Some of the requested messages no longer exist. c uid copy 820 Trash c OK No messages copied. Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB
Re: [Dovecot] dovecot-1.2.9: OK No messages copied
Note how Dovecot sent the client EXPUNGE notification. Prior to that client knew that the message existed. After that client knows that the message no longer exists. It was only during the COPY command that client didn't know that the message had already been expunged. On Mon, 2012-03-26 at 16:51 +0100, Attila Sipos wrote: thanks. I find it odd that the 2nd copy attempt returns OK. I would've thought the expungeissued reason would still stand. For how long does the reason persist? I suppose it only persists for enough time to issue a NO response? Regards Attila -Original Message- From: Timo Sirainen [mailto:t...@iki.fi] Sent: 26 March 2012 16:38 To: Attila Sipos Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot-1.2.9: OK No messages copied On Mon, 2012-03-26 at 16:30 +0100, Attila Sipos wrote: Thanks for your time. If you could possibly tell me how to know if an IMAP UID COPY is successful, I would appreciate it. Basically I'm moving a message from one folder to another. I thought I could issue a COPY command, check for success, then delete the email from the source folder. What kind of an application are you building? Most IMAP clients would track the state of the mailbox, so they would already know if the UIDs exist or no before they do a COPY. And that's really the only solution for this. If the client sees that some UID exists, but another session deletes it, the COPY will fail: a fetch 1 uid * 1 FETCH (UID 820) a OK Fetch completed. b uid copy 820 Trash * 1 EXPUNGE b NO [EXPUNGEISSUED] Some of the requested messages no longer exist. c uid copy 820 Trash c OK No messages copied. Netcall Telecom Ltd Registered in England 2831215. Registered Office : 3rd Floor, Hamilton House, 111 Marlowes, Hemel Hempstead, Herts, HP1 1BB
Re: [Dovecot] dsync is SLOW compared to rsync
On Fri, 2012-03-23 at 23:12 -0700, Linda Walsh wrote: Next -- bench cp -ax, against rsync -axHAX when it has to copy 75% of the data (cp ~6-8x speed). But for file speed, 'dd' is king, as it can use large buffers (~16MB gives best results on my local Gbit network), but it misses all those pesky acls and extended attrs, not to mention file perms...*sigh* Compare that to the I/O done 4k at a time by many older utils... cp -ax: real0m3.088s user0m0.034s sys 0m3.054s rsync -axHAX real0m15.850s user0m19.314s sys 0m8.816s dsync's time was over six minutes. Each time I cleared out the destination folder. dsync is doing something that is taking much, much, much longer to do. ...Jeff
Re: [Dovecot] dsync is SLOW compared to rsync
On Sat, 2012-03-24 at 14:21 +0100, Maarten Bezemer wrote: On Fri, 23 Mar 2012, Jeff Gustafson wrote: That didn't seem to make much of a difference. On a 3.1GB backup it shaved off 5 seconds. dsync's time was over 6 minutes with or without the mail_fsync=never. rsync copied the same 3.1GB mailbox in 15 seconds. It seems to me that dsync *should* be able to be just as fast, but it currently is spending way too much time doing something. What is it? Syncing 3.1GB in 15 seconds would require a speed of more than 200MB per second. Depending on the harddisks used, that would be quite a challenge. If you use rsync to only transfer the files that changed (based on file modification time) you may or may not miss files that have changed but still have the same time stamp. I assume you didn't use the --checksum parameter to rsync, right? The destination directory was empty. I was doing a full backup. dsync does so much more than simply copy some files... I realize that. I am hoping that the extra data that dsync has available to it would improve the speed of syncing backups. My baseline testing of simply backing up a mailbox to an empty directory shows that dsync is takes way too long to backup a single mailbox. I have over a terabyte of data to backup. I'm currently using rsync and it must traverse tens of thousands of files and check the time information. It works, but I was hoping dsync would be a better solution. dsync should be able to sync faster, by gulping in the index information for each mailbox. I haven't even moved to the point of sync'ing since the baseline test of simply exporting a mailbox is so slow. ...Jeff
Re: [Dovecot] dsync redesign
On Sat, 2012-03-24 at 08:19 +0100, Attila Nagy wrote: I personally think that Dovecot could gain much more if the amount of work going into fixing or improving dsync would go into making Dovecot to (be able of) use a high scale, distributed storage backend. I know it's much harder, because there are several major differences compared to the low latency and consistency problem free local file systems, but its fruits are also sweeter for the long term. :) Do you have any suggestions for a distributed replicated filesystem that works well with dovecot? I've looked into glusterfs, but the latency is way too high for lots of small files. They claim this problem is fixed in glusterfs 3.3. NFS too slow for my installation so I don't see how any of the distributed filesystems would help me. I've also tried out ZFS, but it appears to have issues with metadata look ups with directories that have tens or hundreds of thousands of files in them. For me, the best filesystem is straight up ext4 running on locally attached storage. I think a solid, fast dsync implementation would be very useful for a large installation. ...Jeff
Re: [Dovecot] Error: Couldn't create namespace 'Share/' Dovecot 2.1.3 ldap
When i put service=lib-storage to users in ldap everything works. Is this a bug? cartman dovecot: auth: Debug: master in: USER 1 u...@example.net service=lib-storage Tomislav Mihalicek wrote: Mar 26 16:38:58 cartman dovecot: imap(m...@example.com): Error: Couldn't create namespace 'Share/' for user miha-sh...@example.com: userdb didn't return a home directory, but location used it (%h): maildir:%%h/Maildir:INDEX=%h/index/Shared/%%u Where is the problem, the same config worked with Dovecot 1.2.x -- View this message in context: http://old.nabble.com/Error%3A-Couldn%27t-create-namespace-%27Share-%27-Dovecot-2.1.3-ldap-tp33544743p33544762.html Sent from the Dovecot mailing list archive at Nabble.com.
Re: [Dovecot] Dovecot IMAP is broken after upgrade from 2.1.2 to 2.1.3
On 23.3.2012, at 22.57, Michael Neubert wrote: I just upgraded my servers from Dovecot 2.1.2 to Dovecot 2.1.3-0~auto+5 by using Debian binaries from http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.1 main. Mar 23 21:45:28 imap-login: Warning: SSL alert: where=0x4008, ret=256: warning close notify [xxx.xxx.xxx.xxx] Fixed: http://hg.dovecot.org/dovecot-2.1/rev/339b1337aab0
Re: [Dovecot] dsync redesign
Hello Timo, Thank you very much for planning a redesign of the dsycn and for opening this discussion. As I can see from the replies that came until now everybody misses the main point of IMAP: IMAP has been designed to work as a disconnected, high-latency data store. To make this more clear: once and IMAP client finishes the synchronization with the server, both have client and server have a consistent state of the mailbox. After this both the client and the server act like master for their own local copy (on the server new emails get created etc, on the client existing emails get changed (flags) and moved, and new emails appear (sent items)). So the protocol is designed, originally, to handle the master-master replication. And as this it make sense a deployment global-wide, where servers work independently and from time to time they merge the changes. This being said and acknowledged here are my 2 cents: I think that the current '1 brain / 2 workers' seems to be the correct model. The the client connects to the server and pushes the local changes and after retrieves the updated/new items from the server. The brain considers first server as the local storage and the second server as server storage. For the split design, come to the same conclusion of the state is very race-condition prone. As long as the algorithm is kept as you described it in the original document then the backups should really be incremental (because you only do the changes since last sync). As the most changes are metadata-only the sync can be pretty fast by merging indexes. Thank you, Andrei In case anyone is interested in reading (and maybe helping!) with a dsync redesign that's intended to fix all of its current problems, here are some possibly incoherent ramblings about it: http://dovecot.org/tmp/dsync-redesign.txt and even if you don't understand that, here's another document disguising as an algorithm class problem :) If anyone has thoughts on how to solve it, would be great: http://dovecot.org/tmp/dsync-redesign-problem.txt It only deals with saving new messages, not expunges/flag changes/etc, but those should be much simpler. !DSPAM:4f6cea4c260302917022693!
[Dovecot] LDAP Lookup not returning value in maxStorage
Hi there, We're setting up a Dovecot virtual email setup - we've got everything working perfect with LDAP logins authenticating against AD and so forth, but we're having issues with retrieving the maxStorage value from AD (this is a pre-setup field in AD that we'd like to use to set per user quotas). In our LDAP lookup, we have the maxStorage entry listed under user_attrs for the quota (user_attrs = maxStorage=quota_rule=*:storage=%$M), and in the debug logs, can see it trying to get the entry, but it fails with: Mar 27 13:19:27 auth: Debug: ldap(username@site,192.168.1.5): user search: base=dc=site,dc=local scope=subtree filter=((objectClass=person)(| (userPrincipalName=username@site) (|(mail=username@site)(samAccountName=username@site fields=maxStorage Mar 27 13:19:27 auth: Debug: ldap(username@site,192.168.1.5): no fields returned by the server At this point, we then see the default quota applied. If we change the name of the field from maxStorage to instanceType we see the value show up in the logs and passed through to the quota system and applied successfully: Mar 27 11:09:01 auth: Debug: ldap(username@site,192.168.1.5): user search: base=dc=site,dc=local scope=subtree filter=((objectClass=person)(| (userPrincipalName=username@site) (|(mail=username@site)(samAccountName=username@site fields=instanceType Mar 27 11:09:01 auth: Debug: ldap(username@site,192.168.1.5): result: instanceType(quota_rule=*:storage=%$M)=*:storage=4M Mar 27 11:09:01 auth: Debug: master out: USER 3901227009 username@sitequota_rule=*:storage=4M Which seems a bit weird. If we use ldapsearch and pass it the same search string and look for the field maxStorage, we clearly see the field and the value being returned. The result looks the same if we also lookup instanceType. We're using Dovecot 2.0.9. Does anyone have any idea as to why we can't use this field? Thanks, Andrew
Re: [Dovecot] Many messages clustered around the same date.saved value
Timo Sirainen wrote: However, I noticed a strange thing: querying what would have been deleted doveadm -ftab fetch -A date.saved mailbox Trash savedbefore 7d showed many date.saved values are clustered around the same timestamp, even among different user's Trash mailbox. ... I can't explain why many different users would have messages with the same (or closeby) date.saved value. Which mailbox format? With Maildir the date.saved is taken from dovecot.index.cache file, and in some cases that might get dropped. If it does, then it fallbacks to using the file's ctime. mbox. A further look into this reveals that the clustered date.saved values are the earliest values for every mailbox in the system. This timestamp is close to the time I was testing doveadm ... -A, so the likely explanation is that I accidentally deleted/updated these values using some variation of doveadm, even though I remember confining my testing to query/search/fetch. This appears to be a case of PEBKAC. These wrong values shouldn't cause problems with expunge queries since they err on the side of safety. Thanks for the insight though. Joseph Tam jtam.h...@gmail.com
