Re: [Dovecot] mail spool filesystem

2011-08-31 Thread Kelsey Cummings
e my last choice: > > > > XFS is nice if you are working with large files (> 2GB), but > > for E-Mail i'd stick with ext3 (or maybe even reiser3) > > as it works very well with small files. > > XFS was designed for parallelism, whether with large files

[Dovecot] Master Users

2012-03-05 Thread Kelsey Cummings
? It would be totally acceptable to be able to say that master logins were only valid from a specific list of hosts rather than wiring specific master users to specific hosts. -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way

Re: [Dovecot] Master Users

2012-03-06 Thread Kelsey Cummings
On 03/05/12 17:33, Kelsey Cummings wrote: I have a setup where I need to use a Master User account to login on behalf of users normally authed via PAM. Is there any existing mechanism that will allow master users to be wired down to specific ip address rather Ah, found it. http://wiki2

[Dovecot] Just in time AV scanning

2012-03-14 Thread Kelsey Cummings
n scanning through the MXs to message retreval to snag a few more virues with updated definitions before they reach customers. Anyone doing anything similar? -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260

Re: [Dovecot] POP3 Performance

2012-03-16 Thread Kelsey Cummings
On 03/16/12 06:07, Timo Sirainen wrote: Maildir isn't very good for POP3, especially if the POP3 clients delete the mails after download. With Dovecot you could look into switching to multi-dbox format, which would have much better performance. Timo, can you explain why Maildir isn't a good f

Re: [Dovecot] Just in time AV scanning

2012-03-16 Thread Kelsey Cummings
On 03/16/12 08:30, Ed W wrote: 2) Extremely racey, but if you were on maildir you could use some kind of pre-login scripting to kick off a scan on login. Touch some lock file so that you can tell when last scanned and only scan if the definitions have been updated since you last scanned? I thin

Re: [Dovecot] POP3 Performance

2012-03-16 Thread Kelsey Cummings
On 03/16/12 10:54, Timo Sirainen wrote: Another thing our existing POP3 servers did was batch all of the deletes until after the +OK... was returned from quit. This doesn't reduce server load but has the impression of creating faster response times to the clients. You mean deleting the messa

[Dovecot] POP3 dele to Trash?

2012-04-06 Thread Kelsey Cummings
move the lost message from Trash to the Inbox where it would be fetched by their client again. Has anyone already done this? Should this be possible via a plugin? I see the deleted-to-trash imap plugin. We are using Maildir if it makes a difference. -- Kelsey Cummings - k...@corp.soni

Re: [Dovecot] POP3 dele to Trash?

2012-04-06 Thread Kelsey Cummings
On 04/06/12 16:40, Kelsey Cummings wrote: Has anyone already done this? Should this be possible via a plugin? I see the deleted-to-trash imap plugin. We are using Maildir if it makes a difference. Of course, this is exactly what the Lazy Expunge plugin does, isn't it? -K

Re: [Dovecot] Hints for a NFS-Setup

2012-04-17 Thread Kelsey Cummings
On 03/30/12 07:35, Timo Sirainen wrote: IP stickiness isn't enough if user uses more than one IMAP client, which is pretty common nowadays. And doesn't help at all with LDA. Timo, having the LDA flow through the director with maildir and NFS is only an issue if you want to use the dovecot del

Re: [Dovecot] High level of pop3 popping causing server to become unresponsive

2012-05-18 Thread Kelsey Cummings
is happening? -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

Re: [Dovecot] RAID1+md concat+XFS as mailstorage

2012-06-28 Thread Kelsey Cummings
On 06/28/12 05:56, Ed W wrote: So given the statistics show us that 2 disk failures are much more common than we expect, and that "silent corruption" is likely occurring within (larger) real world file stores, there really aren't many battle tested options that can protect against this - really

[Dovecot] Questions, Issues with 2.0

2010-05-03 Thread Kelsey Cummings
ot-test/sonic-imap ... It fails altogether: doveconf: Fatal: Error in configuration file /opt/dovecot-test/etc/dovecot/conf.d/imap.conf line 7: Unknown setting: executable Similarly, it also suggests 'drop_priv_before_exec = no' which doesn't appear to be valid either. -- Kelsey

Re: [Dovecot] Questions, Issues with 2.0

2010-05-03 Thread Kelsey Cummings
On Mon, May 03, 2010 at 03:25:48PM -0700, Kelsey Cummings wrote: > I'm trying to use an external program to set the location of user's > maildirs to match an existing hashing schema but the docs for how to do > this in 1.x do not seem to apply to 2.0 or I'm misinte

Re: [Dovecot] Questions, Issues with 2.0

2010-05-03 Thread Kelsey Cummings
On Tue, May 04, 2010 at 03:41:04AM +0300, Timo Sirainen wrote: > On 4.5.2010, at 1.25, Kelsey Cummings wrote: > > > I'm trying to use an external program to set the location of user's > > maildirs to match an existing hashing schema but the docs for how to do > >

Re: [Dovecot] Questions, Issues with 2.0

2010-05-07 Thread Kelsey Cummings
On Mon, May 03, 2010 at 05:33:12PM -0700, Kelsey Cummings wrote: > But I'm still curious for any tips or pointers on the other issue > w/regards adding an exterior maildir into a user's namespace. Anyone? (I'll freely admit to missing something obvious...) I'd rathe

[Dovecot] fts, solr, and client support

2010-09-04 Thread Kelsey Cummings
beats the snot out of the built in search for thunderbird. That said, is anyone running any of the fts plugins in a large scale environment? If so, what kind of scaling issues do you see? How do the search servers compare hardware wise to users count/spool size? -- Kelsey Cummings - k...@corp.so

Re: [Dovecot] restarting director

2011-02-07 Thread Kelsey Cummings
On Fri, Jan 21, 2011 at 08:00:08PM +0200, Timo Sirainen wrote: > On Fri, 2011-01-21 at 19:59 +0200, Timo Sirainen wrote: > > > I can take a look at it, but it would help if you were able to reproduce > > the problem. > > More clearly: Reliably reproduce this in a test setup :) Timo & Cor, did yo

[Dovecot] Client IP log variable for proxy/director setups?

2011-05-27 Thread Kelsey Cummings
e ages to figure out the Right place to add it since client->user doesn't seem to be available in client-common.c: get_var_expand_table(..). Perhaps I'm missing something obvious? -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect

Re: [Dovecot] Client IP log variable for proxy/director setups?

2011-05-31 Thread Kelsey Cummings
On Fri, May 27, 2011 at 12:00:25PM -0700, Kelsey Cummings wrote: > Timo - it would be very convenient if we could get a variable that held > the real client ip for use in logging with director/proxy setups. It's > clearly already passed around in client->user->remote_ip bu

Re: [Dovecot] doveadm "-S " option enabled in 2.0.8?

2011-06-01 Thread Kelsey Cummings
ll stats (and system health) directly out of dovecot rather than having to run agents on the dovecot servers to get the info into some other transport like SNMP. -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

[Dovecot] director monitoring?

2011-06-01 Thread Kelsey Cummings
vers and, so long as it was over a given threshold, to assume that the director is otherwise able to do its job and rely on external monitoring to pickup internal failures where dovecot isn't able to successfully proxy the connection to one of the real servers. So, how are people doing thi

Re: [Dovecot] director monitoring?

2011-06-02 Thread Kelsey Cummings
ction from human error rather than anticipated software failure. -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

Re: [Dovecot] director monitoring?

2011-08-05 Thread Kelsey Cummings
On Fri, Aug 05, 2011 at 11:12:03AM +0200, Jan-Frode Myklebust wrote: > On Thu, Jun 02, 2011 at 12:29:10PM -0700, Kelsey Cummings wrote: > > I'm using a hacked up version of poolmon. The only important changes > > are that it actually logs into the real server rathe

Re: [Dovecot] dovecot stats error

2012-08-25 Thread Kelsey Cummings
On 6/22/2012 6:34 AM, Timo Sirainen wrote: Which Dovecot version? I thought I fixed this already.. I'm seeing these errors running 2.1.8 -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522

Re: [Dovecot] dovecot stats error

2012-08-25 Thread Kelsey Cummings
On 8/25/2012 12:14 PM, Kelsey Cummings wrote: On 6/22/2012 6:34 AM, Timo Sirainen wrote: Which Dovecot version? I thought I fixed this already.. I'm seeing these errors running 2.1.8 Examples below, let me know if I can provide any other info Timo. In other news, we're finally m

[Dovecot] FS Quotas, what am I doing wrong?

2012-08-29 Thread Kelsey Cummings
I'm not able to get the FS quota module to behave as I expect. Depsite having function fs quotas and dovecot apparently configured to use then, the quotas appear to be empty and/or not configured. Any clues? # quota kgc Disk quotas for user kgc (uid 500): Filesystem blocks quota limi

[Dovecot] TIMO HELP! director ring wont stay connected

2012-09-03 Thread Kelsey Cummings
10.10.76 (old_ts=1346689481,handshaking,recv_ts=1346689468) >Sep 3 09:25:12 a.director. a dovecot: director: Error: Director 10.10.10.37:9321/right disconnected >Sep 3 09:25:12 a.director. a dovecot: director: Warning: director: Couldn't connect to right side, we must b

Re: [Dovecot] TIMO HELP! director ring wont stay connected

2012-09-03 Thread Kelsey Cummings
On 9/3/2012 11:32 AM, Robert Schetterer wrote: Am 03.09.2012 20:26, schrieb Kelsey Cummings: I've had 2x director ring up and running with production load on 2.1.8 with around 10,000 active connections for two weeks and everything has been working great - until this morning. meanwhil

Re: [Dovecot] TIMO HELP! director ring wont stay connected

2012-09-03 Thread Kelsey Cummings
mething to do with the OS or the network is really having some issues. I can't rule that out but there are not any signs that there are any hardware, OS or network related issues. Thanks for gettting the ring status into doveadm by the way. At least our monitoring caught this quick

Re: [Dovecot] TIMO HELP! director ring wont stay connected

2012-09-04 Thread Kelsey Cummings
On 09/03/12 12:06, Timo Sirainen wrote: On 3.9.2012, at 21.26, Kelsey Cummings wrote: I've had 2x director ring up and running with production load on 2.1.8 with around 10,000 active connections for two weeks and everything has been working great - until this morning. There isn'

Re: [Dovecot] TIMO HELP! director ring wont stay connected

2012-09-04 Thread Kelsey Cummings
On 9/4/2012 5:58 PM, Timo Sirainen wrote: On 3.9.2012, at 21.26, Kelsey Cummings wrote: passdb { args = proxy=y nopassword=y driver = static } I wonder if someone was doing a ton of logins for different usernames? This kind of setup where director doesn't verify the username c

Re: [Dovecot] dovecot stats: useful data to gather

2012-09-05 Thread Kelsey Cummings
On 06/02/12 17:10, Daniel Parthey wrote: Patrick Ben Koetter wrote: following our discussion on dovecot stats at the LinuxTag 2012 my team and I sat down and put together a list of stat items we think to be useful in daily dovecot usage. Besides pulling together all the data we also think it wo

Re: [Dovecot] TIMO HELP! director ring wont stay connected

2012-09-12 Thread Kelsey Cummings
Timo, I'm glad to hear that you found a plausible cause and have got a patch in to fix it. -K

[Dovecot] Proxy connection timeouts

2012-09-17 Thread Kelsey Cummings
We are seeing a few (0-15) proxy failures like the following out of ~3m successful proxied connections a day. Average session creation load over our peak hour is about 47/sec. The backend servers aren't logging anything that would suggest any internal problem like insufficient processes to han

[Dovecot] (new) director issues in 2.1.10

2012-09-26 Thread Kelsey Cummings
Timo - I upgraded to 2.1.10 on our director servers two nights ago and apart from errors associated with the directors processes restarting everything looked great for ~24 hours until I failed our the real servers last night to update the nfs mount options for the spools. I followed the sugges

Re: [Dovecot] (new) director issues in 2.1.10

2012-09-26 Thread Kelsey Cummings
On Wed, Sep 26, 2012 at 08:57:58PM +0300, Timo Sirainen wrote: > On 26.9.2012, at 20.34, Kelsey Cummings wrote: > > > The following errors on the directors that started after this went > > unnoticed until this AM. > > > > director: User bb host lookup failed: Time

Re: [Dovecot] (new) director issues in 2.1.10

2012-09-26 Thread Kelsey Cummings
On 09/26/12 11:06, Kelsey Cummings wrote: No, there continued to be a mix of both. The pattern seems to look like this. I'll run some stats later but it looks like a pretty significant number of users where affected. Timo, it looks like the total number of affected users was only about

Re: [Dovecot] possible nfs issue

2012-10-03 Thread Kelsey Cummings
urs are ex messages? I figured this was a probably a regression in the RHEL6.3 (Sl6.3) (2.6.32-279.9.1.el6.x86_64) kernel. What are you running Cor? -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 70

Re: [Dovecot] Multiple Maildir?

2012-10-09 Thread Kelsey Cummings
On 10/09/12 15:42, Daniel Parthey wrote: Marc Perkel wrote: if the mail location doesn't exist then I want to try a second mail location: mail_location = maildir:/email/%d/%n:INBOX=/email/%d/%n:LAYOUT=fs You might do this with a script which exports the MAIL environment variable and then execu

Re: [Dovecot] (new) director issues in 2.1.10

2012-10-22 Thread Kelsey Cummings
On Mon, Oct 22, 2012 at 03:39:34PM +0300, Timo Sirainen wrote: > On 26.9.2012, at 21.06, Kelsey Cummings wrote: > > > 09:25:21 .. User X host lookup failed: Timeout - queued for 30 secs (Ring > > synced for 5032 secs) > > 09:25:55 .. User X host lookup failed: Timeout -

[Dovecot] memory allocation issues

2012-11-08 Thread Kelsey Cummings
her identical servers are/were handling virtually identical load with the same service uptime and haven't had any issues so far. (Crash happened 7 days ago.) -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 22

Re: [Dovecot] memory allocation issues

2012-11-26 Thread Kelsey Cummings
On Fri, Nov 23, 2012 at 08:36:37AM +0200, Timo Sirainen wrote: > On 9.11.2012, at 2.49, Kelsey Cummings wrote: > > One of our dovecot backend servers ran into a problem with it's auth > > process a few days ago. This doesn't appear to be the error logged when > >

[Dovecot] stats plugins causing dns lookup per connection

2013-03-11 Thread Kelsey Cummings
ssary. -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

Re: [Dovecot] stats plugins causing dns lookup per connection

2013-03-13 Thread Kelsey Cummings
On 03/12/13 06:58, Axel Luttgens wrote: > started for seemingly unrelated reasons, but ended with some form of cacheing > of the results fetched with gethostbyname(). It is a bit odd that it would totally block unless DNS requests on your hosts weren't working at all - and even then, the requests

[Dovecot] ios clients and namespace trouble

2013-04-24 Thread Kelsey Cummings
We migrated to dovecot from courier and maintained a courier compatible namespace configuration. This resulted in ios clients needing to be manually configured in order to use the special folders correctly (delete messages, save drafts, etc) either by being given the correct "Path Prefix" or b

Re: [Dovecot] ios clients and namespace trouble

2013-04-24 Thread Kelsey Cummings
On 2013-04-24 10:54, Robert Schetterer wrote: Apple has a long history with bugs on imap, they are focused in using their own services, so they might never fix outside stuff, but however why not ask Apple for help, you paid a lot to them I've never paid them a dime to them in my life but I prob

Re: [Dovecot] ios clients and namespace trouble

2013-04-26 Thread Kelsey Cummings
On 4/24/2013 12:05 PM, Kelsey Cummings wrote: > before or if they had tried and failed. Perhaps a hidden namespace with > folders linked to the real special folders or might that have unintended > consequences? This seems to kinda work with the only oddity being that the ios clien

Re: [Dovecot] Idea: POP3 deletion as a flag

2013-05-03 Thread Kelsey Cummings
On 2013-05-03 09:14, Timo Sirainen wrote: GMail doesn't delete mails when POP3 client issues a DELE command for it. Instead they just become invisible for future POP3 sessions, but they still exist for IMAP/webmail. The same could be implemented pretty easily for Dovecot: How does the usage cas

Re: [Dovecot] Idea: POP3 deletion as a flag

2013-05-03 Thread Kelsey Cummings
On 2013-05-03 15:44, Timo Sirainen wrote: I didn't ask what their main reason for this was, but for me it would be: "Oops, I accidentally configured my new email client as POP3 instead of IMAP, and now it deleted everything from my INBOX." With lazy_expunge the user would have to explicitly go an

Re: [Dovecot] Idea: POP3 deletion as a flag

2013-05-06 Thread Kelsey Cummings
On 2013-05-03 19:13, Professa Dementia wrote: When I specify that an email be deleted from the server, I expect that it is *deleted*. While I see the point you're trying to make, I don't think it is valid. On our servers the deleted message could exist in filesystem snapshots, disk->disk bac

Re: [Dovecot] avoid log message when using nagios check

2013-07-10 Thread Kelsey Cummings
networks would be really helpful. Same here. We use LVS with surealived and LUA scripting to do a complete login/logout cycle as part of the health check. Even the ancient Alteon's had similar functionality (and supported common protocols like pop and imap out of the box.) -- Kelsey

Re: [Dovecot] courier to dovecot

2013-07-16 Thread Kelsey Cummings
lity so existing clients that are hard coded hopefully wont trip up on themselves too bad. -- Kelsey Cummings - k...@corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

Re: index corruption weirdness

2018-10-10 Thread Kelsey Cummings
On 10/10/18 7:26 AM, Aki Tuomi wrote: >> Are you saying that there is a bug in this version that affects RHEL 7.5 >> but not RHEL 6 or just use the newest version and maybe the problem goes >> away? > > We have very limited interest in figuring out problems with (very) old > dovecot versions. At m

namespace alias issues?

2017-04-25 Thread Kelsey Cummings
The Courier IMAP backwards compatibility section in the Namespaces wiki suggests that hidden aliased namespace can cause problems for some clients but doesn't quantify the extent or likelihood of running into these problems. Does anyone with real world experience with similar configurations have a

Storage Design (Regligious War, Whatever)

2015-10-13 Thread Kelsey Cummings
We've been running dovecot director setup using MAILDIR++ spools on NFS served by 4 (aging) Netapp clustered filers and are considering modernizing our storage. There's nothing particularly wrong with the existing storage except the age, density and power consumption don't compare well when agains