Re: users filling up disk microsoft office outlook 2013 ?
An other way to catch clients that are misbehaving is to count nr of entries for user_deny for that user in the log file. The client that is misbehaving is always at the head of the list. We have a plan to keep the count in the cyrus.index header and make it available via an annotation(metadata). https://bugzilla.cyrusimap.org/show_bug.cgi?id=3562 How are people looking at this now? It's clear that in my situation it's causing issues... I was thinking to maybe use fail2ban to block the users to make to many log entries with user_deny. But after looking at fail2ban it needs a hostname in the logline. Which the logged messages doesn't have. Although I could say the username is the hostname I think. An other option would be to coble something together with logstash/statsd and graphite I think... Any other easier solution anybody can think of? Thanks, -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Rudy Gevaert e-mail: rudy.geva...@ugent.be Directie ICT, Afdeling Infrastructuur Groep Systemen tel: +32 9 264 4750 Universiteit Gent fax: +32 9 264 4994 Krijgslaan 281, gebouw S9, 9000 Gent, Belgie www.UGent.be -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
Quoting David Carter dp...@cam.ac.uk, Fri, 06 Mar 2015: On 2015-03-05 23:47, Bron Gondwana wrote: On Thu, Mar 5, 2015, at 08:34 PM, Rudy Gevaert wrote: Quoting Frank Richter frank.rich...@hrz.tu-chemnitz.de, Thu, 05 Mar 2015: Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. This isn't a Cyrus issue or even something that Cyrus can fix I don't think :( One thing which would help is a limit on the amount of expunged data which can be held in a single mailbox before an expire automatically kicks in. As far as I know there isn't a way to actually see this from cyrus. For know I have a script that goes over every mailbox and does a a du and cyrus quota lookup. If they are to much different (e.g. 200MB difference) I force an expunge. This also catches mailboxes that haven't been expired like it should be. An other way to catch clients that are misbehaving is to count nr of entries for user_deny for that user in the log file. The client that is misbehaving is always at the head of the list. -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Rudy Gevaert e-mail: rudy.geva...@ugent.be Directie ICT, Afdeling Infrastructuur Groep Systemen tel: +32 9 264 4750 Universiteit Gent fax: +32 9 264 4994 Krijgslaan 281, gebouw S9, 9000 Gent, Belgie www.UGent.be -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
On Sat, Mar 7, 2015, at 11:21 PM, Rudy Gevaert wrote: Quoting David Carter dp...@cam.ac.uk, Fri, 06 Mar 2015: On 2015-03-05 23:47, Bron Gondwana wrote: On Thu, Mar 5, 2015, at 08:34 PM, Rudy Gevaert wrote: Quoting Frank Richter frank.rich...@hrz.tu-chemnitz.de, Thu, 05 Mar 2015: Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. This isn't a Cyrus issue or even something that Cyrus can fix I don't think :( One thing which would help is a limit on the amount of expunged data which can be held in a single mailbox before an expire automatically kicks in. As far as I know there isn't a way to actually see this from cyrus. For know I have a script that goes over every mailbox and does a a du and cyrus quota lookup. If they are to much different (e.g. 200MB difference) I force an expunge. This also catches mailboxes that haven't been expired like it should be. An other way to catch clients that are misbehaving is to count nr of entries for user_deny for that user in the log file. The client that is misbehaving is always at the head of the list. We have a plan to keep the count in the cyrus.index header and make it available via an annotation(metadata). https://bugzilla.cyrusimap.org/show_bug.cgi?id=3562 Bron. -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
On Fri, Mar 6, 2015, at 06:29 PM, David Carter wrote: On 2015-03-05 23:47, Bron Gondwana wrote: On Thu, Mar 5, 2015, at 08:34 PM, Rudy Gevaert wrote: Quoting Frank Richter frank.rich...@hrz.tu-chemnitz.de, Thu, 05 Mar 2015: Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. This isn't a Cyrus issue or even something that Cyrus can fix I don't think :( One thing which would help is a limit on the amount of expunged data which can be held in a single mailbox before an expire automatically kicks in. At the moment my largest concern is that we can hit the 4 GByte limit on the cyrus.cache file, which causes replication to break (at least in Cyrus 2.4.17). That's how we found out that this was going on in the first place. Ooh, interesting - so some kind of limit that forces an expunge of the oldest half the messages or something if you hit some number of expired messages. (I am considering splitting cyrus.cache somehow...) Bron. -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
On Thu, Mar 5, 2015, at 08:34 PM, Rudy Gevaert wrote: Quoting Frank Richter frank.rich...@hrz.tu-chemnitz.de, Thu, 05 Mar 2015: Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. I contacted the user and he has AV installed, but is not sure it is in outlook also active. (I wouldn't know ATM) We've seen this as well. It appears that the magic 8-ball hasn't been proved wrong yet. This isn't a Cyrus issue or even something that Cyrus can fix I don't think :( Bron. -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
users filling up disk microsoft office outlook 2013 ?
Hello, I'm hitting a strange issue. A user had his mailbox grow (multiple GB) without him noticing. I can clean up with cyr_expire. Multiple messages are actually the same. It seems that the client uploads the message and deletes it immediately. Yesterday it filled up a partition, so I couldn't enable telemetry on his mailbox to actually see what happened. The client is outlook 2013. Has anybody seen this issue before? I'm running 2.4.17 -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Rudy Gevaert e-mail: rudy.geva...@ugent.be Directie ICT, Afdeling Infrastructuur Groep Systemen tel: +32 9 264 4750 Universiteit Gent fax: +32 9 264 4994 Krijgslaan 281, gebouw S9, 9000 Gent, Belgie www.UGent.be -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
On Thu, 5 Mar 2015, Rudy Gevaert wrote: Hello, I'm hitting a strange issue. A user had his mailbox grow (multiple GB) without him noticing. I can clean up with cyr_expire. Multiple messages are actually the same. It seems that the client uploads the message and deletes it immediately. Yesterday it filled up a partition, so I couldn't enable telemetry on his mailbox to actually see what happened. The client is outlook 2013. Has anybody seen this issue before? I'm running 2.4.17 Yes, this is the same issue that I descriped in the attached message to info-cyrus last April. At one point we were seeing numerous instances of this every week, to the point that it was a potential denial of service attack against our mail system. Dozens of separate cases. Fortunately things seem to have settled down in the last 6 months. Individual Outlook clients can be fixed using the procedure described at: http://www.ucs.cam.ac.uk/email/hints-and-tips/hermes/outlook-ost The problem appears to be associated with virus scanner plugins to Outlook (at least AVG and Kaspersky: it is possible others are also affected). Applying the most recent patches to Outlook doesn't seem to help. So far the only way that I have been able to reproduce the precise effect including a tight spin of uploads and deletes was when I switched from one AV plugin to another. One of the people affected who I contacted reported that they had made a similar change directly before problems started. A Google search on Outlook 2013 IMAP bandwidth problems strongly suggested that the problem wasn't specific to our mail system, e.g: http://ddkonline.blogspot.co.uk/2013/06/outlook-2013-bug-when-using-imap-beware.html -- David Carter Email: david.car...@uis.cam.ac.uk University of Cambridge, Phone: (01223) 334502 Information Services,Fax: (01223) 334679 7 J J Thomson Avenue, Cambridge UK. CB3 0RB From dp...@cam.ac.uk Tue Apr 29 13:00:27 2014 Date: Tue, 29 Apr 2014 12:56:07 +0100 From: David Carter dp...@cam.ac.uk To: info-cyrus@lists.andrew.cmu.edu Subject: Outlook 2013 broken synchronisation We have had a couple of cases recently where the IMAP synchronisation process in Outlook 2013 seems to go nuts. The client system APPENDs large numbers of messages stored on the user's local hard disk to the Cyrus inbox and then deletes and expunges them (one at a time). It does this repeatedly. X-OlkEid: in the message headers and MIME multipart boundary markers in the body are different in each message, so the additional messages aren't exact copies. (I guess this could be some kind of broken filter rule. At the moment I'm working with third hand information). In one case the client managed to generate a 3.5 GByte cyrus.cache file (with about 1.5 million recently expunged messages), which is dangerously close to the 4 GByte limit on that file. We are running Cyrus 2.4.17. I appreciate that this isn't really a Cyrus question: I was just hoping that someone somewhere had seen the same effect and had worked out how to make Outlook behave. A Google search suggests that Microsoft improved the IMAP support in Outlook 2013, but I haven't found a specific match to the symptoms that I am seeing. -- David Carter Email: david.car...@uis.cam.ac.uk University of Cambridge, Phone: (01223) 334502 Information Services,Fax: (01223) 334679 7 J J Thomson Avenue, Cambridge UK. CB3 0RB Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
Quoting Frank Richter frank.rich...@hrz.tu-chemnitz.de, Thu, 05 Mar 2015: Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. I contacted the user and he has AV installed, but is not sure it is in outlook also active. (I wouldn't know ATM) Rudy -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Rudy Gevaert e-mail: rudy.geva...@ugent.be Directie ICT, Afdeling Infrastructuur Groep Systemen tel: +32 9 264 4750 Universiteit Gent fax: +32 9 264 4994 Krijgslaan 281, gebouw S9, 9000 Gent, Belgie www.UGent.be -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
I'm hitting a strange issue. A user had his mailbox grow (multiple GB) without him noticing. I can clean up with cyr_expire. Multiple messages are actually the same. It seems that the client uploads the message and deletes it immediately. Yesterday it filled up a partition, so I couldn't enable telemetry on his mailbox to actually see what happened. The client is outlook 2013. Has anybody seen this issue before? I'm running 2.4.17 Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. -- Frank Richter Chemnitz University of Technology, Germany smime.p7s Description: S/MIME Cryptographic Signature Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: users filling up disk microsoft office outlook 2013 ?
On 2015-03-05 23:47, Bron Gondwana wrote: On Thu, Mar 5, 2015, at 08:34 PM, Rudy Gevaert wrote: Quoting Frank Richter frank.rich...@hrz.tu-chemnitz.de, Thu, 05 Mar 2015: Last night ecactly this happened on our mail server the 1st time. One partition was filled up ... The user was noticing some duplicate messages, but not thousands. I'll check up if a virus scanner is involved in our case. This isn't a Cyrus issue or even something that Cyrus can fix I don't think :( One thing which would help is a limit on the amount of expunged data which can be held in a single mailbox before an expire automatically kicks in. At the moment my largest concern is that we can hit the 4 GByte limit on the cyrus.cache file, which causes replication to break (at least in Cyrus 2.4.17). That's how we found out that this was going on in the first place. -- David Carter Email: david.car...@uis.cam.ac.uk University of Cambridge, Phone: (01223) 334502 Information Services,Fax: (01223) 334679 7 J J Thomson Avenue, Cambridge UK. CB3 0RB Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
