Re: backupd IOERROR reading backup files larger than 2GB

2019-06-06 Thread Carlos Larrañaga 

Hi Ellie,

Thanks for answering. We use latest 64bit Oracle Linux (not CentOs like I said 
before, sorry) and zlib is also 64bit version:


   # uname -a
   Linux xxx 3.10.0-957.12.2.el7.x86_64 #1 SMP Tue May 14 17:35:45 PDT 2019
   x86_64 x86_64 x86_64 GNU/Linux

   # yum list installed zlib
   Loaded plugins: langpacks, ulninfo
   Installed Packages
   zlib.x86_64 1.2.7-18.el7  @ol7_latest

   # lsof -p 17005 |grep lib |grep -i z
   backupd 17005 cyrus  mem    REG  253,0  90248 134400930
   /usr/lib64/libz.so.1.2.7

   # file /usr/lib64/libz.so.1.2.7
   /usr/lib64/libz.so.1.2.7: ELF 64-bit LSB shared object, x86-64, version 1
   (SYSV), dynamically linked,
   BuildID[sha1]=b9d5f73428bd6ad68c96986b57bea3b7cedb9745, stripped

   # rpm -qf /usr/lib64/libz.so.1.2.7
   zlib-1.2.7-18.el7.x86_64

I have summarized here some information about the backupd error reading the file 
descriptor 15, which is a backup larger than 2GB. The error is logged 1755 
times. Instead, there is no error for fd 12, which is a backup of less than 2 GB:


   *#-- CLIENT SIDE ---***

   # time sync_client -v -o -n backup -A
   Thu Jun  6 17:08:02 CEST 2019
   USER aaa
   QUOTA user.aaa
   USER ccc
   Error from do_user(ccc): bailing out!

   real    30m16.223s
   user    0m0.006s
   sys 0m0.006s
   *
   *
   **#-- BACKUP SERVER SIDE 

   *# LOGFILE
   *# tail -f /var/log/imapd.log
   Jun  6 17:09:11 bcrux cyrus/backupd[2584]: IOERROR: gzuc_read: lseek 15: No
   such file or directory
   Jun  6 17:09:11 bcrux cyrus/backupd[2584]: IOERROR: gzuc_read: lseek 15: No
   such file or directory
   Jun  6 17:09:11 bcrux cyrus/backupd[2584]: IOERROR: gzuc_read: lseek 15: No
   such file or directory
   Jun  6 17:09:11 bcrux cyrus/backupd[2584]: IOERROR: gzuc_read: lseek 15: No
   such file or directory

   *# lsof of the backupd PROCESS
   *# lsof -P -p 2584
   COMMAND  PID  USER   FD   TYPE DEVICE SIZE/OFF    NODE NAME
   backupd 2584 cyrus  cwd    DIR  253,0 4096 128 /
   backupd 2584 cyrus  rtd    DIR  253,0 4096 128 /
   backupd 2584 cyrus  txt    REG  253,0 768632   939542214
   /usr/local/cyrus/libexec/backupd
   backupd 2584 cyrus  mem    REG  253,0 37208   135746334
   /usr/lib64/libnss_sss.so.2
   backupd 2584 cyrus  mem    REG  253,0 31416   134406707
   /usr/lib64/libnss_dns-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 61632   134406709
   /usr/lib64/libnss_files-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 43336    68814977
   /usr/lib64/sasl2/webmail.so.0.0.0
   backupd 2584 cyrus  mem    REG  253,0 57960    68856627
   /usr/lib64/sasl2/libdigestmd5.so.3.0.0
   backupd 2584 cyrus  mem    REG  253,0 24232    68797220
   /usr/lib64/sasl2/libcrammd5.so.3.0.0
   backupd 2584 cyrus  mem    REG  253,0 20088    68797044
   /usr/lib64/sasl2/libplain.so.3.0.0
   backupd 2584 cyrus  mem    REG  253,0 20056    68797036
   /usr/lib64/sasl2/liblogin.so.3.0.0
   backupd 2584 cyrus  mem    REG  253,0 1845816   135873512
   /usr/lib64/libdb-5.3.so
   backupd 2584 cyrus  mem    REG  253,0 28272    67113426
   /usr/lib64/sasl2/libsasldb.so.3.0.0
   backupd 2584 cyrus  mem    REG  253,0 20064    67113423
   /usr/lib64/sasl2/libanonymous.so.3.0.0
   backupd 2584 cyrus  mem    REG  253,0 11448   135872733
   /usr/lib64/libfreebl3.so
   backupd 2584 cyrus  mem    REG  253,0 155784   134400716
   /usr/lib64/libselinux.so.1
   backupd 2584 cyrus  mem    REG  253,0 15464   134401447
   /usr/lib64/libkeyutils.so.1.5
   backupd 2584 cyrus  mem    REG  253,0 40672   134399432
   /usr/lib64/libcrypt-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 105824   134781819
   /usr/lib64/libresolv-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 53944   134406785
   /usr/lib64/libjansson.so.4.10.0
   backupd 2584 cyrus  mem    REG  253,0 88776   135352942
   /usr/lib64/libgcc_s-4.8.5-20150702.so.1
   backupd 2584 cyrus  mem    REG  253,0 1137032   134400337
   /usr/lib64/libm-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 991616   135352396
   /usr/lib64/libstdc++.so.6.0.19
   backupd 2584 cyrus  mem    REG  253,0 19296   134399434
   /usr/lib64/libdl-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 142008   134722750
   /usr/lib64/libpthread-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 2151704   134365659
   /usr/lib64/libc-2.17.so
   backupd 2584 cyrus  mem    REG  253,0 753232   134401161
   /usr/lib64/libsqlite3.so.0.8.6
   *backupd 2584 cyrus  mem    REG  253,0 90248   134400930
   /usr/lib64/libz.so.1.2.7*
   backupd 2584 cyrus  mem    REG  253,0 1

How to exclude "Archived" email from Quota usage ?

2019-06-06 Thread Jayesh Shinde 

Hi ,

I am testing Archiving  feature with Cyrus-imapd-3.0.9 .

Is it possible to exclude the mailbox quota for "Archived emails" ( 
which is in different partition )  and only consider mailbox quota of 
default partition ?


OR

Is it possible to know how much quota used for end user's mailbox in 
Archive partition ?


By  listquota command I am able to view overall Mailbox Quota.

Thank You

Regards
Jayesh Shinde

https://ps1.saymails.com/client_customize/raman/reg_lp.php?utm_source=email-disclaimer&utm_medium=email&utm_campaign=beatraman


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Deleting seen state file keeps unstable seen state for mailbox

2019-06-06 Thread Ismaël Tanguy 

Hello cyrus list,

due to a careless mistake, our global NFS pool became full last Monday.
The mail data storage (/var/spool/imap) is a pool of this global pool.
/var/lib/imap is stored somewhere else

During this outage of five minutes, thousand of mailboxes undergo IOERROR.
This mailboxes has been reconstruted immediately after.

But a problem remains, for some users, the seen state of their mailboxes 
is inconstant.

So, we tried to repair this with skiplist.py:

https://lists.andrew.cmu.edu/pipermail/info-cyrus/2008-July/029375.html
http://oss.netfarm.it/python-cyrus.php

That did'nt work for some users, (but works for some, weird!)
We then delete the seen state file, but the problem still remains.

Is there anywhere else that the seen state of a mailbox is kept?

Thank four your help.

Ismaël TANGUY

-- --


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus