Re: Fatal error: Exists wrong 513 512 483 17057

2019-02-05 Thread Daniel Bareiro
Hi, Bron. Thanks for your reply.

On 5/2/19 17:21, Bron Gondwana wrote:

> You need to run cyr_expire occasionally to clean up deleted messages!

Checking the syslog, apparently it ran automatically this morning:

--
# grep cyr_expire /var/log/syslog /var/log/syslog.1
/var/log/syslog.1:Feb  5 04:01:03 mail cyrus/cyr_expire[6111]: Expired 0
and expunged 0 out of 53555 messages from 80 mailboxes
/var/log/syslog.1:Feb  5 04:01:03 mail cyrus/cyr_expire[6111]:
duplicate_prune: pruning back 3.00 days
/var/log/syslog.1:Feb  5 04:03:16 mail cyrus/cyr_expire[6111]:
duplicate_prune: purged 562 out of 1756 entries
/var/log/syslog.1:Feb  5 04:30:00 mail cyrus/cyr_expire[6585]: Expired 0
and expunged 0 out of 53558 messages from 80 mailboxes
/var/log/syslog.1:Feb  5 04:30:00 mail cyrus/cyr_expire[6585]: Removed 0
deleted mailboxes
/var/log/syslog.1:Feb  5 04:30:00 mail cyrus/cyr_expire[6585]:
duplicate_prune: pruning back 4.00 days
/var/log/syslog.1:Feb  5 04:30:00 mail cyrus/cyr_expire[6585]:
duplicate_prune: purged 0 out of 1200 entries
/var/log/syslog.1:Feb  5 04:45:00 mail cyrus/cyr_expire[6849]: Expired 0
and expunged 0 out of 53558 messages from 80 mailboxes
/var/log/syslog.1:Feb  5 04:45:00 mail cyrus/cyr_expire[6849]:
duplicate_prune: pruning back 4.00 days
/var/log/syslog.1:Feb  5 04:45:00 mail cyrus/cyr_expire[6849]:
duplicate_prune: purged 0 out of 1200 entries
--

But still I see those files from 2016 to the present.

Checking /etc/cyrus.conf I found this configuration as default in Stretch:

--
EVENTS {
(...)

# this is only necessary if using duplicate delivery suppression
delprunecmd="/usr/sbin/cyrus expire -E 3" at=0401

(...)

# Expire data older than 28 days.
deleteprune cmd="/usr/sbin/cyrus expire -E 4 -D 28" at=0430
expungeprunecmd="/usr/sbin/cyrus expire -E 4 -X 28" at=0445
(...)
--

Am I missing something?


Thanks for your time.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Fatal error: Exists wrong 513 512 483 17057

2019-02-05 Thread Daniel Bareiro
Hi, Bron.

On 4/2/19 14:02, Bron Gondwana wrote:

> Awesome - yes, the IOERROR messages are because files it expected to
> find weren't there.  It's frustrating that reconstruct isn't robust
> enough to bring a slightly bogus cyrus.index back from the dead, but the
> end result is a working mailbox with a fully correct cyrus.index file :)
> 
> The only thing that may have happened is that some emails which were
> previously deleted in the TareasCron folder came back from the dead -
> and of course all the flags on those messages will have gone away too. 
> But the mailbox will work correctly now.

Maybe that explains why I came across about 16,000 messages in the
folder :) But everything works correctly now.

I deleted the very old messages and only left the last ones, although in
the 'TasksCron' directory I am seeing messages on filesystem
(. files) of 2016 still. Could it be that for some reason
Cyrus keeps these files? In fact, in the 'Trash' directory I'm also
seeing files from 2016, even though I deleted everything I had there
using Thunderbird.

Thanks for your reply.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Fatal error: Exists wrong 513 512 483 17057

2019-02-04 Thread Daniel Bareiro
Hi, Bron. Thanks for your reply.

On 4/2/19 05:45, Bron Gondwana wrote:

> Oh how frustrating...

>> I tried using 'reconstruct' as you suggested and this was the result:
>>
>> --
>> # /usr/lib/cyrus/bin/reconstruct -r user.admin
>> user.admin
>> user.admin.Backups
>> user.admin.Drafts
>> user.admin.Sent
>> user.admin.TareasCron: record corrupted 13 (maybe uid 9836)
>> user.admin.TareasCron: Mailbox format corruption detected Failed to
>> reconstruct mailbox
>> user.admin.Trash
>> --

> This clearly isn't syslogging enough!  Can you check the permissions on
> the underlying filesystem!  Also, try running reconstruct with -G,
> though it shouldn't make a difference.

The previous thing was the output that I was obtaining in the console
when executing 'reconstruct'. This is what I get in the syslog when
executing the command with the '-G' flag:

--
Feb  4 11:48:29 mail cyrus/reconstruct[22727]: reconstructing user.admin
Feb  4 11:48:47 mail cyrus/reconstruct[22727]: mailbox: longlock
user.admin for 17.8 seconds
Feb  4 11:48:47 mail cyrus/reconstruct[22727]: Repacking mailbox
user.admin version 13
Feb  4 11:48:48 mail cyrus/reconstruct[22727]: reconstructing
user.admin.Backups
Feb  4 11:48:50 mail cyrus/reconstruct[22727]: mailbox: longlock
user.admin.Backups for 2.5 seconds
Feb  4 11:48:50 mail cyrus/reconstruct[22727]: Repacking mailbox
user.admin.Backups version 13
Feb  4 11:48:50 mail cyrus/reconstruct[22727]: reconstructing
user.admin.Drafts
Feb  4 11:48:51 mail cyrus/reconstruct[22727]: reconstructing
user.admin.Sent
Feb  4 11:48:51 mail cyrus/reconstruct[22727]: reconstructing
user.admin.TareasCron
--

But in essence the console shows the same output as without adding '-G':

--
# /usr/lib/cyrus/bin/reconstruct -G -r user.admin
user.admin
user.admin.Backups
user.admin.Drafts
user.admin.Sent
user.admin.TareasCron: record corrupted 13 (maybe uid 9836)
user.admin.TareasCron: Mailbox format corruption detected Failed to
reconstruct mailbox
user.admin.Trash
--

>> Just 'TasksCron' is the folder that I can not open. What do you suggest
>> to do in this case?

> I'd take a backup, and then delete the cyrus.index file in that folder
> and run reconstruct again...  That's a pretty extreme approach, but it
> should work.

Let's try the pretty extreme approach... :-D

--
Feb  4 12:04:43 mail cyrus/reconstruct[22990]: reconstructing user.admin
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: reconstructing
user.admin.Backups
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: reconstructing
user.admin.Drafts
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: reconstructing
user.admin.Sent
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: reconstructing
user.admin.TareasCron
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: IOERROR: opening index
user.admin.TareasCron: System I/O error
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: create new mailbox
user.admin.TareasCron
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: failed to read index
header for user.admin.TareasCron
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9837 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9838 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9839 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9840 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9841 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9842 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9843 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9844 found - adding
Feb  4 12:04:44 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
9845 found - adding
[...]
Feb  4 12:07:21 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
27841 found - adding
Feb  4 12:07:21 mail cyrus/reconstruct[22990]: user.admin.TareasCron uid
27842 found - adding
Feb  4 12:07:21 mail cyrus/reconstruct[22990]: mailbox: longlock
user.admin.TareasCron for 157.3 seconds
Feb  4 12:07:21 mail cyrus/reconstruct[22990]: reconstructing
user.admin.Trash
--

I guess the 'IOERROR' is because the cyrus.index file can not be found.
When afterwards it says 'create new mailbox user.admin.TareasCron' what
it is creating is the index? Because, if so, I don't understand why
later it says 'failed to read index header for user.admin.TareasCron'.

In any case, I am now able to access the 'TareasCron' folder without
problems. Thank you so much!

>> I'm using Cyrus 2.5.10-3 on Debian Stretch. A few days ago I upgraded
>> the entire operating system with Debian Jessie and Cyrus 2.4.17.

> That upgrade should be fine, and 2.5.10 should be fine as well.  I just
> poked around in the code there to see how the reconstruct might be
> failing, and there's not enough information to 

Re: Fatal error: Exists wrong 513 512 483 17057

2019-02-03 Thread Daniel Bareiro
Hi, Bron. Thanks for your reply.

On 3/2/19 08:33, Bron Gondwana wrote:

> Wow. A reconstruct should fix that. What version are you running?

I tried using 'reconstruct' as you suggested and this was the result:

--
# /usr/lib/cyrus/bin/reconstruct -r user.admin
user.admin
user.admin.Backups
user.admin.Drafts
user.admin.Sent
user.admin.TareasCron: record corrupted 13 (maybe uid 9836)
user.admin.TareasCron: Mailbox format corruption detected Failed to
reconstruct mailbox
user.admin.Trash
--

Just 'TasksCron' is the folder that I can not open. What do you suggest
to do in this case?

I'm using Cyrus 2.5.10-3 on Debian Stretch. A few days ago I upgraded
the entire operating system with Debian Jessie and Cyrus 2.4.17.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Fatal error: Exists wrong 513 512 483 17057

2019-02-02 Thread Daniel Bareiro
Hi!

Several days ago I am trying to solve this issue but without success.
When opening a folder inside a mailbox through Thunderbird, I get this
message: "Server [servername] has disconnected. The server may have gone
down or there may be a network problem".

In that access attempt the log shows an entry like this:

--
Feb  2 21:55:38 mail cyrus/imaps[6510]: Fatal error: Exists wrong 513
512 483 17057
--

Maybe the index is corrupt and has some duplicate message?

Investigating on the web I found this reference [1]:

--
/* make sure we don't overflow the memory we mapped */
if (msgno >= state->mapsize) {
char buf[2048];
sprintf(buf, "Exists wrong %u %u %u %u", msgno,
state->mapsize, mailbox->i.exists, mailbox->i.num_records);
fatal(buf, EC_IOERR);
}
--

I would like to know what you think. Is it possible that this is a
problem with the index for this mailbox? If so, do you recommend some
way to regenerate it?


Thanks in advance for your reply.

Kind regards,
Daniel

[1]
https://forge.bluemind.net/stash/projects/BM/repos/bm-cyrus-imapd/browse/imap/index.c?at=c196236d937608270283c681ae27f1bb00265b62



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imapd not starting after upgrade

2019-01-17 Thread Daniel Bareiro
Hi, Jan. Good to see you here. Thanks for your reply.

On 17/1/19 05:32, Jan Schneider wrote:


>> After that I managed to get the service is up and running (although I
>> have still doubt about the "http" line).

> http is used for CalDAV / CardDav so is most likely in the
> cyrus-caldav
> package.
> This enables your cyrus server to store address books and calendars.

 It seems that "http" does indeed enable CalDAV / CardDAV support with
 the cyrus-caldav package. I had not thought of it :-) After installing
 the package and uncommenting the "http" line, the error was not
 shown. I
 will need this to synchronize calendars and tasks.

 I guess it would have to work with this but Thunderbird shows a message
 saying "the calendar is momentarily unavailable". It's weird because it
 brought the information from Horde calendar and in fact I added a new
 event in Thunderbird and it was shown by Horde. But when I pressed the
 sync button this message was shown with an exclamation mark. But this
 has already happened to me with Cyrus 2.4.17 and Thunderbird 60.x. I'm
 thinking if it has to do with something on the side of Thunderbird 60.x
 or Horde or the result of the interaction of both.

>>> Horde (Kronolith and Turba) have there own ClaDAV / CardDav Server,
>>> AFAIK Horde is at the moment not able to use cyrus as an Backend for
>>> its calendars and address books.
>>>
>>> Horde had support for Kolab, and the CalDAV / CardDAV in Cyrus is
>>> based on what Kolab did there. But the support in Horde has not been
>>> updated yet.
>>>
>>> So most likely you have configured your thunderbird to synchronize
>>> to horde and do not use the cyrus CalDAV / CardDAV feature
>>
>> Yes, I did it using the HTTP address provided by Horde for the
>> corresponding calendar. I thought Thunderbird needed that Cyrus support
>> from CalDAV / CarDAV to interact with Horde.

> Just for clarification: you can use Cyrus as a backend for address books
> and calendars in Horde, though not via CalDAV/CardDAV but via its
> generic IMAP backend (which has evolved from the Kolab backends). There
> is also a generic CalDAV backend support in Kronolith, but I haven't
> tested this with Cyrus' CalDAV server yet.

Thanks for the observation. I think that explains why when I have a
notification window for a calendar event in Thunderbird and I press a
button in that Window, the Postfix log shows an IMAP access. Something
like this:

--
Jan 17 12:03:06 mail cyrus/imap[3326]: starttls: TLSv1.2 with cipher
ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits new) no authentication
Jan 17 12:03:06 mail cyrus/imap[3326]: login: localhost [::1] dbareiro
PLAIN+TLS User logged in
SESSIONID=
--

By the way, if you have a moment to check the last message I sent in the
thread "Invalid VObject, line 1 did not follow the icalendar / vcard
format" in the Horde list, I would appreciate that. It's my response to
an email from Michael Rubinsky. In case it's helpful, I'm using Horde
Groupware Webmail Edition 5.2.22.

Thanks for your time.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imapd not starting after upgrade

2019-01-16 Thread Daniel Bareiro
Hi, Michael. Thanks for your reply.

On 16/1/19 04:19, Michael Menge wrote:

 After that I managed to get the service is up and running (although I
 have still doubt about the "http" line).

>>> http is used for CalDAV / CardDav so is most likely in the cyrus-caldav
>>> package.
>>> This enables your cyrus server to store address books and calendars.

>> It seems that "http" does indeed enable CalDAV / CardDAV support with
>> the cyrus-caldav package. I had not thought of it :-) After installing
>> the package and uncommenting the "http" line, the error was not shown. I
>> will need this to synchronize calendars and tasks.
>>
>> I guess it would have to work with this but Thunderbird shows a message
>> saying "the calendar is momentarily unavailable". It's weird because it
>> brought the information from Horde calendar and in fact I added a new
>> event in Thunderbird and it was shown by Horde. But when I pressed the
>> sync button this message was shown with an exclamation mark. But this
>> has already happened to me with Cyrus 2.4.17 and Thunderbird 60.x. I'm
>> thinking if it has to do with something on the side of Thunderbird 60.x
>> or Horde or the result of the interaction of both.

> Horde (Kronolith and Turba) have there own ClaDAV / CardDav Server,
> AFAIK Horde is at the moment not able to use cyrus as an Backend for
> its calendars and address books.
> 
> Horde had support for Kolab, and the CalDAV / CardDAV in Cyrus is
> based on what Kolab did there. But the support in Horde has not been
> updated yet.
> 
> So most likely you have configured your thunderbird to synchronize
> to horde and do not use the cyrus CalDAV / CardDAV feature

Yes, I did it using the HTTP address provided by Horde for the
corresponding calendar. I thought Thunderbird needed that Cyrus support
from CalDAV / CarDAV to interact with Horde.

I think I would just be missing solve the crash of the process when
trying to access a specific folder (I think it just happens with that).

--
Jan 16 10:47:17 mail cyrus/imaps[10794]: Fatal error: Exists wrong 257
256 22 16596
Jan 16 10:47:17 mail cyrus/master[2694]: process type:SERVICE name:imaps
path:/usr/lib/cyrus/bin/imapd age:0.298s pid:10794 exited, status 75
--

I was not able to find the cause yet. Maybe a problem with repeated
messages (that "257 256" makes me think about that) causes a process
crash? This had never happened to me with 2.4.17. Apparently, it only
happens with that folder. Yesterday I deleted all the messages there
using Thunderbird (they were cron jobs mails) and now I would have to
see the cron jobs that ran today, but I don't see anything. When I try
to open the folder, Thunderbird displays a message saying "Server
[mailserver] has disconnected. The server may have gone down or there
may be a network problem". Maybe the information in the folder is in an
inconsistent state for some reason after the upgrade?

Thanks for your time.


Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imapd not starting after upgrade

2019-01-16 Thread Daniel Bareiro
Hi, Andrew. Thanks for your reply.

On 15/1/19 13:57, Andrew Morgan wrote:

>> I'm not sure what the problem is but that "invalid magic header" makes
>> me think that maybe it changed the header format of
>> /var/lib/cyrus/tls_sessions.db and the migration process did not do the
>> corresponding conversion. Can that be the reason why it doesn't start or
>> I'm missing something else? Any ideas that can bring more light?
>>
>> The associated problem is that because of this it seems that Postfix can
>> not deliver the mails since there is no /var/run/cyrus/socket/lmtp.

> It wants tls_sessions.db to be a twoskip-format file, but the current
> format is skiplist.  However, it was able to detect this and open it as
> skiplist.  You can fix this issue by stopping Cyrus, removing
> tls_sessions.db, and starting Cyrus.

Thank you for this. It seems that Cyrus does not automatically create
this file but after creating it manually, it starts without problems.

> However, your real problem seems to be the missing nntp executable:
> 
> Jan 14 23:10:46 mail cyrus/master[5311]: cannot find executable for
> service 'nntp'
> 
> Do you use NNTP?  You could comment it out of cyrus.conf in order to get
> the rest of Cyrus up and running.

Thank you! Indeed that was the problem as you will have seen in a
previous message.

> Take a look at the release notes for v2.5.0:
> 
>   https://www.cyrusimap.org/imap/download/release-notes/2.5/x/2.5.0.html
> 
> It covers important changes from v2.4 to v2.5.  You may need to update
> your cyrus.conf and imapd.conf files.

Thanks for the reference. I will read it to see the changes introduced
in this new version.

Now I am having this problem when trying to open a folder inside one of
the mailboxes:

--
Jan 16 10:47:17 mail cyrus/imaps[10794]: Fatal error: Exists wrong 257
256 22 16596
Jan 16 10:47:17 mail cyrus/master[2694]: process type:SERVICE name:imaps
path:/usr/lib/cyrus/bin/imapd age:0.298s pid:10794 exited, status 75
--

I was not able to find the cause yet. Maybe a problem with repeated
messages (that "257 256" makes me think about that) causes a process
crash? This had never happened to me with 2.4.17. Apparently, it only
happens with that folder. Yesterday I deleted all the messages there
using Thunderbird (they were cron jobs mails) and now I would have to
see the cron jobs that ran today, but I do not see anything. When I try
to open the folder Thunderbird displays a message saying "Server
[mailserver] has disconnected. The server may have gone down or there
may be a network problem". Maybe the information in the folder is in an
inconsistent state for some reason after the upgrade?

Thanks for your time.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imapd not starting after upgrade

2019-01-15 Thread Daniel Bareiro
Hi, Michael.

Thanks for your reply.

On 15/1/19 17:47, Michael Menge wrote:

>> After that I managed to get the service is up and running (although I
>> have still doubt about the "http" line).

> http is used for CalDAV / CardDav so is most likely in the cyrus-caldav
> package.
> This enables your cyrus server to store address books and calendars.

It seems that "http" does indeed enable CalDAV / CardDAV support with
the cyrus-caldav package. I had not thought of it :-) After installing
the package and uncommenting the "http" line, the error was not shown. I
will need this to synchronize calendars and tasks.

I guess it would have to work with this but Thunderbird shows a message
saying "the calendar is momentarily unavailable". It's weird because it
brought the information from Horde calendar and in fact I added a new
event in Thunderbird and it was shown by Horde. But when I pressed the
sync button this message was shown with an exclamation mark. But this
has already happened to me with Cyrus 2.4.17 and Thunderbird 60.x. I'm
thinking if it has to do with something on the side of Thunderbird 60.x
or Horde or the result of the interaction of both.

>> I have also come across this error now:
>>
>> --
>> Jan 15 15:32:16 mail cyrus/imaps[21978]: IDLE: error sending message
>> INIT to idled for mailbox user.jsmith: No such file or directory.
>> Falling back to polling every 60 seconds.
>> --

> is idled (man idled) configured in cyrus.conf?

When I upgraded to Stretch I initially installed the versions of
configurations provided by the package maintainer and then passed the
changes from the previous configuration files to the new versions of the
configuration files. I thought that this would be the best.

The "idled" line was commented out with Cyrus 2.4.17 and I don't
remember having ever seen those messages in the log. So here I also kept
it commented out (as it came initially). Maybe this is because something
changed in the new version of Cyrus. Now I have activated that line and
the message has vanished.

>> It seems this is preventing access to IMAP mailboxes. I am investigating
>> the cause. Any contribution is welcome.

> It should not preventing access to IMAP mailboxes. This is a cpu friendly
> "inform me if there is new mail" feature which results in
> "Falling back to polling every 60 seconds." if it is missing

Sorry. I expressed myself inaccurately. The content of the mailboxes is
accessed. What I meant is it seems that from time to time the connection
is lost. This is what I see in the log when that happens:

--
Jan 15 19:12:22 mail cyrus/imaps[27754]: Fatal error: Exists wrong 257
256 11 16585
Jan 15 19:12:22 mail cyrus/master[26739]: process type:SERVICE
name:imaps path:/usr/lib/cyrus/bin/imapd age:0.265s pid:27754 exited,
status 75
--

For example, that happens when I try to access a folder with more than
2000 messages. I am investigating the cause. If you know what it can be,
any info will be welcome. It's weird because I don't remember seeing
this with Cyrus 2.4.17.

Thanks for your time.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imapd not starting after upgrade

2019-01-15 Thread Daniel Bareiro

On 15/1/19 15:05, Daniel Bareiro wrote:

> The fact is that if I also comment out the "http" line, now it seems
> that I get a syntax error:
> 
> --
> Jan 15 14:14:28 mail cyrus/master[20778]: configuration file
> /etc/cyrus.conf: bad character '_' in name on line 101
> Jan 15 14:14:28 mail cyrus/master[20778]: exiting
> --
> 
> I think the configuration file already came with the "squatter_a" line
> and I just removed the comment. Unless this is a bug in the
> configuration file provided by Stretch for Cyrus 2.5.10:
> 
> --
>  99 # reindex all mailboxes (fulltext) daily
> 100 # DGB - 20190114
> 101 squatter_a  cmd="/usr/sbin/cyrus squatter" at=0517
> --

H... it seems this is a bug in the Debian Stretch configuration file
because of what I see in the examples shown here [1]. The file also has
the line "squatter_1" and it should be "squatter1".

After that I managed to get the service is up and running (although I
have still doubt about the "http" line).

I have also come across this error now:

--
Jan 15 15:32:16 mail cyrus/imaps[21978]: IDLE: error sending message
INIT to idled for mailbox user.jsmith: No such file or directory.
Falling back to polling every 60 seconds.
--

It seems this is preventing access to IMAP mailboxes. I am investigating
the cause. Any contribution is welcome.

Thanks in advance for your time.


Kind regards,
Daniel

[1] https://www.cyrusimap.org/2.5/imap/admin/systemcommands/squatter.html



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: cyrus-imapd not starting after upgrade

2019-01-15 Thread Daniel Bareiro
Hi, Michael. Thanks for your reply.

On 15/1/19 13:54, Michael Menge wrote:

>> I'm not sure what the problem is but that "invalid magic header" makes
>> me think that maybe it changed the header format of
>> /var/lib/cyrus/tls_sessions.db and the migration process did not do the
>> corresponding conversion. Can that be the reason why it doesn't start or
>> I'm missing something else? Any ideas that can bring more light?

> some defaults for database format have changed between 2.4 and 2.5 but this
> is automatically handled.

Thanks for confirm.

> You Problem lies in
> 
> Jan 14 23:10:46 mail cyrus/master[5311]: cannot find executable for
> service 'nntp'
> Jan 14 23:10:46 mail cyrus/master[5311]: exiting
> 
> Either the executables are installed in the wrong place, or cyrus was
> compiled/packaged without news support. You can comment out nntp in 
> /etc/cyrus.conf to try to start without running an nntp server

It seems that support for NNTP was separated in Debian Stretch regarding
to Debian Jessie. I don't use NNTP, so I simply commented out the "nntp"
line in the /etc/cyrus.conf configuration file. I think I had tried that
before, although it seems to me that time I forgot to do it also with
the "nntps" line.

Then I tried again to start the service and now the error changed:

--
Jan 15 14:13:59 mail cyrus/master[20737]: cannot find executable for
service 'http'
--

But I'm not sure if this has been included in another separate package:

--
root@mail:/var/run/cyrus/socket# aptitude search ^cyrus
idA cyrus-admin
- Cyrus mail system - administration tools
c   cyrus-admin-2.4
-
p   cyrus-caldav
- Cyrus mail system - CalDAV and CardDAV support
idA cyrus-clients
- Cyrus mail system - test clients
c   cyrus-clients-2.4
-
idA cyrus-common
- Cyrus mail system - common files
i   cyrus-common-2.4
- Cyrus mail system - common files [dummy package]
p   cyrus-dev
- Cyrus mail system - developer files
p   cyrus-doc
- Cyrus mail system - documentation files
idA cyrus-imapd
- Cyrus mail system - IMAP support
c   cyrus-imapd-2.4
-
p   cyrus-imspd
- Internet Message Support Protocol daemon
p   cyrus-murder
- Cyrus mail system - proxies and aggregator
p   cyrus-nntpd
- Cyrus mail system - NNTP support
p   cyrus-pop3d
- Cyrus mail system - POP3 support
p   cyrus-replication
- Cyrus mail system - replication
p   cyrus-sasl2-doc
- Cyrus SASL - documentation
--

The fact is that if I also comment out the "http" line, now it seems
that I get a syntax error:

--
Jan 15 14:14:28 mail cyrus/master[20778]: configuration file
/etc/cyrus.conf: bad character '_' in name on line 101
Jan 15 14:14:28 mail cyrus/master[20778]: exiting
--

I think the configuration file already came with the "squatter_a" line
and I just removed the comment. Unless this is a bug in the
configuration file provided by Stretch for Cyrus 2.5.10:

--
 99 # reindex all mailboxes (fulltext) daily
100 # DGB - 20190114
101 squatter_a  cmd="/usr/sbin/cyrus squatter" at=0517
--

>> The associated problem is that because of this it seems that Postfix can
>> not deliver the mails since there is no /var/run/cyrus/socket/lmtp.

> As cyrus aborted the start there is no process listening

That's what I thought :-)

Thanks for your time.

Kind regards,
Daniel



signature.asc
Description: OpenPGP digital signature

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

cyrus-imapd not starting after upgrade

2019-01-15 Thread Daniel Bareiro
Hi all!

After quite some time, today I decided to update the mail server from
Debian Jessie (cyrus-imapd 2.4.17) to Debian Stretch (cyrus-imapd 2.5.10-3).

All without problems until I reach the part of cyrus-imapd that does not
start. This is what I see in the log:

--
Jan 14 23:10:45 mail systemd[1]: Started Cyrus IMAP/POP3 daemons.
Jan 14 23:10:45 mail cyrus/ctl_cyrusdb[5318]: skiplist: clean shutdown
file missing, updating recovery stamp
Jan 14 23:10:45 mail cyrus/ctl_cyrusdb[5318]: recovering cyrus databases
Jan 14 23:10:45 mail cyrus/ctl_cyrusdb[5318]: done recovering cyrus
databases
Jan 14 23:10:46 mail cyrus/cyr_expire[5332]: Repacking mailbox
user.admin.TareasCron version 12
Jan 14 23:10:46 mail cyrus/cyr_expire[5332]: Expired 0 and expunged 0
out of 28809 messages from 80 mailboxes
Jan 14 23:10:46 mail cyrus/cyr_expire[5332]: duplicate_prune: pruning
back 3.00 days
Jan 14 23:10:46 mail cyrus/cyr_expire[5332]: duplicate_prune: purged 0
out of 438 entries
Jan 14 23:10:46 mail cyrus/tls_prune[5335]: twoskip: invalid magic
header: /var/lib/cyrus/tls_sessions.db
Jan 14 23:10:46 mail cyrus/tls_prune[5335]: cyrusdb: opening
/var/lib/cyrus/tls_sessions.db with backend skiplist (requested twoskip)
Jan 14 23:10:46 mail cyrus/tls_prune[5335]: skiplist: recovered
/var/lib/cyrus/tls_sessions.db (223 records, 41200 bytes) in 0 seconds
Jan 14 23:10:46 mail cyrus/tls_prune[5335]: skiplist: checkpointed
/var/lib/cyrus/tls_sessions.db (223 records, 41200 bytes) in 0.091 sec
Jan 14 23:10:46 mail cyrus/tls_prune[5335]: tls_prune: purged 2 out of
223 entries
Jan 14 23:10:46 mail cyrus/master[5311]: cannot find executable for
service 'nntp'
Jan 14 23:10:46 mail cyrus/master[5311]: exiting
Jan 14 23:10:46 mail systemd[1]: cyrus-imapd.service: Main process
exited, code=exited, status=78/n/a
Jan 14 23:10:46 mail systemd[1]: cyrus-imapd.service: Unit entered
failed state.
Jan 14 23:10:46 mail systemd[1]: cyrus-imapd.service: Failed with result
'exit-code'.
--

I'm not sure what the problem is but that "invalid magic header" makes
me think that maybe it changed the header format of
/var/lib/cyrus/tls_sessions.db and the migration process did not do the
corresponding conversion. Can that be the reason why it doesn't start or
I'm missing something else? Any ideas that can bring more light?

The associated problem is that because of this it seems that Postfix can
not deliver the mails since there is no /var/run/cyrus/socket/lmtp.


Thanks in advance.

Kind regards,
Daniel

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus