On 2025-08-14 12:06 PM, Jonathan Kamens via Info wrote:
On 8/14/25 3:08 AM, Sebastian Hagedorn wrote:
On 13 Aug 2025, at 22:05, jik via Info wrote:
I tried just running squatter without any arguments and the same problem
occurs; it claims to be indexing way more messages that the first mailbox it
finds has in it, and the xapian files just grow and grow.
I ran strace on the squatter process and it appears to be indexing the same 20
messages over and over again.
I tried running squatter -i instead of just squatter and that does not appear
to have this problem.
Unless I am missing something, this seems to be a bug in squatter?
I’m pretty sure that issue has been discussed before.
I have looked and have been unable to find a previous discussion of this
particular issue. Perhaps you can point me in the correct direction.
You didn’t mention which version you are running. It’s quite possible that bug
has been fixed in a newer release. With Cyrus it’s not always the best idea to
run a version supplied by a distribution.
I have just spent all morning upgrading to 3.12.1, only to discover that
not only does the bug still exist, it is now worse. Now regardless of
whether I run `squatter` or `squatter -i` it still loops over the same
20 messages over and over again. As far as I can tell, the only way I
can successfully rebuild xapian indexes is to temporarily shut down the
rolling squatter process, delete the indexes I want to rebuild, and then
restart the rolling squatter process. It appears that the rolling
squatter logic does not have this bug.
If that’s not an option you probably need to find the message(s) that cause
that issue and remove them.
It is not specific messages causing the problem. It happens on every
mailbox I test it on. It is a bug in the logic in squatter, not a
corrupt message.
I find it somewhat hard to imagine that no one else has encountered this?
What configuration directives do you have for the conversations database
(which is required for xapian) and for search?
There's a longstanding issue with xapian indexing which can be worked
around by setting search_batchsize to a very large number (like
1000000), blowing away the contents of your search partition and then
regenerating with "squatter -v -i".
--
Nels Lindquist
[email protected]
------------------------------------------
Cyrus: Info
Permalink:
https://cyrus.topicbox.com/groups/info/T5a3c00cdf15ad8da-M0e1cce3404b927f0bf94763e
Delivery options: https://cyrus.topicbox.com/groups/info/subscription
