Re: Trying to rebuild xapian indexes, indexer is indexing more messages than exist

On 8/14/25 3:08 AM, Sebastian Hagedorn wrote:
> On 13 Aug 2025, at 22:05, jik via Info wrote:
>
>> I tried just running squatter without any arguments and the same problem occurs; it claims to be indexing way more messages that the first mailbox it finds has in it, and the xapian files just grow and grow.
>>
>> I ran strace on the squatter process and it appears to be indexing the same 20 messages over and over again.
>>
>> I tried running squatter -i instead of just squatter and that does not appear to have this problem.
>>
>> Unless I am missing something, this seems to be a bug in squatter?
> I’m pretty sure that issue has been discussed before.
I have looked and have been unable to find a previous discussion of this 
particular issue. Perhaps you can point me in the correct direction.
> You didn’t mention which version you are running. It’s quite possible that bug has been fixed in a newer release. With Cyrus it’s not always the best idea to run a version supplied by a distribution.

I have just spent all morning upgrading to 3.12.1, only to discover that 
not only does the bug still exist, it is now worse. Now regardless of 
whether I run `squatter` or `squatter -i` it still loops over the same 
20 messages over and over again. As far as I can tell, the only way I 
can successfully rebuild xapian indexes is to temporarily shut down the 
rolling squatter process, delete the indexes I want to rebuild, and then 
restart the rolling squatter process. It appears that the rolling 
squatter logic does not have this bug.

> If that’s not an option you probably need to find the message(s) that cause that issue and remove them.

It is not specific messages causing the problem. It happens on every 
mailbox I test it on. It is a bug in the logic in squatter, not a 
corrupt message.

I find it somewhat hard to imagine that no one else has encountered this?

   jik


------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/T5a3c00cdf15ad8da-Mcfd267a5273d00adf5c7ebd1
Delivery options: https://cyrus.topicbox.com/groups/info/subscription