Re: How to «bootstrap» xapian/squatter

On 2024-09-27 8:21 AM, Luca Olivetti via Info wrote:
> El 26/9/24 a les 22:46, Luca Olivetti via Info ha escrit:
>> El 26/9/24 a les 21:50, Luca Olivetti via Info ha escrit:
>>> El 26/9/24 a les 20:34, Luca Olivetti via Info ha escrit:
>>>> El 26/9/24 a les 19:52, Luca Olivetti via Info ha escrit:
>>>>> El 26/9/24 a les 19:43, Nels Lindquist ha escrit:
>>>>>
>>>>> OK, I'll try twoskip an report back
>>>>
>>>>
>>>> Mmh, with twoskip the conversations db is already 8.3GB, I don't 
>>>> think this is going to end well....
>>>
>>> I installed cyrus 3.8.1 from backports, reverted the setting for 
>>> conversations_db to skiplist, and ctl_conversationsdb still segfaults 
>>> when the file grows to 4.1GB :-(
>>
>>
>> I'm now trying the squat backend (removing the need for the 
>> conversations db) and both the indexing and the search work.
>> Pity that it's being phased out.
>>
>> search_engine: squat
>> search_index_headers: no
>> search_batchsize: 1000000
>> defaultsearchtier: t1
>> t1searchpartition-default: /var/spool/cyrus/search
>> conversations: 0
>> sync_log: off
>> sync_log_channels: squatter
>> search_fuzzy_always: 1
>> conversations_db: skiplist
>>
>>
>> (I know that some parameters make no sense with squat an no 
>> conversations but I left them there in case I want to try xapian again 
>> later)
> 
> 
> For the record, I solved the problem by following the instructions in
> 
> https://www.cyrusimap.org/imap/download/upgrade.html
> 
> specifically using the
> 
> reconstruct -G -V
> 
> command then nuking (ctl_conversationsdb -z) and rebuilding 
> (ctl_conversationsdb -b) the conversations db for each user, then I used 
> "squatter -v" to reindex all the messages.
> 
> I guess that ctl_conversationsdb in the two versions I tried (3.6.1 and 
> 3.8.1) has no safeguards against malformed mailboxes.
> 
> (BTW, the above is using 3.6.1, I removed the 3.8.1 version from 
> backports).
> 
> This is fine and dandy for this small test server with 4 users, I'll 
> have to devise a better way to migrate the production server.

Yeah, looks like the squatter fixes applied to later 3.6.x versions were 
applied simultaneously in the 3.8.x branch, so 3.8.1 probably has the 
same issues as 3.6.1.

Glad you got it figured out!


-- 
Nels Lindquist
[email protected]


------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/Tb146f45ff23d5ffa-Mbca029f46f41955b3d855acd
Delivery options: https://cyrus.topicbox.com/groups/info/subscription