Re: How to «bootstrap» xapian/squatter

El 26/9/24 a les 13:05, Luca Olivetti via Info ha escrit:

> 
> I "only" have around 600000 messages.
> 
> Anyway, ctl_conversationsdb also segfaulted for another user with just a 
> handful of messages (around 7k, 650MB) when the conversations db, again, 
> reached the 4.1GB size.
> 
> These are my search parameters in imapd.conf
> 
> search_engine: xapian
> search_index_headers: no
> search_batchsize: 1000000
> defaultsearchtier: t1
> t1searchpartition-default: /var/spool/cyrus/search
> conversations: 1
> sync_log: on
> sync_log_channels: squatter
> search_fuzzy_always: 1
> 
> 
> I though that maybe the segfault was due to a memory error, but the 
> virtual machine (actually an lxc container in proxmox) has 8GB assigned 
> and the usage stays well below 2GB.


I ran ctl_conversationsdb under gdb but I'm none the wiser



(gdb) run -b martina
Starting program: /usr/lib/cyrus/bin/ctl_conversationsdb -b martina
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

Program received signal SIGSEGV, Segmentation fault.
find_node (db=db@entry=0x55555558b2f0, key=key@entry=0x55555594d5f0 
"<[email protected]>", 
keylen=keylen@entry=64, updateoffsets=updateoffsets@entry=0x0)
     at lib/cyrusdb_skiplist.c:1026
1026    lib/cyrusdb_skiplist.c: Permission denied.
(gdb) bt
#0  find_node (db=db@entry=0x55555558b2f0, key=key@entry=0x55555594d5f0 
"<[email protected]>", 
keylen=keylen@entry=64, updateoffsets=updateoffsets@entry=0x0)
     at lib/cyrusdb_skiplist.c:1026
#1  0x00007ffff7d865c4 in myfetch (db=0x55555558b2f0, key=0x55555594d5f0 
"<[email protected]>", 
keylen=64, data=0x7fffffffdfa0, datalen=0x7fffffffdf98, 
tidptr=<optimized out>)
     at lib/cyrusdb_skiplist.c:1074
#2  0x00007ffff7eb761e in conversations_get_msgid 
(state=state@entry=0x55555558dbc0, msgid=msgid@entry=0x55555594d5f0 
"<[email protected]>", 
cids=cids@entry=0x7fffffffe070)
     at imap/conversations.c:783
#3  0x00007ffff7f100f3 in extract_convdata 
(state=state@entry=0x55555558dbc0, msg=<optimized out>, 
msgidlist=msgidlist@entry=0x7fffffffe200, 
matchlist=matchlist@entry=0x7fffffffe210, 
msubjp=msubjp@entry=0x7fffffffe1e0)
     at imap/message.c:3819
#4  0x00007ffff7f1064c in message_update_conversations 
(state=state@entry=0x55555558dbc0, mailbox=0x5555556708c0, 
record=record@entry=0x7fffffffe330, convp=convp@entry=0x0) at 
imap/message.c:3878
#5  0x0000555555556992 in build_cid_cb (mbentry=0x55555558b210, 
rock=<optimized out>) at imap/ctl_conversationsdb.c:231
#6  0x00007ffff7d7eecd in cyrusdb_forone (db=<optimized out>, 
key=0x55555558dfa0 "Nuser\037martina\177", keylen=keylen@entry=13, 
p=p@entry=0x7ffff7eee120 <allmbox_p>, cb=cb@entry=0x7ffff7eee020 
<allmbox_cb>,
     rock=rock@entry=0x7fffffffe540, tid=0x0) at lib/cyrusdb.c:301
#7  0x00007ffff7ef3fa0 in mboxlist_mboxtree 
(mboxname=mboxname@entry=0x555555571d20 "user.martina", 
proc=proc@entry=0x5555555568d0 <build_cid_cb>, rock=rock@entry=0x0, 
flags=flags@entry=0) at imap/mboxlist.c:3715
#8  0x00007ffff7ef4270 in mboxlist_usermboxtree 
(userid=userid@entry=0x7fffffffee0c "martina", 
auth_state=auth_state@entry=0x0, proc=0x5555555568d0 <build_cid_cb>, 
rock=0x0, flags=0) at imap/mboxlist.c:3942
#9  0x00005555555576b7 in do_build (userid=<optimized out>) at 
imap/ctl_conversationsdb.c:259
#10 do_user (userid=userid@entry=0x7fffffffee0c "martina", 
rock=rock@entry=0x0) at imap/ctl_conversationsdb.c:794
#11 0x00005555555566a5 in main (argc=<optimized out>, argv=<optimized 
out>) at imap/ctl_conversationsdb.c:930
(gdb)


Bye
-- 
Luca Olivetti
Wetron Automation Technology https://wetron.es/
Tel. +34 93 5883004 (Ext.3010)  Fax +34 93 5883007


------------------------------------------
Cyrus: Info
Permalink: https://cyrus.topicbox.com/groups/info/Tb146f45ff23d5ffa-M6d2a12101ea032a04d51c7f2
Delivery options: https://cyrus.topicbox.com/groups/info/subscription