Re: How to «bootstrap » xapian/squatter
Albert Shih <[email protected]>
| Newsgroups | gmane.mail.imap.cyrus |
|---|---|
| Message-ID | <[email protected]> |
Le 26/09/2024 à 09:31:51+0200, Vladislav Kurz a écrit Hi, > Dne 25. 09. 24 v 21:23 Albert Shih napsal(a): > > Hi everyone. > > > > So I would like to know what would be the most efficient method to > > bootstrap squatter. > > > > On my new server after sync almost all the mail I got, I try to «bootstrap» > > squatter, meaning I launch the command squatter. But it's take lot of time. > > So I try to run 64 threads (the server got 32 cores) of squatter, but still > > after 10 h I just run 10% of the mailbox. > > > > Is they are any way to speed up ? Or the only solution is to wait ? > > > > Regards > > I'd not run squatter on as many threads as possible. I expect I/O would be > the bottleneck in this case. Thanks for the tips, I though about it but I run with 16 nvme ssd, and the server are still in test phase. With the right search_batchsize I think I will be able to index my 50 millions email in less than 4 hours. Regards. -- Albert SHIH 🦫 🐸 Observatoire de Paris France Heure locale/Local time: jeu. 26 sept. 2024 11:49:39 CEST ------------------------------------------ Cyrus: Info Permalink: https://cyrus.topicbox.com/groups/info/Tb146f45ff23d5ffa-M0cf1a0967e055675b9a4173d Delivery options: https://cyrus.topicbox.com/groups/info/subscription