System requirements to boost xapian's performance?
Philip Colmer <[email protected]> Fri, 14 Jan 2022 09:00:52 +0000
| Newsgroups | gmane.comp.search.xapian.general |
|---|---|
| Message-ID | <CAKTSSTi7qTLrYtDmf6+mpN3cZY51dHsmHpngw83x-kn-K9b+_g@mail.gmail.com> |
Hi I'm using Xapian as the search engine for Mailman 3. Having just migrated our mailing lists from Mailman 2, a key task we need to do is to index the existing archives for each list. This is a one-off task for each list so, as we have Mailman 3 running on AWS compute servers, I'd like to temporarily configure the specification of the servers so that Mailman 3 and Xapian complete the job as quickly as possible. What changes can I make to the specification of a server to best improve the performance of the indexing? For example, if I throw more cores at this, will the indexing go faster? Thanks for any insight/suggestions. Regards Philip