System requirements to boost xapian's performance?

Philip Colmer <[email protected]> Fri, 14 Jan 2022 09:00:52 +0000
Newsgroups gmane.comp.search.xapian.general
Message-ID <CAKTSSTi7qTLrYtDmf6+mpN3cZY51dHsmHpngw83x-kn-K9b+_g@mail.gmail.com>
Hi

I'm using Xapian as the search engine for Mailman 3. Having just migrated
our mailing lists from Mailman 2, a key task we need to do is to index the
existing archives for each list.

This is a one-off task for each list so, as we have Mailman 3 running on
AWS compute servers, I'd like to temporarily configure the specification of
the servers so that Mailman 3 and Xapian complete the job as quickly as
possible.

What changes can I make to the specification of a server to best improve
the performance of the indexing? For example, if I throw more cores at
this, will the indexing go faster?

Thanks for any insight/suggestions.

Regards

Philip