Re: How to make database build threaded?

Jean-Francois Dockes <[email protected]>
Newsgroups gmane.comp.search.xapian.general
Message-ID <[email protected]>
Franco Martelli writes:
 > Hi everybody,
 > I'm the author of a small C++11 program called XDGSearch. The source
 > code is hosted on Github, for a quick overview you can visit this link
 > https://github.com/frank67/XDGSearch/blob/master/README.md
 > I'm writing to the mailing list because I'd like to make the database
 > build process splitted in more thread. Is it possible? If you are a C++
 > programmer you can take a look at the populateDB() function at this link
 > https://github.com/frank67/XDGSearch/blob/597380bfd7de94857cef08c95e5e31392807a7cb/indexer.cpp#L85
 > which is the heart of the databases creation process.
 > I'd be also happy if I find somebody that want to be involved in the
 > XDGSearch development :)
 > Thanks in advance for any answer, best regards
 > 
 > -- 
 > Franco Martelli

Hi,

You may be interested by how Recoll does it:

https://www.lesbonscomptes.com/recoll/idxthreads/threadingRecoll.html

A few things in the document are slightly obsolete (esp. the last
paragraph: recollindex now does use vfork()), but it's overall quite close
to how the current indexer works.

jfd
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.