Re: Dev chat reminder, issue 150465c4-989e-4f64-a2a8-acb12cda9b13
Wieland Hoffmann <[email protected]>
| Newsgroups | gmane.comp.audio.musicbrainz.devel |
|---|---|
| Message-ID | <[email protected]> |
Hallo Paul Taylor: > On 12/05/2014 14:46, Wieland Hoffmann wrote: > > I spent last week making recording imports faster. To do that, I split > > the whole import process into multiple processes with Pythons > > multiprocessing module and experimented with different settings > > regarding the amount of used processes etc. > I thought that what Solr Cores are for, it doesnt like a very good idea > to be creating custom code outside of Solr for index building. The Python code performs only one part if building the index - it retrieves the raw values from the DB and hands them off to Solr (via its HTTP interface), which then does all the analysing, filtering and storing. -- Wieland