[gensim:1376] Re: LDA on large corpora: Pryo4, Atlas, and multiprocessing

Radim, sorry for my belated response.

> I cannot replicate this problem, on Lion with Pyro 4.14 -- the 
> distributed LDA seems to work fine. Can you give more debug info? 

No exceptions were raised.  Instead, when launching workers, only the first 
few would receive a port number, etc.  Then, the LdaModel code could not 
initialize any of the workers.  If others are not experiencing this, I'm 
content to write it off as a peculiarity of my set-up.

> That's the method that (lazily) reads in your corpus. Perhaps the data 
> is stored on a slow medium -- slow disk? Or the documents take time to 
> compute (on-the-fly corpus)? 

That's the most logical explaination.  Although, it appeared to me that I 
was CPU (rather than I/O) bound.  May investigate some time.

-Kyle