Fwd: [Durus-users] PersistentDict vs BTree

Forwarding to Quixote list at Jesus's request.

On 10/23/06, Jesus Cea <[email protected]> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Mike Orr wrote:
> >    - Three Quixote processes on the server would take 645 MB, a good
> > chunk of the 1 GB total, though one or two would be swapped out
> > sometimes.
>
> If your data is "read only" and you are using a pickle, I guess you
> should be able to share the entire data between threads, without any
> special code.
>
> Another option would use a single-thread server with the quixote
> instances acting as "clients" (sending search terms to the server). This
> makes sense because a) eats less RAM and b) since your search is CPU
> bound, processing "x" queries at once will be (slightly) slower that
> processing the queries serially.

The problem is that Quixote does not come with a threaded server and I
don't know anybody who's used it with one, so I'd need to write a
compatibility layer to a third-party server (probably flup) and test
it, and this would take time away from more pressing tasks.

Your second suggestion is a more specialized version of the Durus
server, one that would return only the query results.  That has some
promise but would be a non-trivial project to implement.

-- 
Mike Orr <[email protected]>