Re: Non-blocking publishing in Python

Hi Brian,

The question was not bone-headed at all. It's just that sometimes our
Python guy goes into  { while 1: sleep } mode. ;)

Both of those client libraries were experimental prototypes, as is
probably clear from reading the source. Plus, I was kind of learning
Python as we wrote them.

I'm Cc'ing Ben in case he knows the answer to your embedding question.

I do know that no one is currently working to port the client library
to Twisted; right now all the energy and effort is going into
rewriting the server using Twisted, and hopefully we can learn from
that to do a client rewrite sometime later. If you're feeling
ambitious, feel free to take a crack at doing it with Twisted's
Deferred mechanism...

   -- Adam



On Apr 5, 2005 4:13 AM,
[email protected]
<[email protected]> wrote:
> Haven't heard anything back from the list regarding this question. If it is
> because the question was too bone-headed, then there is no remedy. Otherwise,
> the following information might be useful to someone else getting started.
> 
> There are two python client libraries: pubsublib.py and libkn/libkn.py.
> According to the source, pubsublib.py is a non-blocking implementation, while
> libkn.py is blocking. The examples in apps are built off of pubsublib, so they
> should be non-blocking.
> 
> This seems to be true when running as a standalone script, but what about when I
> want to embed? Is the logging package being used to help the debugging process
> or are people using pdb?
> 
> Also, I read somewhere that the client is supposed to be using Twisted in the
> near future. Is this still the case, and if so, what's the progress on it?
> 
> Thanks,
> Brian
> 
> 
> Quoting [email protected]:
> 
> > Hello:
> >
> > I'm trying to use the apps/publish.py module as a starting point for writing
> > my
> > own simple publishing lib to work with repubsub. The script runs fine on its
> > own, but whenever I try to embed it in other code, I seem to get blocking
> > issues and the CPU load spikes.
> >
> > Inside the apps/publish.py script, I looked at the following method calls:
> >
> >   asyncore.poll()
> >   scheduler.timeout()
> >   scheduler.run()
> >
> > Now Python's asyncore does not have documentation on the poll function,
> > although
> > in my interpreter, I do see a reference for poll. The two scheduler function
> > calls both pass in their implementations. If I comment out that loop, my
> > messages don't get published. So what's going on here?
> >
> > Ideally, I'd like to be able to use Twisted's Deferred mechanism to handle
> > the
> > blocking issue, but I'm unsure the best way to approach it without heavily
> > modifying the code base.
> >
> > Any help is greatly appreciated.
> >
> > Thanks,
> > Brian
> >
> > --
> >   ====
> > brian lee dae yung
> > biomimetic art and research
> >   mux space . com
> >
> > ----------------------------------------------------------------
> > This message was sent using IMP, the Internet Messaging Program.
> >
> >
> >
> > -------------------------------------------------------
> > SF email is sponsored by - The IT Product Guide
> > Read honest & candid reviews on hundreds of IT Products from real users.
> > Discover which products truly live up to the hype. Start reading now.
> > http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
> > _______________________________________________
> > Mod-pubsub-developer mailing list
> > [email protected]
> > https://lists.sourceforge.net/lists/listinfo/mod-pubsub-developer
> >
> 
> --
>   ====
> brian lee dae yung
> biomimetic art and research
>   mux space . com
> 
> ----------------------------------------------------------------
> This message was sent using IMP, the Internet Messaging Program.
> 
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
> _______________________________________________
> Mod-pubsub-developer mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/mod-pubsub-developer
>


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click