Re: UBH slow downloading headers.

--- In [email protected], "Ben" <synaptic_axon@y...> wrote:
> I'm not sure ubh is under active development anymore.  The last update
> seems to have happened about 5 months ago with the most activity
> almost a year ago.

Yes, I share your impression.

> I recently picked up the cvs version and noticed the same speed issues
> you have encoutnered.  I have been converting it to use PostgreSQL and
> reaching an island of stability yesterday, having significantly
> improved the performance.  

Sounds good.

> ubhasm runs in about 10-20 seconds with 100k articles in the database
> and several thousand multiparts.  I made all the queries in the
> add_articles() sub use stored procedures and they average about
> 1ms/query.  This is on an Athlon 900MHz tbird with 768MB and an out of
> the box postgresql 7.4 config (no optimizations whatsoever).  
> 
> This program still has a lot of potential and Gerard's clean
> programming style has made it really easy to dig into.  I think the
> problems lie with MySQL, not ubh.  
> 
> While I can provide a patches, I have made a lot of changes.  I'm not
> sure the patches would be accepted or if Gerard even cares anymore. 
> If you want my patches or a snapshot of my branch, let me know.

I'm interested; please upload a tarball to the yahoo group.

> I'm at a crossroads of wanting to add support for threading and if
> anyone has suggestions on the use of POE versus 5.8 ithreads or some
> other ideas I would be very interested.  

I have played around with perl threads and POE in the past. I don't
really like POE (most other people do, though) and the threads stuff
is quite unstable, especially on SMP systems. I think it's a better
idea to stick with separate processes that can be started and
terminated at any time. I'd like to help in modifying UBH so that
multiple instances of different type of ubh-processes can be started
at the same time without interefering with each other.

> My newsserver,
> news.west.cox.net limits each connection to 384kbps but permits 4
> simultaneous connections for 1.5MB.

I use news.claranews.com, they allow 3 connection at 60kbyte/s each.
It would be really nice to be able to download article headers for
more than 1 group in parallel for example - perhaps even for 1 group;
800,000 headers in a newsgroup can take forever to download!

-Sven


 

------------------------ Yahoo! Groups Sponsor ---------------------~-->
Buy Ink Cartridges or Refill Kits for your HP, Epson, Canon or Lexmark
Printer at MyInks.com. Free s/h on orders $50 or more to the US & Canada.
http://www.c1tracking.com/l.asp?cid=5511
http://us.click.yahoo.com/mOAaAA/3exGAA/qnsNAA/IHFolB/TM
---------------------------------------------------------------------~->

Yahoo! Groups Links

To visit your group on the web, go to:
 http://groups.yahoo.com/group/ubh/

To unsubscribe from this group, send an email to:
 [email protected]

Your use of Yahoo! Groups is subject to:
 http://docs.yahoo.com/info/terms/