Re: UBH slow downloading headers.

"Ben" <[email protected]> Mon, 08 Dec 2003 21:01:24 -0000
Newsgroups gmane.network.ubh
Message-ID <[email protected]>
I'm not sure ubh is under active development anymore.  The last update
seems to have happened about 5 months ago with the most activity
almost a year ago.

I recently picked up the cvs version and noticed the same speed issues
you have encoutnered.  I have been converting it to use PostgreSQL and
reaching an island of stability yesterday, having significantly
improved the performance.  

ubhasm runs in about 10-20 seconds with 100k articles in the database
and several thousand multiparts.  I made all the queries in the
add_articles() sub use stored procedures and they average about
1ms/query.  This is on an Athlon 900MHz tbird with 768MB and an out of
the box postgresql 7.4 config (no optimizations whatsoever).  

This program still has a lot of potential and Gerard's clean
programming style has made it really easy to dig into.  I think the
problems lie with MySQL, not ubh.  

While I can provide a patches, I have made a lot of changes.  I'm not
sure the patches would be accepted or if Gerard even cares anymore. 
If you want my patches or a snapshot of my branch, let me know.

I'm at a crossroads of wanting to add support for threading and if
anyone has suggestions on the use of POE versus 5.8 ithreads or some
other ideas I would be very interested.  My newsserver,
news.west.cox.net limits each connection to 384kbps but permits 4
simultaneous connections for 1.5MB.

Best Regards,

Benjamin

--- In [email protected], "ashakpezivink" <ashakpezivink@h...>
wrote:
> Hi,
> 
> This problem seems to have been plaguing me for a while. When I
> download headers, it seems to take forever to do it. I use the
command:
> 
> ./ubhdb -g <groupname>
> 
> From a graphical usenet client, I can max out my connection whilst
> downloading headers no troubles. But with ubh from the exact same
> groups it takes ages. For example. A group with 10000 new articals
> will take about 10 times longer on the machine running ubh as the
> machine running a graphical client. I've tried running top to see if
> anything was using lots of cpu, but it isn't. The only thing I can
> think of that might be affecting this is MySQL. This is also because
> other ubh actions (such as ubhasm), seem to take far longer than i'd
> expect too. The machine i'm running ubh on is an Athlon XP2200+.
> 
> Anyone got any other things I can try, or ways of testing how fast
> MySQL might be? (I'm using MySQL 3.23.58-1.9 which is the most
recent
> version with Redhat 9).
> 
> Thanks


------------------------ Yahoo! Groups Sponsor ---------------------~-->
Buy Ink Cartridges or Refill Kits for your HP, Epson, Canon or Lexmark
Printer at MyInks.com. Free s/h on orders $50 or more to the US & Canada.
http://www.c1tracking.com/l.asp?cid=5511
http://us.click.yahoo.com/mOAaAA/3exGAA/qnsNAA/IHFolB/TM
---------------------------------------------------------------------~->

To unsubscribe from this group, send an email to:
[email protected]

 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/