Re: So, are people still using ubh?

Doug McLaren <[email protected]> Tue, 20 Mar 2007 12:06:21 -0500
Newsgroups gmane.network.ubh
Message-ID <[email protected]>
--i00shBDksuAWEBmfh16PlRHFymuXo8XkdV8qQJg
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit

On Sat, Mar 17, 2007 at 11:27:55PM -0700, Gerard Lanois wrote:
 
|    There was quite a bit of extra logic added to ubh3 by
|    a volunteer developer that severely hampers the
|    performance of inserts (way too many indexes being
|    computed).  Thus I am reluctant to accept
|    anyone else's work.  If you think you can improve the
|    speed of ubh by **removing** code (and indexes),
|    by all means, show me what you have.

I never said I could speed it up, only that there's room for
improvement.  (At least I hope there is -- it's painful as-is with big
groups.)  I also said nothing about removing code or indexes.

If I can come up with something, I'll let you know.  Right now, the
idea that comes to mind would be seperate tables for the headers in
each group (so we could reduce the number of rows that we're looking
at), and perhaps removing the headers from the table once it's found a
complete multi-part file.  I dunno -- I haven't done any further work
towards this, so it's not tested, attempted or even well thought out
yet.

So far, my goal would be to make it easier on the database -- the ubh
part itself seems plenty fast.

|    What would be the compelling reason(s) for
|    moving to a different database engine?

Probably none.  Unless somebody already has it going.  Considering the
lack of response I got (which surprised me with something like 300
people on the mailing list), I don't anticipate doing anything towards
that goal -- mysql probably performs better than any alternatives for
what ubh3 needs anyways.

Really, I don't see much in ubh that looks mysql specific.  If
somebody wanted to make it work with Oracle, it ought to only take a
few minutes.  If ubh3 were more popular, I'd probably go ahead and do
it, but since it looks like anything I do will just be for me,
probably not.

|    As far as disk space checking is concerned, multi-terabyte RAIDs
|    are very affordable, why bother?  Unless you are downloading
|    questionable material into a size-limited encrypted filesystem.
|    It seems that everyone who has ever desired disk space checking
|    has been in that boat.

   `The steady state of disks is full.' - Ken Thompson

I don't care how many terabytes of disk you have, if you're
automatically downloading stuff from Usenet with something like ubh,
you'll eventually fill it up.  (If you use it interactively, maybe
not, or at least it'll take longer.)

As for `questionable material', I'm not touching that one.

Fortunately, occasional disk space checking is very easily added.

-- 
Doug McLaren, [email protected]    All wiyht. Rho sritched mg kegtops awound?


--i00shBDksuAWEBmfh16PlRHFymuXo8XkdV8qQJg
Content-Type: text/html; charset=US-ASCII
Content-Transfer-Encoding: 7bit


<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
</head>

<!-- Network content -->


<body style="background-color: #ffffff;">

<!--~-|**|PrettyHtmlStartT|**|-~-->
<div id="ygrp-mlmsg" style="width:655px; position:relative;">
  <div id="ygrp-msg" style="width: 490px; padding: 0 15px 0 0; float:left;  z-index:1;">
<!--~-|**|PrettyHtmlEndT|**|-~-->

    <div id="ygrp-text">
            <p>On Sat, Mar 17, 2007 at 11:27:55PM -0700, Gerard Lanois wrote:<br>
 <br>
|    There was quite a bit of extra logic added to ubh3 by<br>
|    a volunteer developer that severely hampers the<br>
|    performance of inserts (way too many indexes being<br>
|    computed).  Thus I am reluctant to accept<br>
|    anyone else's work.  If you think you can improve the<br>
|    speed of ubh by **removing** code (and indexes),<br>
|    by all means, show me what you have.<br>
<br>
I never said I could speed it up, only that there's room for<br>
improvement.  (At least I hope there is -- it's painful as-is with big<br>
groups.)  I also said nothing about removing code or indexes.<br>
<br>
If I can come up with something, I'll let you know.  Right now, the<br>
idea that comes to mind would be seperate tables for the headers in<br>
each group (so we could reduce the number of rows that we're looking<br>
at), and perhaps removing the headers from the table once it's found a<br>
complete multi-part file.  I dunno -- I haven't done any further work<br>
towards this, so it's not tested, attempted or even well thought out<br>
yet.<br>
<br>
So far, my goal would be to make it easier on the database -- the ubh<br>
part itself seems plenty fast.<br>
<br>
|    What would be the compelling reason(s) for<br>
|    moving to a different database engine?<br>
<br>
Probably none.  Unless somebody already has it going.  Considering the<br>
lack of response I got (which surprised me with something like 300<br>
people on the mailing list), I don't anticipate doing anything towards<br>
that goal -- mysql probably performs better than any alternatives for<br>
what ubh3 needs anyways.<br>
<br>
Really, I don't see much in ubh that looks mysql specific.  If<br>
somebody wanted to make it work with Oracle, it ought to only take a<br>
few minutes.  If ubh3 were more popular, I'd probably go ahead and do<br>
it, but since it looks like anything I do will just be for me,<br>
probably not.<br>
<br>
|    As far as disk space checking is concerned, multi-terabyte RAIDs<br>
|    are very affordable, why bother?  Unless you are downloading<br>
|    questionable material into a size-limited encrypted filesystem.<br>
|    It seems that everyone who has ever desired disk space checking<br>
|    has been in that boat.<br>
<br>
`The steady state of disks is full.' - Ken Thompson<br>
<br>
I don't care how many terabytes of disk you have, if you're<br>
automatically downloading stuff from Usenet with something like ubh,<br>
you'll eventually fill it up.  (If you use it interactively, maybe<br>
not, or at least it'll take longer.)<br>
<br>
As for `questionable material', I'm not touching that one.<br>
<br>
Fortunately, occasional disk space checking is very easily added.<br>
<br>
-- <br>
Doug McLaren, <a href="mailto:dougmc%40frenzied.us">dougmc@frenzied.<wbr>us</a>    All wiyht. Rho sritched mg kegtops awound?<br>
<br>
</p>
    </div>  

    <!--~-|**|PrettyHtmlStart|**|-~-->
    <span width="1" style="color: white;">__._,_.___</span>
    <!-- Start the section with Message In topic -->
    <div id="ygrp-actbar">
              <span class="left">
          <a href="http://groups.yahoo.com/group/ubh/message/780;_ylc=X3oDMTMyMzRiMGpmBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBG1zZ0lkAzc4MgRzZWMDZnRyBHNsawN2dHBjBHN0aW1lAzExNzQ5MzE5NjMEdHBjSWQDNzgw">
            Messages in this topic          </a> (<span class="bld">0</span>)
        </span>
        <a href="http://groups.yahoo.com/group/ubh/post;_ylc=X3oDMTJvNmw3bG45BF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBG1zZ0lkAzc4MgRzZWMDZnRyBHNsawNycGx5BHN0aW1lAzExNzQ5MzE5NjM-?act=reply&messageNum=782">
          <span class="bld">
            Reply          </span> (via web post)
        </a>  | 
        <a href="http://groups.yahoo.com/group/ubh/post;_ylc=X3oDMTJlZmwyZGE0BF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTE3NDkzMTk2Mw--" class="bld">
          Start a new topic        </a>
          </div> 
    <!-------     Start Nav Bar  ------>
    <!-- |**|begin egp html banner|**| -->
    <div id="ygrp-vitnav">
                <a href="http://groups.yahoo.com/group/ubh/messages;_ylc=X3oDMTJlaGczbGUzBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA21zZ3MEc3RpbWUDMTE3NDkzMTk2Mw--">Messages</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/files;_ylc=X3oDMTJmc2o0YTMyBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA2ZpbGVzBHN0aW1lAzExNzQ5MzE5NjM-">Files</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/photos;_ylc=X3oDMTJlbHYxdWMyBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA3Bob3QEc3RpbWUDMTE3NDkzMTk2Mw--">Photos</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/links;_ylc=X3oDMTJmN2kyamQwBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA2xpbmtzBHN0aW1lAzExNzQ5MzE5NjM-">Links</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/database;_ylc=X3oDMTJjNnNycm5rBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA2RiBHN0aW1lAzExNzQ5MzE5NjM-">Database</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/polls;_ylc=X3oDMTJmMm4yN3FzBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA3BvbGxzBHN0aW1lAzExNzQ5MzE5NjM-">Polls</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/members;_ylc=X3oDMTJlY2xjYmw4BF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA21icnMEc3RpbWUDMTE3NDkzMTk2Mw--">Members</a>  
            |    <a href="http://groups.yahoo.com/group/ubh/calendar;_ylc=X3oDMTJkb3A3dTYwBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA2NhbARzdGltZQMxMTc0OTMxOTYz">Calendar</a>  
    </div>  
    <!-- |**|end egp html banner|**| -->

    <!-- Do not have place to put it yet -->
    <div id="ygrp-grft">
          </div>

    <!-- yahoo logo -->
    <!-- |**|begin egp html banner|**| -->
    <div id="ygrp-ft">
      <a href="http://groups.yahoo.com/;_ylc=X3oDMTJkZmEyZDJxBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA2dmcARzdGltZQMxMTc0OTMxOTYz">
      <img src="http://us.i1.yimg.com/us.yimg.com/i/yg/img/logo/ma_grp_160.gif" height="15" width="106" border="0" alt="Yahoo! Groups"></a> <br>
      <a href="http://groups.yahoo.com/group/ubh/join;_ylc=X3oDMTJmYjJlaGNkBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA3N0bmdzBHN0aW1lAzExNzQ5MzE5NjM-">Change settings via the Web</a> (Yahoo! ID required) <br>
      Change settings via email: <a href="mailto:[email protected]?subject=Email Delivery: Digest">Switch delivery to Daily Digest</a> | <a href = "mailto:[email protected]?subject=Change Delivery Format: Traditional">Switch format to Traditional</a> <br>

      <a href="http://groups.yahoo.com/group/ubh;_ylc=X3oDMTJkY2VvaHYzBF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwNmdHIEc2xrA2hwZgRzdGltZQMxMTc0OTMxOTYz">
        Visit Your Group 
      </a> |
      <a href="http://docs.yahoo.com/info/terms/">
        Yahoo! Groups Terms of Use      </a> |
      <a href="mailto:[email protected]?subject=">
        Unsubscribe      </a> 
    </div>     <!-- |**|end egp html banner|**| -->
  </div> <!-- ygrp-msg -->

  
  <!-- Sponsor -->
  <!-- |**|begin egp html banner|**| -->
  <div id="ygrp-sponsor" style="width:140px;float: left; clear: none; margin-left: 5px; background:white; margin-bottom:25px ;position:absolute; top:0; right: 0;">
    <!-- Network content -->
    
    <!-- Start vitality -->
    <div id="ygrp-vital">
            <a href="http://groups.yahoo.com/group/ubh;_ylc=X3oDMTJlOXVqbGE2BF9TAzk3MzU5NzE0BGdycElkAzI5MTcwNTQEZ3Jwc3BJZAMxNzA1MDA1NTEyBHNlYwN2dGwEc2xrA3ZnaHAEc3RpbWUDMTE3NDkzMTk2Mw--">
        Visit Your Group      </a>
    </div> 
                <div id="hd">SPONSORED LINKS</div>
      <div id="ov">
        <ul>
                    <li><a href="http://groups.yahoo.com/gads;_ylc=X3oDMTJja3VmNDljBF9TAzk3MzU5NzE0BF9wAzEEZ3JwSWQDMjkxNzA1NARncnBzcElkAzE3MDUwMDU1MTIEc2VjA3NsbW9kBHN0aW1lAzExNzQ5MzE5NjQ-?t=ms&k=Computer+internet+help&w1=Computer+internet+help&w2=Usenet+binaries&w3=Computer+internet+business&w4=Computer+internet+access&w5=Computer+internet+security&c=5&s=143&g=2&.sig=aansB8eBE9FcZ_QqM8FNvg">Computer internet help</a></li>
                    <li><a href="http://groups.yahoo.com/gads;_ylc=X3oDMTJjOGxvcm1qBF9TAzk3MzU5NzE0BF9wAzIEZ3JwSWQDMjkxNzA1NARncnBzcElkAzE3MDUwMDU1MTIEc2VjA3NsbW9kBHN0aW1lAzExNzQ5MzE5NjQ-?t=ms&k=Usenet+binaries&w1=Computer+internet+help&w2=Usenet+binaries&w3=Computer+internet+business&w4=Computer+internet+access&w5=Computer+internet+security&c=5&s=143&g=2&.sig=ZdhV59iRoMVES-myjBkykg">Usenet binaries</a></li>
                    <li><a href="http://groups.yahoo.com/gads;_ylc=X3oDMTJjODRqNWQ2BF9TAzk3MzU5NzE0BF9wAzMEZ3JwSWQDMjkxNzA1NARncnBzcElkAzE3MDUwMDU1MTIEc2VjA3NsbW9kBHN0aW1lAzExNzQ5MzE5NjQ-?t=ms&k=Computer+internet+business&w1=Computer+internet+help&w2=Usenet+binaries&w3=Computer+internet+business&w4=Computer+internet+access&w5=Computer+internet+security&c=5&s=143&g=2&.sig=bxsS2jcJWULXfkbxxpfEfg">Computer internet business</a></li>
                    <li><a href="http://groups.yahoo.com/gads;_ylc=X3oDMTJjOTBsY2UxBF9TAzk3MzU5NzE0BF9wAzQEZ3JwSWQDMjkxNzA1NARncnBzcElkAzE3MDUwMDU1MTIEc2VjA3NsbW9kBHN0aW1lAzExNzQ5MzE5NjQ-?t=ms&k=Computer+internet+access&w1=Computer+internet+help&w2=Usenet+binaries&w3=Computer+internet+business&w4=Computer+internet+access&w5=Computer+internet+security&c=5&s=143&g=2&.sig=5UMS8lqLVqs9RPJYb9B5lA">Computer internet access</a></li>
                    <li><a href="http://groups.yahoo.com/gads;_ylc=X3oDMTJjZ21qbmljBF9TAzk3MzU5NzE0BF9wAzUEZ3JwSWQDMjkxNzA1NARncnBzcElkAzE3MDUwMDU1MTIEc2VjA3NsbW9kBHN0aW1lAzExNzQ5MzE5NjQ-?t=ms&k=Computer+internet+security&w1=Computer+internet+help&w2=Usenet+binaries&w3=Computer+internet+business&w4=Computer+internet+access&w5=Computer+internet+security&c=5&s=143&g=2&.sig=ONCODGPpGKw6R2MQtUivbQ">Computer internet security</a></li>
                  </ul>
      </div>
              
    <!-- Network content -->
              <div id="nc">
              <div class="ad">
                      <div id="hd1">Y! Messenger</div> 
<p><a href="http://us.ard.yahoo.com/SIG=12imr4sfk/M=493064.9803215.10510209.8674578/D=groups/S=1705005512:NC/Y=YAHOO/EXP=1174939164/A=3848590/R=0/SIG=12dds2hov/*http://us.rd.yahoo.com/evt=42403/*http://messenger.yahoo.com/feat_voice.php">Make free calls</a></p> 
<p>Call PC-to-PC</p> 
<p>worldwide- free!</p>                  </div>
                    <div class="ad">
                      <div id="hd1">Yahoo! Mail</div> 
<p><a href="http://us.ard.yahoo.com/SIG=12iero11h/M=493064.9803214.10510208.8674578/D=groups/S=1705005512:NC/Y=YAHOO/EXP=1174939164/A=3848568/R=0/SIG=12jllrvsk/*http://us.rd.yahoo.com/evt=42409/*http://advision.webevents.yahoo.com/handraisers">Next gen email?</a></p> 
<p>Try the all-new</p> 
<p>Yahoo! Mail Beta.</p>                  </div>
                    <div class="ad">
                      <div id="hd1">New web site?</div> 
<p><a href="http://us.ard.yahoo.com/SIG=12i4032bg/M=493064.9803227.10510220.8674578/D=groups/S=1705005512:NC/Y=YAHOO/EXP=1174939164/A=3848642/R=0/SIG=131eshi2t/*http://searchmarketing.yahoo.com/arp/srchv2.php?o=US2004&cmp=Yahoo&ctv=Groups3&s=Y&s2=&s3=&b=50">Drive traffic now.</a></p> 
<p>Get your business</p> 
<p>on Yahoo! search.</p>                  </div>
          </div>
    
  </div>   <!-- |**|end egp html banner|**| -->
  <div style="clear:both; color: #FFF; font-size:1px;">.</div>
</div>   <img src="http://geo.yahoo.com/serv?s=97359714/grpId=2917054/grpspId=1705005512/msgId=782/stime=1174931963/nc1=3848590/nc2=3848568/nc3=3848642" width="1" height="1"> <br>

<span  style="color: white;">__,_._,___</span>
<!--~-|**|PrettyHtmlEnd|**|-~-->
</body>
<!--~-|**|PrettyHtmlStart|**|-~-->
<head>
<style type="text/css">
<!--
#ygrp-mlmsg {font-size:13px; font-family: arial,helvetica,clean,sans-serif;*font-size:small;*font:x-small;}
#ygrp-mlmsg table {font-size:inherit;font:100%;}
#ygrp-mlmsg select, input, textarea {font:99% arial,helvetica,clean,sans-serif;}
#ygrp-mlmsg pre, code {font:115% monospace;*font-size:100%;}
#ygrp-mlmsg * {line-height:1.22em;}
#ygrp-text{
    font-family: Georgia;	
}
#ygrp-text p{
    margin: 0 0 1em 0;
}
#ygrp-tpmsgs{
    font-family: Arial;	
    clear: both;
}
#ygrp-vitnav{
	padding-top: 10px;
	font-family: Verdana;
	font-size: 77%;
	margin: 0;
}
#ygrp-vitnav a{
	padding: 0 1px;
}
#ygrp-actbar{
	clear: both;
	margin: 25px 0;
	white-space:nowrap;
	color: #666;
	text-align: right;
}
#ygrp-actbar .left{
	float: left;
	white-space:nowrap;
}
.bld{font-weight:bold;}
#ygrp-grft{
	font-family: Verdana;
	font-size: 77%;
	padding: 15px 0;
}
#ygrp-ft{
  font-family: verdana;
  font-size: 77%;
  border-top: 1px solid #666; 
  padding: 5px 0; 
}
#ygrp-mlmsg #logo{
  padding-bottom: 10px;
}

#ygrp-vital{
	background-color: #e0ecee;
	margin-bottom: 20px;
	padding: 2px 0 8px 8px;
}
#ygrp-vital #vithd{
	font-size: 77%;
	font-family: Verdana;
	font-weight: bold;
	color: #333;
	text-transform: uppercase;
}
#ygrp-vital ul{
	padding: 0;
	margin: 2px 0;
}
#ygrp-vital ul li{
  list-style-type: none;
  clear: both;
  border: 1px solid #e0ecee;  
}
#ygrp-vital ul li .ct{
  font-weight: bold;
  color: #ff7900;
  float: right;
  width: 2em;
  text-align:right;
  padding-right: .5em;
}
#ygrp-vital ul li .cat{
  font-weight: bold;
}
#ygrp-vital a {
	text-decoration: none;
}

#ygrp-vital a:hover{
  text-decoration: underline;
}

#ygrp-sponsor #hd{
	color: #999;
	font-size: 77%;
}
#ygrp-sponsor #ov{
	padding: 6px 13px;
	background-color: #e0ecee;
	margin-bottom: 20px;
}
#ygrp-sponsor #ov ul{
	padding: 0 0 0 8px;
	margin: 0;
}
#ygrp-sponsor #ov li{
	list-style-type: square;
	padding: 6px 0;
	font-size: 77%;
}
#ygrp-sponsor #ov li a{
	text-decoration: none;
	font-size: 130%;
}
#ygrp-sponsor #nc {
  background-color: #eee;
  margin-bottom: 20px;
  padding: 0 8px;
}
#ygrp-sponsor .ad{
	padding: 8px 0;
}
#ygrp-sponsor .ad #hd1{
	font-family: Arial;
	font-weight: bold;
	color: #628c2a;
	font-size: 100%;
	line-height: 122%;
}
#ygrp-sponsor .ad a{
	text-decoration: none;
}
#ygrp-sponsor .ad a:hover{
	text-decoration: underline;
}
#ygrp-sponsor .ad p{
	margin: 0;
}
o {font-size: 0; }
.MsoNormal {
   margin: 0 0 0 0;
}
#ygrp-text tt{
  font-size: 120%;
}
blockquote{margin: 0 0 0 4px;}
.replbq {margin:4}
-->
</style>
</head>
<!--~-|**|PrettyHtmlEnd|**|-~-->
</html><!--End group email -->


--i00shBDksuAWEBmfh16PlRHFymuXo8XkdV8qQJg--