Re: Compression related performance

Jim,
 	Thanks for the numbers.  Pretty different from Joe's.

Question #1)

    Could you download a fresh copy of BDB 3.0.55 from
http://www.sleepycat.com/download/index.shtml

It's easy to build, I am most interested in the results when you run 
db_stat on the uncompressed files and report back the fill-factor.  This 
is a measure of wasted space in the BDB pages.  This won't work on the 
compressed index.

Question #2)
   What page_size are you using?

Question #3)
   Do you ever see any errors when using the compressed index?

   Joe:  Do you?

Thanks

Neal

On Fri, 14 Jan 2005, Jim wrote:

> Here is another performance comparison collected when the server was under 
> less load. The data is essentially the same as that used for the last set of 
> numbers.
>
> Uncompressed
> ------------
> 416.28 user
> 97.72 system
> 1:30:23 elapsed
>
>  10510336 Jan 15 00:00 db.docdb
>  10444800 Jan 15 00:00 db.docs.index
>  90488832 Jan 15 00:00 db.excerpts
>  436043776 Jan 15 00:00 db.words.db
>
> Compressed
> ----------
> 2008.63 user
> 133.35 system
> 2:40:16 elapsed
>
>  10526720 Jan 14 09:35 db.docdb
>  10444800 Jan 14 09:35 db.docs.index
>  90611712 Jan 14 09:36 db.excerpts
>  113773568 Jan 14 09:36 db.words.db
>     16384 Jan 14 09:36 db.words.db_weakcmpr
>
>
> I do have a large data set that I could test with if it would be of real
> value. However I would need to try rebuilding ht://Dig with large file
> support before I could consider dropping compression for that set.
>
>
> Jim
>
>
> -------------------------------------------------------
> The SF.Net email is sponsored by: Beat the post-holiday blues
> Get a FREE limited edition SourceForge.net t-shirt from ThinkGeek.
> It's fun and FREE -- well, almost....http://www.thinkgeek.com/sfshirt
> _______________________________________________
> ht://Dig Developer mailing list:
> [email protected]
> List information (subscribe/unsubscribe, etc.)
> https://lists.sourceforge.net/lists/listinfo/htdig-dev
>

-- 
Neal Richter 
Knowledgebase Developer
RightNow Technologies, Inc.
Customer Service for Every Web Site
Office: 406-522-1485



-------------------------------------------------------
The SF.Net email is sponsored by: Beat the post-holiday blues
Get a FREE limited edition SourceForge.net t-shirt from ThinkGeek.
It's fun and FREE -- well, almost....http://www.thinkgeek.com/sfshirt
_______________________________________________
ht://Dig Developer mailing list:
[email protected]
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-dev