Re: Re: Htdig 3.2.0 in Debian Sarge?

On Tue, 27 Apr 2004, Joe R. Jah wrote:

> Date: Tue, 27 Apr 2004 10:41:13 -0700 (PDT)
> From: Joe R. Jah <[email protected]>
> To: Lachlan Andrew <[email protected]>
> Cc: [email protected]
> Subject: [htdig-dev] Re: Htdig 3.2.0 in Debian Sarge?
> 
> On Tue, 27 Apr 2004, Lachlan Andrew wrote:
> 
> > Date: Tue, 27 Apr 2004 20:06:40 +1000
> > From: Lachlan Andrew <[email protected]>
> > To: Joe R. Jah <[email protected]>
> > Cc: [email protected]
> > Subject: Re: Htdig 3.2.0 in Debian Sarge?
> > 
> > Greetings Joe,
> > 
> > Thanks for testing it.  Did you do a "make clean" first?  I'm not sure 
> > if it is the cause, but I think there is something flakey in 
> > ht://Dig's compile dependencies.  I also got a crash (after about 20 
> > seconds or 300 pages) if I compiled the patch in a directory that 
> > already had .o files, but that went away on a clean compile.
> 
> Hi Lachlan,
> 
> I made distclean, and started over.  There wasn't any core dumps; however,
> the dig went on a lot slower than expected; it was even slower than before
> exclude_perform.1 patch.  I killed the process.
> 
> Patches present:
> 
>  DESTDIR.0
>  TMPFILE.0
>  operator[].0
>  extension_filter.0
>  robots.0
>  fileSpace.1
>  exclude_perform.1
>  config_parser.1
>  Soundex.0
>  store_phrases.0
> 
> config:
>  store_phrases:    false
> 
> Any ideas?
> 
> I plan to make another dig tonight, and profile it.

I randig again today.  Here is the time comparison with other versions
and/or patches:

htdig-3.2.0b5:

  Total dig time:  01:37:35 == 5255 seconds

 With exclude_perform.0

  Total dig time:  00:58:48 == 3528 seconds, or ~33% less time

 With exclude_perform.1

  Total dig time:  00:57:35 == 3455 seconds, or ~34% less time

 With exclude_perform.1 and store_phrases.0
  store_phrases: true
  Total dig time:  01:00:17 == 3617 seconds, or ~31% less time
  store_phrases: false
  Total dig time:  01:00:17 == 2941 seconds, or ~44% less time

And since store_phrases.0 is meant to recreate digging speeds comparable
to 3.1.6:

htdig-3.1.6:

  Total dig time:  00:14:59 == 899 seconds, or ~83% less time

The profiles are in ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profiles/

 htdig.gmon.exclude_perform.1-store_phrases.0-false.gz
 htdig.gmon.exclude_perform.1-store_phrases.0-true.gz

Regards,

Joe
-- 
     _/   _/_/_/       _/              ____________    __o
     _/   _/   _/      _/         ______________     _-\<,_
 _/  _/   _/_/_/   _/  _/                     ......(_)/ (_)
  _/_/ oe _/   _/.  _/_/ ah        [email protected]



-------------------------------------------------------
This SF.Net email is sponsored by: Oracle 10g
Get certified on the hottest thing ever to hit the market... Oracle 10g. 
Take an Oracle 10g class now, and we'll give you the exam FREE. 
http://ads.osdn.com/?ad_id=3149&alloc_id=8166&op=click
_______________________________________________
ht://Dig Developer mailing list:
[email protected]
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-dev