Re: PATCH: Performance issue with exclude_urls

"Joe R. Jah" <[email protected]> Sun, 25 Apr 2004 16:02:15 -0700 (PDT)
Newsgroups	gmane.comp.web.htdig.devel
Message-ID	<[email protected]>
On Sun, 25 Apr 2004, Lachlan Andrew wrote:

> Date: Sun, 25 Apr 2004 22:01:46 +1000
> From: Lachlan Andrew <[email protected]>
> To: Joe R. Jah <[email protected]>
> Cc: "ht://Dig developers list" <[email protected]>
> Subject: Re: [htdig-dev] PATCH: Performance issue with exclude_urls
> 
> Greetings Joe,
> 
> Thanks for doing that testing.  I took a look at 
> <ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profile/htdig.gmon.exclude_perform.1.gz> 
> but it seemed to take about the same time as previously, dominated by  
> regexec.  Could you please check that this is the correct profile?

It is the correct profile; however, for accuracy I ran a second profile:

ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profile/htdig.gmon.exclude_perform.1-rerun.gz

Also, I backed out exclude_perform.1, compiled, ran htdig, and profile:

ftp://ftp.ccsf.org/htdig-patches/3.2.0b5/0Profile/htdig.gmon-rerun.gz

Here are my three htdig run times (3.2.0b5):

  Total dig time:  01:37:35 == 5255 seconds

With exclude_perform.0

  Total dig time:  00:58:48 == 3528 seconds, or ~33% less time

With exclude_perform.1

  Total dig time:  00:57:35 == 3455 seconds, or ~34% less time

Note the correction of speed gain; I had not correctly calculated the
percent in my previous messages.

Regards,

Joe
-- 
     _/   _/_/_/       _/              ____________    __o
     _/   _/   _/      _/         ______________     _-\<,_
 _/  _/   _/_/_/   _/  _/                     ......(_)/ (_)
  _/_/ oe _/   _/.  _/_/ ah        [email protected]




-------------------------------------------------------
This SF.net email is sponsored by: The Robotic Monkeys at ThinkGeek
For a limited time only, get FREE Ground shipping on all orders of $35
or more. Hurry up and shop folks, this offer expires April 30th!
http://www.thinkgeek.com/freeshipping/?cpg=12297
_______________________________________________
ht://Dig Developer mailing list:
[email protected]
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-dev