Re: Re: 3.1.6 vs. 3.2.0b5 speed test results

Ted Stresen-Reuter <[email protected]>
Newsgroups gmane.comp.web.htdig.devel
Message-ID <[email protected]>
Contradictory results when run against the same machine.

3.1.6
Start time: Wed Jun 2 13:20:41 WEST 2004
PDF::parse: cannot find pdf parser /usr/local/bin/acroread
Done Digging: Wed Jun 2 13:22:47 WEST 2004
Total: 2:06

3.2
Start time: Wed Jun 2 13:22:47 WEST 2004
Done Digging: Wed Jun 2 13:27:39 WEST 2004
Total: 4:52

I haven't been following the whole thread on what's at issue here, but 
if someone can give me an indication of what we want to test, maybe I 
could set up a site that tests specifically that issue. It might also 
be an issue of the size of the database. When indexing my development 
machine, the databases are significantly smaller than when indexing 
htdig.org using "robotstxt_name: master-htdig" (a few MB vs. ABOUT 40 
MB).

Does it matter that by default 3.2 does HEAD before GET? Would that 
influence the dig time?

Let me know... (back to painting)

Ted

On Jun 2, 2004, at 12:29 PM, Lachlan Andrew wrote:

> Greetings Ted,
>
> Thanks for your test.  I'm both pleased and puzzled by the results...
> My guess is that there is something about your particular set-up
> which is different from the default.  Could you post your  htdig.conf
> file (with any sensitive details removed)?  That may help us to track
> down the source of the problem.  It certainly adds weight to Neal's
> belief that it is just a bug, not a fundamental database problem,
> which is very encouraging.
>
> Thanks,
> Lachlan
>
> On Wed, 2 Jun 2004 07:00 pm, Ted Stresen-Reuter wrote:
>> It appears that 3.2.0b5 is about 20%
>> faster than 3.1.6 at digging (indexing) a site on Mac OS X
>> (10.3.4).
>>
>> I hope this helps with the pending decision.
>
> -- 
> [email protected]
> ht://Dig developer DownUnder  (http://www.htdig.org)
>
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by the new InstallShield X.
> From Windows to Linux, servers to mobile, InstallShield X is the one
> installation-authoring solution that does it all. Learn more and
> evaluate today! http://www.installshield.com/Dev2Dev/0504
> _______________________________________________
> ht://Dig Developer mailing list:
> [email protected]
> List information (subscribe/unsubscribe, etc.)
> https://lists.sourceforge.net/lists/listinfo/htdig-dev
>



-------------------------------------------------------
This SF.Net email is sponsored by the new InstallShield X.
From Windows to Linux, servers to mobile, InstallShield X is the one
installation-authoring solution that does it all. Learn more and
evaluate today! http://www.installshield.com/Dev2Dev/0504
_______________________________________________
ht://Dig Developer mailing list:
[email protected]
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-dev
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.