Re: Performance issue with exclude_urls
Lachlan Andrew <[email protected]>
| Newsgroups | gmane.comp.web.htdig.devel |
|---|---|
| Organization | sourceforge |
| Message-ID | <[email protected]> |
Yes, the heavy I/O is why we should also look at optimising the database format / access. Cheers, Lachlan On Thu, 22 Apr 2004 01:05 am, Christopher Murtagh wrote: > Once I stopped re-parsing the URL list at for each URL, the CPU > usage was down to about 6-10%, essentially making it an I/O bound > problem rather than CPU. -- [email protected] ht://Dig developer DownUnder (http://www.htdig.org) ------------------------------------------------------- This SF.Net email is sponsored by: IBM Linux Tutorials Free Linux tutorial presented by Daniel Robbins, President and CEO of GenToo technologies. Learn everything from fundamentals to system administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click _______________________________________________ ht://Dig Developer mailing list: [email protected] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev