[Task #87781] htdig Spidering
"SourceForge.net" <[email protected]>
| Newsgroups | gmane.comp.web.htdig.devel |
|---|---|
| Message-ID | <[email protected]> |
Task #87781 has been updated. Project: ht://Dig Subproject: Testing 3.2 Summary: htdig Spidering Complete: 95% Status: Open Authority : nealr Assigned to: nobody Description: Use the documenation to test each one of these config verbs # spidering max_hop_count start_url robotstxt_name(1) check_unique_date(1) check_unique_md5 md5_db limit_normalized limit_urls_to exclude_urls bad_querystr url_rewrite_rules url_part_aliases local_urls local_urls_only local_user_urls valid_extensions bad_extensions bad_local_extensions Follow-Ups: ------------------------------------------------------- Date: 2004-03-11 12:03 By: angusgb Comment: The md5 database problem for initial digs has been fixed by Lachlan's fix of the 8th of february ------------------------------------------------------- Date: 2004-03-11 11:38 By: angusgb Comment: check_unique_md5: does not work properly if "htdig -i" is executed, because the hash database is not erased. Fix and test are needed again for this. ------------------------------------------------------- Date: 2004-01-24 15:00 By: lha Comment: Done all but check_unique_date. (Patches not yet committed, as CVS is down.) -- lha ------------------------------------------------------- Date: 2004-01-24 07:04 By: lha Comment: Done all but: check_unique_date check_unique_md5 md5_db limit_normalized url_rewrite_rules url_part_aliases -- lha ------------------------------------------------------- For more info, visit: http://sourceforge.net/pm/task.php?func=detailtask&project_task_id=87781&group_id=4593&group_project_id=32485 ------------------------------------------------------- This SF.Net email is sponsored by: IBM Linux Tutorials Free Linux tutorial presented by Daniel Robbins, President and CEO of GenToo technologies. Learn everything from fundamentals to system administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click _______________________________________________ ht://Dig Developer mailing list: [email protected] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev