New proposed nofollow robot exclusion on links
Neal Richter <[email protected]> Sat, 22 Jan 2005 22:17:56 -0700 (MST)
| Newsgroups | gmane.comp.web.htdig.devel |
|---|---|
| Message-ID | <[email protected]> |
Read this! http://www.searchenginejournal.com/index.php?p=1254 Basically they are proposing to support puting nofollow robot directives in individual links. This is great.. I've been wishing for this for a while. This makes it possible to more carefully direct the spider.. ie follow some links on a page, but not all without having to write huge list of exclusion patterns. We should probably implement this since it looks like it could become a defacto standard. Thanks. -- Neal Richter Knowledgebase Developer RightNow Technologies, Inc. Customer Service for Every Web Site Office: 406-522-1485 ------------------------------------------------------- This SF.Net email is sponsored by: IntelliVIEW -- Interactive Reporting Tool for open source databases. Create drag-&-drop reports. Save time by over 75%! Publish reports on the web. Export to DOC, XLS, RTF, etc. Download a FREE copy at http://www.intelliview.com/go/osdn_nl _______________________________________________ ht://Dig Developer mailing list: [email protected] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev