New proposed nofollow robot exclusion on links

Neal Richter <[email protected]> Sat, 22 Jan 2005 22:17:56 -0700 (MST)
Newsgroups gmane.comp.web.htdig.devel
Message-ID <[email protected]>
Read this!

http://www.searchenginejournal.com/index.php?p=1254

Basically they are proposing to support puting nofollow robot directives 
in individual links.  This is great.. I've been wishing for this for a 
while.  This makes it possible to more carefully direct the spider.. ie 
follow some links on a page, but not all without having to write huge 
list of exclusion patterns.

We should probably implement this since it looks like it could become a 
defacto standard.

Thanks.

-- 
Neal Richter 
Knowledgebase Developer
RightNow Technologies, Inc.
Customer Service for Every Web Site
Office: 406-522-1485



-------------------------------------------------------
This SF.Net email is sponsored by: IntelliVIEW -- Interactive Reporting
Tool for open source databases. Create drag-&-drop reports. Save time
by over 75%! Publish reports on the web. Export to DOC, XLS, RTF, etc.
Download a FREE copy at http://www.intelliview.com/go/osdn_nl
_______________________________________________
ht://Dig Developer mailing list:
[email protected]
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-dev