Re: site-wide metadata discovery

On Thu, Oct 16, 2003 at 01:40:41PM -0400, Chad Everett wrote:
> 
> Another thought would be to use comments in the robots.txt file.  Something
> akin to embedding javascript in HTML comments.  Comments are widely accepted
> in robots.txt and shouldn't cause any harm.  Something like:
> 
> #Public-Feeds: myPublicFeeds.opml
> #Format: http://www.opml.org/spec
> #Title: Public Feed List
> 
> #Public-Feeds: feedindex.xml
> #Format: http://purl.org/ocs/directory/0.5/
> #Title: Public Feed List
> 
> #Subscriptions: mySubscriptions.opml
> #Format: http://www.opml.org/spec
> #Title: My Subscriptions

Indeed.

http://www.robotstxt.org/wc/norobots.html says:

  Comments can be included in file using UNIX bourne shell
  conventions: the '#' character is used to indicate that preceding
  space (if any) and the remainder of the line up to the line
  termination is discarded. Lines containing only a comment are
  discarded completely, and therefore do not indicate a record
  boundary.

This sounds like the best suggestion so far.

Jeremy
-- 
Jeremy D. Zawodny     |  Perl, Web, MySQL, Linux Magazine, Yahoo!
<Jeremy-LaWf/[email protected]>  |  http://jeremy.zawodny.com/

 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/