RE: site-wide metadata discovery

Hi Dave -

Thanks for the vote of confidence.  :)

Here's where I found that text:

http://www.robotstxt.org/wc/norobots.html

Under "The Format", at the end of the sentence just prior to "User-agent".

It actually says "Unrecognised headers are ignored".  I took some small,
hopefully irrelevant, liberties with my interpretation.  :)

Chad.

-----Original Message-----
From: Dave Winer [mailto:dave-rH/ioLL7x7RWk0Htik3J/[email protected]] 
Sent: Wednesday, October 15, 2003 5:44 PM
To: [email protected]
Subject: Re: [syndication] site-wide metadata discovery


This is a very interesting idea.

I just went for a quick look and couldn't find where it says "unrecognized
headers should be ignored."

And then we'd have to know if it works in practice too, just because a spec
says robots should work some way doesn't mean they do.

But kudos for coming up with a new angle. Worth exploring, imho.

Dave


 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/