Re: site-wide metadata discovery

Cool. Thanks for the reference.

Now let's set up a test case?

1. My OPML file is here..

http://blogs.law.harvard.edu/myPublicFeeds.opml

2. My robots.txt is here..

http://blogs.law.harvard.edu/robots.txt

3. How would I modify my robots.txt to point to my OPML file?

Dave





----- Original Message -----
From: "Chad Everett" <yahoogroups-ipyKpt5L2sG2CP6mJM4Q19i2O/[email protected]>
To: <[email protected]>
Sent: Wednesday, October 15, 2003 5:52 PM
Subject: RE: [syndication] site-wide metadata discovery


> Hi Dave -
>
> Thanks for the vote of confidence.  :)
>
> Here's where I found that text:
>
> http://www.robotstxt.org/wc/norobots.html
>
> Under "The Format", at the end of the sentence just prior to "User-agent".
>
> It actually says "Unrecognised headers are ignored".  I took some small,
> hopefully irrelevant, liberties with my interpretation.  :)
>
> Chad.
>
> -----Original Message-----
> From: Dave Winer [mailto:dave-rH/ioLL7x7RWk0Htik3J/[email protected]]
> Sent: Wednesday, October 15, 2003 5:44 PM
> To: [email protected]
> Subject: Re: [syndication] site-wide metadata discovery
>
>
> This is a very interesting idea.
>
> I just went for a quick look and couldn't find where it says "unrecognized
> headers should be ignored."
>
> And then we'd have to know if it works in practice too, just because a
spec
> says robots should work some way doesn't mean they do.
>
> But kudos for coming up with a new angle. Worth exploring, imho.
>
> Dave
>
>
>
>
> Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
>
>


 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/