RE: site-wide metadata discovery
"Chad Everett" <yahoogroups-ipyKpt5L2sG2CP6mJM4Q19i2O/[email protected]>
| Newsgroups | gmane.network.syndication.discuss |
|---|---|
| Message-ID | <350411BE3B7FF4488CA7797C9F1E90A69E014B@exchange.ibmi.informedbeverage.com> |
Don't know that I'd qualify to answer, but I'll give it a go. Site-Index: default Public-Feeds: myPublicFeeds.opml *** I added the "default" to the Site-Index field, since that draft info I posted seems to require a value on that field, rather than just the field name. It also seems to read a bit better. *** A value other than "default" may work better here, but I'm out of ideas for the moment. :) Add the example above to your robots.txt file. Now you just need to parse the file looking for the default Site-Index, then look through that recordset (until the next blank line) to find the value of Public-Feeds, and use that value as the file name. Then retrieve the file (myPublicFeeds.opml) in the current location (http://blogs.law.harvard.edu). Chad. -----Original Message----- From: Dave Winer [mailto:dave-rH/ioLL7x7RWk0Htik3J/[email protected]] Sent: Wednesday, October 15, 2003 6:12 PM To: [email protected] Subject: Re: [syndication] site-wide metadata discovery Cool. Thanks for the reference. Now let's set up a test case? 1. My OPML file is here.. http://blogs.law.harvard.edu/myPublicFeeds.opml 2. My robots.txt is here.. http://blogs.law.harvard.edu/robots.txt 3. How would I modify my robots.txt to point to my OPML file? Dave ----- Original Message ----- From: "Chad Everett" <yahoogroups-ipyKpt5L2sG2CP6mJM4Q19i2O/[email protected]> To: <[email protected]> Sent: Wednesday, October 15, 2003 5:52 PM Subject: RE: [syndication] site-wide metadata discovery > Hi Dave - > > Thanks for the vote of confidence. :) > > Here's where I found that text: > > http://www.robotstxt.org/wc/norobots.html > > Under "The Format", at the end of the sentence just prior to "User-agent". > > It actually says "Unrecognised headers are ignored". I took some small, > hopefully irrelevant, liberties with my interpretation. :) > > Chad. > > -----Original Message----- > From: Dave Winer [mailto:dave-rH/ioLL7x7RWk0Htik3J/[email protected]] > Sent: Wednesday, October 15, 2003 5:44 PM > To: [email protected] > Subject: Re: [syndication] site-wide metadata discovery > > > This is a very interesting idea. > > I just went for a quick look and couldn't find where it says "unrecognized > headers should be ignored." > > And then we'd have to know if it works in practice too, just because a spec > says robots should work some way doesn't mean they do. > > But kudos for coming up with a new angle. Worth exploring, imho. > > Dave > > > > > Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/ > > Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/ Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/