Re: site-wide metadata discovery

> As a fall back position, in the kind of cases Bill pointed out.

Well, let's be clear, Chad brainstormed this idea and Jeremy (the prime mover on
this idea in general) seems to like it.  As long as it steps back from inventing
yet-another-fixed-url I'm all for it.  My greatest concern is to not have RSS
waltz up to website administrators and start making reinvention demands or
sudden increases in scheduled or spidered requests for non-existant data.

> Nah, I think a little hook is elegant.

Indeed, if we /can/ use live lines in the robots.txt I'd think that would be
ideal.  If we have to sneak our way in through use of comments then we'd want to
be /really/ regexp-friendly in whatever we suggest.

> > Another thought would be to use comments in the robots.txt file.
> That's gentle!

Well, we haven't resolved the negative impacts of using robots.txt here.  I'd
still like to hear the strong arguments against the idea.  Better to get them
out now before everyone gets too invested in it.

-Bill Kearney


 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/