Re: Compromise time....
Jeremy Zawodny <[email protected]>
| Newsgroups | gmane.network.syndication.discuss |
|---|---|
| Message-ID | <20031118032025.GA2201@thermal> |
On Sun, Nov 16, 2003 at 01:37:39PM -0500, Ian Graham wrote: > > So, back from holidays. I spend some time digging around trying to > find a good summary of historical proposals for robots.txt, but > didn't find anything. [snip] > Basic conclusion: robots.txt not worth changing, all other issues are > really about providing metadata about site contents, and this doesn't > belong in robots.txt (but no one figured out where it should go...) Thanks for the digging. It's really quite a mess, isn't it? :-( Jeremy -- Jeremy D. Zawodny | Perl, Web, MySQL, Linux Magazine, Yahoo! <Jeremy-LaWf/[email protected]> | http://jeremy.zawodny.com/ Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/