Re: site-wide metadata discovery

> Bill Kearney <[email protected]> wrote:
> >Site-Index:    http://somesite.example.com/feedindex.xml
> >http://purl.org/ocs/directory/0.5/
>
> I woke up thinking "put the pointer in robots.txt" and discovered
> someone had beaten me to it. Damn!

Once upon a time I heard this concept attributed to comedy.  Often it seems like
the same joke instantaneously comes to life in many different places all at
once.  Tech stuff's often the same way.

> Interestingly, robots.txt is valid if trivial YAML[1]. So I wonder what
> would happen if you added lines like
>
> Site-Index: default
>   href: http://somesite.example.com/feedindex.xml
>   type: http://purl.org/ocs/directory/0.5/
>   title: My Feed List
>
> I suspect that existing readers of robots.txt would treat this as one
> long line with continuation.

I've got an example setup at:
http://www.syndic8.com/robots-test.txt

I'm open to feedback on it.

-Bill Kearney
Syndic8.com


 

Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/