Re: robots.txt, etc?

Ryan Barrett on 2007-01-25 16:01:50 -0800:

> On Thu, 25 Jan 2007, Alec Berryman wrote:
> 
> > Apache's mod_rewrite works very well for me.
> 
> agreed. i'd hate to offer that solution to pyblosxom users as a whole, though. 
> it requires that you 1) use apache and 2) have some mod_rewrite fu.
> (mod_rewrite may rock, but it's not the easiest thing to use. :/ )

I think that anyone who has a problem with PyBlosxom interpreting
robots.txt is already doing some sort of rewriting to have PyBlosxom
handle all calls to the top-level of the site.

It would certainly easier on the rewrite configuration if you could
shove everything to PyBlosxom and have it handle it, but I don't know if
configuring an additional plugin would be easier than adding an extra
mod_rewrite line.  Having that sort of flexibility wouldn't be bad,
though.

> out of curiosity, what do you do for GET /robots requests? do you use 
> mod_rewrite to handle them too?

I don't; I just have a "RewriteRule ^/robots.txt - [last]".  Looking
through my webserver logs, no one has recently asked for /robots.

-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV

_______________________________________________
pyblosxom-users mailing list
pyblosxom-users-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org
https://lists.sourceforge.net/lists/listinfo/pyblosxom-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFFuUrIAud/2YgchcQRAiPlAJwMlIeGwRZAVFtOYgLhyLjdeCZr4gCgkS7h
PDnWVfnC9vXGfoSyL/IdGQY=
=ybta
-----END PGP SIGNATURE-----