Re: [Pound Mailing List] Blocking spambots
Mike Slinn <[email protected]> Tue, 1 Mar 2016 10:13:44 -0800
| Newsgroups | gmane.comp.web.pound.general |
|---|---|
| Message-ID | <[email protected]> |
robots.txt is only honored by the good guys. For bad guys, robots.txt provides a list of places that they know you don't want them to look at. Also, if pound blocks the bad guys, the web server won't have to handle those requests, which can present a significant load. -- To unsubscribe send an email with subject unsubscribe to [email protected] Please contact [email protected] for questions.