Re: Suggestion/Enhancement request: Please add to FAQ: list of User-agents for robots.txt files
"Andrew Avdeenko" <[email protected]> Sun, 02 Aug 2015 16:00:34 +0300
| Newsgroups | gmane.org.w3c.validator |
|---|---|
| Message-ID | <op.x2qrq8zm278snb@microsof-c0ae01> |
Is it possible to deny access to my website for W3C validators using robots.txt? If "yes", what user-agent(s) must be specified?