git: 5dfc794fcb - main - there are no cgi scripts running at docs.freebsd.org anymore
Wolfram Schneider <[email protected]>
| Newsgroups | gmane.os.freebsd.devel.cvs.doc |
|---|---|
| Message-ID | <[email protected]> |
The branch main has been updated by wosch: URL: https://cgit.FreeBSD.org/doc/commit/?id=5dfc794fcbbbcbc62f4dc1f3256fb6c27aeb4cb4 commit 5dfc794fcbbbcbc62f4dc1f3256fb6c27aeb4cb4 Author: Wolfram Schneider <[email protected]> AuthorDate: 2023-08-07 15:04:59 +0000 Commit: Wolfram Schneider <[email protected]> CommitDate: 2023-08-07 15:04:59 +0000 there are no cgi scripts running at docs.freebsd.org anymore --- documentation/themes/beastie/layouts/robots.txt | 15 +-------------- 1 file changed, 1 insertion(+), 14 deletions(-) diff --git a/documentation/themes/beastie/layouts/robots.txt b/documentation/themes/beastie/layouts/robots.txt index edd7c5252a..fd409b7c52 100644 --- a/documentation/themes/beastie/layouts/robots.txt +++ b/documentation/themes/beastie/layouts/robots.txt @@ -1,18 +1,5 @@ User-agent: * #Crawl-delay: 10 -Disallow: /cgi/confirm-code.cgi -Disallow: /cgi/cvsweb.cgi -Disallow: /cgi/dosendpr.cgi -Disallow: /cgi/getmsg.cgi -Disallow: /cgi/mailindex.cgi -Disallow: /cgi/man.cgi?apropos=2& -Disallow: /cgi/mid.cgi -Disallow: /cgi/mirror.cgi -Disallow: /cgi/missing_handler.cgi -Disallow: /cgi/ports.cgi -Disallow: /cgi/query-pr-summary.cgi -Disallow: /cgi/query-pr.cgi -Disallow: /cgi/search.cgi -Disallow: /cgi/url.cgi Disallow: /statistic Disallow: /doc/ +