git: a0f41809ca - main - Improve SEO of the Documentation Portal
Sergio Carlavilla Delgado <[email protected]>
| Newsgroups | gmane.os.freebsd.devel.cvs.doc |
|---|---|
| Message-ID | <[email protected]> |
The branch main has been updated by carlavilla: URL: https://cgit.FreeBSD.org/doc/commit/?id=a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2 commit a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2 Author: Sergio Carlavilla Delgado <[email protected]> AuthorDate: 2022-12-10 11:10:07 +0000 Commit: Sergio Carlavilla Delgado <[email protected]> CommitDate: 2022-12-10 11:11:01 +0000 Improve SEO of the Documentation Portal * Remove SVN tag * Stop indexing the archive --- documentation/themes/beastie/layouts/robots.txt | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/documentation/themes/beastie/layouts/robots.txt b/documentation/themes/beastie/layouts/robots.txt index b94bcd43cf..d5ac9c0dbd 100644 --- a/documentation/themes/beastie/layouts/robots.txt +++ b/documentation/themes/beastie/layouts/robots.txt @@ -1,5 +1,3 @@ -# $FreeBSD$ - User-agent: * #Crawl-delay: 10 Disallow: /cgi/confirm-code.cgi @@ -17,3 +15,5 @@ Disallow: /cgi/query-pr.cgi Disallow: /cgi/search.cgi Disallow: /cgi/url.cgi Disallow: /statistic +Disallow: /statistic +Disallow: /doc