[Tiki-devel] Reviewing and limiting crawling to pages we don't need people to see as search results

Hello,

I took on me to review t.o Google search results.
There is many case of pages that should be crawled and suggested as results.

One way is to log them on the Google console and it will be temporary.

The right way is to block robot from indexing such pages.
Also this is good for Tiki to learn from such results and improve the robot.txt we are releasing.


To do so I need one of those:
* A __safe and non time consuming__ method to be able to do it.
* A volunteer to review the links and block them (or not) from being crawled

Exemples for this month:
https://doc.tiki.org/tiki-slideshow.php?page=elFinder&pdf=1&landscape=1

Thank you for helping making things better !

Bernard