Re: Google's Robots.txt Parser is Now Open Source

Lawrence D'Oliveiro <[email protected]>
Newsgroups gmane.org.user-groups.linux.waikato
Organization Geek Central
Message-ID <[email protected]>
On Tue, 2 Jul 2019 12:50:05 +1200, Peter Reutemann quoted:

> '... like when their text editor included BOM characters in their
> robots.txt files.'

Gee, I wonder which “editor” did that ...
_______________________________________________
wlug mailing list | [email protected]
Unsubscribe: https://list.waikato.ac.nz/mailman/listinfo/wlug
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.