Re: Google's Robots.txt Parser is Now Open Source
Lawrence D'Oliveiro <[email protected]>
| Newsgroups | gmane.org.user-groups.linux.waikato |
|---|---|
| Organization | Geek Central |
| Message-ID | <[email protected]> |
On Tue, 2 Jul 2019 12:50:05 +1200, Peter Reutemann quoted: > '... like when their text editor included BOM characters in their > robots.txt files.' Gee, I wonder which “editor” did that ... _______________________________________________ wlug mailing list | [email protected] Unsubscribe: https://list.waikato.ac.nz/mailman/listinfo/wlug