Re: Correctly dealing with bots and scrapers.
John Levine via NANOG <[email protected]>
| Newsgroups | gmane.org.operators.nanog |
|---|---|
| Organization | Taughannock Networks |
| Message-ID | <[email protected]> |
It appears that Andrew Kirch via NANOG <[email protected]> said: >Get a small version of a very old very fast very inaccurate LLM. Have it >generate a couple terabytes of endless nonsense. See https://www.web.sp.am/ Feel free to point stuff at it, it's a tiny overloaded VPS that has nothing better to do. You may think it's hopelessly lame, but see https://jl.ly/Internet/scrapeup.html Anthropic's bot has visited it over 48 million times since November. R's, John _______________________________________________ NANOG mailing list https://lists.nanog.org/archives/list/[email protected]/message/I3F2VVN2VMKQJMNK6BKLLEGEWSH5WLZF/