Re: Bot protection on RSS feed for git.netfilter.org
Slavko <[email protected]> Mon, 20 Jul 2026 20:13:45 +0200
| Newsgroups | gmane.comp.security.firewalls.netfilter.general |
|---|---|
| Message-ID | <[email protected]> |
Ahoj, Dňa Mon, 20 Jul 2026 17:51:05 +0000 [email protected] napísal: > I'm no RSS expert, but aren't feeds meant to be read by feed readers > (bots)? How could the feed work if it's behind bot protection? Is my > client expected to solve whatever challenge Anubis is posing? Does > that not defeat the purpose of the bot protection? curl works here: curl -i 'https://git.netfilter.org/iptables/atom/?h=master' Date: Mon, 20 Jul 2026 18:08:39 GMT Server: Apache Content-Type: text/xml; charset=utf-8 Expires: Mon, 20 Jul 2026 18:13:26 GMT Last-Modified: Mon, 20 Jul 2026 18:08:26 GMT Vary: Accept-Encoding Transfer-Encoding: chunked ... Are you sure, that you do not impersonate (fake) real browser? When i set Firefox's User-Agent header, i hit anubis: curl -iA "Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0" ... HTTP/1.1 200 OK Date: Mon, 20 Jul 2026 18:11:53 GMT Server: Apache Cache-Control: no-store Content-Type: text/html; charset=utf-8 Set-Cookie: techaro.lol-anubis-auth=; Path=/; Expires=Mon, 20 Jul 2026 18:10:53 GMT; Max-Age=0; Secure; SameSite=None Set-Cookie: techaro.lol-anubis-cookie-verification=019f80ba-316b-7dae-a172-50fdeecbc5ba; Path=/; Expires=Mon, 20 Jul 2026 18:41:53 GMT; Secure; SameSite=None Vary: Accept-Encoding Content-Length: 4469 regards -- Slavko https://www.slavino.sk