about user agent headers is sudden site access failure: realclearpolitics.com
Karen Lewellen <[email protected]>
| Newsgroups | gmane.comp.web.lynx.devel |
|---|---|
| Message-ID | <[email protected]> |
Hi Rudy, everyone. Is the user agent header field saved when changed, if one chooses the write options to disc selection? I want to test Rudy's user agent on my office shell, and as that does not seem to be a cut / paste box, wanted to ask before I try and work on this. Thanks, Karen On Fri, 12 Nov 2021, Rudy Vener wrote: > Hi Ian, > > Okay, so I modified my lynx.cfg to use HTTP_PROTOCOL:1.1 and > to enable its setting in the lynxrc file. > Set my user agent to: > Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; XH; rv:8.578.498) fr, Gecko/20121021 Camino/8.723+ (Firefox compatible) > > and tried to access http://www.realclearpolitics.com once more. > > and get a landing page with this: > > Please enable JS and disable any ad blocker > > It looks like they just aren't going to allow any browsers that don't support javascript. > > Or am I missing something else? > >> On Thu, 11 Nov 2021, Ian Collier wrote: >> >> >> >>> I find it interesting that Lynx cannot verify the certificate of >>> 'realclearpolitics.com' (without the www) because the server is >>> not returning the certificate chain. But with the www is a completely >>> different server which does have a valid certificate. >>> >>> Anyway I have found that links (the chain) will display the web site >>> correctly by default, but gets denied if I supply any one (or more) >>> of the following options: >>> >>> -http-bugs.no-compression 1 >>> -http-bugs.http10 1 >>> -http.fake-user-agent Lynx >>> >>> So as far as Lynx (the cat) is concerned, what we need to do in order >>> to visit this site is (a) change the user agent, and (b) enable HTTP 1.1. >>> >>> Enable HTTP 1.1 can be done either in the Options screen or in lynx.cfg. >>> User agent can be done either in Options or on the command line. My >>> experimentation shows that they want at least your OS in the user agent, >>> so "Lynx (Linux 5)" works, while Lynx's default user agent does not >>> because it doesn't contain the OS name. >>> >>> imc >>> >>> >> >> -- >> ent- > > -- > Rudy Vener > Website: http://www.rudyvener.com > Twitter: https://twitter.com/RudySalt > >