Wget fails to download some URLs from www.investing.com
Chris Smith via Primary discussion list for GNU Wget <[email protected]> Wed, 14 Feb 2024 10:21:19 +0000
| Newsgroups | gmane.comp.web.wget.general |
|---|---|
| Message-ID | <[email protected]> |
Hi guys,
This is not so much a bug as requests being blocked by the cloudflare server.
Checkout:
https://www.investing.com/crypto/bitcoin/btc-usd-historical-data
The URL works in Firefox, but fails to download using cURL or Wget.
I have tried various user-agent strings, so that is not the problem.
The following URL works for Firefox, cURL and Wget:
https://www.investing.com/equities/lloyds-banking-grp-historical-data
Kind regards,
Chris Smith <[email protected]>
_________________________________________________________________
________________________________________________________
Your E-Mail. Your Cloud. Your Office. eclipso Mail Europe. https://www.eclipso.de