Re: Can find a line with curl

On Fri, Jan 19, 2024 at 11:42:42PM -0800, ToddAndMargo via curl-users wrote:
> With Firefox:
> 
> view-source:https://semiconductor.samsung.com/consumer-storage/support/tools/
> 
> I find this line.
> 
> 6219: <a href="https://semiconductor.samsung.com/resources/software-resources/Samsung_Data_Migration_Setup_4.0.0.18.exe"
> target="_blank" data-an-tr="hero banner" data-an-ca="outbound click"
> data-an-ac="download file" data-an-la="data migration software">
> 
> 
> But I can not find it with cURL:

Chances are, the site thinks you're running a robot and is providing a
different page to curl than Firefox. Try matching the Firefox headers exactly
and you might get something different. Or, it might be basing the difference on
the presence of cookies. Try enabling cookie support and go get a cookie from
another page first before downloading this one. You can use Firefox's "Copy as
cURL" feature to get a curl command-line with all the headers and cookies as
used by Firefox to test this theory fairly easily.

Dan
-- 
Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users
Etiquette:   https://curl.se/mail/etiquette.html