Re: pypi.org change which may affect currency checks

"Bruce Dubbs" ([email protected] via blfs-dev Mailing List) <[email protected]>
Newsgroups gmane.linux.lfs.beyond.devel
Message-ID <[email protected]>
On 12/7/24 13:58, Joe Locash ([email protected] via blfs-dev Mailing List) wrote:
> I noticed the other day that my python module version checks were failing. It appears 
> that pypi.org now uses javascript to verify the browser.  This causes my curl 
> requests to fail. I see that the BLFS currency check scripts use php and I suspect 
> they may also suffer from this.
> 
> As a work around I now check for the latest release of a package from
>    https://pypi.org/rss/project/<project_name>/releases.xml
> which doesn't suffer from the problem.
> 
> Found in https://docs.pypi.org/api/feeds/

Generally I wait for a few days after a currency problem to see if upstream fixes 
itself.

In the currency checks I use a variety of methods to get pages: links -dump, wget,
curl -L -s -m40 -A Firefox/41.0, etc.  Most of the time it's just wget.  The biggest 
problem is those sites that use a lot of javascript.

   -- Bruce

-- 
http://lists.linuxfromscratch.org/sympa/info/blfs-dev
Unsubscribe: See the above information page
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.