Re: 0repo failing on redirect to Amazon S3

Thomas Leonard <[email protected]> Wed, 9 Sep 2015 20:05:06 +0100
Newsgroups gmane.comp.file-systems.zero-install.devel
Message-ID <CAG4opy-dRNf=DxCyOy1afATeW_DJ=68=xYXUAUse_YCWib1woA@mail.gmail.com>
On 9 September 2015 at 19:42, Bastian Eicher <[email protected]> wrote:
> I'm using 0repo to maintain the feed http://0install.de/feeds/msysgit.xml
> (among others).
> Git for Windows (msysgit) recently switched binary hosting to Amazon S3
> fronted by a GitHub URL that uses an HTTP redirect.
>
> 0install itself (on Windows and Linux) handles this just fine but 0repo
> seems to be running in some trouble:
>
> Processing msysgit-2.5.1.xml
> Checking
> https://github.com/git-for-windows/git/releases/download/v2.5.1.windows.1/Po
> rtableGit-2.5.1-64-bit.7z.exe... Moved
> Checking new URL
> https://s3.amazonaws.com/github-cloud/releases/23216272/75956244-4fcc-11e5-9
> f11-abdcba6fa9d7.exe?response-content-disposition=attachment%3B%20filename%3
> DPortableGit-2.5.1-64-bit.7z.exe&response-content-type=application/octet-str
> eam&AWSAccessKeyId=AKIAISTNZFOVBIJMK3TQ&Expires=1441818644&Signature=v3X9izC
> C13wDTfvNIzroO8sYOPo%3D...ERROR
> HTTP error: got status code 403 for
> https://s3.amazonaws.com/github-cloud/releases/23216272/75956244-4fcc-11e5-9
> f11-abdcba6fa9d7.exe?response-content-disposition=attachment%3B%20filename%3
> DPortableGit-2.5.1-64-bit.7z.exe&response-content-type=application/octet-str
> eam&AWSAccessKeyId=AKIAISTNZFOVBIJMK3TQ&Expires=1441818644&Signature=v3X9izC
> C13wDTfvNIzroO8sYOPo%3D
>
> Any ideas why the two tools behave differently? Something to do with cookies
> or the user agent?

Most likely, it's doing a HEAD but only GET is authorised.

You can disable the check by using this in your 0repo-config.py:

def check_uploaded_archive(archive, url):
    pass

We should probably detect S3 endpoints and do a GET for them,
terminating the connection as soon as we have the size.


-- 
Dr Thomas Leonard        http://roscidus.com/blog/
GPG: DA98 25AE CAD0 8975 7CDA  BD8E 0713 3F96 CA74 D8BA

------------------------------------------------------------------------------
Monitor Your Dynamic Infrastructure at Any Scale With Datadog!
Get real-time metrics from all of your servers, apps and tools
in one place.
SourceForge users - Click here to start your Free Trial of Datadog now!
http://pubads.g.doubleclick.net/gampad/clk?id=241902991&iu=/4140