Re: V4 Pre-PEP: transition to release-file hosting on PYPI

--===============1003441256==
Content-Type: multipart/signed; boundary="Apple-Mail=_92D5F069-7F3B-42CD-AA57-185CCE7B3579"; protocol="application/pgp-signature"; micalg=pgp-sha1


--Apple-Mail=_92D5F069-7F3B-42CD-AA57-185CCE7B3579
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii


On Mar 18, 2013, at 3:02 PM, Richard Jones <[email protected]> wrote:

> Some suggested edits; I'm otherwise quite happy with the current =
draft.
>=20
> On 15 March 2013 02:29, holger krekel <[email protected]> wrote:
>> History and motivations for external hosting
>=20
> Could we please have a reference to the Package Index "API"* here?
>=20
>=20
>> Today, most packages released on PyPI host their release files on
>> PyPI, but a small percentage (XXX need updated data) rely on
>> external hosting.
>=20
> The above should probably be re-worded since "rely" is loaded and we
> don't necessarily know the motivation for projects using external
> links. The important numbers though are:
>=20
> projects with any external only links: 2581
> projects with only external only links: 1332
> total projects: 29117
>=20
> Whether the projects with links that also have hosted files (ie. the
> 1249 project difference between those numbers) *rely* on us retaining
> the external links facility is unknown.
>=20
>=20
>> Hosting modes
>> -------------
>>=20
>> The foundation of the first transition phase is the introduction of
>> three "modes" of PyPI hosting for a package, affecting which links =
are
>> generated for the ``simple/`` index.  These modes are implemented
>> without requiring changes to installation tools via changes to the
>> algorithm for generating the machine-readable ``simple/`` index.
>>=20
>> The modes are:
>>=20
>> - ``pypi-scrape-crawl``: no change from the current situation of
>>  generating machine-readable links for installation tools, as
>>  outlined in the history_.
>>=20
>> - ``pypi-scrape``: for a package in this mode, links to be added to
>>  the ``simple/`` index are still scraped from package
>>  metadata. However, the "Home-page" and "Download-url" links are
>>  given ``rel=3Dext-homepage`` and ``rel=3Dext-download`` attributes
>>  instead of ``rel=3Dhomepage`` and ``rel=3Ddownload``. The effect of =
this
>>  (with no change in installation tools necessary) is that these links
>>  will not be followed and scraped for further candidate links by =
present-day
>>  installation tools: only installable files directly hosted from PYPI =
or
>>  linked directly from PyPI metadata will be considered for =
installation.
>>  Installation tools MAY evolve to offer an option to use the new
>>  rel-attribution to crawl external pages but MUST NOT default to it.
>=20
> I'd just like to confirm that the rel=3D"download" / =
rel=3D"ext-download"
> switch will not affect the installability of distribution downloads
> linked directly by download_url.

As far as I know all existing tools ignore the rel attribute for =
purposes of finding direct links.

>=20
>=20
>> - ``pypi-explicit``: for a package in this mode, only links to =
release
>>  files uploaded to PyPI, and external links to release files
>>  explicitly nominated by the package owner (via a new interface
>>  exposed by PyPI) will be added to the ``simple/`` index.
>=20
> The bracketed bit there needs to be emphasised (ie. not just a
> bracketed afterthought) as it changes the current packaging user
> experience considerably for those who wish to remain externally
> hosting files.
>=20
>=20
>=20
>     Richard
>=20
> * =
http://peak.telecommunity.com/DevCenter/EasyInstall#package-index-api
> _______________________________________________
> Catalog-SIG mailing list
> [email protected]
> http://mail.python.org/mailman/listinfo/catalog-sig


-----------------
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 =
DCFA


--Apple-Mail=_92D5F069-7F3B-42CD-AA57-185CCE7B3579
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.19 (Darwin)

iQIcBAEBAgAGBQJRR2gDAAoJEG48vOkzctz6MkEP/0tZm4SM6hOCqL2gMyiz+2tC
INTdXxzAAlStuVILdNKQmNNwx0qGKR1rpdwVDxzPe7bBWIHapo1GkohjgXDSArFq
2jGR4k9cA3f2dWmfbfNA4+YOh08y44pQHlXVZbtsh3G9N9E9BKjEV8fdWA7qEwo+
1fvP5l3FNkmPHlgq6V8mnzgVfbPIYJ9wvQE1gU4o7w9vvYdGCBtg88ah2dZ5fS/F
ODf0ljoCtwLiAX8euwD8EhbVsCPlAFKk+9mmrw+0A7Y/aj6Zf0xLVUNcCMjfLCl3
ttV3O1RxLrogoJXfvEK+xR5VZFPctxpxNGWOGK9uMBLYOXv7HvZgPiTHW0eBryi3
k49viesAUu0u5uq/Aqibaydeh2BQfGY0EdllJeKsa//QpKhR2ZJSaezzpGYZCtoI
buIxvRszybVvUDamBYSD4yEieOZgI7ESKUsCNz434IyWDks7n/E+NTThrOk9EOW7
8fMKMq0tAvLU1KYKZTFklG+MPt3EHuE7rxYgXpktJbXdHDz6JtDfZILtFlGltJKl
ZisnsxijxOLmNjM3zgUDwPDEiKMomBDJeaQp9IUvp7X/+KJKPnrBZixt0Qc7COfb
zVZrx9WsXtoPWErU/Y/784zGQUrOYcZBk9YhVuu3yedf185M5a2d9p7+aDFV+f2r
97SjENeLx3pVRGITVnkA
=c6LK
-----END PGP SIGNATURE-----

--Apple-Mail=_92D5F069-7F3B-42CD-AA57-185CCE7B3579--

--===============1003441256==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Catalog-SIG mailing list
[email protected]
http://mail.python.org/mailman/listinfo/catalog-sig

--===============1003441256==--