Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Nick Coghlan
A couple of significant upcoming changes: "build label" will be renamed as "source label" (since it refers to the common unbuilt source rather than a specific build) "version URL" will be renamed as "source URL" (same rationale) The current names are ambiguous as to whether they refer to the sour

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Nick Coghlan
On Tue, May 28, 2013 at 7:28 AM, Donald Stufft wrote: > On May 27, 2013, at 10:44 AM, Ronald Oussoren > wrote: > The versioning spec mentions that distribution tools may refuse to publish > distributions that pin the versions of dependencies. I understand why this > is needed, and agree in genera

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Nick Coghlan
On Wed, May 29, 2013 at 11:04 AM, Donald Stufft wrote: > > On May 28, 2013, at 9:00 PM, Nick Coghlan wrote: > > On Mon, May 27, 2013 at 9:36 PM, Nick Coghlan wrote: > > After preliminary reviews by Donald and Daniel, I have now pushed the > first complete draft of the JSON-based metadata 2.0 pro

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 9:00 PM, Nick Coghlan wrote: > On Mon, May 27, 2013 at 9:36 PM, Nick Coghlan wrote: >> After preliminary reviews by Donald and Daniel, I have now pushed the >> first complete draft of the JSON-based metadata 2.0 proposal to >> python.org >> >> PEP 426 (metadata 2.0): http:/

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Nick Coghlan
On Mon, May 27, 2013 at 9:36 PM, Nick Coghlan wrote: > After preliminary reviews by Donald and Daniel, I have now pushed the > first complete draft of the JSON-based metadata 2.0 proposal to > python.org > > PEP 426 (metadata 2.0): http://www.python.org/dev/peps/pep-0426/ > PEP 440 (versioning): h

[Distutils] [ANN] pypiserver 1.1.1 - minimal private pypi server

2013-05-28 Thread Ralf Schmitt
Hi, I've just uploaded pypiserver 1.1.1 to the python package index. pypiserver is a minimal PyPI compatible server. It can be used to serve a set of packages and eggs to easy_install or pip. pypiserver is easy to install (i.e. just 'pip install pypiserver'). It doesn't have any external depende

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Daniel Holth
On Tue, May 28, 2013 at 2:07 PM, Erik Bray wrote: > On Mon, May 27, 2013 at 7:36 AM, Nick Coghlan wrote: >> After preliminary reviews by Donald and Daniel, I have now pushed the >> first complete draft of the JSON-based metadata 2.0 proposal to >> python.org >> >> PEP 426 (metadata 2.0): http://w

Re: [Distutils] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 2:21 PM, Erik Bray wrote: > On Mon, May 27, 2013 at 1:19 AM, Lennart Regebro wrote: >> On Sun, May 26, 2013 at 7:34 PM, Noah Kantrowitz wrote: >>> >>> >>> but seriously, at long last today it was my honor to throw the DNS switch >>> to move PyPI to the Fastly caching CDN

Re: [Distutils] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Erik Bray
On Mon, May 27, 2013 at 1:19 AM, Lennart Regebro wrote: > On Sun, May 26, 2013 at 7:34 PM, Noah Kantrowitz wrote: >> >> >> but seriously, at long last today it was my honor to throw the DNS switch to >> move PyPI to the Fastly caching CDN. I would like to thank Donald Stufft for >> doing much

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-28 Thread Erik Bray
On Mon, May 27, 2013 at 7:36 AM, Nick Coghlan wrote: > After preliminary reviews by Donald and Daniel, I have now pushed the > first complete draft of the JSON-based metadata 2.0 proposal to > python.org > > PEP 426 (metadata 2.0): http://www.python.org/dev/peps/pep-0426/ > PEP 440 (versioning): h

Re: [Distutils] changelog / CDN inconsistency

2013-05-28 Thread Martin v. Löwis
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 28.05.13 11:04, schrieb Christian Theune: > So - what's the next step that can happen ASAP? In addition to the changes Donald already did, I think it would be wise to restart mirroring at min(last_serial, last_mirroring - 1 minute). This will caus

Re: [Distutils] pypi protocol

2013-05-28 Thread Martin v. Löwis
Am 26.05.13 22:08, schrieb Jonas Geiregat: > I ended up reading pypiserver's source code to find out the internals. Notice that this is the wrong source code. The real PyPI source code is in https://bitbucket.org/pypa/pypi/src Regards, Martin ___ Dist

Re: [Distutils] [Infrastructure] changelog / CDN inconsistency

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 12:00 PM, "Martin v. Löwis" wrote: > Am 28.05.13 16:23, schrieb Donald Stufft: >> Option 4: We add the expected hash of the simple page to the change log. >> Mirror clients can then assert their state consistent. > > That would work. It would also cover the case where a new

Re: [Distutils] [Infrastructure] changelog / CDN inconsistency

2013-05-28 Thread Martin v. Löwis
Am 28.05.13 16:23, schrieb Donald Stufft: > Option 4: We add the expected hash of the simple page to the change log. > Mirror clients can then assert their state consistent. That would work. It would also cover the case where a new release happens while the mirroring is in progress. On the other

Re: [Distutils] [Infrastructure] changelog / CDN inconsistency

2013-05-28 Thread Martin v. Löwis
Am 28.05.13 16:39, schrieb Donald Stufft: > On May 28, 2013, at 10:36 AM, holger krekel wrote: >> yes, i also thought of option 4. Is that easy to implement on the side of >> pypi? >> If we checksum the simple-page, we need idem-potent generation of simple >> pages >> and ordering to begin with

Re: [Distutils] [Infrastructure] changelog / CDN inconsistency

2013-05-28 Thread Martin v. Löwis
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > Mirroring is in a bad state because it comes (and has always) with > absolutely no guarantees of consistency. That is not true. There are no absolute guarantees, but certainly partial guarantees of consistency. It's a kind of "eventual consistency"

Re: [Distutils] [Infrastructure] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Martin v. Löwis
Am 28.05.13 14:48, schrieb M.-A. Lemburg: > We've had the CDN discussion for quite a while and I even setup > a test CDN some months ago. No one ever mentioned the HTTP/1.0 > problem and so it simply wasn't on the radar. On the other hand, the other problems *where* mentioned with respect to CDNs

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 10:36 AM, holger krekel wrote: > On Tue, May 28, 2013 at 10:23 -0400, Donald Stufft wrote: >> On May 28, 2013, at 8:20 AM, Donald Stufft wrote: >> >>> >>> On May 28, 2013, at 5:04 AM, Christian Theune wrote: >>> Hi, On 27. May2013, at 10:41 PM, Donal

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 10:36 AM, holger krekel wrote: > On Tue, May 28, 2013 at 10:23 -0400, Donald Stufft wrote: >> On May 28, 2013, at 8:20 AM, Donald Stufft wrote: >> >>> >>> On May 28, 2013, at 5:04 AM, Christian Theune wrote: >>> Hi, On 27. May2013, at 10:41 PM, Dona

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread holger krekel
On Tue, May 28, 2013 at 10:23 -0400, Donald Stufft wrote: > On May 28, 2013, at 8:20 AM, Donald Stufft wrote: > > > > > On May 28, 2013, at 5:04 AM, Christian Theune wrote: > > > >> Hi, > >> > >> > >> On 27. May2013, at 10:41 PM, Donald Stufft wrote: > >>> Just to assure folks. I do conside

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 8:20 AM, Donald Stufft wrote: > > On May 28, 2013, at 5:04 AM, Christian Theune wrote: > >> Hi, >> >> >> On 27. May2013, at 10:41 PM, Donald Stufft wrote: >>> Just to assure folks. I do consider Mirroring a first class citizen and an >>> important feature. >> >> Thanks

Re: [Distutils] [Infrastructure] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread M.-A. Lemburg
On 28.05.2013 14:26, Nick Coghlan wrote: > On Tue, May 28, 2013 at 10:07 PM, Donald Stufft wrote: >> Moving to a CDN has been discussed before on either catalog-sig or >> distutils-sig (Can't recall which offhand). >> >> Weekly status updates were posted to the infrastructure list as well as the >

Re: [Distutils] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 8:26 AM, Nick Coghlan wrote: > On Tue, May 28, 2013 at 10:07 PM, Donald Stufft wrote: >> Moving to a CDN has been discussed before on either catalog-sig or >> distutils-sig (Can't recall which offhand). >> >> Weekly status updates were posted to the infrastructure list as we

Re: [Distutils] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Nick Coghlan
On Tue, May 28, 2013 at 10:07 PM, Donald Stufft wrote: > Moving to a CDN has been discussed before on either catalog-sig or > distutils-sig (Can't recall which offhand). > > Weekly status updates were posted to the infrastructure list as well as the > communication between us and Fastly as we iron

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 5:04 AM, Christian Theune wrote: > Hi, > > > On 27. May2013, at 10:41 PM, Donald Stufft wrote: >> Just to assure folks. I do consider Mirroring a first class citizen and an >> important feature. > > Thanks for that acknowledgement. Lets sort out what to do now - this is

Re: [Distutils] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 2:57 AM, holger krekel wrote: > On Tue, May 28, 2013 at 07:42 +0100, Paul Moore wrote: >> On 28 May 2013 02:53, Donald Stufft wrote: >> >>> Figured it out. >>> >>> Use HTTPS. >>> >> >> Can I suggest that if the new CDN means that there are additional >> restrictions on w

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread Christian Theune
Hi, On 27. May2013, at 10:41 PM, Donald Stufft wrote: > Just to assure folks. I do consider Mirroring a first class citizen and an > important feature. Thanks for that acknowledgement. Lets sort out what to do now - this is becoming urgent for me as the author of the currently recommended mir

Re: [Distutils] PyPI Download Counts

2013-05-28 Thread Domen Kožar
I'll also be at EP and can help to explain how Nix could solve the isolation problem. On Mon, May 27, 2013 at 5:46 PM, holger krekel wrote: > Hi Florian, > > On Mon, May 27, 2013 at 10:36 +0200, Florian Friesdorf wrote: > > Hi Holger, > > > > holger krekel writes: > > > On Mon, May 27, 2013 at

Re: [Distutils] Good news everyone, PyPI is behind a CDN

2013-05-28 Thread Donald Stufft
On May 28, 2013, at 2:42 AM, Paul Moore wrote: > On 28 May 2013 02:53, Donald Stufft wrote: > Figured it out. > > Use HTTPS. > > Can I suggest that if the new CDN means that there are additional > restrictions on what is supported (I've used the XMLRPC API without https in > one-off scripts

Re: [Distutils] changelog / CDN inconsistency (was: Re: Good news everyone, PyPI is behind a CDN)

2013-05-28 Thread holger krekel
On Tue, May 28, 2013 at 11:04 +0200, Christian Theune wrote: > On 27. May2013, at 10:41 PM, Donald Stufft wrote: > > Just to assure folks. I do consider Mirroring a first class citizen and an > > important feature. > > Thanks for that acknowledgement. Lets sort out what to do now - this is > be