Re: [Distutils] Using code from a dependency in setup.py

2013-05-29 Thread George V. Reilly
Actually, Bread's setup is fine; it's not doing anything interesting. It's Jam's setup that's the problem. Robert's mention of `setup_requires` led me to http://stackoverflow.com/a/12061891/6364, which gave me the hint I needed: create a separate `Distribution` object before calling `setup` which

Re: [Distutils] Using code from a dependency in setup.py

2013-05-29 Thread zooko
Here is my explanation of why it can be problematic if you import Bread in Bread's setup.py: https://bugs.launchpad.net/nevow/+bug/812537/comments/3 If you do want to import dependencies of Bread in Bread's setup.py, and if your build tool (e.g. setuptools) supports it, then you could add the dep

Re: [Distutils] changelog / CDN inconsistency

2013-05-29 Thread Christian Theune
On 2013-05-28 16:31:02 +, Martin v. Löwis said: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Am 28.05.13 11:04, schrieb Christian Theune: So - what's the next step that can happen ASAP? In addition to the changes Donald already did, I think it would be wise to restart mirroring at min(l

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Daniel Holth
On Wed, May 29, 2013 at 3:33 PM, holger krekel wrote: > On Wed, May 29, 2013 at 15:15 -0400, Daniel Holth wrote: >> On Wed, May 29, 2013 at 2:36 PM, holger krekel wrote: >> > Hi Nick, >> > >> > On Mon, May 27, 2013 at 21:36 +1000, Nick Coghlan wrote: >> >> After preliminary reviews by Donald and

Re: [Distutils] Using code from a dependency in setup.py

2013-05-29 Thread Robert Collins
On 30 May 2013 07:33, George V. Reilly wrote: > Can this be done with Distutils / setuptools / Distribute? I believe that setup_requires can do what you want, in principle - AIUI that describes what modules are needed to run setup correctly : of course you have to bootstrap manually - but insta

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread holger krekel
On Wed, May 29, 2013 at 15:15 -0400, Daniel Holth wrote: > On Wed, May 29, 2013 at 2:36 PM, holger krekel wrote: > > Hi Nick, > > > > On Mon, May 27, 2013 at 21:36 +1000, Nick Coghlan wrote: > >> After preliminary reviews by Donald and Daniel, I have now pushed the > >> first complete draft of the

[Distutils] Using code from a dependency in setup.py

2013-05-29 Thread George V. Reilly
I have a little web framework, let's call it Bread, which is used to build applications like Jam, Marmalade, PeanutButter, and other toppings. Bread both *builds* and *serves* these applications. I'm trying to figure out how to make the applications' `setup.py`s work, given the following requireme

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Daniel Holth
On Wed, May 29, 2013 at 2:36 PM, holger krekel wrote: > Hi Nick, > > On Mon, May 27, 2013 at 21:36 +1000, Nick Coghlan wrote: >> After preliminary reviews by Donald and Daniel, I have now pushed the >> first complete draft of the JSON-based metadata 2.0 proposal to >> python.org >> >> PEP 426 (met

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread holger krekel
Hi Nick, On Mon, May 27, 2013 at 21:36 +1000, Nick Coghlan wrote: > After preliminary reviews by Donald and Daniel, I have now pushed the > first complete draft of the JSON-based metadata 2.0 proposal to > python.org > > PEP 426 (metadata 2.0): http://www.python.org/dev/peps/pep-0426/ After a fi

Re: [Distutils] Small Usability/UX Change to PyPI

2013-05-29 Thread Erik Bray
On Wed, May 29, 2013 at 9:28 AM, Donald Stufft wrote: > Just deployed a small update to PyPI that sets autofocus on the search > form. This'll mean that you don't need to manually move to the search > form upon page load and should be able to start typing immediately. That is so trivial yet so aw

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Donald Stufft
On Wed, May 29, 2013, at 11:48 AM, Nick Coghlan wrote: I only allowed build URLs at all because it seemed silly to force installation tools to come up with a distinct format for them. However, if allowing both appears to be too confusing, that's the half that will go away, leaving it up to the int

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Nick Coghlan
On 30 May 2013 01:47, "Daniel Holth" wrote: > > In 440, < 2.0 means < 2.0, != 2.0.* to avoid dev releases. Would it be > equivalent for < 2.0 to expand to the smallest possible release in the > 2.0 series 2.0.dev0? Yes, but that approach doesn't work to exclude post and maintenance releases in th

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Daniel Holth
In 440, < 2.0 means < 2.0, != 2.0.* to avoid dev releases. Would it be equivalent for < 2.0 to expand to the smallest possible release in the 2.0 series 2.0.dev0? ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listi

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Nick Coghlan
On 30 May 2013 01:23, "Donald Stufft" wrote: > > I feel like we are still conflating some names and use cases here with > source_label, source_url, source reference, and the is operator. > > source_label // source_url - References to the source that is associated > with this release. Must not poin

Re: [Distutils] [ANN] pypiserver 1.1.1 - minimal private pypi server

2013-05-29 Thread Chris Withers
On 29/05/2013 00:32, Ralf Schmitt wrote: I've just uploaded pypiserver 1.1.1 to the python package index. pypiserver is a minimal PyPI compatible server. It can be used to serve a set of packages and eggs to easy_install or pip. pypiserver is easy to install (i.e. just 'pip install pypiserver')

Re: [Distutils] Small Usability/UX Change to PyPI

2013-05-29 Thread Eric V. Smith
On 05/29/2013 09:28 AM, Donald Stufft wrote: > Just deployed a small update to PyPI that sets autofocus on the search > form. This'll mean that you don't need to manually move to the search > form upon page load and should be able to start typing immediately. Thank you, thank you, thank you! Eric

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Donald Stufft
I feel like we are still conflating some names and use cases here with source_label, source_url, source reference, and the is operator. source_label // source_url - References to the source that is associated with this release. Must not point to anything besides source (no whls, no other built or

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Nick Coghlan
On Thu, May 30, 2013 at 12:32 AM, Daniel Holth wrote: > On Wed, May 29, 2013 at 10:25 AM, Nick Coghlan wrote: >> On Thu, May 30, 2013 at 12:14 AM, Daniel Holth wrote: >>> Request the test extra to also install >>> >>> test_requires >>> test_may_require >>> " >>> >>> If test requirements are not

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Donald Stufft
I support using :test, or :test: or whatever to mark it as a "special" name. -- Donald Stufft don...@stufft.io ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Daniel Holth
On Wed, May 29, 2013 at 10:25 AM, Nick Coghlan wrote: > On Thu, May 30, 2013 at 12:14 AM, Daniel Holth wrote: >> Request the test extra to also install >> >> test_requires >> test_may_require >> " >> >> If test requirements are not actually extras then I would prefer >> having no special-cased ex

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Nick Coghlan
On Tue, May 28, 2013 at 12:44 AM, Ronald Oussoren wrote: > > On 27 May, 2013, at 13:36, Nick Coghlan wrote: > >> After preliminary reviews by Donald and Daniel, I have now pushed the >> first complete draft of the JSON-based metadata 2.0 proposal to >> python.org >> >> PEP 426 (metadata 2.0): htt

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Nick Coghlan
On Thu, May 30, 2013 at 12:14 AM, Daniel Holth wrote: > Request the test extra to also install > > test_requires > test_may_require > " > > If test requirements are not actually extras then I would prefer > having no special-cased extra names at all, or a special extra-like > syntax used for pip-i

Re: [Distutils] Draft PEP for JSON based metadata published

2013-05-29 Thread Daniel Holth
On Tue, May 28, 2013 at 11:12 PM, Nick Coghlan wrote: > A couple of significant upcoming changes: > > "build label" will be renamed as "source label" (since it refers to > the common unbuilt source rather than a specific build) > "version URL" will be renamed as "source URL" (same rationale) > > T

[Distutils] Small Usability/UX Change to PyPI

2013-05-29 Thread Donald Stufft
Just deployed a small update to PyPI that sets autofocus on the search form. This'll mean that you don't need to manually move to the search form upon page load and should be able to start typing immediately. -- Donald Stufft don...@stufft.io ___ Di

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Maurits van Rees
Op 29-05-13 15:01, Donald Stufft schreef: I believe this should be fixed now. I ensured Vary: Accept-Encoding was called even when responses were gzipped. I also purged the cache so bad entries should be gone. IF you have any more issues after this email please tell me. Looks fine here now. I

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Donald Stufft
I believe this should be fixed now. I ensured Vary: Accept-Encoding was called even when responses were gzipped. I also purged the cache so bad entries should be gone. IF you have any more issues after this email please tell me. -- Donald Stufft don...@stufft.io On Wed, May 29, 2013, at 08:

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Donald Stufft
I believe this should be fixed now. I ensured Vary: Accept-Encoding was called even when responses were gzipped. I also purged the cache so bad entries should be gone. IF you have any more issues after this email please tell me. -- Donald Stufft don...@stufft.io On Wed, May 29, 2013, at 08:

Re: [Distutils] PyPI CDN + Buildout

2013-05-29 Thread Donald Stufft
I believe this should be fixed now. I ensured Vary: Accept-Encoding was called even when responses were gzipped. I also purged the cache so bad entries should be gone. IF you have any more issues after this email please tell me. -- Donald Stufft don...@stufft.io _

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Marius Gedminas
On Wed, May 29, 2013 at 02:30:55PM +0200, Maurits van Rees wrote: > Op 29-05-13 14:16, Donald Stufft schreef: > >Can you get me outputs of curl with the -i flag of it both gzipped and > >not gzipped? I can't seem to reproduce it. > > When it works I get this: > > $ curl -i http://pypi.python.org/

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Donald Stufft
I'm in #buildout working on this. We might have sorted out what's going on. It appears we still aren't geting the Vary header sent if Accept-Encoding: gzip is sent. Only if Accept-Encoding: identity is sent. Trying to find my ssh key (ugh laptop I don't normally use) so I can get that header sent

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Maurits van Rees
Op 29-05-13 14:16, Donald Stufft schreef: Can you get me outputs of curl with the -i flag of it both gzipped and not gzipped? I can't seem to reproduce it. When it works I get this: $ curl -i http://pypi.python.org/simple/pep8/ HTTP/1.1 200 OK Server: nginx/1.1.19 Content-Type: text/html; char

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Maurits van Rees
Op 29-05-13 14:10, Donald Stufft schreef: Are you able to consistently reproduce this? Can you get me output with the -v flag to easy_install? E.g. easy_install -v 'zc.buildout<2dev'? Here's what I get: https://gist.github.com/dstufft/5669826 For zc.buildout it now works, but that may be luck.

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Donald Stufft
Can you get me outputs of curl with the -i flag of it both gzipped and not gzipped? I can't seem to reproduce it. -- Donald Stufft don...@stufft.io ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distu

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Donald Stufft
Are you able to consistently reproduce this? Can you get me output with the -v flag to easy_install? E.g. easy_install -v 'zc.buildout<2dev'? Here's what I get: https://gist.github.com/dstufft/5669826 -- Donald Stufft don...@stufft.io ___ Distutils

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Maurits van Rees
Op 29-05-13 11:43, Donald Stufft schreef: On May 29, 2013, at 5:39 AM, Donald Stufft wrote: The cache timeout is an hour unless modifications are made to the package which triggers a cache invalidation. I bet there is a missing Vary for the encoding. I'll check and get back to you. There was

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Maurits van Rees
Op 29-05-13 12:18, Maurits van Rees schreef: $ curl -O http://downloads.buildout.org/2/bootstrap.py $ python2.7 bootstrap.py No local packages or download links found for zc.buildout error: Could not find suitable distribution for Requirement.parse('zc.buildout') Traceback (most recent call last)

[Distutils] PyPI CDN + Buildout

2013-05-29 Thread Donald Stufft
There's been some issues with buildout and the new PyPI CDN. I'm going to see if I can sort this out. If anyone has buildout successfully working and sees this I'd love to know. To see if this is widespread or specific to a certain set of circumstances. -- Donald Stufft don...@stufft.io

[Distutils] Buildout (still) can't talk to PyPI

2013-05-29 Thread Wes Mason
We're getting a similar issue to: http://mail.python.org/pipermail/distutils-sig/2013-May/020927.html For every new build right now, I've recorded the output from "bin/buildout" (initially bootstrap.py would also fail until I added buildout.org to allowed-hosts, as it couldn't get the egg zc.b

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Maurits van Rees
Op 29-05-13 12:34, Donald Stufft schreef: On May 29, 2013, at 6:18 AM, Maurits van Rees wrote: 6. easy_install the same 1.7.1 again, now it fails: mauritsvanrees@procyon:foo (git:master?) $ bin/easy_install zc.buildout==1.7.1 Searching for zc.buildout==1.7.1 Reading http://pypi.python.org/sim

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Donald Stufft
On May 29, 2013, at 6:18 AM, Maurits van Rees wrote: > Op 29-05-13 11:47, Donald Stufft schreef: >> There was an issue with a missing Vary: Accept-Encoding and gzip pages >> getting cached and served even for non gzip enabled clients. I've fixed >> this and purged the cache. See if this fixes yo

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Maurits van Rees
Op 29-05-13 11:47, Donald Stufft schreef: There was an issue with a missing Vary: Accept-Encoding and gzip pages getting cached and served even for non gzip enabled clients. I've fixed this and purged the cache. See if this fixes your issue. I have problems on and off. I have created a virtual

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Donald Stufft
On May 29, 2013, at 5:31 AM, Donald Stufft wrote: > > On May 29, 2013, at 4:22 AM, Andreas Jung wrote: > >> Hi there, >> >> after switching to the new PyPI CDN infrastructure we have seen some >> odd behavior with buildout fetching two hundred packages or so. >> Packages that are a located o

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Donald Stufft
On May 29, 2013, at 5:39 AM, Donald Stufft wrote: > > On May 29, 2013, at 5:18 AM, Marius Gedminas wrote: > >> On Wed, May 29, 2013 at 11:03:39AM +0200, Lennart Regebro wrote: >>> On Wed, May 29, 2013 at 10:19 AM, Marius Gedminas wrote: Could it be that recent PyPI CDN changes broke zc.

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Donald Stufft
On May 29, 2013, at 5:18 AM, Marius Gedminas wrote: > On Wed, May 29, 2013 at 11:03:39AM +0200, Lennart Regebro wrote: >> On Wed, May 29, 2013 at 10:19 AM, Marius Gedminas wrote: >>> Could it be that recent PyPI CDN changes broke zc.buildout somehow? >>> Witness this: >>> >>> $ wget http://do

Re: [Distutils] PyPI CDN issues

2013-05-29 Thread Donald Stufft
On May 29, 2013, at 4:22 AM, Andreas Jung wrote: > Hi there, > > after switching to the new PyPI CDN infrastructure we have seen some > odd behavior with buildout fetching two hundred packages or so. > Packages that are a located on PyPI have not been available to the CDN > or only after some m

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Marius Gedminas
On Wed, May 29, 2013 at 11:03:39AM +0200, Lennart Regebro wrote: > On Wed, May 29, 2013 at 10:19 AM, Marius Gedminas wrote: > > Could it be that recent PyPI CDN changes broke zc.buildout somehow? > > Witness this: > > > > $ wget http://downloads.buildout.org/2/bootstrap.py > > > > $ cat buildo

Re: [Distutils] [ANN] pypiserver 1.1.1 - minimal private pypi server

2013-05-29 Thread Jonas Geiregat
On 29 May 2013, at 10:33, Ralf Schmitt wrote: > Jonas Geiregat writes: > >> Hello Ralf, >> >> I already started working on your code and using it a s a base for my >> pypiserver project. >> >> Thanks again, great piece of minimal work! > > Thanks! What features do you plan to implement? I

Re: [Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Lennart Regebro
On Wed, May 29, 2013 at 10:19 AM, Marius Gedminas wrote: > Could it be that recent PyPI CDN changes broke zc.buildout somehow? > Witness this: > > $ wget http://downloads.buildout.org/2/bootstrap.py > > $ cat buildout.cfg > [buildout] > parts = zodbbrowser > [zodbbrowser] > recipe = zc

Re: [Distutils] [ANN] pypiserver 1.1.1 - minimal private pypi server

2013-05-29 Thread Ralf Schmitt
Jonas Geiregat writes: > Hello Ralf, > > I already started working on your code and using it a s a base for my > pypiserver project. > > Thanks again, great piece of minimal work! Thanks! What features do you plan to implement? Maybe some of that functionality is already available in other im

[Distutils] PyPI CDN issues

2013-05-29 Thread Andreas Jung
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi there, after switching to the new PyPI CDN infrastructure we have seen some odd behavior with buildout fetching two hundred packages or so. Packages that are a located on PyPI have not been available to the CDN or only after some minutes. Note that

[Distutils] Buildout can't talk to PyPI any more?

2013-05-29 Thread Marius Gedminas
Could it be that recent PyPI CDN changes broke zc.buildout somehow? Witness this: $ wget http://downloads.buildout.org/2/bootstrap.py $ cat buildout.cfg [buildout] parts = zodbbrowser [zodbbrowser] recipe = zc.recipe.egg $ python bootstrap.py $ bin/buildout Error: Couldn't fin

Re: [Distutils] [ANN] pypiserver 1.1.1 - minimal private pypi server

2013-05-29 Thread Jonas Geiregat
Hello Ralf, I already started working on your code and using it a s a base for my pypiserver project. Thanks again, great piece of minimal work! Jonas. On 29 May 2013, at 01:32, Ralf Schmitt wrote: > Hi, > > I've just uploaded pypiserver 1.1.1 to the python package index. > > pypiserver is