Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Alex Clark
anatoly techtonik techtonik at gmail.com writes:
 
 
 I'd say that not getting access to download stats from the start is a fail
on the side of PSF or whoever involved in coordination with Fastly. There
are many CDN providers out there and I suspect so far only Fastly was
contacted. The primary responsibility of that coordinator is correctly
sending the message for CDN provider that PyPI is a public exhibition of
their service quality, and not a tax exemption for charity. I'd say Fastly
should be interested to help with making us download stats exposed in a
convenient API friendly way, because real-time stats is the key feature of
their marketing advantage as I see it.
 
 
 Infrastructure will be setting up a secure method for receiving these logs
at which point PyPI can use them.
 
 
 
 Is it done already? I am free to some degree to help with that. What is
the current problem to tackle on?


+1 


small_rantBut: this happens all the time in open source communities, even
mature ones. Someone volunteers to perform some complex task and
hand-waves-away some requirement they don't personally feel is important
under the too hard or I don't have time for that, I'm doing this umbrella.

Someone else comes along and says wait, what happened to XXX? at which
point others join in to emphasize the importance of XXX. At this point, it's
more clear whether or not XXX is actually important. But during this time:
XXX is broken and many people on both sides are unhappy.

GOLDEN RULE: That's why even in open source, the golden rule of OPS is
still important: PLEASE DO NOT BREAK SHIT. Even if you are fixing other more
important functionality and don't think XXX is important. Or if XXX and the
thing you want to do cannot co-exist, then make sure you get extensive
buy-in from a large percentage of folks before you consider removing XXX. If
for no other reason, then you will most certainly draw unwanted attention to
yourself (which is especially frustrating in the context of trying to do
good things).
/small_rant

Anyway, I've seen this so many times I don't even get angry anymore. Because
I know everyone involved has nothing but the best intentions. In this case,
I'd like to see the download count functionality restored. (I spent a full
year building a website whose almost-sole-functionality relies on download
counts existing and working properly.) So, please call me when they are
back.:-) And if I can help in anyway to make that happen, please let me know.


Alex





 
 
 
 
 
 
 ___
 Distutils-SIG maillist  -  Distutils-SIG at python.org
 http://mail.python.org/mailman/listinfo/distutils-sig
 


---

Alex Clark · http://about.me/alex.clark



___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] PyPI Download Counts

2013-06-09 Thread holger krekel
On Sun, Jun 09, 2013 at 01:57 +0300, anatoly techtonik wrote:
 On Thu, May 30, 2013 at 6:56 PM, Donald Stufft don...@stufft.io wrote:
 
 
  On May 30, 2013, at 8:05 AM, Jim Fulton j...@zope.com wrote:
 
  On Mon, May 27, 2013 at 3:27 AM, holger krekel hol...@merlinux.eu wrote:
 
  Hi Donald,
 
  On Sun, May 26, 2013 at 20:08 -0400, Donald Stufft wrote:
 
  Hello!
 
  As you have have noticed the download counts on PyPI are no longer
  updating. Originally this was due to an issue with the script that
  processes these download counts. However I have now removed the download
  counts from the PyPI webui and their use via the API is considered
  deprecated.
 
  There are numerous reasons for their removal/deprecation some of which are:
 - Technically hard to make work with the new CDN
 - The CDN is being donated to the PSF, and the donated tier does
  not offer any form of log access
 
 
  What would be involved money/effort wise to get such access?
 
 
  I didn't see an answer to this.
 
  Any idea how much this would cost?  With access to logs, we could
  compute download counts.
 
  Jim
 
  --
  Jim Fulton
  http://www.linkedin.com/in/jimfulton
 
 
  Fastly has given us access to their streaming log support.
 
 
 That's another deal. This is just what is expected in exchange for the
 Real-time CDN by Fastly phrase at the bottom of the page to make it
 reflect the reality.
 
 I'd say that not getting access to download stats from the start is a fail
 on the side of PSF or whoever involved in coordination with Fastly. 

I also was surprised when download counts were gone but download stats
aren't very reliable indicators, anyway.  To begin with, one might configure
a CI system to cache pypi packages, another might re-download all the time.
Some popular packages are rather used from system distros, others downloaded
from pypi.  And there are many more issues.  Seems like there are not 
overwhelmingly many people unhappy about its removal.  Doesn't mean
they shouldn't be reinstanted, just saying.

 There
 are many CDN providers out there and I suspect so far only Fastly was
 contacted. The primary responsibility of that coordinator is correctly
 sending the message for CDN provider that PyPI is a public exhibition of
 their service quality, and not a tax exemption for charity. I'd say Fastly
 should be interested to help with making us download stats exposed in a
 convenient API friendly way, because real-time stats is the key feature of
 their marketing advantage as I see it.

FYI Fastly has been responding swiftly and responsibly so far, as far as
i could follow it.  And Donald has been helping people on various fronts
(not only Fastly related) and been the main driver of the CDN move,
thankfully.  Things are starting to work more smoothly now and i guess
some bumps in the road were unavoidable because they only show up in
real life.

cheers,
holger


 Infrastructure will be setting up a secure method for receiving these logs
  at which point PyPI can use them.
 
 
 Is it done already? I am free to some degree to help with that. What is the
 current problem to tackle on?

 ___
 Distutils-SIG maillist  -  Distutils-SIG@python.org
 http://mail.python.org/mailman/listinfo/distutils-sig

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


[Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Jason R. Coombs
On behalf of the PYPA, I'm excited to announce that Setuptools 0.7 is now
official and complete.

 

Released to PyPI, Setuptools 0.7.2 is now available for all to see by
default (https://pypi.python.org/pypi/setuptools/). Users of Setuptools 0.6
may upgrade by simply running `easy_install -U setuptools`.

 

Additionally, I released Distribute 0.7 to PyPI. This means that users who
have Distribute 0.6.x can upgrade to setuptools 0.7 by simply invoking
`easy_install -U distribute` (or `easy_install distribute=0.7`). Windows
users should use `easy_install-script -U distribute` (to avoid file in use
errors on easy_install.exe).

 

The documentation for Setuptools 0.7.2 has been uploaded to
https://pythonhosted.org/setuptools and includes the notes about the merge
in addition to the official documentation.

 

Please report any issues at the project page
(https://bitbucket.org/pypa/setuptools). 

 



smime.p7s
Description: S/MIME cryptographic signature
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Nick Coghlan
Yay, great news!

/me adds updating the packaging essay (both copies) to his TODO list :)

Cheers,
Nick.
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 06/09/2013 12:22 PM, Jason R. Coombs wrote:
 On behalf of the PYPA, I'm excited to announce that Setuptools 0.7 is
 now official and complete.
 
 Released to PyPI, Setuptools 0.7.2 is now available for all to see by 
 default (https://pypi.python.org/pypi/setuptools/). Users of
 Setuptools 0.6 may upgrade by simply running `easy_install -U
 setuptools`.
 
 Additionally, I released Distribute 0.7 to PyPI. This means that users
 who have Distribute 0.6.x can upgrade to setuptools 0.7 by simply
 invoking `easy_install -U distribute` (or `easy_install
 distribute=0.7`). Windows users should use `easy_install-script -U
 distribute` (to avoid file in use errors on easy_install.exe).
 
 The documentation for Setuptools 0.7.2 has been uploaded to 
 https://pythonhosted.org/setuptools and includes the notes about the
 merge in addition to the official documentation.
 
 Please report any issues at the project page 
 (https://bitbucket.org/pypa/setuptools).


Thanks for all the work that went into this release.  I'm working to get
buildout 2.0 to use the new setuptools, and need to encode a more-or-less
permalink URL for 'ez_setup.py' -- do we not have a better URL for it
than the Bitbucket 'raw' source?



Tres.
- -- 
===
Tres Seaver  +1 540-429-0999  tsea...@palladion.com
Palladion Software   Excellence by Designhttp://palladion.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iEYEARECAAYFAlG0t74ACgkQ+gerLs4ltQ6Q5wCg2hMoLBxfv6NIR/DTOUjdBNei
kVUAnjZ9ua2gRpwXyeRw/i1CIBPeV9e0
=Ksc7
-END PGP SIGNATURE-

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


[Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Liam Kirsher
Hi --
I'm hoping for some help with an error I'm suddenly getting with
distribute, setuptools.
It had been working fine, and seemingly overnight it stopped working.  I
really don't think I changed anything.
This is part of a chef recipe, which also installs virtualenv.
It appears that a new version 0.7.2 is downloaded, but it fails to
install, and then the rollback fails, as well.

Not sure quite what is wrong here and how to fix it!

Liam

 Using version 0.7.2 (newest of versions: 0.7.2, 0.7.2, 0.7.1, 0.7)
   Downloading from URL
 https://pypi.python.org/packages/source/s/setuptools/setuptools-0.7.2.tar.gz#md5=de44cd90f8a1c713d6c2bff67bbca65d
 (from https://pypi.python.org/simple/setuptools/)
   Running setup.py egg_info for package setuptools

 running egg_info
 creating pip-egg-info/setuptools.egg-info
 writing requirements to pip-egg-info/setuptools.egg-info/requires.txt
 writing pip-egg-info/setuptools.egg-info/PKG-INFO
 writing top-level names to
 pip-egg-info/setuptools.egg-info/top_level.txt
 writing dependency_links to
 pip-egg-info/setuptools.egg-info/dependency_links.txt
 writing entry points to
 pip-egg-info/setuptools.egg-info/entry_points.txt
 writing requirements to pip-egg-info/setuptools.egg-info/requires.txt
 writing pip-egg-info/setuptools.egg-info/PKG-INFO
 writing top-level names to
 pip-egg-info/setuptools.egg-info/top_level.txt
 writing dependency_links to
 pip-egg-info/setuptools.egg-info/dependency_links.txt
 writing entry points to
 pip-egg-info/setuptools.egg-info/entry_points.txt
 writing manifest file 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
 warning: manifest_maker: standard file '-c' not found
 

 reading manifest file 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
 reading manifest template 'MANIFEST.in'
 writing manifest file 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
   Source in /tmp/pip-build-root/setuptools has version 0.7.2, which
 satisfies requirement setuptools=0.7 (from distribute-supervisor)
   skipping extra ssl:sys_platform=='win32'
   skipping extra ssl:sys_platform=='win32' and python_version=='2.4'
   skipping extra certs
   skipping extra ssl:python_version in '2.4, 2.5'
 Installing collected packages: distribute, setuptools

   Found existing installation: distribute 0.6.45

 Uninstalling distribute:

   Removing file or directory
 /usr/local/lib/python2.7/dist-packages/distribute-0.6.45-py2.7.egg
   Removing pth entries from
 /usr/local/lib/python2.7/dist-packages/easy-install.pth:
   Removing entry: ./distribute-0.6.45-py2.7.egg
   Successfully uninstalled distribute

   Running setup.py install for distribute

 Running command /usr/bin/python -c import
 setuptools;__file__='/tmp/pip-build-root/distribute/setup.py';exec(compile(open(__file__).read().replace('\r\n',
 '\n'), __file__, 'exec')) install --record
 /tmp/pip-5tzG3v-record/install-record.txt
 --single-version-externally-managed
 Traceback (most recent call last):

   File string, line 1, in module

 ImportError: No module named setuptools

 Complete output from command /usr/bin/python -c import
 setuptools;__file__='/tmp/pip-build-root/distribute/setup.py';exec(compile(open(__file__).read().replace('\r\n',
 '\n'), __file__, 'exec')) install --record
 /tmp/pip-5tzG3v-record/install-record.txt
 --single-version-externally-managed:

 Traceback (most recent call last):

   File string, line 1, in module

 ImportError: No module named setuptools

 

   Rolling back uninstall of distribute

   Replacing
 /usr/local/lib/python2.7/dist-packages/distribute-0.6.45-py2.7.egg
 Exception:
 Traceback (most recent call last):
   File
 /usr/local/lib/python2.7/dist-packages/pip-1.3.1-py2.7.egg/pip/basecommand.py,
 line 139, in main
 status = self.run(options, args)
   File
 /usr/local/lib/python2.7/dist-packages/pip-1.3.1-py2.7.egg/pip/commands/install.py,
 line 271, in run
 requirement_set.install(install_options, global_options,
 root=options.root_path)
   File
 /usr/local/lib/python2.7/dist-packages/pip-1.3.1-py2.7.egg/pip/req.py,
 line 1189, in install
 requirement.rollback_uninstall()
   File
 /usr/local/lib/python2.7/dist-packages/pip-1.3.1-py2.7.egg/pip/req.py,
 line 500, in rollback_uninstall
 self.uninstalled.rollback()
   File
 /usr/local/lib/python2.7/dist-packages/pip-1.3.1-py2.7.egg/pip/req.py,
 line 1537, in rollback
 pth.rollback()
 AttributeError: 'str' object has no attribute 'rollback'

-- 
Liam Kirsher
PGP: http://liam.numenet.com/pgp/

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Jason R. Coombs
Is the bitbucket 'raw' source not suitable? It uses the version tag to 
indicate precisely which file is appropriate, which means we don't have to 
redundantly host that file elsewhere.

Oh, I think I see - there's no link that doesn't change - you want a permalink 
for the latest stable release. I hadn't considered that use case, but you're 
right - we do want that. Perhaps the file could be added to pythonhosted.org 
alongside the documentation. Or maybe it belongs on bitbucket in `downloads`.

I need to figure out which is more straightforward w.r.t. authentication. The 
distribute process was messy because it involved SSH and keys that had to be 
manually managed.

I'm leaning toward uploading it to BitBucket downloads as part of the release 
script.

I'll put ez_setup.py for 0.7.2 in downloads for now. You can assume that's 
where the permalink will be.

If anyone has a better suggestion, please raise it.

 -Original Message-
 From: Distutils-SIG [mailto:distutils-sig-
 bounces+jaraco=jaraco@python.org] On Behalf Of Tres Seaver
 Sent: Sunday, 09 June, 2013 13:14
 To: Distutils-Sig@Python.Org
 Subject: Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility
 wrapper) on PyPI

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On 06/09/2013 12:22 PM, Jason R. Coombs wrote:
  On behalf of the PYPA, I'm excited to announce that Setuptools 0.7 is
  now official and complete.
 
  Released to PyPI, Setuptools 0.7.2 is now available for all to see by
  default (https://pypi.python.org/pypi/setuptools/). Users of
  Setuptools 0.6 may upgrade by simply running `easy_install -U
  setuptools`.
 
  Additionally, I released Distribute 0.7 to PyPI. This means that users
  who have Distribute 0.6.x can upgrade to setuptools 0.7 by simply
  invoking `easy_install -U distribute` (or `easy_install
  distribute=0.7`). Windows users should use `easy_install-script -U
  distribute` (to avoid file in use errors on easy_install.exe).
 
  The documentation for Setuptools 0.7.2 has been uploaded to
  https://pythonhosted.org/setuptools and includes the notes about the
  merge in addition to the official documentation.
 
  Please report any issues at the project page
  (https://bitbucket.org/pypa/setuptools).


 Thanks for all the work that went into this release.  I'm working to get
 buildout 2.0 to use the new setuptools, and need to encode a more-or-less
 permalink URL for 'ez_setup.py' -- do we not have a better URL for it than
 the Bitbucket 'raw' source?



 Tres.
 - --
 ==
 =
 Tres Seaver  +1 540-429-0999  tsea...@palladion.com
 Palladion Software   Excellence by Designhttp://palladion.com
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v1.4.11 (GNU/Linux)
 Comment: Using GnuPG with undefined - http://www.enigmail.net/

 iEYEARECAAYFAlG0t74ACgkQ+gerLs4ltQ6Q5wCg2hMoLBxfv6NIR/DTOUjdBNe
 i
 kVUAnjZ9ua2gRpwXyeRw/i1CIBPeV9e0
 =Ksc7
 -END PGP SIGNATURE-

 ___
 Distutils-SIG maillist  -  Distutils-SIG@python.org
 http://mail.python.org/mailman/listinfo/distutils-sig



smime.p7s
Description: S/MIME cryptographic signature
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Jason R. Coombs
Hi Liam,

Sorry for the trouble. The cause is rooted in the latest
updates to Setuptools and Distribute on PyPI which were launched today.

 

I believe what's happening here is pip is installing
Distribute 0.7, which triggers the uninstallation of Distribute, but
Distribute 0.7 (a compatibility wrapper) depends on a setuptools module to
be in place to install.

 

I'm unsure about the failed rollback. That looks like a
separate issue in pip.

 

Based on your report, I'm going to remove the Distribute-0.7
wrapper from PyPI until this issue is resolved. That is done.

 

In order to repair those envs, you may simply be able to
re-run the chef code over the environments and they may repair naturally. If
they don't, you may need to re-initialize the virtualenv (run virtualenv
again on that path) in order to revive distribute in that environment.

 

I hope the pip or virtualenv maintainers can comment as
well.

 

Regards,

Jason

 

From: Distutils-SIG
[mailto:distutils-sig-bounces+jaraco=jaraco@python.org] On Behalf Of
Liam Kirsher
Sent: Sunday, 09 June, 2013 13:24
To: distutils-sig@python.org
Subject: [Distutils] Setuptools/Distribute error with 0.7.2

 

Hi --
I'm hoping for some help with an error I'm suddenly getting with distribute,
setuptools.
It had been working fine, and seemingly overnight it stopped working.  I
really don't think I changed anything.
This is part of a chef recipe, which also installs virtualenv.
It appears that a new version 0.7.2 is downloaded, but it fails to install,
and then the rollback fails, as well.

Not sure quite what is wrong here and how to fix it!

Liam




Using version 0.7.2 (newest of versions: 0.7.2, 0.7.2, 0.7.1, 0.7)
  Downloading from URL
https://pypi.python.org/packages/source/s/setuptools/setuptools-0.7.2.tar.gz
#md5=de44cd90f8a1c713d6c2bff67bbca65d (from
https://pypi.python.org/simple/setuptools/)
  Running setup.py egg_info for package setuptools

running egg_info
creating pip-egg-info/setuptools.egg-info
writing requirements to pip-egg-info/setuptools.egg-info/requires.txt
writing pip-egg-info/setuptools.egg-info/PKG-INFO
writing top-level names to
pip-egg-info/setuptools.egg-info/top_level.txt
writing dependency_links to
pip-egg-info/setuptools.egg-info/dependency_links.txt
writing entry points to
pip-egg-info/setuptools.egg-info/entry_points.txt
writing requirements to pip-egg-info/setuptools.egg-info/requires.txt
writing pip-egg-info/setuptools.egg-info/PKG-INFO
writing top-level names to
pip-egg-info/setuptools.egg-info/top_level.txt
writing dependency_links to
pip-egg-info/setuptools.egg-info/dependency_links.txt
writing entry points to
pip-egg-info/setuptools.egg-info/entry_points.txt
writing manifest file 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
warning: manifest_maker: standard file '-c' not found


reading manifest file 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
  Source in /tmp/pip-build-root/setuptools has version 0.7.2, which
satisfies requirement setuptools=0.7 (from distribute-supervisor)
  skipping extra ssl:sys_platform=='win32'
  skipping extra ssl:sys_platform=='win32' and python_version=='2.4'
  skipping extra certs
  skipping extra ssl:python_version in '2.4, 2.5'
Installing collected packages: distribute, setuptools

  Found existing installation: distribute 0.6.45

Uninstalling distribute:

  Removing file or directory
/usr/local/lib/python2.7/dist-packages/distribute-0.6.45-py2.7.egg
  Removing pth entries from
/usr/local/lib/python2.7/dist-packages/easy-install.pth:
  Removing entry: ./distribute-0.6.45-py2.7.egg
  Successfully uninstalled distribute

  Running setup.py install for distribute

Running command /usr/bin/python -c import
setuptools;__file__='/tmp/pip-build-root/distribute/setup.py';exec(compile(o
pen(__file__).read().replace('\r\n', '\n'), __file__, 'exec')) install
--record /tmp/pip-5tzG3v-record/install-record.txt
--single-version-externally-managed
Traceback (most recent call last):

  File string, line 1, in module

ImportError: No module named setuptools

Complete output from command /usr/bin/python -c import
setuptools;__file__='/tmp/pip-build-root/distribute/setup.py';exec(compile(o
pen(__file__).read().replace('\r\n', '\n'), __file__, 'exec')) install
--record /tmp/pip-5tzG3v-record/install-record.txt
--single-version-externally-managed:

Traceback (most recent call last):

  File string, line 1, in module

ImportError: No module named setuptools



  Rolling back uninstall of distribute

  Replacing
/usr/local/lib/python2.7/dist-packages/distribute-0.6.45-py2.7.egg
Exception:
Traceback (most recent call last):
  File

Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Donald Stufft

On Jun 9, 2013, at 2:07 PM, Jason R. Coombs jar...@jaraco.com wrote:

 I believe what’s happening here is pip is installing Distribute 0.7, which 
 triggers the uninstallation of Distribute, but Distribute 0.7 (a 
 compatibility wrapper) depends on a setuptools module to be in place to 
 install.


If I recall pip hasn't handled the upgrade of distribute very well for awhile 
now but I can't see to find an existing ticket for it. There is a new one an 
hour ago but I assume it stems from this issue.

-
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Julian Berman
(I was also getting this until I used easy_install to upgrade)

What is supposed to happen with stuff that used to do `use_setuptools()` in
their setup.py now?

I upgraded to setuptools 0.7.2, but now if I try to install a thing that
has that in the setup.py, it seems to want to try and install distribute,
and I get:

Downloading/unpacking pudb (from -r
/Users/Julian/.local/share/virtualenvs/requirements-every-virtualenv.txt
(line 2))
  Using download cache from /Users/Julian/Library/Caches/pip/https%3A%2F%
2Fpypi.python.org%2Fpackages%2Fsource%2Fp%2Fpudb%2Fpudb-2013.2.tar.gz
  Running setup.py egg_info for package pudb
Downloading
http://pypi.python.org/packages/source/d/distribute/distribute-0.6.35.tar.gz
Extracting in /var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3
Now working in
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35
Building a Distribute egg in
/Users/Julian/.local/share/virtualenvs/great/build/pudb
Traceback (most recent call last):
  File setup.py, line 45, in module
exec(init_file.read(), d)
  File string, line 8, in module
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/__init__.py,
line 2, in module
from setuptools.extension import Extension, Library
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/extension.py,
line 5, in module
from setuptools.dist import _get_unpatched
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/dist.py,
line 6, in module
from setuptools.command.install import install
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/command/__init__.py,
line 8, in module
from setuptools.command import install_scripts
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/command/install_scripts.py,
line 3, in module
from pkg_resources import Distribution, PathMetadata,
ensure_directory
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/pkg_resources.py,
line 2825, in module
add_activation_listener(lambda dist: dist.activate())
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/pkg_resources.py,
line 710, in subscribe
callback(dist)
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/pkg_resources.py,
line 2825, in lambda
add_activation_listener(lambda dist: dist.activate())
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/pkg_resources.py,
line 2257, in activate
self.insert_on(path)
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/pkg_resources.py,
line 2358, in insert_on
with distribute. Found one at %s % str(self.location))
ValueError: A 0.7-series setuptools cannot be installed with
distribute. Found one at
/Users/Julian/.local/share/virtualenvs/great/lib/python2.7/site-packages/setuptools-0.7.2-py2.7.egg

/Users/Julian/.local/share/virtualenvs/great/build/pudb/distribute-0.6.35-py2.7.egg
Traceback (most recent call last):
  File string, line 16, in module
  File
/Users/Julian/.local/share/virtualenvs/great/build/pudb/setup.py, line 5,
in module
use_setuptools()
  File distribute_setup.py, line 152, in use_setuptools
return _do_download(version, download_base, to_dir, download_delay)
  File distribute_setup.py, line 132, in _do_download
_build_egg(egg, tarball, to_dir)
  File distribute_setup.py, line 123, in _build_egg
raise IOError('Could not build the egg.')
IOError: Could not build the egg.
Complete output from command python setup.py egg_info:
Downloading
http://pypi.python.org/packages/source/d/distribute/distribute-0.6.35.tar.gz

Extracting in /var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3

Now working in
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35

Building a Distribute egg in
/Users/Julian/.local/share/virtualenvs/great/build/pudb

Traceback (most recent call last):

  File setup.py, line 45, in module

exec(init_file.read(), d)

  File string, line 8, in module

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/__init__.py,
line 2, in module

from setuptools.extension import Extension, Library

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/extension.py,
line 5, in module

from setuptools.dist import _get_unpatched

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35/setuptools/dist.py,
line 6, in module

from 

Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Liam Kirsher
Thanks!  That's a relief.
I re-ran it and it worked.

On 06/09/2013 11:07 AM, Jason R. Coombs wrote:

 Hi Liam,

 Sorry for the trouble. The cause is rooted in the
 latest updates to Setuptools and Distribute on PyPI which were
 launched today.

  

 I believe what's happening here is pip is installing
 Distribute 0.7, which triggers the uninstallation of Distribute, but
 Distribute 0.7 (a compatibility wrapper) depends on a setuptools
 module to be in place to install.

  

 I'm unsure about the failed rollback. That looks like
 a separate issue in pip.

  

 Based on your report, I'm going to remove the
 Distribute-0.7 wrapper from PyPI until this issue is resolved. That is
 done.

  

 In order to repair those envs, you may simply be able
 to re-run the chef code over the environments and they may repair
 naturally. If they don't, you may need to re-initialize the virtualenv
 (run virtualenv again on that path) in order to revive distribute in
 that environment.

  

 I hope the pip or virtualenv maintainers can comment
 as well.

  

 Regards,

 Jason

  

 *From:*Distutils-SIG
 [mailto:distutils-sig-bounces+jaraco=jaraco@python.org] *On Behalf
 Of *Liam Kirsher
 *Sent:* Sunday, 09 June, 2013 13:24
 *To:* distutils-sig@python.org
 *Subject:* [Distutils] Setuptools/Distribute error with 0.7.2

  

 Hi --
 I'm hoping for some help with an error I'm suddenly getting with
 distribute, setuptools.
 It had been working fine, and seemingly overnight it stopped working. 
 I really don't think I changed anything.
 This is part of a chef recipe, which also installs virtualenv.
 It appears that a new version 0.7.2 is downloaded, but it fails to
 install, and then the rollback fails, as well.

 Not sure quite what is wrong here and how to fix it!

 Liam


 Using version 0.7.2 (newest of versions: 0.7.2, 0.7.2, 0.7.1, 0.7)
   Downloading from URL
 
 https://pypi.python.org/packages/source/s/setuptools/setuptools-0.7.2.tar.gz#md5=de44cd90f8a1c713d6c2bff67bbca65d
 (from https://pypi.python.org/simple/setuptools/)
   Running setup.py egg_info for package setuptools

 running egg_info
 creating pip-egg-info/setuptools.egg-info
 writing requirements to
 pip-egg-info/setuptools.egg-info/requires.txt
 writing pip-egg-info/setuptools.egg-info/PKG-INFO
 writing top-level names to
 pip-egg-info/setuptools.egg-info/top_level.txt
 writing dependency_links to
 pip-egg-info/setuptools.egg-info/dependency_links.txt
 writing entry points to
 pip-egg-info/setuptools.egg-info/entry_points.txt
 writing requirements to
 pip-egg-info/setuptools.egg-info/requires.txt
 writing pip-egg-info/setuptools.egg-info/PKG-INFO
 writing top-level names to
 pip-egg-info/setuptools.egg-info/top_level.txt
 writing dependency_links to
 pip-egg-info/setuptools.egg-info/dependency_links.txt
 writing entry points to
 pip-egg-info/setuptools.egg-info/entry_points.txt
 writing manifest file
 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
 warning: manifest_maker: standard file '-c' not found
 

 reading manifest file
 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
 reading manifest template 'MANIFEST.in'
 writing manifest file
 'pip-egg-info/setuptools.egg-info/SOURCES.txt'
   Source in /tmp/pip-build-root/setuptools has version 0.7.2,
 which satisfies requirement setuptools=0.7 (from
 distribute-supervisor)
   skipping extra ssl:sys_platform=='win32'
   skipping extra ssl:sys_platform=='win32' and python_version=='2.4'
   skipping extra certs
   skipping extra ssl:python_version in '2.4, 2.5'
 Installing collected packages: distribute, setuptools

   Found existing installation: distribute 0.6.45

 Uninstalling distribute:

   Removing file or directory
 /usr/local/lib/python2.7/dist-packages/distribute-0.6.45-py2.7.egg
   Removing pth entries from
 /usr/local/lib/python2.7/dist-packages/easy-install.pth:
   Removing entry: ./distribute-0.6.45-py2.7.egg
   Successfully uninstalled distribute

   Running setup.py install for distribute

 Running command /usr/bin/python -c import
 
 setuptools;__file__='/tmp/pip-build-root/distribute/setup.py';exec(compile(open(__file__).read().replace('\r\n',
 '\n'), __file__, 'exec')) install --record
 /tmp/pip-5tzG3v-record/install-record.txt
 --single-version-externally-managed
 Traceback (most recent call last):

   File string, line 1, in module

 ImportError: No module named setuptools

 Complete output from command /usr/bin/python -c import
 
 setuptools;__file__='/tmp/pip-build-root/distribute/setup.py';exec(compile(open(__file__).read().replace('\r\n',
 '\n'), 

Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Donald Stufft
On Jun 9, 2013, at 9:20 AM, holger krekel hol...@merlinux.eu wrote:

 There
 are many CDN providers out there and I suspect so far only Fastly was
 contacted. The primary responsibility of that coordinator is correctly
 sending the message for CDN provider that PyPI is a public exhibition of
 their service quality, and not a tax exemption for charity. I'd say Fastly
 should be interested to help with making us download stats exposed in a
 convenient API friendly way, because real-time stats is the key feature of
 their marketing advantage as I see it.
 
 FYI Fastly has been responding swiftly and responsibly so far, as far as
 i could follow it.  And Donald has been helping people on various fronts
 (not only Fastly related) and been the main driver of the CDN move,
 thankfully.  Things are starting to work more smoothly now and i guess
 some bumps in the road were unavoidable because they only show up in
 real life.

Fastly has been a dream to work with. They've been fast at fixing and
diagnosing issues, have helped tune the config to get a higher hit rate,
and when they heard that people were upset that download counts
had to be turned off they offered the logging support to be turned on
for our account.

The infrastructure is setup to receive the logs (and intact was receiving
logs for a day or so) but upgrades to the VM that runs PyPI needs to
occur before we can continue receiving them. The disk drive that PyPI
has is to small to handle the volume of request data that is coming in
from Fastly and it quickly filled up in under 24 hours. Upgrading that
space requires powering off the VM so we (The Infra team) are working
on doing that, ideally without downtime on PyPI.

-
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Lennart Regebro
I'm dancing a small victory-dance in my chair.

On Sun, Jun 9, 2013 at 6:22 PM, Jason R. Coombs jar...@jaraco.com wrote:
 On behalf of the PYPA, I’m excited to announce that Setuptools 0.7 is now
 official and complete.



 Released to PyPI, Setuptools 0.7.2 is now available for all to see by
 default (https://pypi.python.org/pypi/setuptools/). Users of Setuptools 0.6
 may upgrade by simply running `easy_install -U setuptools`.



 Additionally, I released Distribute 0.7 to PyPI. This means that users who
 have Distribute 0.6.x can upgrade to setuptools 0.7 by simply invoking
 `easy_install -U distribute` (or `easy_install distribute=0.7”`). Windows
 users should use `easy_install-script -U distribute` (to avoid “file in use”
 errors on easy_install.exe).



 The documentation for Setuptools 0.7.2 has been uploaded to
 https://pythonhosted.org/setuptools and includes the notes about the merge
 in addition to the official documentation.



 Please report any issues at the project page
 (https://bitbucket.org/pypa/setuptools).




 ___
 Distutils-SIG maillist  -  Distutils-SIG@python.org
 http://mail.python.org/mailman/listinfo/distutils-sig

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Donald Stufft
On Jun 9, 2013, at 8:53 AM, Alex Clark acl...@aclark.net wrote:
 
 small_rantBut: this happens all the time in open source communities, even
 mature ones. Someone volunteers to perform some complex task and
 hand-waves-away some requirement they don't personally feel is important
 under the too hard or I don't have time for that, I'm doing this umbrella.
 
 Someone else comes along and says wait, what happened to XXX? at which
 point others join in to emphasize the importance of XXX. At this point, it's
 more clear whether or not XXX is actually important. But during this time:
 XXX is broken and many people on both sides are unhappy.
 
 GOLDEN RULE: That's why even in open source, the golden rule of OPS is
 still important: PLEASE DO NOT BREAK SHIT. Even if you are fixing other more
 important functionality and don't think XXX is important. Or if XXX and the
 thing you want to do cannot co-exist, then make sure you get extensive
 buy-in from a large percentage of folks before you consider removing XXX. If
 for no other reason, then you will most certainly draw unwanted attention to
 yourself (which is especially frustrating in the context of trying to do
 good things).
 /small_rant
 
 Anyway, I've seen this so many times I don't even get angry anymore. Because
 I know everyone involved has nothing but the best intentions. In this case,
 I'd like to see the download count functionality restored. (I spent a full
 year building a website whose almost-sole-functionality relies on download
 counts existing and working properly.) So, please call me when they are
 back.:-) And if I can help in anyway to make that happen, please let me know.
 

PyPI's central purpose is to act as a repository and index of packages. Download
counts are an auxiliary feature. Prior to the CDN there were large swathes of
people, primarily in non US locations, who simply could not use PyPI because
of bad routes between them and PyPI. Some folks were getting download speeds
more reminiscent of dialup instead of Broadband. Moving to a CDN made PyPI
reasonably function again for those people.

So yes. I broke Download counts because they were not more important than
people being able to actually use PyPI to install from. And, thanks to Fastly
generously giving us a access to streaming logs, will be bringing them back
once the issues are sorted out.

-
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Marcus Smith
 If I recall pip hasn't handled the upgrade of distribute very well for
 awhile now but I can't see to find an existing ticket for it.


the older issue is that pip can't upgrade distribute in python 3 (related
to distribute requiring 2to3)
https://github.com/pypa/pip/issues/650
btw, pip-1.4 (unreleased) has new logic to skip even trying, because the
problem prevents upgrades and wheel building for projects like pyramid
(which formally depend on setuptools)

Marcus
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Jason R. Coombs
Hi Julian,

I believe for those packages that call `use_setuptools()`
from `distribute_setup.py`, the only option to support them is to install
Distribute 0.7 (the stub package), which I believe will satisfy the
use_setuptools() call so it doesn't attempt to install Distribute 0.6.

 

As mentioned in another post, I've temporarily pulled
Distribute 0.7 from PyPI until we can determine a way to avoid the pip
upgrade issue. In the meantime, if you install Distribute 0.7 from
https://bitbucket.org/pypa/setuptools/downloads, does that solve your issue?

 

Regards,

Jason

 

From: Distutils-SIG
[mailto:distutils-sig-bounces+jaraco=jaraco@python.org] On Behalf Of
Julian Berman
Sent: Sunday, 09 June, 2013 14:21
To: distutils-sig@python.org
Subject: Re: [Distutils] Setuptools/Distribute error with 0.7.2

 

(I was also getting this until I used easy_install to upgrade)

 

What is supposed to happen with stuff that used to do `use_setuptools()` in
their setup.py now?

 

I upgraded to setuptools 0.7.2, but now if I try to install a thing that has
that in the setup.py, it seems to want to try and install distribute, and I
get:

 

Downloading/unpacking pudb (from -r
/Users/Julian/.local/share/virtualenvs/requirements-every-virtualenv.txt
(line 2))

  Using download cache from
/Users/Julian/Library/Caches/pip/https%3A%2F%2Fpypi.python.org
http://2Fpypi.python.org
%2Fpackages%2Fsource%2Fp%2Fpudb%2Fpudb-2013.2.tar.gz

  Running setup.py egg_info for package pudb

Downloading
http://pypi.python.org/packages/source/d/distribute/distribute-0.6.35.tar.gz

Extracting in /var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3

Now working in
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribute-0.6.35

Building a Distribute egg in
/Users/Julian/.local/share/virtualenvs/great/build/pudb

Traceback (most recent call last):

  File setup.py, line 45, in module

exec(init_file.read(), d)

  File string, line 8, in module

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/setuptools/__init__.py, line 2, in module

from setuptools.extension import Extension, Library

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/setuptools/extension.py, line 5, in module

from setuptools.dist import _get_unpatched

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/setuptools/dist.py, line 6, in module

from setuptools.command.install import install

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/setuptools/command/__init__.py, line 8, in module

from setuptools.command import install_scripts

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/setuptools/command/install_scripts.py, line 3, in module

from pkg_resources import Distribution, PathMetadata,
ensure_directory

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/pkg_resources.py, line 2825, in module

add_activation_listener(lambda dist: dist.activate())

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/pkg_resources.py, line 710, in subscribe

callback(dist)

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/pkg_resources.py, line 2825, in lambda

add_activation_listener(lambda dist: dist.activate())

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/pkg_resources.py, line 2257, in activate

self.insert_on(path)

  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/tmp8NepZ3/distribu
te-0.6.35/pkg_resources.py, line 2358, in insert_on

with distribute. Found one at %s % str(self.location))

ValueError: A 0.7-series setuptools cannot be installed with distribute.
Found one at
/Users/Julian/.local/share/virtualenvs/great/lib/python2.7/site-packages/set
uptools-0.7.2-py2.7.egg

 
/Users/Julian/.local/share/virtualenvs/great/build/pudb/distribute-0.6.35-py
2.7.egg

Traceback (most recent call last):

  File string, line 16, in module

  File
/Users/Julian/.local/share/virtualenvs/great/build/pudb/setup.py, line 5,
in module

use_setuptools()

  File distribute_setup.py, line 152, in use_setuptools

return _do_download(version, download_base, to_dir, download_delay)

  File distribute_setup.py, line 132, in _do_download

_build_egg(egg, tarball, to_dir)

  File distribute_setup.py, line 123, in _build_egg

raise IOError('Could not build the egg.')

IOError: Could not build the egg.

Complete output from command python setup.py egg_info:

Downloading

Re: [Distutils] b.pypi.python.org

2013-06-09 Thread Noah Kantrowitz

On Jun 7, 2013, at 2:34 PM, Noah Kantrowitz n...@coderanger.net wrote:

 
 On Jun 7, 2013, at 2:27 PM, Donald Stufft don...@stufft.io wrote:
 
 
 On Jun 7, 2013, at 5:26 PM, ken cochrane kencochr...@gmail.com wrote:
 
 
 
 b.pypi.python.org is an official mirror that runs on Google App engine, 
 and it uses a special mirror package built just for GAE. Code for it is 
 found here. https://bitbucket.org/loewis/pypi-appengine
 
 b.pypi.python.org has been broken for over 104 days according to 
 http://www.pypi-mirrors.org, and this is because of an issue when we 
 switched pypi over to serving over SSL. 
 
 I have submitted a pull request to fix this. 
 https://bitbucket.org/loewis/pypi-appengine/pull-request/2/change-pypi-mirror-connection-to-https/diff#comment-262919
   but it hasn't been accepted.
 
 I am one of the maintainers of b.pypi.python.org, so I can see the logs 
 and push out a new version. 
 I haven't needed to push a version out before, and I'm a little hesitant 
 incase I do it wrong and break something. 
 
 I also don't want to push code to GAE from my fork, until my PR gets 
 accepted or else someone else in the future might deploy the original one 
 again and remove my fix.
 
 Two things:
 
 1. Now that we have the pypi CDN up, do we still need this mirror?
 
 Honestly probably not. Mirrors are less important from a availability/speed 
 side of things now and will likely move to being more useful for companies 
 and such to use.
 
 OK, what would be the procedure for removing a mirror? Anyone know who is 
 in charge of this mirror? I think Guido had it setup when he worked at 
 Google, and google is paying for the costs of the mirror, but  now that he 
 doesn't work for Google, not sure who might be the contact person on that 
 side.
 
 I've asked Guido who are admins on the account it to get it turned off. If 
 he doesn't know I can try to find out internally.
 
 
 Brett,
 
 Here is the owner list that I can see on GAE
 
 - guido
 - kencochrane (me)
 - kumar.mcmillan 
 - martin.v.loewis
 - r1chardj0n3s
 
 So Guido didn't even know he was an owner. =)
 
 In terms of shutting down the app, you will want to do two things. First is 
 empty out the cron.yaml file; it should have nothing more than cron:. 
 After that you probably want to return 404 for everything; see 
 http://stackoverflow.com/a/189935/236574 on how to do that for all URLs.
 
 If you want, Ken, I can clone 
 https://bitbucket.org/kencochrane/pypi-appengine and send you a pull 
 request to do all of this since I recently did something similar for 
 py3ksupport.appspot.com when I shut it down.
 
 Brett,
 
 If our goal is to shut it down, then yes please, if you can send a pull 
 request that would be great.. We should also probably remove it from the 
 pypi mirror pool before we do this so it no longer gets traffic sent it's 
 way.
 
 
 
 
 
 If we can get it up to date again, I think it is fine, but an out of date 
 mirror is not useful to anyone, and it could cause problems in the long run.
 
 
 2. If yes to 1. if someone can take a minute to review my PR, and leave 
 comments, or if you have the power, accept my pull request and push out a 
 new version so we can get the mirror up to date.
 
 I don't have such permission sadly.
 
 
 Thank you anyway. 
 
 
 
 
 
 
 Paging Noah to kill the DNS Unless there's any objections to removing it?
 
 If no one complains in the next 24-ish hours I'll just point it back at 
 pypi.python.org like we did with d.pypi.

This is now complete. In another 24 hours there should be no traffic to the GAE 
app and it can just be archived or deleted.

--Noah



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Alex Clark
Donald Stufft donald at stufft.io writes:
 
 So yes. I broke Download counts because they were not more important than
 people being able to actually use PyPI to install from.


FWIW:


You missed the moral of the story: when you make a decision like this,
someone will *always* disagree with you (even over the most trivial things).
And even if they don't, they may disagree with your approach (e.g. why not
sort problems with download counts before enabling the CDN) So the only way
to make everyone happy is to consider everyone who will be affected by your
actions, before you take action.


(I'm not that concerned with this particular incident, just fascinated by
open source community relations in general.)


Alex


 
 -
 Donald Stufft
 PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
 
 
 
 
 ___
 Distutils-SIG maillist  -  Distutils-SIG at python.org
 http://mail.python.org/mailman/listinfo/distutils-sig
 




___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Noah Kantrowitz

On Jun 9, 2013, at 1:04 PM, Alex Clark acl...@aclark.net wrote:

 Donald Stufft donald at stufft.io writes:
 
 So yes. I broke Download counts because they were not more important than
 people being able to actually use PyPI to install from.
 
 
 FWIW:
 
 
 You missed the moral of the story: when you make a decision like this,
 someone will *always* disagree with you (even over the most trivial things).
 And even if they don't, they may disagree with your approach (e.g. why not
 sort problems with download counts before enabling the CDN) So the only way
 to make everyone happy is to consider everyone who will be affected by your
 actions, before you take action.

There is another way, make awesome and wait for history to determine who was 
happy :)

--Noah



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Lennart Regebro
On Sun, Jun 9, 2013 at 8:41 PM, Donald Stufft don...@stufft.io wrote:
 So yes. I broke Download counts because they were not more important than
 people being able to actually use PyPI to install from.

I approve of this message.

//Lennart
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Julian Berman
Hey Jason.

I was getting it before you removed it I think (and yeah, still get it now
if I `pip install
https://bitbucket.org/pypa/setuptools/downloads/distribute-0.7.zip`).

An example of such a package is pudb, if you'd like to try and reproduce
(or I can open an issue on the tracker, just wasn't sure I wasn't missing
something), but even if I install with easy_install I still seem to get the
same output:

⊙  easy_install pudb

 Julian@air
Searching for pudb
Reading https://pypi.python.org/simple/pudb/
Best match: pudb 2013.2
Downloading
https://pypi.python.org/packages/source/p/pudb/pudb-2013.2.tar.gz#md5=16411aaffc6f7ae63aba3830ba4ebee5
Processing pudb-2013.2.tar.gz
Writing
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/setup.cfg
Running pudb-2013.2/setup.py -q bdist_egg --dist-dir
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/egg-dist-tmp-6RBU6H
Downloading
http://pypi.python.org/packages/source/d/distribute/distribute-0.6.35.tar.gz
Extracting in
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl
Now working in
/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35
Building a Distribute egg in
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2
Traceback (most recent call last):
  File setup.py, line 45, in module
exec(init_file.read(), d)
  File string, line 8, in module
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/setuptools/__init__.py,
line 2, in module
from setuptools.extension import Extension, Library
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/setuptools/extension.py,
line 5, in module
from setuptools.dist import _get_unpatched
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/setuptools/dist.py,
line 6, in module
from setuptools.command.install import install
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/setuptools/command/__init__.py,
line 8, in module
from setuptools.command import install_scripts
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/setuptools/command/install_scripts.py,
line 3, in module
from pkg_resources import Distribution, PathMetadata, ensure_directory
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/pkg_resources.py,
line 2825, in module
add_activation_listener(lambda dist: dist.activate())
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/pkg_resources.py,
line 710, in subscribe
callback(dist)
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/pkg_resources.py,
line 2825, in lambda
add_activation_listener(lambda dist: dist.activate())
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/pkg_resources.py,
line 2257, in activate
self.insert_on(path)
  File
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/temp/tmpBW8hGl/distribute-0.6.35/pkg_resources.py,
line 2358, in insert_on
with distribute. Found one at %s % str(self.location))
ValueError: A 0.7-series setuptools cannot be installed with distribute.
Found one at
/usr/local/lib/python2.7/site-packages/setuptools-0.7.2-py2.7.egg
/private/var/folders/zc/bzrwlgxd51594q6lt1yrx5v0gn/T/easy_install-URSqF1/pudb-2013.2/distribute-0.6.35-py2.7.egg
error: None

~
⊙  pip freeze | grep distribute

   Julian@air
distribute==0.7


On Sun, Jun 9, 2013 at 2:29 PM, Jason R. Coombs jar...@jaraco.com wrote:

 Hi Julian,

 I believe for those packages that call `use_setuptools()`
 from `distribute_setup.py`, the only option to support them is to install
 Distribute 0.7 (the stub package), which I believe will satisfy the
 use_setuptools() call so it doesn’t attempt to install Distribute 0.6.

 ** **

 As mentioned in another post, I’ve temporarily pulled
 Distribute 0.7 from PyPI until we can determine a way to avoid the pip
 upgrade issue. In the meantime, if you install Distribute 0.7 from
 https://bitbucket.org/pypa/setuptools/downloads, does that solve your
 issue?

 ** **

 Regards,

 Jason

 ** **

 *From:* Distutils-SIG [mailto:distutils-sig-bounces+jaraco=
 jaraco@python.org] *On Behalf Of *Julian Berman
 *Sent:* Sunday, 09 June, 2013 14:21
 *To:* 

Re: [Distutils] b.pypi.python.org

2013-06-09 Thread Ken Cochrane
On Jun 9, 2013, at 3:46 PM, Noah Kantrowitz n...@coderanger.net wrote:

 
 On Jun 7, 2013, at 2:34 PM, Noah Kantrowitz n...@coderanger.net wrote:
 
 
 On Jun 7, 2013, at 2:27 PM, Donald Stufft don...@stufft.io wrote:
 
 
 On Jun 7, 2013, at 5:26 PM, ken cochrane kencochr...@gmail.com wrote:
 
 
 
 b.pypi.python.org is an official mirror that runs on Google App engine, 
 and it uses a special mirror package built just for GAE. Code for it is 
 found here. https://bitbucket.org/loewis/pypi-appengine
 
 b.pypi.python.org has been broken for over 104 days according to 
 http://www.pypi-mirrors.org, and this is because of an issue when we 
 switched pypi over to serving over SSL. 
 
 I have submitted a pull request to fix this. 
 https://bitbucket.org/loewis/pypi-appengine/pull-request/2/change-pypi-mirror-connection-to-https/diff#comment-262919
   but it hasn't been accepted.
 
 I am one of the maintainers of b.pypi.python.org, so I can see the logs 
 and push out a new version. 
 I haven't needed to push a version out before, and I'm a little hesitant 
 incase I do it wrong and break something. 
 
 I also don't want to push code to GAE from my fork, until my PR gets 
 accepted or else someone else in the future might deploy the original one 
 again and remove my fix.
 
 Two things:
 
 1. Now that we have the pypi CDN up, do we still need this mirror?
 
 Honestly probably not. Mirrors are less important from a 
 availability/speed side of things now and will likely move to being more 
 useful for companies and such to use.
 
 OK, what would be the procedure for removing a mirror? Anyone know who is 
 in charge of this mirror? I think Guido had it setup when he worked at 
 Google, and google is paying for the costs of the mirror, but  now that he 
 doesn't work for Google, not sure who might be the contact person on that 
 side.
 
 I've asked Guido who are admins on the account it to get it turned off. If 
 he doesn't know I can try to find out internally.
 
 
 Brett,
 
 Here is the owner list that I can see on GAE
 
 - guido
 - kencochrane (me)
 - kumar.mcmillan 
 - martin.v.loewis
 - r1chardj0n3s
 
 So Guido didn't even know he was an owner. =)
 
 In terms of shutting down the app, you will want to do two things. First 
 is empty out the cron.yaml file; it should have nothing more than cron:. 
 After that you probably want to return 404 for everything; see 
 http://stackoverflow.com/a/189935/236574 on how to do that for all URLs.
 
 If you want, Ken, I can clone 
 https://bitbucket.org/kencochrane/pypi-appengine and send you a pull 
 request to do all of this since I recently did something similar for 
 py3ksupport.appspot.com when I shut it down.
 
 Brett,
 
 If our goal is to shut it down, then yes please, if you can send a pull 
 request that would be great.. We should also probably remove it from the 
 pypi mirror pool before we do this so it no longer gets traffic sent it's 
 way.
 
 
 
 
 
 If we can get it up to date again, I think it is fine, but an out of date 
 mirror is not useful to anyone, and it could cause problems in the long 
 run.
 
 
 2. If yes to 1. if someone can take a minute to review my PR, and leave 
 comments, or if you have the power, accept my pull request and push out a 
 new version so we can get the mirror up to date.
 
 I don't have such permission sadly.
 
 
 Thank you anyway.
 
 Paging Noah to kill the DNS Unless there's any objections to removing it?
 
 If no one complains in the next 24-ish hours I'll just point it back at 
 pypi.python.org like we did with d.pypi.
 
 This is now complete. In another 24 hours there should be no traffic to the 
 GAE app and it can just be archived or deleted.

Thank you!
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


[Distutils] PEP439 and upgrading pip

2013-06-09 Thread Marcus Smith
maybe this was covered before, but I'm looking for clarification on how pip
upgrades are to work under PEP439.

I see 3 relevant bits right now:

1) attempts to import pip machinery. If it can then the pip command
proceeds as normal

i.e., once it has a pip installed, it doesn't automatically upgrade on
subsequent imports.

2) A bootstrap is used in the place of a the full pip code so that we
don't have to bundle pip and also the install tool is upgradeable outside
of the regular Python upgrade timeframe and processes

to be clear, what is the install tool here?  pip? or the bootstrap?

3) Manual installation of the pip implementation will be supported through
the manual download of the wheel file and pip3 install downloaded wheel
file. This installation will not perform standard pip installation steps
of saving the file to a cache directory or updating any local database of
installed files.

I guess this means manual upgrades as well?
this special logic is to be inside pip itself? or an override of install
in the bootstrap (that detects when it's a pip wheel)?

Marcus
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


[Distutils] Open source community relations: Was: Re: PyPI Download Counts

2013-06-09 Thread Alex Clark
Noah Kantrowitz noah at coderanger.net writes:


 
 There is another way, make awesome and wait for history to determine who
was happy :)


Tee hee hee! :-)


OK this is my 3rd (and likely last) attempt to steer this thread away from
the specific, and contemplate the broader implications. The PyPI CDN is
awesome (seriously, I appreciate all the hard work and progress from Donald,
Noah, Fastly, et al, as I've said recently in another thread). And I'm
prepared to be the only one interested in discussing the broader
implications, at which point I'll go OT and shut up. 


But FWIW I bother to comment here for a reason: to learn from this incident
and apply that knowledge to future incidents, and to help others do the same.



Alex


 
 --Noah
 
 
 
 ___
 Distutils-SIG maillist  -  Distutils-SIG at python.org
 http://mail.python.org/mailman/listinfo/distutils-sig
 




___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Marcus Smith
 It was only working in python2 before now anyway.  (
 https://github.com/pypa/pip/issues/650)
 pip is fundamentally dependent on setuptools to perform upgrades.


with distribute-0.6.X upgrades, even though pip uninstalled distribute as
part of the upgrade, it ran the install subprocess with the cwd equal to
the build dir, so it could import setuptools from the unpacked download.
but now,  distribute-0.7 is just a shell, that contains no importable
setuptools that pip can use.
we could *make* it work I guess, by enforcing non-standard logic when
dealing with distribute (i.e. get setuptools-0.7 installed first; by
default, setuptools gets queued to be installed after the distribute
upgrade)
but like I said before, it's much more motivating to think about PEP439,
than this dreary setuptools/distribute legacy headache stuff.

Marcus



 the best fix I think is to move faster on making pip PEP439 compliant
- i.e. have pip be able to at least install from wheels w/o needing
 setuptools, which would remove the bootstrap headache
- see https://github.com/pypa/pip/issues/863
- this could likely involve pip replacing it's use of pkg_resources
 with distlib (https://github.com/pypa/pip/pull/909)

 Marcus

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


[Distutils] Permission Denied errors on Windows 7 with buildout 1.7.1

2013-06-09 Thread Chris Withers

Hi All,

I'm seeing this exception when running a particular buildout on Windows:

C:\Jenkins\workspace\checker-buildout\aeb5917bbin\buildout
Develop: 'C:\\Jenkins\\workspace\\checker-buildout\\aeb5917b\\.'
Installing py.
Generated script 
'C:\\Jenkins\\workspace\\checker-buildout\\aeb5917b\\bin\\checker'.
Generated script 
'C:\\Jenkins\\workspace\\checker-buildout\\aeb5917b\\bin\\tox'.
Generated script 
'C:\\Jenkins\\workspace\\checker-buildout\\aeb5917b\\bin\\tox-quickstart'.

While:
  Installing py.

An internal error occurred due to a bug in either zc.buildout or in a
recipe being used:
Traceback (most recent call last):
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\buildout.py, 
line 1866, in main

getattr(buildout, command)(args)
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\buildout.py, 
line 625, in install

installed_files = self[part]._call(recipe.install)
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\buildout.py, 
line 1345, in _call

return f()
  File 
c:\users\jenkins\.buildout\eggs\zc.recipe.egg-1.3.2-py2.7.egg\zc\recipe\egg\egg.py, 
line 173, in install

return self._install(reqs, ws, scripts)
  File 
c:\users\jenkins\.buildout\eggs\zc.recipe.egg-1.3.2-py2.7.egg\zc\recipe\egg\egg.py, 
line 195, in _install

relative_paths=self._relative_paths
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\easy_install.py, 
line 1223, in scripts

initialization, executable, arguments)
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\easy_install.py, 
line 1350, in _generate_scripts

module_name, attrs, arguments, block_site=block_site))
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\easy_install.py, 
line 1498, in _script

return _write_script(dest, contents, 'script')
  File 
c:\users\jenkins\.buildout\eggs\zc.buildout-1.7.1-py2.7.egg\zc\buildout\easy_install.py, 
line 1463, in _write_script

open(exe, 'wb').write(new_data)
IOError: [Errno 13] Permission denied: 
'C:\\Jenkins\\workspace\\checker-buildout\\aeb5917b\\bin\\buildout.exe'


This happens every time, on Python 2.5, 2.6 and 2.7. I've tried blowing 
the workspace away, makes no difference:


http://jenkins.simplistix.co.uk/job/checker-buildout/114/PYTHON=2.7,label=windows/console
http://jenkins.simplistix.co.uk/job/checker-buildout/114/PYTHON=2.6,label=windows/console
http://jenkins.simplistix.co.uk/job/checker-buildout/114/PYTHON=2.5,label=windows/console

Any idea what's going on here and how I can fix it?

cheers,

Chris

--
Simplistix - Content Management, Batch Processing  Python Consulting
   - http://www.simplistix.co.uk
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Permission Denied errors on Windows 7 with buildout 1.7.1

2013-06-09 Thread Chris Withers

On 09/06/2013 23:39, Chris Withers wrote:

This happens every time, on Python 2.5, 2.6 and 2.7. I've tried blowing
the workspace away, makes no difference:

http://jenkins.simplistix.co.uk/job/checker-buildout/114/PYTHON=2.7,label=windows/console

http://jenkins.simplistix.co.uk/job/checker-buildout/114/PYTHON=2.6,label=windows/console

http://jenkins.simplistix.co.uk/job/checker-buildout/114/PYTHON=2.5,label=windows/console


Forgot to say, the buildout in question is here:

https://github.com/Simplistix/checker/blob/master/buildout.cfg

cheers,

Chris

--
Simplistix - Content Management, Batch Processing  Python Consulting
   - http://www.simplistix.co.uk
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 06/09/2013 01:49 PM, Jason R. Coombs wrote:
 Is the bitbucket 'raw' source not suitable? It uses the version tag to
  indicate precisely which file is appropriate, which means we don't
 have to redundantly host that file elsewhere.
 
 Oh, I think I see - there's no link that doesn't change - you want a
 permalink for the latest stable release. I hadn't considered that use
 case, but you're right - we do want that. Perhaps the file could be
 added to pythonhosted.org alongside the documentation. Or maybe it
 belongs on bitbucket in `downloads`.
 
 I need to figure out which is more straightforward w.r.t.
 authentication. The distribute process was messy because it involved
 SSH and keys that had to be manually managed.
 
 I'm leaning toward uploading it to BitBucket downloads as part of the
 release script.
 
 I'll put ez_setup.py for 0.7.2 in downloads for now. You can assume
 that's where the permalink will be.
 
 If anyone has a better suggestion, please raise it.

I would prefer a URL on a host managed by the Python infrastructure team:
 either PyPI or the pythonhosted org.


Tres.
- -- 
===
Tres Seaver  +1 540-429-0999  tsea...@palladion.com
Palladion Software   Excellence by Designhttp://palladion.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iEYEARECAAYFAlG1B2sACgkQ+gerLs4ltQ7H8gCdE/g1UBfr74s7v5tmuHLXdktx
3L0AoMxPG48F5KM8Ae+v5A1g9nU2B4To
=pTON
-END PGP SIGNATURE-
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Eric V. Smith
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 6/9/2013 6:53 PM, Tres Seaver wrote:
 On 06/09/2013 01:49 PM, Jason R. Coombs wrote:
 Is the bitbucket 'raw' source not suitable? It uses the version
 tag to indicate precisely which file is appropriate, which means
 we don't have to redundantly host that file elsewhere.
 
 Oh, I think I see - there's no link that doesn't change - you
 want a permalink for the latest stable release. I hadn't
 considered that use case, but you're right - we do want that.
 Perhaps the file could be added to pythonhosted.org alongside the
 documentation. Or maybe it belongs on bitbucket in `downloads`.
 
 I need to figure out which is more straightforward w.r.t. 
 authentication. The distribute process was messy because it
 involved SSH and keys that had to be manually managed.
 
 I'm leaning toward uploading it to BitBucket downloads as part of
 the release script.
 
 I'll put ez_setup.py for 0.7.2 in downloads for now. You can
 assume that's where the permalink will be.
 
 If anyone has a better suggestion, please raise it.
 
 I would prefer a URL on a host managed by the Python infrastructure
 team: either PyPI or the pythonhosted org.

And benefiting from the PyPI CDN would be great.

- -- 
Eric.
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.13 (Cygwin)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJRtQ1oAAoJENxauZFcKtNxHVsH/1AXswEmeQAjH/GuRqOmNoQH
uDIE6D/y3wrld0fyzejpKqponaaiiChvwqfFCL+TU47qsScOl9eyBAoylgeCvVoR
cAmeDlyrn52RILKE9F5p9BhAeFTtWdi+87LIvv3BWu0y/HdrWiYoCMA94xyolSF9
rLPb4hJuVlsau3+jcxi5iNtlTMRsyL1wYrygAmnp7tcJ3LiQ23SQI9kxhdGXvunY
vQvzptMEZOLktyX+5A4IPiFXzsuPkLY5RYD7F+7B/Sn6oH8TSNLEbmagP4U3C/bX
7TAMT4MDTs2tzcby/lKwveQeI7+3VIBrJ1bHhLgqvIBccwTe4iXV4o1lcgGDXgo=
=3NIb
-END PGP SIGNATURE-
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Jason R. Coombs
I think it would be highly desirable to add support for pip to handle the
upgrade from distribute 0.6 to 0.7. You'll note that because 0.7 depends on
setuptools 0.7 that 0.7 has already been downloaded. Perhaps a shim like you
propose would work, or it's also conceivable that distribute 0.7 could
include a setuptools 0.7 source tree which pip could leverage (but not
install).

 

Yes, PEP 439 will be awesome, but I think this important milestone for
setuptools is also essential to simplify the landscape in order to help
migrate users in a sustainable way to the new tools, so we've got to find a
way to make it happen for the good of the eco system.

 

From: qwe...@gmail.com [mailto:qwe...@gmail.com] On Behalf Of Marcus Smith
Sent: Sunday, 09 June, 2013 17:54
To: Jason R. Coombs
Cc: Liam Kirsher; distutils-sig@python.org
Subject: Re: [Distutils] Setuptools/Distribute error with 0.7.2

 

 

It was only working in python2 before now anyway.
(https://github.com/pypa/pip/issues/650)

pip is fundamentally dependent on setuptools to perform upgrades.

 

with distribute-0.6.X upgrades, even though pip uninstalled distribute as
part of the upgrade, it ran the install subprocess with the cwd equal to the
build dir, so it could import setuptools from the unpacked download.

but now,  distribute-0.7 is just a shell, that contains no importable
setuptools that pip can use.

we could *make* it work I guess, by enforcing non-standard logic when
dealing with distribute (i.e. get setuptools-0.7 installed first; by
default, setuptools gets queued to be installed after the distribute
upgrade)

but like I said before, it's much more motivating to think about PEP439,
than this dreary setuptools/distribute legacy headache stuff.

 

Marcus

 

 

the best fix I think is to move faster on making pip PEP439 compliant

   - i.e. have pip be able to at least install from wheels w/o needing
setuptools, which would remove the bootstrap headache

   - see https://github.com/pypa/pip/issues/863

   - this could likely involve pip replacing it's use of pkg_resources with
distlib (https://github.com/pypa/pip/pull/909)

 

Marcus   

 



smime.p7s
Description: S/MIME cryptographic signature
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] PyPI Download Counts

2013-06-09 Thread Nick Coghlan
On 10 June 2013 06:04, Alex Clark acl...@aclark.net wrote:
 Donald Stufft donald at stufft.io writes:

 So yes. I broke Download counts because they were not more important than
 people being able to actually use PyPI to install from.


 FWIW:


 You missed the moral of the story: when you make a decision like this,
 someone will *always* disagree with you (even over the most trivial things).
 And even if they don't, they may disagree with your approach (e.g. why not
 sort problems with download counts before enabling the CDN) So the only way
 to make everyone happy is to consider everyone who will be affected by your
 actions, before you take action.

And, indeed, we plan to run future changes of this magnitude through
the PEP process for exactly this reason. We can't promise not to break
some features in order to achieve gains we think are worth the loss,
but we *can* promise not to break such features without advance
warning and explicit consideration of alternatives that may allow us
to avoid the breakage in the first place.

Regards,
Nick.

--
Nick Coghlan   |   ncogh...@gmail.com   |   Brisbane, Australia
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Nick Coghlan
On 10 June 2013 11:37, Jason R. Coombs jar...@jaraco.com wrote:
 I think it would be highly desirable to add support for pip to handle the
 upgrade from distribute 0.6 to 0.7. You’ll note that because 0.7 depends on
 setuptools 0.7 that 0.7 has already been downloaded. Perhaps a shim like you
 propose would work, or it’s also conceivable that distribute 0.7 could
 include a setuptools 0.7 source tree which pip could leverage (but not
 install).

 Yes, PEP 439 will be awesome, but I think this important milestone for
 setuptools is also essential to simplify the landscape in order to help
 migrate users in a sustainable way to the new tools, so we’ve got to find a
 way to make it happen for the good of the eco system.

I believe Marcus's point was that if pip is using a vendored copy of
distlib to do the installs (rather than relying on a separately
installed instance of setuptools), then it would be able to
upgrade/downgrade setuptools and distribute in both Python 2 and
Python 3 without any dependency issues.

On the other hand, a near-term special casing of distribute to force
installing/upgrading setuptools 0.7 before upgrading distribute to 0.7
is likely a lower impact change to pip.

Regards,
Nick.

--
Nick Coghlan   |   ncogh...@gmail.com   |   Brisbane, Australia
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Nick Coghlan
On 10 June 2013 03:49, Jason R. Coombs jar...@jaraco.com wrote:
 I'm leaning toward uploading it to BitBucket downloads as part of the release
 script.

 I'll put ez_setup.py for 0.7.2 in downloads for now. You can assume that's
 where the permalink will be.

I think that's a good way to publish it securely to the PSF
infrastructure team (at least for now)

 If anyone has a better suggestion, please raise it.

As others have suggested, we should work with Donald and Noah to get
the bootstrapping script an official home somewhere on
pypi.python.org.

Cheers,
Nick.

--
Nick Coghlan   |   ncogh...@gmail.com   |   Brisbane, Australia
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools/Distribute error with 0.7.2

2013-06-09 Thread Marcus Smith
agreed, a quick fix for the upcoming pip-1.4 would be nice. (PEP439 is 1.5
at best)
here's the pip issue for this problem (set for 1.4)
https://github.com/pypa/pip/issues/986
I'll discuss options in the issue.
Marcus

On Sun, Jun 9, 2013 at 6:37 PM, Jason R. Coombs jar...@jaraco.com wrote:

 I think it would be highly desirable to add support for pip to handle the
 upgrade from distribute 0.6 to 0.7. You’ll note that because 0.7 depends on
 setuptools 0.7 that 0.7 has already been downloaded. Perhaps a shim like
 you propose would work, or it’s also conceivable that distribute 0.7 could
 include a setuptools 0.7 source tree which pip could leverage (but not
 install).

 ** **

 Yes, PEP 439 will be awesome, but I think this important milestone for
 setuptools is also essential to simplify the landscape in order to help
 migrate users in a sustainable way to the new tools, so we’ve got to find a
 way to make it happen for the good of the eco system.

 ** **

 *From:* qwe...@gmail.com [mailto:qwe...@gmail.com] *On Behalf Of *Marcus
 Smith
 *Sent:* Sunday, 09 June, 2013 17:54
 *To:* Jason R. Coombs
 *Cc:* Liam Kirsher; distutils-sig@python.org
 *Subject:* Re: [Distutils] Setuptools/Distribute error with 0.7.2

 ** **

 ** **

 It was only working in python2 before now anyway.  (
 https://github.com/pypa/pip/issues/650)

 pip is fundamentally dependent on setuptools to perform upgrades.

 ** **

 with distribute-0.6.X upgrades, even though pip uninstalled distribute as
 part of the upgrade, it ran the install subprocess with the cwd equal to
 the build dir, so it could import setuptools from the unpacked download.**
 **

 but now,  distribute-0.7 is just a shell, that contains no importable
 setuptools that pip can use.

 we could *make* it work I guess, by enforcing non-standard logic when
 dealing with distribute (i.e. get setuptools-0.7 installed first; by
 default, setuptools gets queued to be installed after the distribute
 upgrade)

 but like I said before, it's much more motivating to think about PEP439,
 than this dreary setuptools/distribute legacy headache stuff.

 ** **

 Marcus

 ** **

  

 the best fix I think is to move faster on making pip PEP439 compliant***
 *

- i.e. have pip be able to at least install from wheels w/o needing
 setuptools, which would remove the bootstrap headache

- see https://github.com/pypa/pip/issues/863

- this could likely involve pip replacing it's use of pkg_resources
 with distlib (https://github.com/pypa/pip/pull/909)

 ** **

 Marcus   

 ** **

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Donald Stufft

On Jun 9, 2013, at 9:51 PM, Nick Coghlan ncogh...@gmail.com wrote:

 On 10 June 2013 03:49, Jason R. Coombs jar...@jaraco.com wrote:
 I'm leaning toward uploading it to BitBucket downloads as part of the release
 script.
 
 I'll put ez_setup.py for 0.7.2 in downloads for now. You can assume that's
 where the permalink will be.
 
 I think that's a good way to publish it securely to the PSF
 infrastructure team (at least for now)
 
 If anyone has a better suggestion, please raise it.
 
 As others have suggested, we should work with Donald and Noah to get
 the bootstrapping script an official home somewhere on
 pypi.python.org.
 
 Cheers,
 Nick.
 
 --
 Nick Coghlan   |   ncogh...@gmail.com   |   Brisbane, Australia
 ___
 Distutils-SIG maillist  -  Distutils-SIG@python.org
 http://mail.python.org/mailman/listinfo/distutils-sig

If you want it under pypi.python.org it'll probably need manually sent to 
myself for the time being. I believe it could easily be hosted via python 
hosted.org though without needing manual intervention.

-
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig


Re: [Distutils] Setuptools 0.7.2 and Distribute 0.7 (compatibility wrapper) on PyPI

2013-06-09 Thread Tres Seaver
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 06/09/2013 10:28 PM, Donald Stufft wrote:
 
 On Jun 9, 2013, at 9:51 PM, Nick Coghlan ncogh...@gmail.com wrote:
 
 On 10 June 2013 03:49, Jason R. Coombs jar...@jaraco.com wrote:
 I'm leaning toward uploading it to BitBucket downloads as part of
 the release script.
 
 I'll put ez_setup.py for 0.7.2 in downloads for now. You can
 assume that's where the permalink will be.
 
 I think that's a good way to publish it securely to the PSF 
 infrastructure team (at least for now)
 
 If anyone has a better suggestion, please raise it.
 
 As others have suggested, we should work with Donald and Noah to
 get the bootstrapping script an official home somewhere on 
 pypi.python.org.
 
 If you want it under pypi.python.org it'll probably need manually
 sent to myself for the time being. I believe it could easily be hosted
 via python hosted.org though without needing manual intervention.

I'm not wedded to anyplace in particular.  Having the bootstrap needed to
make effective use of PyPI hosted on PyPI itself makes a lot of sense to
me.  Maybe under a URL like this one?

  https://pypi.python.org/bootstraps/ez_setup.py

The main key is that the URL should be immutable (so we can doucment it
widely, and use it in scripts) and have availability as good as the
cheeseshop (I'm not knocking Bitbucket in particular).

If the file were copied into the Sphinx docs uploaded to
pythonhosted.org, that would probably work just as well.


Tres.
- -- 
===
Tres Seaver  +1 540-429-0999  tsea...@palladion.com
Palladion Software   Excellence by Designhttp://palladion.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with undefined - http://www.enigmail.net/

iEYEARECAAYFAlG1PO8ACgkQ+gerLs4ltQ64WQCeO0tVhPBjlmzvtzdBx0C4V5Hr
lVAAniVJ4XuAnPfV7NXT7KvcextrrTaJ
=ILKd
-END PGP SIGNATURE-

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig