Re: [Distutils] PEP 438 - Transition Phase 1
On Sun, May 19, 2013 at 10:20 PM, Donald Stufft don...@stufft.io wrote: Hrm, ZPT doesn't seem to be stripping the CDATA or unescaping the strings? https://gist.github.com/dstufft/5608838 is what i have in the template file and that appears verbatim in the output? Yes? It will escape *data* inserted into the template (unless told not to), but what is in the template will appear in the output unescaped. I'm not sure how any template system can work otherwise, but perhaps I've been using Zope too long. :-) //Lennart ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Mon, May 20, 2013 at 02:21:05AM -0400, Donald Stufft wrote: On May 20, 2013, at 2:18 AM, Lennart Regebro rege...@gmail.com wrote: On Sun, May 19, 2013 at 10:20 PM, Donald Stufft don...@stufft.io wrote: Hrm, ZPT doesn't seem to be stripping the CDATA or unescaping the strings? https://gist.github.com/dstufft/5608838 is what i have in the template file and that appears verbatim in the output? Yes? It will escape *data* inserted into the template (unless told not to), but what is in the template will appear in the output unescaped. I'm not sure how any template system can work otherwise, but perhaps I've been using Zope too long. :-) //Lennart Maybe you can tell me what I'm doing wrong? Using zope.pagetemplate. ;) More seriously, zope.pagetemplate has two parsing modes: HTML and XML. Nobody actually uses the XML mode (pt files start with an ?xml? declaration, all tal/metal namespaces must be explicitly defined using xmlns:tal=url-that-nobody-can-remember). The HTML mode allows you to write Javascript just like you would do it in a browser, with no extra XML-quoting: script type=text/javascript if (1 2) alert(it works!); /script Does this not work for you? I'm currently looking at a Zope3 app that does precisely this in its working page templates. I need to insert a script tag with Javascript in it. Tres told me to put the contents of the script tag in CDATA blocks which I did, and then when the template was rendered it still had the CDATA blocks so it was invalid javascript. I seem to recall hacks of the form script ... // ![CDATA[ ... // ]] /script but I haven't seen one in a really long time. He also said to just put the javascript in the body of the script but xml escape it. Which I did, and when the template was rendered the data was still xml escaped and again invalid javascript. I think scripts in XHTML were supposed to be XML-escaped. AFAIU zope.pagetemplate was designed back when XHTML was supposed to be The Bright Future of the Web. Marius Gedminas -- Always proofread carefully to see if you any words out. signature.asc Description: Digital signature ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Mon, May 20, 2013 at 8:21 AM, Donald Stufft don...@stufft.io wrote: He also said to just put the javascript in the body of the script but xml escape it. Which I did, and when the template was rendered the data was still xml escaped and again invalid javascript. I think there is a misunderstanding. When you are putting it into the template itself, you typically don't need to do anything. You just add it to the template. //Lennart ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 20, 2013, at 2:44 AM, Marius Gedminas mar...@pov.lt wrote: On Mon, May 20, 2013 at 02:21:05AM -0400, Donald Stufft wrote: On May 20, 2013, at 2:18 AM, Lennart Regebro rege...@gmail.com wrote: On Sun, May 19, 2013 at 10:20 PM, Donald Stufft don...@stufft.io wrote: Hrm, ZPT doesn't seem to be stripping the CDATA or unescaping the strings? https://gist.github.com/dstufft/5608838 is what i have in the template file and that appears verbatim in the output? Yes? It will escape *data* inserted into the template (unless told not to), but what is in the template will appear in the output unescaped. I'm not sure how any template system can work otherwise, but perhaps I've been using Zope too long. :-) //Lennart Maybe you can tell me what I'm doing wrong? Using zope.pagetemplate. ;) More seriously, zope.pagetemplate has two parsing modes: HTML and XML. Nobody actually uses the XML mode (pt files start with an ?xml? declaration, all tal/metal namespaces must be explicitly defined using xmlns:tal=url-that-nobody-can-remember). The HTML mode allows you to write Javascript just like you would do it in a browser, with no extra XML-quoting: script type=text/javascript if (1 2) alert(it works!); /script Does this not work for you? I'm currently looking at a Zope3 app that does precisely this in its working page templates. Nope, copy/pasted that directly and this is what I got on page load (render): https://gist.github.com/dstufft/5611660 I think PyPI might be using XML mode because I seem to recall there being a comment or a commit message referencing the need to do something a particular way because we were in XML mode. I need to insert a script tag with Javascript in it. Tres told me to put the contents of the script tag in CDATA blocks which I did, and then when the template was rendered it still had the CDATA blocks so it was invalid javascript. I seem to recall hacks of the form script ... // ![CDATA[ ... // ]] /script but I haven't seen one in a really long time. He also said to just put the javascript in the body of the script but xml escape it. Which I did, and when the template was rendered the data was still xml escaped and again invalid javascript. I think scripts in XHTML were supposed to be XML-escaped. AFAIU zope.pagetemplate was designed back when XHTML was supposed to be The Bright Future of the Web. Marius Gedminas -- Always proofread carefully to see if you any words out. ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 20, 2013, at 2:44 AM, Marius Gedminas mar...@pov.lt wrote: On Mon, May 20, 2013 at 02:21:05AM -0400, Donald Stufft wrote: On May 20, 2013, at 2:18 AM, Lennart Regebro rege...@gmail.com wrote: On Sun, May 19, 2013 at 10:20 PM, Donald Stufft don...@stufft.io wrote: Hrm, ZPT doesn't seem to be stripping the CDATA or unescaping the strings? https://gist.github.com/dstufft/5608838 is what i have in the template file and that appears verbatim in the output? Yes? It will escape *data* inserted into the template (unless told not to), but what is in the template will appear in the output unescaped. I'm not sure how any template system can work otherwise, but perhaps I've been using Zope too long. :-) //Lennart Maybe you can tell me what I'm doing wrong? Using zope.pagetemplate. ;) More seriously, zope.pagetemplate has two parsing modes: HTML and XML. Nobody actually uses the XML mode (pt files start with an ?xml? declaration, all tal/metal namespaces must be explicitly defined using xmlns:tal=url-that-nobody-can-remember). The HTML mode allows you to write Javascript just like you would do it in a browser, with no extra XML-quoting: script type=text/javascript if (1 2) alert(it works!); /script Does this not work for you? I'm currently looking at a Zope3 app that does precisely this in its working page templates. I need to insert a script tag with Javascript in it. Tres told me to put the contents of the script tag in CDATA blocks which I did, and then when the template was rendered it still had the CDATA blocks so it was invalid javascript. I seem to recall hacks of the form script ... // ![CDATA[ ... // ]] /script but I haven't seen one in a really long time. Using this works though, so awesome! He also said to just put the javascript in the body of the script but xml escape it. Which I did, and when the template was rendered the data was still xml escaped and again invalid javascript. I think scripts in XHTML were supposed to be XML-escaped. AFAIU zope.pagetemplate was designed back when XHTML was supposed to be The Bright Future of the Web. Marius Gedminas -- Always proofread carefully to see if you any words out. ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
And the urls page now has a toggle all checkbox. Thanks again! On May 20, 2013, at 7:16 AM, Donald Stufft don...@stufft.io wrote: On May 20, 2013, at 2:44 AM, Marius Gedminas mar...@pov.lt wrote: On Mon, May 20, 2013 at 02:21:05AM -0400, Donald Stufft wrote: On May 20, 2013, at 2:18 AM, Lennart Regebro rege...@gmail.com wrote: On Sun, May 19, 2013 at 10:20 PM, Donald Stufft don...@stufft.io wrote: Hrm, ZPT doesn't seem to be stripping the CDATA or unescaping the strings? https://gist.github.com/dstufft/5608838 is what i have in the template file and that appears verbatim in the output? Yes? It will escape *data* inserted into the template (unless told not to), but what is in the template will appear in the output unescaped. I'm not sure how any template system can work otherwise, but perhaps I've been using Zope too long. :-) //Lennart Maybe you can tell me what I'm doing wrong? Using zope.pagetemplate. ;) More seriously, zope.pagetemplate has two parsing modes: HTML and XML. Nobody actually uses the XML mode (pt files start with an ?xml? declaration, all tal/metal namespaces must be explicitly defined using xmlns:tal=url-that-nobody-can-remember). The HTML mode allows you to write Javascript just like you would do it in a browser, with no extra XML-quoting: script type=text/javascript if (1 2) alert(it works!); /script Does this not work for you? I'm currently looking at a Zope3 app that does precisely this in its working page templates. I need to insert a script tag with Javascript in it. Tres told me to put the contents of the script tag in CDATA blocks which I did, and then when the template was rendered it still had the CDATA blocks so it was invalid javascript. I seem to recall hacks of the form script ... // ![CDATA[ ... // ]] /script but I haven't seen one in a really long time. Using this works though, so awesome! He also said to just put the javascript in the body of the script but xml escape it. Which I did, and when the template was rendered the data was still xml escaped and again invalid javascript. I think scripts in XHTML were supposed to be XML-escaped. AFAIU zope.pagetemplate was designed back when XHTML was supposed to be The Bright Future of the Web. Marius Gedminas -- Always proofread carefully to see if you any words out. ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 19, 2013, at 6:09 PM, PJ Eby p...@telecommunity.com wrote: On Sun, May 19, 2013 at 4:58 AM, holger krekel hol...@merlinux.eu wrote: Tensed to see how many people will switch without the mails I'll be waiting for the mails, myself, on account of I'm hoping it'll give me a nice list of which of my packages I can switch, so as not to need to go check on all of them myself. It occurred to me today, something I probably should have mentioned earlier in the PEP process, but it'd be nice to be able to switch off home page links without switching off download links. I never have anything to spider in my homepage links, only ever in the download links. Ah well, it'll probably be moot soon. If I understand the PEP correctly, I should be able to write a script that posts #md5-tagged links to my development snapshots, so I can include those directly instead of using directory spidering from the download URLs. Maybe I'll write an uplink command extension for setuptools to generate and send the links to PyPI, using the same hooks the upload command does. Then I could tie it straight into my build process for development snapshots, without having to run a separate script. Sorry I forgot to reply to this. Yes this is completely accurate as far as what you'll be able to do (and can do right now). Emails will be coming soon I hope, my processing of PyPI is in the o's now. Just a data point to show the difference this change can have on the large scale, I'm 3 days into processing all of PyPI looking for things that can be downloaded and isntalled and I'm only on the o's. For kicks I did the same thing but with spidering external sites turned off and it took about 10 minutes to process all of PyPI. - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On 19 May, 2013, at 2:51, Donald Stufft don...@stufft.io wrote: Forgot to mention, both of those options are available by clicking on urls when viewing a package you have permissions on, see: http://d.stufft.io/image/2h073q2L3Z29 I get a Forbidden error when following the urls link in Safari on OSX 10.8. The link does work properly with Chrome on the same machine. Ronald ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Sun, May 19, 2013 at 7:26 PM, Richard Jones rich...@python.org wrote:
Donald wrote a handy script to help make this easier:
https://pypi.python.org/pypi/pypi-show-urls
Doesn't seem to work for me:
$ pypi-show-urls -u pje
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.linux-i686/egg/pkg_resources.py, line 318, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 2221, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 1954, in load
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 24, in module
ImportError: No module named pip.req
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Mon, May 20, 2013 at 6:05 PM, PJ Eby p...@telecommunity.com wrote:
On Sun, May 19, 2013 at 7:26 PM, Richard Jones rich...@python.org wrote:
Donald wrote a handy script to help make this easier:
https://pypi.python.org/pypi/pypi-show-urls
Doesn't seem to work for me:
$ pypi-show-urls -u pje
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.linux-i686/egg/pkg_resources.py, line 318, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 2221, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 1954, in load
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 24, in module
ImportError: No module named pip.req
Do you have pip installed?
//Lennart
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
It requires pip because it process requirements files too. I don't think pip
works in install_requires though.
A few versions older didn't parse requirements files and didn't have pip
requirement.
On May 20, 2013, at 12:05 PM, PJ Eby p...@telecommunity.com wrote:
On Sun, May 19, 2013 at 7:26 PM, Richard Jones rich...@python.org wrote:
Donald wrote a handy script to help make this easier:
https://pypi.python.org/pypi/pypi-show-urls
Doesn't seem to work for me:
$ pypi-show-urls -u pje
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.linux-i686/egg/pkg_resources.py, line 318, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 2221, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 1954, in load
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 24, in module
ImportError: No module named pip.req
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Mon, May 20, 2013 at 1:03 PM, Lennart Regebro rege...@gmail.com wrote:
On Mon, May 20, 2013 at 6:05 PM, PJ Eby p...@telecommunity.com wrote:
On Sun, May 19, 2013 at 7:26 PM, Richard Jones rich...@python.org wrote:
Donald wrote a handy script to help make this easier:
https://pypi.python.org/pypi/pypi-show-urls
Doesn't seem to work for me:
$ pypi-show-urls -u pje
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.linux-i686/egg/pkg_resources.py, line 318, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 2221, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 1954, in load
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 24, in module
ImportError: No module named pip.req
Do you have pip installed?
No, but installing it didn't help; I got an ElementTree exception next:
$ pypi-show-urls -u pje
Download candidates for PEAK
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 148, in main
File /usr/lib/python2.6/xml/etree/ElementPath.py, line 198, in findall
return _compile(path).findall(element)
File /usr/lib/python2.6/xml/etree/ElementPath.py, line 176, in _compile
p = Path(path)
File /usr/lib/python2.6/xml/etree/ElementPath.py, line 93, in __init__
expected path separator (%s) % (op or tag)
SyntaxError: expected path separator ([)
(And of course the package should specify that it has an install-time
requirement for pip.)
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
Someone else got that error on 2.6 they said 2.7 worked for them. I wasn't able
to reproduce on either 2.6 or 2.7.
I can add the dep info when I get home. Currently sitting in the ER for my
wife.
On May 20, 2013, at 3:20 PM, PJ Eby p...@telecommunity.com wrote:
On Mon, May 20, 2013 at 1:03 PM, Lennart Regebro rege...@gmail.com wrote:
On Mon, May 20, 2013 at 6:05 PM, PJ Eby p...@telecommunity.com wrote:
On Sun, May 19, 2013 at 7:26 PM, Richard Jones rich...@python.org wrote:
Donald wrote a handy script to help make this easier:
https://pypi.python.org/pypi/pypi-show-urls
Doesn't seem to work for me:
$ pypi-show-urls -u pje
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.linux-i686/egg/pkg_resources.py, line 318, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 2221, in
load_entry_point
File build/bdist.linux-i686/egg/pkg_resources.py, line 1954, in load
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 24, in module
ImportError: No module named pip.req
Do you have pip installed?
No, but installing it didn't help; I got an ElementTree exception next:
$ pypi-show-urls -u pje
Download candidates for PEAK
Traceback (most recent call last):
File /usr/bin/pypi-show-urls, line 8, in module
load_entry_point('pypi-show-urls==2.1.1', 'console_scripts',
'pypi-show-urls')()
File build/bdist.cygwin-1.7.15-i686/egg/pypi_show_urls/__main__.py,
line 148, in main
File /usr/lib/python2.6/xml/etree/ElementPath.py, line 198, in findall
return _compile(path).findall(element)
File /usr/lib/python2.6/xml/etree/ElementPath.py, line 176, in _compile
p = Path(path)
File /usr/lib/python2.6/xml/etree/ElementPath.py, line 93, in __init__
expected path separator (%s) % (op or tag)
SyntaxError: expected path separator ([)
(And of course the package should specify that it has an install-time
requirement for pip.)
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
___
Distutils-SIG maillist - Distutils-SIG@python.org
http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 19, 2013, at 12:00 AM, Donald Stufft don...@stufft.io wrote: On May 18, 2013, at 8:51 PM, Donald Stufft don...@stufft.io wrote: On May 18, 2013, at 8:50 PM, Donald Stufft don...@stufft.io wrote: Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig Forgot to mention, both of those options are available by clicking on urls when viewing a package you have permissions on, see: http://d.stufft.io/image/2h073q2L3Z29 - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig Made a little app to see how many urls need to be scraped in order to install any particular package (or all the packages for a user): https://pypi.python.org/pypi/pypi-show-urls It also shows how many packages are not available from PyPI. - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig And one more app: http://pypi-externals.caremad.io/ Also shows per package: http://pypi-externals.caremad.io/setuptools/ - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Sat, May 18, 2013 at 20:50 -0400, Donald Stufft wrote: Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index Many thanks, Donald, for your great work on this and also to Richard, for getting this live! Just switched pytest, execnet, pytest-xdist, tox and some more projects and it worked fine! Tensed to see how many people will switch without the mails, probably also depends on everybody making a bit of buzz :) Just quickly blogged a about it: http://holgerkrekel.net/2013/05/19/pep438-is-live-speed-up-python-package-installs-now/ . cheers, holger What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 05/18/2013 08:50 PM, Donald Stufft wrote: Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). I would be glad to update all my packages to explicit mode, but would prefer to be able to do that in a single batch (clicking through to 250 or so to set it will be tedious). It would be good to automate removing all external URLs previously sniffed from the long-description, too. Tres. - -- === Tres Seaver +1 540-429-0999 tsea...@palladion.com Palladion Software Excellence by Designhttp://palladion.com -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iEYEARECAAYFAlGY5dkACgkQ+gerLs4ltQ5q7ACeOz96JWSdd7+cC8LNTlU7YzpF mIEAmwVURbJGsoYQPGBns+1XK4lY3bwN =/Uyr -END PGP SIGNATURE- ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 19, 2013, at 10:46 AM, Tres Seaver tsea...@palladion.com wrote: Signed PGP part On 05/18/2013 08:50 PM, Donald Stufft wrote: Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). I would be glad to update all my packages to explicit mode, but would prefer to be able to do that in a single batch (clicking through to 250 or so to set it will be tedious). It would be good to automate removing all external URLs previously sniffed from the long-description, too. Yea, as soon as I figure out how to embed arbitrary javascript into a zope.pagetemplate there will be a toggle checked for all thing. Tres. - -- === Tres Seaver +1 540-429-0999 tsea...@palladion.com Palladion Software Excellence by Designhttp://palladion.com ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On Sun, May 19, 2013 at 4:58 AM, holger krekel hol...@merlinux.eu wrote: Tensed to see how many people will switch without the mails I'll be waiting for the mails, myself, on account of I'm hoping it'll give me a nice list of which of my packages I can switch, so as not to need to go check on all of them myself. It occurred to me today, something I probably should have mentioned earlier in the PEP process, but it'd be nice to be able to switch off home page links without switching off download links. I never have anything to spider in my homepage links, only ever in the download links. Ah well, it'll probably be moot soon. If I understand the PEP correctly, I should be able to write a script that posts #md5-tagged links to my development snapshots, so I can include those directly instead of using directory spidering from the download URLs. Maybe I'll write an uplink command extension for setuptools to generate and send the links to PyPI, using the same hooks the upload command does. Then I could tie it straight into my build process for development snapshots, without having to run a separate script. ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On 20 May 2013 08:09, PJ Eby p...@telecommunity.com wrote: On Sun, May 19, 2013 at 4:58 AM, holger krekel hol...@merlinux.eu wrote: Tensed to see how many people will switch without the mails I'll be waiting for the mails, myself, on account of I'm hoping it'll give me a nice list of which of my packages I can switch, so as not to need to go check on all of them myself. Donald wrote a handy script to help make this easier: https://pypi.python.org/pypi/pypi-show-urls Richard ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 19, 2013, at 7:26 PM, Richard Jones rich...@python.org wrote: On 20 May 2013 08:09, PJ Eby p...@telecommunity.com wrote: On Sun, May 19, 2013 at 4:58 AM, holger krekel hol...@merlinux.eu wrote: Tensed to see how many people will switch without the mails I'll be waiting for the mails, myself, on account of I'm hoping it'll give me a nice list of which of my packages I can switch, so as not to need to go check on all of them myself. Donald wrote a handy script to help make this easier: https://pypi.python.org/pypi/pypi-show-urls Richard ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig The emails will still go out of course, it just takes awhile to spider all of PyPI :) - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
[Distutils] PEP 438 - Transition Phase 1
Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 18, 2013, at 8:50 PM, Donald Stufft don...@stufft.io wrote: Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig Forgot to mention, both of those options are available by clicking on urls when viewing a package you have permissions on, see: http://d.stufft.io/image/2h073q2L3Z29 - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Re: [Distutils] PEP 438 - Transition Phase 1
On May 18, 2013, at 8:51 PM, Donald Stufft don...@stufft.io wrote: On May 18, 2013, at 8:50 PM, Donald Stufft don...@stufft.io wrote: Phase 1 of PEP 438 (http://www.python.org/dev/peps/pep-0438/) has begun. Deployed to production PyPI is: - New packages default to pypi-explicit - Old packages default to pypi-scrape-crawl - Package Maintainers can select which hosting mode to use - Package Maintainers can control what urls show up on their /simple/ index What's still happening: - All existing packages will be processed to determine if they host files on PyPI, if they host files externally but link directly, or if they Host files externally and require scraping the home or download url pages. - Taking the data obtained from processing email users to tell them if their package can be moved to a more restrictive download option (e.g. all their versions are installable directly from PyPI, or from a direct link from PyPI). - A Month after that actually moving them to their detected new hosting mode (if possible on a per project basis). - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig Forgot to mention, both of those options are available by clicking on urls when viewing a package you have permissions on, see: http://d.stufft.io/image/2h073q2L3Z29 - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig Made a little app to see how many urls need to be scraped in order to install any particular package (or all the packages for a user): https://pypi.python.org/pypi/pypi-show-urls It also shows how many packages are not available from PyPI. - Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA signature.asc Description: Message signed with OpenPGP using GPGMail ___ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
