Re: [Python-Dev] zipimport
On Tue, 02 Jun 2015 21:20:10 + Brett Cannon wrote: > > I vaguely remember people suggesting writing the minimal zip reading code > in C but I can't remember why since we have I/O access in importlib through > _io and thus it's really just the pulling apart of the zip file to get at > the files to import and thus should be doable in pure Python. You would need other modules, such as struct and zlib, right? Regards Antoine. ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] 2.7 is here until 2020, please don't call it a waste.
On 02.06.2015 21:07, Maciej Fijalkowski wrote: > Hi > > There was a PSF-sponsored effort to improve the situation with the > https://bitbucket.org/pypy/codespeed2/src being written (thank you > PSF). It's not better enough than codespeed that I would like, but > gives some opportunities. > > That said, we have a benchmark machine for benchmarking cpython and I > never deployed nightly benchmarks of cpython for a variety of reasons. > > * would be cool to get a small VM to set up the web front > > * people told me that py3k is only interesting, so I did not set it up > for py3k because benchmarks are mostly missing > > I'm willing to set up a nightly speed.python.org using nightly build > on python 2 and possible python 3 if there is an interest. I need > support from someone maintaining python buildbot to setup builds and a > VM to set up stuff, otherwise I'm good to go > > DISCLAIMER: I did facilitate in codespeed rewrite that was not as > successful as I would have hoped. I did not receive any money from the > PSF on that though. I think we should look into getting speed.python.org up and running for both Python 2 and 3 branches: https://speed.python.org/ What would it take to make that happen ? > Cheers, > fijal > > > On Mon, Jun 1, 2015 at 1:14 PM, M.-A. Lemburg wrote: >> On 01.06.2015 12:44, Armin Rigo wrote: >>> Hi Larry, >>> >>> On 31 May 2015 at 01:20, Larry Hastings wrote: p.s. Supporting this patch also helps cut into PyPy's reported performance lead--that is, if they ever upgrade speed.pypy.org from comparing against Python *2.7.2*. >>> >>> Right, we should do this upgrade when 2.7.11 is out. >>> >>> There is some irony in your comment which seems to imply "PyPy is >>> cheating by comparing with an old Python 2.7.2": it is inside a thread >>> which started because "we didn't backport performance improvements to >>> 2.7.x so far". >>> >>> Just to convince myself, I just ran a performance comparison. I ran >>> the same benchmark suite as speed.pypy.org, with 2.7.2 against 2.7.10, >>> both freshly compiled with no "configure" options at all. The >>> differences are usually in the noise, but range from +5% to... -60%. >>> If anything, this seems to show that CPython should take more care >>> about performance regressions. If someone is interested: >>> >>> * "raytrace-simple" is 1.19 times slower >>> * "bm_mako" is 1.29 times slower >>> * "spitfire_cstringio" is 1.60 times slower >>> * a number of other benchmarks are around 1.08. >>> >>> The "7.0x faster" number on speed.pypy.org would be significantly >>> *higher* if we upgraded the baseline to 2.7.10 now. >> >> If someone were to volunteer to set up and run speed.python.org, >> I think we could add some additional focus on performance >> regressions. Right now, we don't have any way of reliably >> and reproducibly testing Python performance. >> >> Hint: The PSF would most likely fund such adventures :-) >> >> -- >> Marc-Andre Lemburg >> eGenix.com >> >> Professional Python Services directly from the Source (#1, Jun 01 2015) > Python Projects, Coaching and Consulting ... http://www.egenix.com/ > mxODBC Plone/Zope Database Adapter ... http://zope.egenix.com/ > mxODBC, mxDateTime, mxTextTools ...http://python.egenix.com/ >> >> >> : Try our mxODBC.Connect Python Database Interface for free ! :: >> >>eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 >> D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg >>Registered at Amtsgericht Duesseldorf: HRB 46611 >>http://www.egenix.com/company/contact/ >> ___ >> Python-Dev mailing list >> Python-Dev@python.org >> https://mail.python.org/mailman/listinfo/python-dev >> Unsubscribe: >> https://mail.python.org/mailman/options/python-dev/fijall%40gmail.com > ___ > Python-Dev mailing list > Python-Dev@python.org > https://mail.python.org/mailman/listinfo/python-dev > Unsubscribe: > https://mail.python.org/mailman/options/python-dev/mal%40egenix.com > -- Marc-Andre Lemburg eGenix.com Professional Python Services directly from the Source (#1, Jun 03 2015) >>> Python Projects, Coaching and Consulting ... http://www.egenix.com/ >>> mxODBC Plone/Zope Database Adapter ... http://zope.egenix.com/ >>> mxODBC, mxDateTime, mxTextTools ...http://python.egenix.com/ : Try our mxODBC.Connect Python Database Interface for free ! :: eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg Registered at Amtsgericht Duesseldorf: HRB 46611 http://www.egenix.com/company/contact/ ___ Python-Dev
Re: [Python-Dev] 2.7 is here until 2020, please don't call it a waste.
On Wed, Jun 3, 2015 at 11:38 AM, M.-A. Lemburg wrote: > On 02.06.2015 21:07, Maciej Fijalkowski wrote: >> Hi >> >> There was a PSF-sponsored effort to improve the situation with the >> https://bitbucket.org/pypy/codespeed2/src being written (thank you >> PSF). It's not better enough than codespeed that I would like, but >> gives some opportunities. >> >> That said, we have a benchmark machine for benchmarking cpython and I >> never deployed nightly benchmarks of cpython for a variety of reasons. >> >> * would be cool to get a small VM to set up the web front >> >> * people told me that py3k is only interesting, so I did not set it up >> for py3k because benchmarks are mostly missing >> >> I'm willing to set up a nightly speed.python.org using nightly build >> on python 2 and possible python 3 if there is an interest. I need >> support from someone maintaining python buildbot to setup builds and a >> VM to set up stuff, otherwise I'm good to go >> >> DISCLAIMER: I did facilitate in codespeed rewrite that was not as >> successful as I would have hoped. I did not receive any money from the >> PSF on that though. > > I think we should look into getting speed.python.org up and > running for both Python 2 and 3 branches: > > https://speed.python.org/ > > What would it take to make that happen ? I guess ideal would be some cooperation from some of the cpython devs, so say someone can setup cpython buildbot ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] 2.7 is here until 2020, please don't call it a waste.
On Wed, 03 Jun 2015 12:04:10 +0200, Maciej Fijalkowski wrote: > On Wed, Jun 3, 2015 at 11:38 AM, M.-A. Lemburg wrote: > > On 02.06.2015 21:07, Maciej Fijalkowski wrote: > >> Hi > >> > >> There was a PSF-sponsored effort to improve the situation with the > >> https://bitbucket.org/pypy/codespeed2/src being written (thank you > >> PSF). It's not better enough than codespeed that I would like, but > >> gives some opportunities. > >> > >> That said, we have a benchmark machine for benchmarking cpython and I > >> never deployed nightly benchmarks of cpython for a variety of reasons. > >> > >> * would be cool to get a small VM to set up the web front > >> > >> * people told me that py3k is only interesting, so I did not set it up > >> for py3k because benchmarks are mostly missing > >> > >> I'm willing to set up a nightly speed.python.org using nightly build > >> on python 2 and possible python 3 if there is an interest. I need > >> support from someone maintaining python buildbot to setup builds and a > >> VM to set up stuff, otherwise I'm good to go > >> > >> DISCLAIMER: I did facilitate in codespeed rewrite that was not as > >> successful as I would have hoped. I did not receive any money from the > >> PSF on that though. > > > > I think we should look into getting speed.python.org up and > > running for both Python 2 and 3 branches: > > > > https://speed.python.org/ > > > > What would it take to make that happen ? > > I guess ideal would be some cooperation from some of the cpython devs, > so say someone can setup cpython buildbot What does "set up cpython buildbot" mean in this context? --David ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] zipimport
On Wed, Jun 3, 2015 at 5:00 AM Antoine Pitrou wrote: > On Tue, 02 Jun 2015 21:20:10 + > Brett Cannon wrote: > > > > I vaguely remember people suggesting writing the minimal zip reading code > > in C but I can't remember why since we have I/O access in importlib > through > > _io and thus it's really just the pulling apart of the zip file to get at > > the files to import and thus should be doable in pure Python. > > You would need other modules, such as struct and zlib, right? > zlib yes, but that's already a C extension so that could get compiled in as a built-in module if necessary. As for struct, it might be nice but it doesn't provide any functionality that couldn't be reproduced manually. ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] 2.7 is here until 2020, please don't call it a waste.
On Wed, Jun 3, 2015 at 3:49 PM, R. David Murray wrote: > On Wed, 03 Jun 2015 12:04:10 +0200, Maciej Fijalkowski > wrote: >> On Wed, Jun 3, 2015 at 11:38 AM, M.-A. Lemburg wrote: >> > On 02.06.2015 21:07, Maciej Fijalkowski wrote: >> >> Hi >> >> >> >> There was a PSF-sponsored effort to improve the situation with the >> >> https://bitbucket.org/pypy/codespeed2/src being written (thank you >> >> PSF). It's not better enough than codespeed that I would like, but >> >> gives some opportunities. >> >> >> >> That said, we have a benchmark machine for benchmarking cpython and I >> >> never deployed nightly benchmarks of cpython for a variety of reasons. >> >> >> >> * would be cool to get a small VM to set up the web front >> >> >> >> * people told me that py3k is only interesting, so I did not set it up >> >> for py3k because benchmarks are mostly missing >> >> >> >> I'm willing to set up a nightly speed.python.org using nightly build >> >> on python 2 and possible python 3 if there is an interest. I need >> >> support from someone maintaining python buildbot to setup builds and a >> >> VM to set up stuff, otherwise I'm good to go >> >> >> >> DISCLAIMER: I did facilitate in codespeed rewrite that was not as >> >> successful as I would have hoped. I did not receive any money from the >> >> PSF on that though. >> > >> > I think we should look into getting speed.python.org up and >> > running for both Python 2 and 3 branches: >> > >> > https://speed.python.org/ >> > >> > What would it take to make that happen ? >> >> I guess ideal would be some cooperation from some of the cpython devs, >> so say someone can setup cpython buildbot > > What does "set up cpython buildbot" mean in this context? The way it works is dual - there is a program running the benchmarks (the runner) which is in the pypy case run by the pypy buildbot and the web side that reports stuff. So someone who has access to cpython buildbot would be useful. ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] 2.7 is here until 2020, please don't call it a waste.
> If someone were to volunteer to set up and run speed.python.org, I think we could add some additional focus on performance regressions. Right now, we don't have any way of reliably and reproducibly testing Python performance. I'm very interested in speed.python.org and feel regret that the project is standing still. I have a mind to contribute something ... thanks, Tetsuya On Mon, Jun 1, 2015 at 8:14 PM, M.-A. Lemburg wrote: > On 01.06.2015 12:44, Armin Rigo wrote: > > Hi Larry, > > > > On 31 May 2015 at 01:20, Larry Hastings wrote: > >> p.s. Supporting this patch also helps cut into PyPy's reported > performance > >> lead--that is, if they ever upgrade speed.pypy.org from comparing > against > >> Python *2.7.2*. > > > > Right, we should do this upgrade when 2.7.11 is out. > > > > There is some irony in your comment which seems to imply "PyPy is > > cheating by comparing with an old Python 2.7.2": it is inside a thread > > which started because "we didn't backport performance improvements to > > 2.7.x so far". > > > > Just to convince myself, I just ran a performance comparison. I ran > > the same benchmark suite as speed.pypy.org, with 2.7.2 against 2.7.10, > > both freshly compiled with no "configure" options at all. The > > differences are usually in the noise, but range from +5% to... -60%. > > If anything, this seems to show that CPython should take more care > > about performance regressions. If someone is interested: > > > > * "raytrace-simple" is 1.19 times slower > > * "bm_mako" is 1.29 times slower > > * "spitfire_cstringio" is 1.60 times slower > > * a number of other benchmarks are around 1.08. > > > > The "7.0x faster" number on speed.pypy.org would be significantly > > *higher* if we upgraded the baseline to 2.7.10 now. > > If someone were to volunteer to set up and run speed.python.org, > I think we could add some additional focus on performance > regressions. Right now, we don't have any way of reliably > and reproducibly testing Python performance. > > Hint: The PSF would most likely fund such adventures :-) > > -- > Marc-Andre Lemburg > eGenix.com > > Professional Python Services directly from the Source (#1, Jun 01 2015) > >>> Python Projects, Coaching and Consulting ... http://www.egenix.com/ > >>> mxODBC Plone/Zope Database Adapter ... http://zope.egenix.com/ > >>> mxODBC, mxDateTime, mxTextTools ...http://python.egenix.com/ > > > : Try our mxODBC.Connect Python Database Interface for free ! :: > >eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 > D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg >Registered at Amtsgericht Duesseldorf: HRB 46611 >http://www.egenix.com/company/contact/ > ___ > Python-Dev mailing list > Python-Dev@python.org > https://mail.python.org/mailman/listinfo/python-dev > Unsubscribe: > https://mail.python.org/mailman/options/python-dev/tetsuya.morimoto%40gmail.com > ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] zipimport
On 06/03/2015 08:56 AM, Antoine Pitrou wrote: Le 03/06/2015 14:34, Rose Ames a écrit : On 06/03/2015 04:59 AM, Antoine Pitrou wrote: On Tue, 02 Jun 2015 21:20:10 + Brett Cannon wrote: I vaguely remember people suggesting writing the minimal zip reading code in C but I can't remember why since we have I/O access in importlib through _io and thus it's really just the pulling apart of the zip file to get at the files to import and thus should be doable in pure Python. You would need other modules, such as struct and zlib, right? zlib is already required for compressed zips: https://github.com/python/cpython/blob/master/Modules/zipimport.c#L1030 Ah, the C code already importing the zlib module? Then I guess it's fine :-) Do some companies zip the standard library or something? I don't know. If they do so, they probably exclude the zlib module in some way. Regards Antoine. Sounds like I can just add a zipimporter to Lib/importlib/_bootstrap.py and remove zipimport.c entirely, is that right? ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
