Re: [Python-Dev] speed.python.org (was: 2.7 is here until 2020, please don't call it a waste.)
> On Jun 22, 2015, at 6:58 PM, Zachary Ware > wrote: > > On Thu, Jun 4, 2015 at 10:51 AM, Maciej Fijalkowski wrote: >> On Thu, Jun 4, 2015 at 4:32 PM, R. David Murray >> wrote: >>> OK, so what you are saying is that speed.python.org will run a buildbot >>> slave so that when a change is committed to cPython, a speed run will be >>> triggered? Is "the runner" a normal buildbot slave, or something >>> custom? In the normal case the master controls what the slave >>> runs...but regardless, you'll need to let us know how the slave >>> invocation needs to be configured on the master. >> >> Ideally nightly (benchmarks take a while). The setup for pypy looks like >> this: >> >> >> https://bitbucket.org/pypy/buildbot/src/5fa1f1a4990f842dfbee416c4c2e2f6f75d451c4/bot2/pypybuildbot/builds.py?at=default#cl-734 >> >> so fairly easy. This already generates a json file that you can plot. >> We can setup an upload automatically too. > > I've been looking at what it will take to set up the buildmaster for > this, and it looks like it's just a matter of checking out the > benchmarks, building Python, testing it, and running the benchmarks. > There is the question of which benchmark repo to use: > https://bitbucket.org/pypy/benchmarks or > https://hg.python.org/benchmarks; ideally, we should use > hg.python.org/benchmarks for CPython benchmarks, but it looks like > pypy/benchmarks has the necessary runner, so I suppose we'll be using > it for now. Is there interest from both sides to merge those > repositories? PyPy’s is a more extensive suite but it does not fully support Python 3 yet. It makes sense to merge them. -- Philip Jenvey ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] speed.python.org (was: 2.7 is here until 2020, please don't call it a waste.)
On Thu, Jun 4, 2015 at 10:51 AM, Maciej Fijalkowski wrote: > On Thu, Jun 4, 2015 at 4:32 PM, R. David Murray wrote: >> OK, so what you are saying is that speed.python.org will run a buildbot >> slave so that when a change is committed to cPython, a speed run will be >> triggered? Is "the runner" a normal buildbot slave, or something >> custom? In the normal case the master controls what the slave >> runs...but regardless, you'll need to let us know how the slave >> invocation needs to be configured on the master. > > Ideally nightly (benchmarks take a while). The setup for pypy looks like this: > > > https://bitbucket.org/pypy/buildbot/src/5fa1f1a4990f842dfbee416c4c2e2f6f75d451c4/bot2/pypybuildbot/builds.py?at=default#cl-734 > > so fairly easy. This already generates a json file that you can plot. > We can setup an upload automatically too. I've been looking at what it will take to set up the buildmaster for this, and it looks like it's just a matter of checking out the benchmarks, building Python, testing it, and running the benchmarks. There is the question of which benchmark repo to use: https://bitbucket.org/pypy/benchmarks or https://hg.python.org/benchmarks; ideally, we should use hg.python.org/benchmarks for CPython benchmarks, but it looks like pypy/benchmarks has the necessary runner, so I suppose we'll be using it for now. Is there interest from both sides to merge those repositories? The big question for the buildmaster is what options to pass to the benchmark runner. I suppose most of them should match the CPythonBenchmark BuildFactory from the PyPy buildbot master configuration, but otherwise I'm not sure. The other big question is where the benchmarks will be run. The speed.python.org page makes it sound like there's a box intended for that purpose (the one running the speed.python.org page?); can anyone with access to it contact me to get the build slave set up? -- Zach ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] speed.python.org (was: 2.7 is here until 2020, please don't call it a waste.)
On Thu, Jun 4, 2015 at 4:32 PM, R. David Murray wrote: > On Thu, 04 Jun 2015 12:55:55 +0200, "M.-A. Lemburg" wrote: >> On 04.06.2015 04:08, Tetsuya Morimoto wrote: >> >> If someone were to volunteer to set up and run speed.python.org, I think >> > we could add some additional focus on performance regressions. Right now, >> > we don't have any way of reliably and reproducibly testing Python >> > performance. >> > >> > I'm very interested in speed.python.org and feel regret that the project is >> > standing still. I have a mind to contribute something ... >> >> On 03.06.2015 18:59, Maciej Fijalkowski wrote:> On Wed, Jun 3, 2015 at 3:49 >> PM, R. David Murray >> I think we should look into getting speed.python.org up and >> running for both Python 2 and 3 branches: >> >> https://speed.python.org/ >> >> What would it take to make that happen ? >> >>> >> >>> I guess ideal would be some cooperation from some of the cpython devs, >> >>> so say someone can setup cpython buildbot >> >> >> >> What does "set up cpython buildbot" mean in this context? >> > >> > The way it works is dual - there is a program running the benchmarks >> > (the runner) which is in the pypy case run by the pypy buildbot and >> > the web side that reports stuff. So someone who has access to cpython >> > buildbot would be useful. > > (I don't seem to have gotten a copy of Maciej's message, at least not > yet.) > > OK, so what you are saying is that speed.python.org will run a buildbot > slave so that when a change is committed to cPython, a speed run will be > triggered? Is "the runner" a normal buildbot slave, or something > custom? In the normal case the master controls what the slave > runs...but regardless, you'll need to let us know how the slave > invocation needs to be configured on the master. Ideally nightly (benchmarks take a while). The setup for pypy looks like this: https://bitbucket.org/pypy/buildbot/src/5fa1f1a4990f842dfbee416c4c2e2f6f75d451c4/bot2/pypybuildbot/builds.py?at=default#cl-734 so fairly easy. This already generates a json file that you can plot. We can setup an upload automatically too. > >> Ok, so there's interest and we have at least a few people who are >> willing to help. >> >> Now we need someone to take the lead on this and form a small >> project group to get everything implemented. Who would be up >> to such a task ? >> >> The speed project already has a mailing list, so you could use >> that for organizing the details. > > If it's a low volume list I'm willing to sign up, but regardless I'm > willing to help with the buildbot setup on the CPython side. (As soon > as my credential-update request gets through infrastructure, at least :) > > --David > ___ > Python-Dev mailing list > Python-Dev@python.org > https://mail.python.org/mailman/listinfo/python-dev > Unsubscribe: > https://mail.python.org/mailman/options/python-dev/fijall%40gmail.com ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] speed.python.org (was: 2.7 is here until 2020, please don't call it a waste.)
On Thu, 04 Jun 2015 12:55:55 +0200, "M.-A. Lemburg" wrote: > On 04.06.2015 04:08, Tetsuya Morimoto wrote: > >> If someone were to volunteer to set up and run speed.python.org, I think > > we could add some additional focus on performance regressions. Right now, > > we don't have any way of reliably and reproducibly testing Python > > performance. > > > > I'm very interested in speed.python.org and feel regret that the project is > > standing still. I have a mind to contribute something ... > > On 03.06.2015 18:59, Maciej Fijalkowski wrote:> On Wed, Jun 3, 2015 at 3:49 > PM, R. David Murray > I think we should look into getting speed.python.org up and > running for both Python 2 and 3 branches: > > https://speed.python.org/ > > What would it take to make that happen ? > >>> > >>> I guess ideal would be some cooperation from some of the cpython devs, > >>> so say someone can setup cpython buildbot > >> > >> What does "set up cpython buildbot" mean in this context? > > > > The way it works is dual - there is a program running the benchmarks > > (the runner) which is in the pypy case run by the pypy buildbot and > > the web side that reports stuff. So someone who has access to cpython > > buildbot would be useful. (I don't seem to have gotten a copy of Maciej's message, at least not yet.) OK, so what you are saying is that speed.python.org will run a buildbot slave so that when a change is committed to cPython, a speed run will be triggered? Is "the runner" a normal buildbot slave, or something custom? In the normal case the master controls what the slave runs...but regardless, you'll need to let us know how the slave invocation needs to be configured on the master. > Ok, so there's interest and we have at least a few people who are > willing to help. > > Now we need someone to take the lead on this and form a small > project group to get everything implemented. Who would be up > to such a task ? > > The speed project already has a mailing list, so you could use > that for organizing the details. If it's a low volume list I'm willing to sign up, but regardless I'm willing to help with the buildbot setup on the CPython side. (As soon as my credential-update request gets through infrastructure, at least :) --David ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] speed.python.org (was: 2.7 is here until 2020, please don't call it a waste.)
On 04.06.2015 04:08, Tetsuya Morimoto wrote: >> If someone were to volunteer to set up and run speed.python.org, I think > we could add some additional focus on performance regressions. Right now, > we don't have any way of reliably and reproducibly testing Python > performance. > > I'm very interested in speed.python.org and feel regret that the project is > standing still. I have a mind to contribute something ... On 03.06.2015 18:59, Maciej Fijalkowski wrote:> On Wed, Jun 3, 2015 at 3:49 PM, R. David Murray I think we should look into getting speed.python.org up and running for both Python 2 and 3 branches: https://speed.python.org/ What would it take to make that happen ? >>> >>> I guess ideal would be some cooperation from some of the cpython devs, >>> so say someone can setup cpython buildbot >> >> What does "set up cpython buildbot" mean in this context? > > The way it works is dual - there is a program running the benchmarks > (the runner) which is in the pypy case run by the pypy buildbot and > the web side that reports stuff. So someone who has access to cpython > buildbot would be useful. Ok, so there's interest and we have at least a few people who are willing to help. Now we need someone to take the lead on this and form a small project group to get everything implemented. Who would be up to such a task ? The speed project already has a mailing list, so you could use that for organizing the details. We could also create a PSF work group and assign a budget to it, if that helps. If you need help with all this, let me know. -- Marc-Andre Lemburg eGenix.com Professional Python Services directly from the Source (#1, Jun 04 2015) >>> Python Projects, Coaching and Consulting ... http://www.egenix.com/ >>> mxODBC Plone/Zope Database Adapter ... http://zope.egenix.com/ >>> mxODBC, mxDateTime, mxTextTools ...http://python.egenix.com/ : Try our mxODBC.Connect Python Database Interface for free ! :: eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg Registered at Amtsgericht Duesseldorf: HRB 46611 http://www.egenix.com/company/contact/ ___ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
