Re: [Python-Dev] Information about how cpython in benchmarked
On Wed, Mar 30, 2011 at 1:19 AM, Nick Stinemates wrote: > This is really great to hear and something I would be hugely interested in > contributing to. > Lurking has paid off :) > Nick > Once I get the machine in place, and the team engaged, I am sure they'll be looking for help. As it stands, the best place to start helping is by getting in conact with the speed.pypy.org team (the pypy folks) and look into the codespeed codebase. We have to start work on it now to get it ready to be more general use. jesse ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Information about how cpython in benchmarked
This is really great to hear and something I would be hugely interested in contributing to. Lurking has paid off :) Nick On Tue, Mar 29, 2011 at 4:00 AM, Nick Coghlan wrote: > On Tue, Mar 29, 2011 at 8:01 PM, Tennessee Leeuwenburg > wrote: > > PyPy maintains http://speed.pypy.org/, which provides very clear > information > > about the relative performance of PyPy trunk against some version of > cpython > > (presumably 2.6 or 2.7). I'm not aware of a similar site for cpython, but > > that could easily just be my ignorance speaking. > > My interest is that I'm looking at building a benchmarking solution at > work. > > and I can't think of a better way to build something good and general > than > > to try and write something that could potentially be released as open > source > > and be useful to others. As such I thought that benchmarking cpython > would > > be a great use case, but I want to find out as much as I can about how > > people currently go about benchmarking Python. Initially I'm just looking > at > > CPU profiling since it's easiest. > > One of the points coming out of the VM summit at Pycon is actually > that we want to create a shared benchmarking site for CPython, PyPy, > Jython, IronPython (and possibly Stackless) under the python.org > banner (either speed.python.org, or possibly performance.python.org, > since we want to do memory profiling as well). > > speed.pypy.org will be the reference site for this, but Maciej > indicated at the VM summit that the code that runs that site needs > some improvements before it will really be up to the task of > effectively benchmarking multiple targets. > > So, according to http://speed.pypy.org/about/, the place to start with > your benchmarking system would probably be > https://github.com/tobami/codespeed. > > Cheers, > Nick. > > -- > Nick Coghlan | ncogh...@gmail.com | Brisbane, Australia > ___ > Python-Dev mailing list > Python-Dev@python.org > http://mail.python.org/mailman/listinfo/python-dev > Unsubscribe: > http://mail.python.org/mailman/options/python-dev/nstinemates%40gmail.com > ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Information about how cpython in benchmarked
Hi Nick, Jesse, Thanks both for your responses, it's much appreciated! It's very useful to have a clear pointer to the right place to begin looking. Regards, -Tennessee On Tue, Mar 29, 2011 at 10:47 PM, Jesse Noller wrote: > On Tue, Mar 29, 2011 at 7:00 AM, Nick Coghlan wrote: > > On Tue, Mar 29, 2011 at 8:01 PM, Tennessee Leeuwenburg > > wrote: > >> PyPy maintains http://speed.pypy.org/, which provides very clear > information > >> about the relative performance of PyPy trunk against some version of > cpython > >> (presumably 2.6 or 2.7). I'm not aware of a similar site for cpython, > but > >> that could easily just be my ignorance speaking. > >> My interest is that I'm looking at building a benchmarking solution at > work. > >> and I can't think of a better way to build something good and general > than > >> to try and write something that could potentially be released as open > source > >> and be useful to others. As such I thought that benchmarking cpython > would > >> be a great use case, but I want to find out as much as I can about how > >> people currently go about benchmarking Python. Initially I'm just > looking at > >> CPU profiling since it's easiest. > > > > One of the points coming out of the VM summit at Pycon is actually > > that we want to create a shared benchmarking site for CPython, PyPy, > > Jython, IronPython (and possibly Stackless) under the python.org > > banner (either speed.python.org, or possibly performance.python.org, > > since we want to do memory profiling as well). > > > > speed.pypy.org will be the reference site for this, but Maciej > > indicated at the VM summit that the code that runs that site needs > > some improvements before it will really be up to the task of > > effectively benchmarking multiple targets. > > > > So, according to http://speed.pypy.org/about/, the place to start with > > your benchmarking system would probably be > > https://github.com/tobami/codespeed. > > > > Cheers, > > Nick. > > Essentially echoing what nick said. I'm currently working on getting > the HW for this together. > -- -- Tennessee Leeuwenburg http://myownhat.blogspot.com/ "Don't believe everything you think" ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Information about how cpython in benchmarked
On Tue, Mar 29, 2011 at 7:00 AM, Nick Coghlan wrote: > On Tue, Mar 29, 2011 at 8:01 PM, Tennessee Leeuwenburg > wrote: >> PyPy maintains http://speed.pypy.org/, which provides very clear information >> about the relative performance of PyPy trunk against some version of cpython >> (presumably 2.6 or 2.7). I'm not aware of a similar site for cpython, but >> that could easily just be my ignorance speaking. >> My interest is that I'm looking at building a benchmarking solution at work. >> and I can't think of a better way to build something good and general than >> to try and write something that could potentially be released as open source >> and be useful to others. As such I thought that benchmarking cpython would >> be a great use case, but I want to find out as much as I can about how >> people currently go about benchmarking Python. Initially I'm just looking at >> CPU profiling since it's easiest. > > One of the points coming out of the VM summit at Pycon is actually > that we want to create a shared benchmarking site for CPython, PyPy, > Jython, IronPython (and possibly Stackless) under the python.org > banner (either speed.python.org, or possibly performance.python.org, > since we want to do memory profiling as well). > > speed.pypy.org will be the reference site for this, but Maciej > indicated at the VM summit that the code that runs that site needs > some improvements before it will really be up to the task of > effectively benchmarking multiple targets. > > So, according to http://speed.pypy.org/about/, the place to start with > your benchmarking system would probably be > https://github.com/tobami/codespeed. > > Cheers, > Nick. Essentially echoing what nick said. I'm currently working on getting the HW for this together. ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Information about how cpython in benchmarked
On Tue, Mar 29, 2011 at 8:01 PM, Tennessee Leeuwenburg wrote: > PyPy maintains http://speed.pypy.org/, which provides very clear information > about the relative performance of PyPy trunk against some version of cpython > (presumably 2.6 or 2.7). I'm not aware of a similar site for cpython, but > that could easily just be my ignorance speaking. > My interest is that I'm looking at building a benchmarking solution at work. > and I can't think of a better way to build something good and general than > to try and write something that could potentially be released as open source > and be useful to others. As such I thought that benchmarking cpython would > be a great use case, but I want to find out as much as I can about how > people currently go about benchmarking Python. Initially I'm just looking at > CPU profiling since it's easiest. One of the points coming out of the VM summit at Pycon is actually that we want to create a shared benchmarking site for CPython, PyPy, Jython, IronPython (and possibly Stackless) under the python.org banner (either speed.python.org, or possibly performance.python.org, since we want to do memory profiling as well). speed.pypy.org will be the reference site for this, but Maciej indicated at the VM summit that the code that runs that site needs some improvements before it will really be up to the task of effectively benchmarking multiple targets. So, according to http://speed.pypy.org/about/, the place to start with your benchmarking system would probably be https://github.com/tobami/codespeed. Cheers, Nick. -- Nick Coghlan | ncogh...@gmail.com | Brisbane, Australia ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
[Python-Dev] Information about how cpython in benchmarked
Hi all, Apologies for emailing this list with such an apparently trivial question. Is there some source of documentation or information on how Python is benchmarked? I am aware of the Python regression testing module, regrtest.py, which I presume, if profiled, would good be a good baseline test. PyPy maintains http://speed.pypy.org/, which provides very clear information about the relative performance of PyPy trunk against some version of cpython (presumably 2.6 or 2.7). I'm not aware of a similar site for cpython, but that could easily just be my ignorance speaking. My interest is that I'm looking at building a benchmarking solution at work. and I can't think of a better way to build something good and general than to try and write something that could potentially be released as open source and be useful to others. As such I thought that benchmarking cpython would be a great use case, but I want to find out as much as I can about how people currently go about benchmarking Python. Initially I'm just looking at CPU profiling since it's easiest. Anyway, if this is the wrong place to send this email, I'm very sorry for clogging up your inbox. Thanks very much, -Tennessee ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
