[pypy-dev] Waf benchmark
Hello. I propose the waf benchmark removal. Originally, the idea was that we're slower than CPython for no good reason. Now that this benchmark measures some obscure piece of stdlib time (subprocesses) I don't think it's that necessary. Besides: * the variation between runs is too big, so we don't care * noone was ever remotely interested in speeding this up any opinions? Cheers, fijal ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
[pypy-dev] translationmodules option failing
Hi just tried to bootstrap myself in the quickest way possible via the --translationmodules option (cmdline below) and encountered an issue with the md5 module which appears to be renamed _md5. the patch below corrects this. while there was an md5 directory present in my tree it only contained untracked pyc files and as such i have also removed this - ./translate.py -O jit --thread --make-jobs=9 ./targetpypystandalone.py --translationmodules - --- a/pypy/config/pypyoption.py +++ b/pypy/config/pypyoption.py @@ -39,7 +39,7 @@ translation_modules = default_modules.copy() translation_modules.update(dict.fromkeys( ["fcntl", "rctime", "select", "signal", "_rawffi", "zlib", - "struct", "md5", "cStringIO", "array"])) + "struct", "_md5", "cStringIO", "array"])) - ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
[pypy-dev] benchunix.py fixes
Hi bench-unix.py did not work so i did q quick repair job and enhancement on a small bit of the code, included as 3 patches below. i seem to recall someone mentioning that this was depreciated however as a new user it was tempting to use it as it was the first thing i saw and is a nice quick test for getting a rough guide of the relative performance of several versions of pypy i have generated currently contemplating a rewrite of the code so let me know if there is something better or if someone else is working on something Add newer python implementations and benchmark system default interpreter --- a/pypy/translator/goal/bench-unix.py +++ b/pypy/translator/goal/bench-unix.py @@ -102,7 +102,7 @@ ref_rich, ref_stone = None, None #for exe in '/usr/local/bin/python2.5 python2.4 python2.3'.split(): -for exe in 'python2.4 python2.3'.split(): +for exe in 'python2.7 python2.6 python2.4 python2.3 python'.split(): v = os.popen(exe + ' -c "import sys;print sys.version.split()[0]"').rea if not v: continue -- Discard missing interpreters --- a/pypy/translator/goal/bench-unix.py +++ b/pypy/translator/goal/bench-unix.py @@ -102,7 +102,13 @@ ref_rich, ref_stone = None, None #for exe in '/usr/local/bin/python2.5 python2.4 python2.3'.split(): -for exe in 'python2.4 python2.3'.split(): +for exe in 'python2.7 python2.6 python2.4 python2.3 python'.split(): +path = os.environ.get("PATH", "") +path = [x + os.sep + exe for x in path.split(os.pathsep) if exe in os.l +if len(path) > 0: +exe = path[0] +else: +continue v = os.popen(exe + ' -c "import sys;print sys.version.split()[0]"').rea if not v: continue -- Fix off by one --- a/pypy/translator/goal/bench-unix.py +++ b/pypy/translator/goal/bench-unix.py @@ -85,7 +85,7 @@ if os.path.isdir(exe) or exe.endswith('.jar'): continue try: -exes.append( (exe.split('-')[2], exe) ) +exes.append( (exe.split('-')[1], exe) ) except: pass#skip filenames without version number exes.sort() -- ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
[pypy-dev] File overwriting (--output flag to translate.py)
Hi again i have been compiling a bunch of different pypy instances with different levels of optimizations and features and found that if i run pypy-c from the current directory and dont specify a new output filename it will attempt to and fail to overwrite pypy-c due to the file being "in use". unfortunately the exception generated is in the shutil lib from mem and the error message/exception does not give away immediately what the cause is which can lead to some frustration on some of the longer compiles ;) its quick and dirty and i don't mind if it gets changed at all. not 100% sure what the correct way to report an error and abandon is other than what everything else does (uncaught exception to a pdb shell) --- a/pypy/translator/goal/translate.py +++ b/pypy/translator/goal/translate.py @@ -285,6 +285,10 @@ elif drv.exe_name is None and '__name__' in targetspec_dic: drv.exe_name = targetspec_dic['__name__'] + '-%(backend)s' +# Ensure the file does not exisit else we fail at end of translation +if os.path.isfile(drv.exe_name): +raise ValueError('File "' + drv.exe_name+ '" already exisits (--output)') + goals = translateconfig.goals try: drv.proceed(goals) ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
[pypy-dev] Licensing of PyPy Speed Logo Artwork
Hello everybody. As fijal asked me to do, I will now clarify the licensing of the PyPy Logo Artwork that was provided by me and is currently in use at speed.pypy.org. Herewith I declare this artwork to be subject to the terms of the Creative Commons Attribution-Share Alike license (http://creativecommons.org/licenses/by-sa/3.0/). I view the aspect of attribution to be fulfilled by the mention of my name in the LICENSE file of the PyPy source distribution. I wish you guys good progress and success, so that we all can see a compliant Python that is gaining more and more speed. Greetings, Samuel___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
[pypy-dev] Pre sprint beer session Sunday 24th of April
( emailing this list since I was not allowed to post to pypy-sprint and people don´t seem to use it?) Hi there Since I am travelling to Japan on the 25th of April I will miss the Gothenburg sprint (that was not the original plan but my family had to move our trip because of what happened there). I still would like to meet up so I invite you to a pre sprint beer session at Bishops Arms pub in central Gothenburg, Sunday 24th of April, starting from 18:00. The Bishop Arms pub is a very nice, quiet pub (library inspired but cosy) and they have a good selection of beers and whiskey. Here is a map: http://www.bishopsarms.com/Goteborg_Park/Presentation This way I get to meet most of you - and drink beer! Talk about eating the cake and having it ;-) Cheers Bea p.s. Anto - will miss you there d.s ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
[pypy-dev] thinking about the EuroPython sprint
2 days after the conference is not a lot of time. Do we want to rent some space to have a longer sprint? Or is it too late, people will already have booked their plane tickets, or ... Laura ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] Pre sprint beer session Sunday 24th of April
On 11/04/11 14:47, Bea During wrote: > I still would like to meet up so I invite you to a pre sprint beer > session at Bishops Arms pub in central Gothenburg, Sunday 24th of April, > starting from 18:00. [cut] > p.s. Anto - will miss you there d.s yeah, unfortunately I won't be able to make it :-( Have fun! ciao, Anto ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] The JVM backend and Jython
Hi Frank, On 30/03/11 04:40, fwierzbi...@gmail.com wrote: [cut] > So to my question - just how broken is the JVM backend? Are there > workarounds that would allow the Java code to get generated? so, now the jvm (and cli) translation works again. You can just type ./translate.py -b jvm, and the fish the relevant .class/.j files from /tmp/usession-default-*/pypy. ciao, Anto ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] An interesting article on chip design
On 2011-04-11 01:01, Maciej Fijalkowski wrote: > For those interested in hardware/assembler. > > http://www.lighterra.com/papers/modernmicroprocessors/ For specifics of x86 processors, http://www.agner.org/optimize/ is a good source of information (particularly microarchitecture.pdf and optimizing_assembly.pdf). -M- ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] Waf benchmark
Hi Maciej, On Mon, Apr 11, 2011 at 11:53 AM, Maciej Fijalkowski wrote: > I propose the waf benchmark removal. Given that its speed is at "1 for CPython, 1 for PyPy without JIT, 1 for PyPy with JIT", it seems rather pointless indeed, at least for us. Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] translationmodules option failing
Hi, On Mon, Apr 11, 2011 at 1:44 PM, wrote: > - "struct", "md5", "cStringIO", "array"])) > + "struct", "_md5", "cStringIO", "array"])) Thanks! Applied. Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] File overwriting (--output flag to translate.py)
Re-Hi, On Mon, Apr 11, 2011 at 2:45 PM, wrote: > + # Ensure the file does not exisit else we fail at end of translation > + if os.path.isfile(drv.exe_name): > + raise ValueError('File "' + drv.exe_name+ '" already exisits > (--output)') Sadly everyone so far has his own additional hacks to categorize multiple translated versions. Mine is to ignore the pypy-c entirely and copy the executable from the /tmp, after it has been produced there. I also copy the C sources (but not the other files produced by gcc). Anyway, my point is that the particular change you are proposing would actually harm me, because I always have a pypy-c and I'm fine if it gets overwritten by every translation :-) We need to think of some better solution... Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] Pre sprint beer session Sunday 24th of April
Hi Bea, On Mon, Apr 11, 2011 at 8:27 PM, Antonio Cuni wrote: >> session at Bishops Arms pub in central Gothenburg, Sunday 24th of April, Good, it will be nice to see you again Bea! Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] thinking about the EuroPython sprint
Hi Laura, On Mon, Apr 11, 2011 at 3:40 PM, Laura Creighton wrote: > 2 days after the conference is not a lot of time. Do we want to rent some > space to have a longer sprint? Or is it too late, people will already > have booked their plane tickets, or ... As far as I'm concerned, I think a sprint should be a bit longer to be useful. Wasn't there also talk about having the sprint (or *a* sprint) done before the conference? Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] Waf benchmark
Maciej Fijalkowski, 11.04.2011 11:53: > I propose the waf benchmark removal. > > Originally, the idea was that we're slower than CPython for no good > reason. Now that this benchmark measures some obscure piece of stdlib > time (subprocesses) I don't think it's that necessary. > > Besides: > > * the variation between runs is too big, so we don't care > * noone was ever remotely interested in speeding this up > > any opinions? Despite the relatively large variations, Cython runs this benchmark persistently ~1/3 faster than CPython 2.7 for me - minus the currently missing support for "__file__", which is used at build time here. So my vote would be to leave it in, maybe someone has an incentive to speed this up once you have bars up for Cython. :) Stefan ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] Waf benchmark
On Mon, Apr 11, 2011 at 5:02 PM, Stefan Behnel wrote: > Maciej Fijalkowski, 11.04.2011 11:53: > > I propose the waf benchmark removal. > > > > Originally, the idea was that we're slower than CPython for no good > > reason. Now that this benchmark measures some obscure piece of stdlib > > time (subprocesses) I don't think it's that necessary. > > > > Besides: > > > > * the variation between runs is too big, so we don't care > > * noone was ever remotely interested in speeding this up > > > > any opinions? > > Despite the relatively large variations, Cython runs this benchmark > persistently ~1/3 faster than CPython 2.7 for me - minus the currently > missing support for "__file__", which is used at build time here. So my > vote would be to leave it in, maybe someone has an incentive to speed this > up once you have bars up for Cython. :) > > Stefan > > ___ > pypy-dev@codespeak.net > http://codespeak.net/mailman/listinfo/pypy-dev > Personally I'd be happier if it was a bit more of a microbenchmark, it's apparently a macro-benchmark, of subprocess ATM, which makes no sense really :) Alex -- "I disapprove of what you say, but I will defend to the death your right to say it." -- Evelyn Beatrice Hall (summarizing Voltaire) "The people's good is the highest law." -- Cicero ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] thinking about the EuroPython sprint
In a message of Mon, 11 Apr 2011 21:46:25 +0200, Armin Rigo writes: >Hi Laura, > >On Mon, Apr 11, 2011 at 3:40 PM, Laura Creighton wrote: >> 2 days after the conference is not a lot of time. =A0Do we want to rent > s= >ome >> space to have a longer sprint? =A0Or is it too late, people will alread >y >> have booked their plane tickets, or ... > >As far as I'm concerned, I think a sprint should be a bit longer to be >useful. Wasn't there also talk about having the sprint (or *a* >sprint) done before the conference? yes, I was hoping to catch Alex Gaynor for that, as he is attending EuroDjango earlier the same month. My point is that we need to decide what we are doing very, very soon. else everybody will have their plane tickets already, since we will have to announce what we are doing differently. Laura > > >Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] thinking about the EuroPython sprint
Hi Laura, On Tue, Apr 12, 2011 at 12:13 AM, Laura Creighton wrote: > yes, I was hoping to catch Alex Gaynor for that, as he is attending > EuroDjango earlier the same month. My point is that we need to decide > what we are doing very, very soon. else everybody will have their > plane tickets already, since we will have to announce what we are > doing differently. Then what about a short week's sprint before the conference, plus the two days after? Armin ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev
Re: [pypy-dev] Waf benchmark
On 04/12/2011 06:02 AM, Stefan Behnel wrote: > Maciej Fijalkowski, 11.04.2011 11:53: >> I propose the waf benchmark removal. >> >> Originally, the idea was that we're slower than CPython for no good >> reason. Now that this benchmark measures some obscure piece of stdlib >> time (subprocesses) I don't think it's that necessary. >> >> Besides: >> >> * the variation between runs is too big, so we don't care >> * noone was ever remotely interested in speeding this up >> >> any opinions? > > Despite the relatively large variations, Cython runs this benchmark > persistently ~1/3 faster than CPython 2.7 for me - minus the currently > missing support for "__file__", which is used at build time here. So my > vote would be to leave it in, maybe someone has an incentive to speed this > up once you have bars up for Cython. :) I could look at the waf script used for the benchmark so that it depends more on python performances. One thing which is annoying in all the python build tools (waf, scons, etc...) is that when you use multiple builds with python-based build functions, it is slower than with a single job. That's a bottleneck for the waf-based build of numpy, at least. cheers, David ___ pypy-dev@codespeak.net http://codespeak.net/mailman/listinfo/pypy-dev