I'm back with some tests that I made with the U-S test suite. 2010/1/30 Scott Dial <scott+python-...@scottdial.com<scott%2bpython-...@scottdial.com> >
> Cesare, just FYI, your Hg repository has lost the execute bits on some > files (namely "./configure" and "./Parser/asdl_c.py"), so it does not > quite build out-of-the-box. > Unfortunately, I haven't found a solution to this problem. If somebody working with Windows and Mercurial (I use TortoiseHg graphical client) can give help on this issue, I'll release wpython 1.1 final. > I took the liberty of cloning your repo into my laptop's VirtualBox > instance of Ubuntu. I ran the default performance tests from the U-S > repo, with VirtualBox at highest priority. As a sanity check, I ran it > against the U-S trunk. I think the numbers speak for themselves. > > -- > Scott Dial > sc...@scottdial.com > scod...@cs.indiana.edu > I downloaded U-S test suite, and made some benchmarks with my machine. Django and Spambayes tests didn't run: Running django... INFO:root:Running D:\Projects\wpython\wpython10_test\PCbuild\python performance/bm_django.py -n 100 Traceback (most recent call last): File "perf.py", line 1938, in <module> main(sys.argv[1:]) File "perf.py", line 1918, in main options))) File "perf.py", line 1193, in BM_Django return SimpleBenchmark(MeasureDjango, *args, **kwargs) File "perf.py", line 590, in SimpleBenchmark *args, **kwargs) File "perf.py", line 1189, in MeasureDjango return MeasureGeneric(python, options, bm_path, bm_env) File "perf.py", line 960, in MeasureGeneric inherit_env=options.inherit_env) File "perf.py", line 916, in CallAndCaptureOutput raise RuntimeError("Benchmark died: " + err) RuntimeError: Benchmark died: Traceback (most recent call last): File "performance/bm_django.py", line 25, in <module> from django.template import Context, Template ImportError: No module named template Running spambayes... INFO:root:Running D:\Projects\wpython\wpython10_test\PCbuild\python performance/bm_spambayes.py -n 50 Traceback (most recent call last): File "perf.py", line 1938, in <module> main(sys.argv[1:]) File "perf.py", line 1918, in main options))) File "perf.py", line 1666, in BM_spambayes return SimpleBenchmark(MeasureSpamBayes, *args, **kwargs) File "perf.py", line 590, in SimpleBenchmark *args, **kwargs) File "perf.py", line 1662, in MeasureSpamBayes return MeasureGeneric(python, options, bm_path, bm_env) File "perf.py", line 960, in MeasureGeneric inherit_env=options.inherit_env) File "perf.py", line 916, in CallAndCaptureOutput raise RuntimeError("Benchmark died: " + err) RuntimeError: Benchmark died: Traceback (most recent call last): File "performance/bm_spambayes.py", line 18, in <module> from spambayes import hammie, mboxutils ImportError: No module named spambayes Anyway, I run all others with wpython 1.0 final: C:\Temp\unladen-swallow-tests>C:\temp\Python-2.6.4\PCbuild\python perf.py -r -b default,-django,-spambayes C:\temp\Python-2.6.4\PCbuild\python D:\Projects\wpython\wpython10_test\PCbuild\python Report on Windows Conan post2008Server 6.1.7600 x86 AMD64 Family 15 Model 12 Stepping 0, AuthenticAMD Total CPU cores: 1 ### 2to3 ### Min: 43.408000 -> 38.528000: 1.1267x faster Avg: 44.448600 -> 39.391000: 1.1284x faster Significant (t=10.582185) Stddev: 0.84415 -> 0.65538: 1.2880x smaller Timeline: http://tinyurl.com/ybdwese ### nbody ### Min: 1.124000 -> 1.109000: 1.0135x faster Avg: 1.167630 -> 1.148190: 1.0169x faster Not significant Stddev: 0.09607 -> 0.09544: 1.0065x smaller Timeline: http://tinyurl.com/yex7dfv ### slowpickle ### Min: 1.237000 -> 1.067000: 1.1593x faster Avg: 1.283800 -> 1.109070: 1.1575x faster Significant (t=11.393574) Stddev: 0.11086 -> 0.10596: 1.0462x smaller Timeline: http://tinyurl.com/y8t5ess ### slowspitfire ### Min: 2.079000 -> 1.928000: 1.0783x faster Avg: 2.148920 -> 1.987540: 1.0812x faster Significant (t=7.731224) Stddev: 0.15384 -> 0.14108: 1.0904x smaller Timeline: http://tinyurl.com/yzexcqa ### slowunpickle ### Min: 0.617000 -> 0.568000: 1.0863x faster Avg: 0.645420 -> 0.590790: 1.0925x faster Significant (t=7.087322) Stddev: 0.05478 -> 0.05422: 1.0103x smaller Timeline: http://tinyurl.com/ycsoouq I also made some tests with wpython 1.1, leaving bytecode peepholer enabled: C:\Temp\unladen-swallow-tests>C:\temp\Python-2.6.4\PCbuild\python perf.py -r -b default,-django,-spambayes C:\temp\Python-2.6.4\PCbuild\python D:\Projects\wpython\wpython_test\PCbuild\python Report on Windows Conan post2008Server 6.1.7600 x86 AMD64 Family 15 Model 12 Stepping 0, AuthenticAMD Total CPU cores: 1 ### 2to3 ### Min: 43.454000 -> 39.912000: 1.0887x faster Avg: 44.301000 -> 40.766800: 1.0867x faster Significant (t=8.188533) Stddev: 0.65325 -> 0.71041: 1.0875x larger Timeline: http://tinyurl.com/ya5z9mg ### nbody ### Min: 1.125000 -> 1.070000: 1.0514x faster Avg: 1.169270 -> 1.105530: 1.0577x faster Significant (t=4.774702) Stddev: 0.09655 -> 0.09219: 1.0473x smaller Timeline: http://tinyurl.com/y8udjmk ### slowpickle ### Min: 1.235000 -> 1.094000: 1.1289x faster Avg: 1.275860 -> 1.132740: 1.1263x faster Significant (t=10.080562) Stddev: 0.10247 -> 0.09827: 1.0428x smaller Timeline: http://tinyurl.com/y9p6lmt ### slowspitfire ### Min: 2.053000 -> 1.927000: 1.0654x faster Avg: 2.130690 -> 1.993580: 1.0688x faster Significant (t=6.065325) Stddev: 0.16818 -> 0.15105: 1.1134x smaller Timeline: http://tinyurl.com/yfyo53w ### slowunpickle ### Min: 0.616000 -> 0.583000: 1.0566x faster Avg: 0.643100 -> 0.606650: 1.0601x faster Significant (t=4.304239) Stddev: 0.05675 -> 0.06286: 1.1076x larger Timeline: http://tinyurl.com/yzlyo3d Also I run wpython 1.1 with bytecode peepholer disabled (wpython 1.1 has all peepholer ported to compiler.c, working with instr struct): C:\Temp\unladen-swallow-tests>C:\temp\Python-2.6.4\PCbuild\python perf.py -r -b default,-django,-spambayes C:\temp\Python-2.6.4\PCbuild\python D:\Projects\wpython\wpython_test\PCbuild\python Report on Windows Conan post2008Server 6.1.7600 x86 AMD64 Family 15 Model 12 Stepping 0, AuthenticAMD Total CPU cores: 1 ### 2to3 ### Min: 44.128000 -> 39.575000: 1.1150x faster Avg: 45.231400 -> 40.455600: 1.1181x faster Significant (t=10.515725) Stddev: 0.67464 -> 0.75905: 1.1251x larger Timeline: http://tinyurl.com/ye4un63 ### nbody ### Min: 1.126000 -> 1.065000: 1.0573x faster Avg: 1.161410 -> 1.093630: 1.0620x faster Significant (t=6.344257) Stddev: 0.08324 -> 0.06697: 1.2429x smaller Timeline: http://tinyurl.com/ykyoflv ### slowpickle ### Min: 1.245000 -> 1.121000: 1.1106x faster Avg: 1.282420 -> 1.154450: 1.1108x faster Significant (t=10.719276) Stddev: 0.09569 -> 0.07139: 1.3404x smaller Timeline: http://tinyurl.com/y85m3wa ### slowspitfire ### Min: 2.081000 -> 1.964000: 1.0596x faster Avg: 2.148110 -> 2.033300: 1.0565x faster Significant (t=5.089408) Stddev: 0.16229 -> 0.15669: 1.0357x smaller Timeline: http://tinyurl.com/ydruyqf ### slowunpickle ### Min: 0.621000 -> 0.600000: 1.0350x faster Avg: 0.649120 -> 0.624950: 1.0387x faster Significant (t=3.057153) Stddev: 0.05377 -> 0.05796: 1.0780x larger Timeline: http://tinyurl.com/yd2sy5v Albeit some tests are missing, I think the numbers speak for themselves, too. Cesare
_______________________________________________ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com