Re: [pypy-dev] Details on project idea: Explicit typing in RPython

2017-04-03 Thread Richard Plangger
Hi, I would suggest to change the deliverables. We already have a way to specify the type for function signatures (mentioned in this email thread). It should at least mention that you extend those. It would be also very useful if you kind of gave an example how the mini language (e.g. specified in

Re: [pypy-dev] Details on project idea: Explicit typing in RPython

2017-03-29 Thread Richard Plangger
Hello Joannah, Ronan might know more about this topic. But here is a short explanation: A solid start is to read the following documentation: http://rpython.readthedocs.io/en/latest/translation.html It explains how Python source code is analyzed, transformed and compiled. As you know, there ar

Re: [pypy-dev] Remaining test_importlib failures

2017-03-16 Thread Richard Plangger
Hello, > Most (or all) tests from test_importlib.frozen are failing because PyPy > doesn't really have frozen modules (in the sense of CPython, where these > are a special kind of modules besides normal Python modules and > extension modules). Does it sound reasonable to skip these tests > comple

Re: [pypy-dev] Speeds of various utf8 operations

2017-03-08 Thread Richard Plangger
Yes ;)… At some point, now I'm still experimenting with the operations we think we need. Cheers, Richard On Mar 8, 2017 6:50 PM, "David Edelsohn" wrote: > And POWER VSX and Z VX? ;-) > > - David > > > On Wed, Mar 8, 2017 at 12:17 PM, Richard Plangger > wr

Re: [pypy-dev] Speeds of various utf8 operations

2017-03-08 Thread Richard Plangger
Hi, as we discussed on the sprint I have now experimented with an SSE/AVX implementation to 'len(utf8 string)' (this includes a check if it is valid utf8). Since this is related to this mailing list thread I'll just add it here! I ran some small measurements on it: Here some explanation of the n

[pypy-dev] PyPy as a Sub-org

2017-03-01 Thread Richard Plangger
Hi, as we discussed during this years PyPy sprint, PyPy again wants to participate as a Sub-org in this years Google Summer of Code. We are already on the wiki ideas page, but I think we did not formally apply by writing this email. Regards, Richard ___

Re: [pypy-dev] Leysin Winter Sprint 2017

2017-02-16 Thread Richard Plangger
Hi Robert, I have added you (25.01-01.03). Looking forward meeting you there! Cheers, Richard On 02/16/2017 06:48 PM, Robert Zaremba wrote: > Hi, > > I would like to join the Leysin sprint. > Any additional steps I have to do? When do I need to confirm dates? > I will be available 25/02 - 1/03,

Re: [pypy-dev] VMProf 0.4.0

2017-02-15 Thread Richard Plangger
Hi, sorry about the lengthy email, but you asked for details :) windows is certainly out of scope (not even sure if somebody succeeded compiling libunwind on windows, probably it needs lots of porting). Some technical details how it now works now (did not finish it yet completely): In the PyPy

Re: [pypy-dev] VMProf 0.4.0

2017-02-15 Thread Richard Plangger
Hi, > Avoiding to make it a hard dependency would be a good idea. Also, > libunwind is a hack that showed problems when vmprof previously > supported C frames, and it was removed for that reason. Maybe you > should give a word about why re-enabling C frames with libunwind looks > ok now? Can yo

[pypy-dev] VMProf 0.4.0

2017-02-15 Thread Richard Plangger
Hi there, I'm currently finishing up vmprof native profilng for CPython & PyPy. Here are some highlights (soon to be released in 0.4.0): * Native profiling (C stack) is included in the profile (using libunwind) for Linux & Mac * Windows 64bit support (no native profiling) * The platform that read

Re: [pypy-dev] Leysin sprint?

2017-01-15 Thread Richard Plangger
Hi Armin, I'm happy to join the sprint (either location). I would prefer: All of February or March 1-10th. Cheers, Richard On 01/15/2017 09:41 AM, Armin Rigo wrote: > Hi all, > > I'm starting to organize the Leysin sprint for this winter. > > The first note is that the Swiss Python Summit will

Re: [pypy-dev] Pypy Contribution

2016-12-20 Thread Richard Plangger
Hi, I think a good approach is to start reading this page: http://doc.pypy.org/en/latest/how-to-contribute.html Generally speaking, we have lots of documentation at http://doc.pypy.org, which you should use to get into PyPy development. I think a solid approach would be to setup your development

Re: [pypy-dev] how do you parse jit log containing binary dump ?

2016-12-09 Thread Richard Plangger
Hi, you previously wrote: > I'm building a tool which attempts to map Jit ByteCodes back to the actual function which was called at the Python level. jitlog does already do that. If you call your program this way: (env) $ pip install vmprof (env) $ pypy -m jitlog --web yourbenchmark.py you can

Re: [pypy-dev] how do you parse jit log containing binary dump ?

2016-12-09 Thread Richard Plangger
I just want to run some open source benchmark > ? What if I don't want to add JItdriver and merge_point to the code and run > it "as is" non rpython - can I still dump jitlog ? > > Sent from Shubha Ramani's iPhone 7 > >> On Dec 9, 2016, at 1:19 AM, Richard P

Re: [pypy-dev] how do you parse jit log containing binary dump ?

2016-12-09 Thread Richard Plangger
Hi, the jit log currently is only functional with the vmprof platform. There was this idea of a command line tool to inspect, but it is not yet finished. Unsure if the test generated file can be uploaded, but you can try: $ pip install vmprof $ python -m jitlog --upload The output of the last

Re: [pypy-dev] starting a release cycle

2016-11-02 Thread Richard Plangger
Hi, > Would someone else like to pair with me for the release so they could do > the next one? Yes, I would like to help out here! In cape town I have done the same release procedure for pypy3 (Python 3.3). It annoyed me :) I think most of the steps could be done automatically (ideally a script

[pypy-dev] SSL module Py3.5, Github? Bitbucket?

2016-10-31 Thread Richard Plangger
Hi, I'm currenlty working on the ssl stdlib replacement we agreed to implement during for py3.5. I'm unsure what the current rule for new project is. Github? Bitbucket? VMProf was initiated on Github, what did we learn from that experiment? Is the bar lower for new contributions? Cheers, Richar

[pypy-dev] pypy3.3 release

2016-10-09 Thread Richard Plangger
Hello, I have prepared an alpha release for the python 3.3 branching from the py3k branch. As far as I understood this means that the development will now continue towards python 3.5 in the py3.5 branch. Should we rename the py3k branch to py3.3 (branch py3.3 from py3k and close py3k)? I have not

Re: [pypy-dev] NumPyPy vs NumPy

2016-07-27 Thread Richard Plangger
Hi, > Is there an official benchmark suite for NumPy or a more relevant workload to > compare against CPython? What is NumPyPy's maturity / adoption rate from your > knowledge? I do not think there is. I have been looking for something similar for over a year. It seems though people tend to mak

Re: [pypy-dev] Any core devs want to come to the python compilers workshop next month?

2016-06-26 Thread Richard Plangger
Hi, > ... So if any of you are > interested in a free last minute trip to Austin + a chance to maybe > help influence future plans and funding in a more PyPy-friendly > direction, please get in touch ASAP... I'm interested and would find some time to join the workshop. Cheers, Richard signatu

[pypy-dev] Micro NumPy & VecOpt 2.0

2016-06-25 Thread Richard Plangger
Hi, in case you have not heard: I'm currently working on the PPC and S390X port for micro numpy. Thanks to IBM for funding this work. I'm ~50% through the ppc operations to implement. The goal is to turn this optimization on (by default) in the micro numpy module. I recently had the idea to enha

[pypy-dev] jitlog 2.0

2016-04-29 Thread Richard Plangger
Hello, I have spent a lot of my free time to improve our jitviewer. Finally I'm happy to present some results and I want to get some feedback (bad or good). I run a test server (at http://217.172.172.207:8000) so without installing anything you can just have a quick look. Here [1] is richards.py

Re: [pypy-dev] PyPY 5.1 release is close, help needed

2016-04-20 Thread Richard Plangger
Hello, > I need help: > - please check that the targz bundles of release 3260adbeba4a, available > here > http://buildbot.pypy.org/nightly/release-5.x > are usable on your platform I ran the benchmark suite on s390x. Additionally I even setup some django service with virtual env to see if the

[pypy-dev] GSoC 2016

2016-03-02 Thread Richard Plangger
Hi, I was wondering who applied as a sub org to python last year? The registration for new sub orgs is open until March 7th. (https://wiki.python.org/moin/SummerOfCode/2016#Sub-orgs) As we discussed on the sprint I will try to attract some students tomorrow at the university in Vienna. Of course

[pypy-dev] s390x jit backend the first results and status update

2016-02-11 Thread Richard Plangger
Hi, I have been looking quite elaborately to find the last remaining issues in the JIT backend. I identified some problems (related to the ABI for floats and ffi issues). Those are fixed. There are two major left: 1) Bug that occurs very late in the translation of PyPy. As you are aware I'm not

[pypy-dev] s390x backend gil and threading issue

2016-02-02 Thread Richard Plangger
hi, I'm currently searching for a problem, I have debugged for quite a long time. I think this is the root problem why the pypy translation with pypy is still slower than cpython. Here are some of my findings (+questions): The list of last tests that fail all have one thing in common: They have a

[pypy-dev] Stack limit in the jit backends

2016-01-28 Thread Richard Plangger
Hi, the file rpython/translator/c/src/stack.h defines MAX_STACK_SIZE. PPC has a bigger limit than e.g. x86. I experienced that on s390x there is as well a higher consumption of memory for stack frames (they are variable sized with a pretty high minimum limit (160 bytes) by the ABI). I have two qu

Re: [pypy-dev] s390x the last failing tests

2016-01-19 Thread Richard Plangger
for Debian) 2.25.90.20160101 > > On Tue, Jan 19, 2016 at 6:12 AM, Richard Plangger wrote: >> hi, >> >> I wanted to give a quick update on the state of the implementation. Good >> news! I think there is not that much left to be done! >> >> I'm currently

[pypy-dev] s390x the last failing tests

2016-01-19 Thread Richard Plangger
hi, I wanted to give a quick update on the state of the implementation. Good news! I think there is not that much left to be done! I'm currently waiting for a bigger VM (already wrote an email to lin...@us.ibm.com, 2 days ago? They are maybe on holiday?) to translate the full project. There are

Re: [pypy-dev] s390x libffi issue

2016-01-15 Thread Richard Plangger
Hi, > libffi is *documented* to return the non sign-extended value. I have fixed this issue at the call site. The caller sign/zero extends narrower integer types. The reason I did not change it to that in the first place is: I thought that it is not easy to determine this information at the calls

[pypy-dev] s390x libffi issue

2016-01-14 Thread Richard Plangger
Hi, so far this issue is not resolved. Sadly the argument is that I/we probably do not handle the return type of libffi correctly. Let me explain the problem (again). For instance in the test [1] the case lltype.FuncType([rffi.Short, rffi.Short], rffi.Short). Here is what happens step by step (i

Re: [pypy-dev] Leysin Winter sprint?

2015-11-27 Thread Richard Plangger
Hi, I would like to come. Date: I have no preference and I'm flexible as well. Cheers, Richard On 11/27/2015 11:18 AM, Armin Rigo wrote: > Hi all, > > Due to public pressure :-) I'm trying to organize this winter's > sprint, in Leysin, Switzerland. This is a fully public sprint of 7 > days,

Re: [pypy-dev] Diploma Thesis on Pypy

2015-10-31 Thread Richard Plangger
Hi there, I finished my thesis recently implementing a vectorizing optimization. So I guess it is feasible :). My advice would be to build the VM and make some baby steps in the test environment. This might sound weird, but the development is very different to what you do at university (at least i

Re: [pypy-dev] Automatic SIMD vectorization

2015-10-20 Thread Richard Plangger
You're welcome. I forgot to mention that I'm happy to help if vec_all crashes. So if you give it a shot and get stuck get in touch with me here (or issues on bitbucket)! Cheers, Richard On 10/20/2015 05:08 PM, Tuom Larsen wrote: > Awesome, thank you! > > On Tue, Oct 20, 2015

Re: [pypy-dev] Automatic SIMD vectorization

2015-10-20 Thread Richard Plangger
Hi, glad you liked the post! See the answers below... On 10/20/2015 04:20 PM, Tuom Larsen wrote: > Hello all! > > I just read with great interest the blog post "Automatic SIMD > vectorization support in PyPy". > > Please, I have a few questions: > > - Does regular Python code benefit from the

Re: [pypy-dev] guidance about working with pypy

2015-07-28 Thread Richard Plangger
Hi, the answer to your question very much depends on your python experience. A good place to start is the bug tracker [1] and (potentially much more interesting) the documentation[2][3]. Most of the time smaller tasks include adding features in the python 3 branch of pypy (py3k or py3.3). I gues

Re: [pypy-dev] EuroPython?

2015-04-28 Thread Richard Plangger
and I hope my abstract does not give the impression that I am), but it might still be cool to draw some attention of something 'new' in the RPython toolchain? Best, Richard PS.: I'm up to now only get the digest of the mailing list, thus I don't know how to repsond to the origin

[pypy-dev] Vectorizing pypy traces no3

2015-04-14 Thread Richard Plangger
Hi, I have recently managed to correctly transform a trace to a vectorized trace that includes a guard. I'm hoping that this might be merged into the code base of pypy (when it is finished), thus it would be nice to get feedback and iron out some problems I currently have. Of course this needs exp

[pypy-dev] GSoC 15 vectorizing traces

2015-03-03 Thread Richard Plangger
hi, pypy participated in GSoC 14 and my thesis mentor had the idea that it would benefit if I apply to GSoC 15 for my thesis. I'm currently planning my thesis and I think the application would be very similar to what is required to GSoC 15. Do you think that it would be worth trying? Best, Richar

[pypy-dev] Vectorizing numpy traces

2015-02-24 Thread Richard Plangger
hi, i'm currently trying to find a way to generate simd code for python loops that operate on numpy arrays. The IRC is quite busy so I think I'd rather post it as an email... I have familiarized myself with pypy and read most of the docs and read the code in the metainterp to understand how the t

Re: [pypy-dev] PyPy improving generated machine code

2015-02-02 Thread Richard Plangger
On 01/31/2015 03:40 PM, Armin Rigo wrote: ce optimizations utilizing type information." > > This doesn't mean the performance of PyPy is perfectly optimal today. > There are certainly things to do and try. One of the major ones (in > terms of work involved) would be to add a method-JIT-like app

Re: [pypy-dev] PyPy improving generated machine code

2015-01-31 Thread Richard Plangger
: > Hi Richard, > > On 31 January 2015 at 10:51, Richard Plangger wrote: >> By using the PEP 484 proposal I think this opens up new possibilities. > > The short answer is - no, it doesn't make sense. User-supplied type > annotations wouldn't help at all if they

[pypy-dev] PyPy improving generated machine code

2015-01-31 Thread Richard Plangger
Hi, I'm a student at the technical university of Vienna and currently looking for a topic to complete my master thesis. I stumbled over PEP 484 that currently is discussed on the mailing list. It seems to me that this is going to become reality pretty soon. I had the idea that this additional ty