Re: [pypy-dev] clarification cffi vs _ffi_ vs _ffi vs libffi vs _rawffi vs rffi

2013-11-27 Thread Armin Rigo
Re-Hi, On Wed, Nov 27, 2013 at 5:24 PM, Armin Rigo wrote: >> http://doc.pypy.org/en/latest/extending.html I updated that page. Armin ___ pypy-dev mailing list pypy-dev@python.org https://mail.python.org/mailman/listinfo/pypy-dev

[pypy-dev] PyPy 2.2.1

2013-11-27 Thread Armin Rigo
Windows. * If sys.maxunicode==65535 (on Windows and maybe OS/X), the json decoder incorrectly decoded surrogate pairs. * some FreeBSD fixes. Note that CFFI 0.8.1 was released. Both versions 0.8 and 0.8.1 are compatible with both PyPy 2.2 and 2.2.1. Cheers, Armin R

[pypy-dev] PyPy3 release?

2013-11-27 Thread Armin Rigo
Hi all, Any volunteer to handle the PyPy3 release corresponding to PyPy 2.2? A bientôt, Armin. ___ pypy-dev mailing list pypy-dev@python.org https://mail.python.org/mailman/listinfo/pypy-dev

[pypy-dev] Leysin sprint (11-19 January 2014)

2013-11-30 Thread Armin Rigo
ere will be some Swiss-to-EU adapters around -- bring a EU-format power strip if you have one. Armin Rigo ___ pypy-dev mailing list pypy-dev@python.org https://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] PyPy3 release?

2013-11-30 Thread Armin Rigo
Hi Rami, On Fri, Nov 29, 2013 at 8:20 PM, Rami Chowdhury wrote: > What would this involve? I ask not only for my benefit but also for > any other newbies that may be lurking here and thinking about getting > involved :-) http://doc.pypy.org/en/latest/how-to-release.html A bientôt, Armin.

Re: [pypy-dev] Pluggable HTM

2013-12-03 Thread Armin Rigo
Hi Dimitri, On Wed, Nov 27, 2013 at 9:17 AM, Dimitri Vorona wrote: > the original STM proposal spoke of HTM as of a thing of a far future. Now, > Haswells are out and provide built-in HTM support in form of TSX. In the > near future I expect more and more systems to have it. > > Are there plan to

[pypy-dev] Integrating CPython and PyPy, maybe

2013-12-03 Thread Armin Rigo
Hi all, Starting from last night, the nightly builds of PyPy are able to run this kind of code: http://bpaste.net/show/155166/ (You have to adjust the libpython2.x.so path manually.) The idea is to link in the libpython.so, using cffi. Then you can use it much like you would in C. For example

Re: [pypy-dev] Integrating CPython and PyPy, maybe

2013-12-03 Thread Armin Rigo
Hi Davide, On Tue, Dec 3, 2013 at 9:24 PM, Davide Del Vento wrote: > Let me try to state a possible goal: > > Allow PyPy to become "exactly" drop-in replacement for CPython not just the > current "almost", by using CPython itself for the things that don't work in > PyPy Thank you for stating th

Re: [pypy-dev] Questions about pypy log

2013-12-07 Thread Armin Rigo
Hi Andrea, On Fri, Dec 6, 2013 at 11:24 AM, wrote: > I'm Andrea Jeradi, a computer science student of university of Verona > (Italy). I'm doing a project and I'm using pypy. On Internet I have not > found explanation about the meaning of some entry of the log. The whole log's format and what it

Re: [pypy-dev] Questions about pypy log

2013-12-09 Thread Armin Rigo
Hi again, On Mon, Dec 9, 2013 at 10:06 AM, Andrea Jeradi wrote: > (...) i need to > understand the meaning of the jit-summary, and for completeness what the > entry of the summary refers to. As I said, half the entries are very internal. I could try to explain them to you but that would take a

Re: [pypy-dev] Compiling stmgc-c4 fails on 32bit

2013-12-09 Thread Armin Rigo
Hi Jean-Philippe, On Sun, Dec 8, 2013 at 8:46 PM, Jean-Philippe Caissy wrote: > I'm trying to compile stmgc-c4 on a fresh Ubuntu 12.04 32bit machine (lxc > containers if that matters), and it fails. However, a fresh 12.04 64bit > installation, it compiles without any problem. For now, it's known

Re: [pypy-dev] why logging in pypy not need acquire lock?

2013-12-24 Thread Armin Rigo
Hi KaShining, On Tue, Dec 24, 2013 at 9:15 AM, KaShining wrote: > why logging in pypy not need acquire lock? > left from pypy whle right from cpython PyPy's stdlib is from CPython 2.7.3, where it doesn't acquire a lock either. It seems it was some bug that was discovered and fixed in a more rec

Re: [pypy-dev] Interested in GSoC 2014

2013-12-24 Thread Armin Rigo
Hi Prasad, On Tue, Dec 24, 2013 at 7:41 AM, Prasad Joshi wrote: > After going through GSoC 2013 page > (https://wiki.python.org/moin/SummerOfCode/2013), I think I would be > interested in Core Python or PyPy. Please let me know how should I > start. PyPy is most active on IRC (although right now

Re: [pypy-dev] Leysin

2013-12-25 Thread Armin Rigo
Hi Johan! On Tue, Dec 24, 2013 at 3:59 PM, Romain Guillebert wrote: >> I'm a software developer from Sweden. >> I would like to attend the Leysin Winter sprint. Sure, you are welcome! And great: another person --- the sprint was looking thin so far :-) If you didn't do it so far, you should sh

Re: [pypy-dev] Kindly guide

2013-12-26 Thread Armin Rigo
Hi Jashan, On Wed, Dec 25, 2013 at 9:20 AM, Jashan Goyal wrote: > I am jashan goyal.I am interested in contributing to pypy please guide me > how to begin. Have a look at our getting-started guides: http://doc.pypy.org/en/latest/getting-started.html http://doc.pypy.org/en/latest/getting-started

Re: [pypy-dev] Haswell System

2014-01-04 Thread Armin Rigo
Hi all, (sent for the pypy-dev mailing list) A quick status update about STM. As I've said on IRC, I am *again* looking at a new approach. This would change the core of STM, but lets us keep most of the work we did on top of it, i.e. inside PyPy and PyPy's JIT. The pre-prototypes (called "c5"

Re: [pypy-dev] ctypes create_string_buffer

2014-01-10 Thread Armin Rigo
Hi, On Fri, Jan 10, 2014 at 2:52 PM, Kenny Lasse Hoff Levinsen wrote: > On 09/01/2014, at 14.30, HY wrote: > import ctypes as C > s1= "0"* 1024* 1024* 10 > # mem engross add 10M bytes > b1= C.create_string_buffer(s1 ) > # CPU 1 core 100% and mem engross add 300M bytes ? > I don't know! > please

Re: [pypy-dev] ctypes create_string_buffer

2014-01-12 Thread Armin Rigo
Hi, On Sun, Jan 12, 2014 at 6:28 AM, HY wrote: > I test 2f0d7dced731 > memory isn't large engross. but at the AMD 5000+ CPU, 5 secs CPU 100%. > I think this has a BUG. :) Yes :-) You can see why it's slow by following the logic in pure Python in lib_pypy/_ctypes/, maybe by using just pdb. It's

Re: [pypy-dev] ctypes create_string_buffer

2014-01-13 Thread Armin Rigo
Hi HY, On Mon, Jan 13, 2014 at 2:55 AM, HY wrote: > thanks you reply my message. > I think the string is pure struct, mybe should special process; > want a little of change as soon as possible enablement. > > I have a little think of a way, > whether add shareptr class in ctypes or cffi? > this a

[pypy-dev] pypyjit/test_pypy_c

2014-01-21 Thread Armin Rigo
Hi all, There are failures in pypyjit/test_pypy_c/test_string.py that shows that the JIT gets much worse code in some cases. This is probably related to the refactor-str-types branch merge (at least the dates match). I found and fixed one issue, which was that some code in stringmethods.py has a

[pypy-dev] STM minor collections

2014-01-22 Thread Armin Rigo
Hi Remi, I thought about another possible way to handle minor collections in stm-c7. If we synchronize the threads to do minor collections, then we no longer need to force minor collections after each transaction. This is possible if we use a single coordinated nursery instead of one per thread.

Re: [pypy-dev] PyPy 2 unicode class

2014-01-22 Thread Armin Rigo
Hi Johan, On Wed, Jan 22, 2014 at 8:01 AM, Johan Råde wrote: > (I hope this makes more sense than my ramblings on IRC last night.) All versions you gave make sense as far as I'm concerned :-) But this last one is the clearest indeed. It seems that Python 3 went that way anyway too, and exposes

Re: [pypy-dev] PyPy 2 unicode class

2014-01-23 Thread Armin Rigo
Hi Oscar, Thanks for explaining the caching in detail :-) On Thu, Jan 23, 2014 at 2:27 PM, Oscar Benjamin wrote: > big saving. If the string comes from anything other than utf-8 the indexing > cache can be built while decoding (and reencoding as utf-8 under the hood). Actually, you need to walk

Re: [pypy-dev] pypyjit/test_pypy_c

2014-01-23 Thread Armin Rigo
Hi Manuel, On Tue, Jan 21, 2014 at 1:50 PM, Manuel Jacob wrote: > So we have to solve this in > a non-technical way. Everyone should feel responsible for tests that fail > and check whether he broke that test by accident. If not, he should feel > free to blame others on IRC or the mailing list.

Re: [pypy-dev] Questions on stdlib-2.7.5 failures

2014-01-23 Thread Armin Rigo
Hi Christian, On Fri, Jan 24, 2014 at 3:40 AM, Christian Hudon wrote: > First, I kicked the buildbots yesterday, and there are a *lot* of errors due > to tests not being able to import the MAXREPEAT constant from the _sre > module. But it seems to me that it is defined in > pypy/module/_sre/__ini

Re: [pypy-dev] Questions on stdlib-2.7.5 failures

2014-01-24 Thread Armin Rigo
Hi Christian, On Fri, Jan 24, 2014 at 8:54 AM, Armin Rigo wrote: >> pypy/module/_sre/__init__.py... Am I missing something? Are the errors due >> to a build problem or something else? > > This is merely a detail for a deeper an issue. CPython's "re" format >

Re: [pypy-dev] PyPy 2 unicode class

2014-01-24 Thread Armin Rigo
Hi all, Thanks everybody for your comments on this topic. Our initial motivation for doing that is to simplify RPython by getting rid of the RPython unicode type. I think that the outcome of these mails is that there is no single obvious answer as to whether the change would benefit or hurt Pyth

Re: [pypy-dev] cppyy and callbacks

2014-01-24 Thread Armin Rigo
Hi, On Thu, Jan 23, 2014 at 10:36 PM, wrote: >> I was considering the possibility of taking an index or id() of the object >> and just casting it into "void*" form, and then converting it back and >> using it to look up objects in a list/dict somewhere.. > > Alex Pyattaev did this (is in the pyp

Re: [pypy-dev] Validate SSL/TLS

2014-01-24 Thread Armin Rigo
Hi, On Thu, Jan 23, 2014 at 5:28 PM, Maciej Fijalkowski wrote: > Since I have absolutely no idea what you're talking about, let's start with: Same for me. Also, using another SSL library like PyOpenSSL is a good idea anyway --- on both CPython and PyPy. If I had a choice I'd prefer to scrap th

Re: [pypy-dev] PyD and PyPy [was Boost.Python and PyPy -- status?]

2014-01-24 Thread Armin Rigo
Hi Russel, On Sun, Jan 19, 2014 at 6:28 PM, Russel Winder wrote: > I am delving into PyD just now to get it working with CPython 3 as well > as CPython 2. Can you point me towards the best way of trying to make > this also work with PyPy and PyPy3? Sorry, you're not getting answers because your

Re: [pypy-dev] PyD and PyPy [was Boost.Python and PyPy -- status?]

2014-01-24 Thread Armin Rigo
Hi Piotr, On Fri, Jan 24, 2014 at 3:11 PM, Piotr Skamruk wrote: > Probably http://pyd.dsource.org/ is this about what You are asking. > It's wrapper of python api for http://dlang.org/ I actually guessed that much from googling. What I'm asking is the kind of C++ code that it needs to interact

Re: [pypy-dev] cppyy and callbacks

2014-01-24 Thread Armin Rigo
Hi Wim, On Fri, Jan 24, 2014 at 6:28 PM, wrote: > yes, it does. Is high on my wish list (and not just the programmer-facing > side, also the internals although there are several things that are close > but don't quite fit). I meant specifically the way the interface is to be used by the end pro

Re: [pypy-dev] cppyy and callbacks

2014-01-24 Thread Armin Rigo
Hi Wim, On Fri, Jan 24, 2014 at 6:56 PM, wrote: > By default, there is memory tracking, auto-casting, overloading, template > instantiation (with cling; partially with cint), etc. And if that is not > desired, a Python layer can be written to do things differently. E.g. to > select a specific ov

Re: [pypy-dev] Validate SSL/TLS

2014-01-27 Thread Armin Rigo
Hi Donald, On 27 January 2014 00:07, Donald Stufft wrote: > The CPython developers have thus far decided that back porting hostname > verification to > CPython 2.x is not worth breaking the policy of no new features in 2.7. I > disagree with this > conclusion fwiw. You're considering adding a

Re: [pypy-dev] Help with memory usage

2014-02-03 Thread Armin Rigo
Hi Matheus, On 3 February 2014 03:55, Matheus Salvia wrote: > When running my app under CPython, it uses about 1GB of memory, but when > running with pypy it goes up to almost 3GB. This is a question that doesn't have a single answer. You need to give us a lot more information about what your a

Re: [pypy-dev] Help with memory usage

2014-02-03 Thread Armin Rigo
Hi Matheus, On 3 February 2014 20:07, Matheus Salvia wrote: > Last but not least, is there a way to change pypy from using a GC to using > refcount like CPython? No, PyPy cannot use refcounting. > That was the information you needed? This is still too vague to know why memory usage is so high.

Re: [pypy-dev] Spam mail?

2014-02-04 Thread Armin Rigo
Hi, These recent spams are sent to pypy-...@codespeak.net. Given that the last non-spam message to be sent to this old address was apparently in 2012, I think we should just close that address now. Now the question is, who knows how? A bientôt, Armin. _

[pypy-dev] Fwd: This old address is now deprecated

2014-02-04 Thread Armin Rigo
Hi all, The address pypy-...@codespeak.net has been deprecated and cannot be used any more. Armin ___ pypy-dev mailing list pypy-dev@python.org https://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] PyPy 2.2.1 segfault

2014-02-08 Thread Armin Rigo
Hi Vasily, On 8 February 2014 07:13, Vasily Evseenko wrote: > I've attached program that segfaults pypy. No external modules used and > its works under CPython. Thanks! Fixed in 3a0ef8f31265. The problem was caused by a list of floats that contains "nan" values (the Z variable in your code): a

Re: [pypy-dev] crash with high number of threads in libpypy-c

2014-02-08 Thread Armin Rigo
Hi Roberto, On 8 February 2014 14:14, Roberto De Ioris wrote: > > RPython traceback: > File "rpython_memory_gctransform_shadowstack.c", line 425, in > switch_shadow_stacks > File "rpython_rtyper_lltypesystem_rdict.c", line 8053, in > ll_dict_getitem__dicttablePtr_Signed_5 Thanks for the rep

Re: [pypy-dev] PyPy Intermediate C Files

2014-02-18 Thread Armin Rigo
Hi Kirk, On 17 February 2014 21:33, Kirk Liberty wrote: > It's it correct to assume that the generated C code will be > identical regardless of the computer PyPy it's translated on? This allowing > for translation on one machine, and compilation on another? No, it's wrong: translation hard-codes

[pypy-dev] Conferences for STM paper

2014-02-18 Thread Armin Rigo
Hi Remi, For reference, here are two workshops where an STM paper would probably be a good idea: * Dyla'14 (Workshop on Dynamic Languages and Applications), June 12th, Edinburgh, UK, co-located with PLDI'14. We have already published about PyPy at a couple of previous Dyla workshops. Fwiw, Carl

[pypy-dev] GitHub

2014-02-18 Thread Armin Rigo
Hi all, GitHub has a two-years-old mirror of PyPy: https://github.com/pypy/pypy . Nowadays that looks not only useless, but harmful. Would anyone with the proper priviledges disable, hide, or kill it? I can't do it myself apparently (or didn't find the correct button). A bientôt, Armin.

[pypy-dev] Bytearray broken complexity

2014-02-18 Thread Armin Rigo
Hi all, Yet another mail :-) This is a small note to mention that the str/unicode/bytearray branch that was merged earlier into "default" has some problems of complexity with bytearrays. For example, simply reading "ba[5]" requires a complete copy of the bytearray to be done internally. This me

Re: [pypy-dev] GitHub

2014-02-18 Thread Armin Rigo
Hi Maciej, On 18 February 2014 18:09, Maciej Fijalkowski wrote: > I moved it to fijal/pypy I'll delete it later if there is any need. That's my point :-) Please delete it. I hear people complain that something doesn't work after they cloned from github... A bientôt, Armin. _

Re: [pypy-dev] numpy plans in the next 6 months?

2014-02-20 Thread Armin Rigo
Hi Ian, On 20 February 2014 12:59, Ian Ozsvald wrote: > Hi again. In relation to my other mail, I'm curious about the plans > for numpy in the next 6 months. Is there an expectation that > better-than-numpy results might be obtained (e.g. using AVX/SSE or > being cache friendly)? I'll mention the

Re: [pypy-dev] Very slow Julia example on PyPy/numpy - can you help me understand why it is slow?

2014-02-20 Thread Armin Rigo
Hi Ian, On 20 February 2014 12:53, Ian Ozsvald wrote: > def calculate_z(maxiter, zs, cs, output): > """Calculate output list using Julia update rule""" This particular example uses numpy is a very strange and useless way, as I'm sure you know. It builds a regular list of 1'000'000 items; th

Re: [pypy-dev] numpy plans in the next 6 months?

2014-02-20 Thread Armin Rigo
Hi Yury, On 20 February 2014 19:21, Yury V. Zaytsev wrote: > FYI: https://github.com/numpy/numpy/pull/4322 Maybe you missed the point I made in the paragraph you quote? Without a JIT, "a b c" cannot reasonably be done in a single iteration over the three arrays. The pull request you quote im

Re: [pypy-dev] Easy way to get access to cmpxchg?

2014-02-21 Thread Armin Rigo
Hi Timothy, On 22 February 2014 01:39, Timothy Baldridge wrote: > compare_and_swap(foo.bar, oldval, newval) At some point we added a way to do it (basically you can do it yourself, by writing a one-line function in C and calling it). We no longer do that: it's too much of a mess if you start ha

Re: [pypy-dev] Debugging Blocked Block exceptions

2014-02-21 Thread Armin Rigo
Hi Timothy, On 21 February 2014 15:45, Timothy Baldridge wrote: > In an interpreter I'm writing I'm often running into Blocked block > exceptions. I've been able to solve several of these errors but the problem > is always figuring out what exactly I've done to cause the error. Most of > the time

Re: [pypy-dev] slow-ish multithreaded primitives

2014-02-21 Thread Armin Rigo
Hi Dima, On 21 February 2014 15:43, Dima Tisnek wrote: > sorry I don't have code handy, it's part of a larger project, but if > someone's interested, please reply and I'll hack up a short test case. Please do. Armin ___ pypy-dev mailing list pypy-dev

Re: [pypy-dev] unaligned raw_load (align_float_cast branch)

2014-02-22 Thread Armin Rigo
Hi Matti, On 18 February 2014 14:05, matti picus wrote: > I would like to ask for help with this branch, as I have not been able to > move it forward fast enough. I moved it forward a little bit, but now I'm wondering if it actually makes sense. What is the goal? Is it to fix a problem in ctyp

Re: [pypy-dev] Very slow Julia example on PyPy/numpy - can you help me understand why it is slow?

2014-02-22 Thread Armin Rigo
Hi Ian, On 20 February 2014 21:40, Ian Ozsvald wrote: > compiler technologies. The simple answer might be 'because pypynumpy > is young' and that'd be fine - at least I'd have an answer if someone > asks the question in my talk. If someone has more details, that'd be > really interesting too. Is

Re: [pypy-dev] Telling the JIT to remove a stack array

2014-02-23 Thread Armin Rigo
Hi Timothy, On 23 February 2014 01:24, Timothy Baldridge wrote: > I tried digging into the PyPy source to find how how this is done there, but > I haven't been able to find it yet. pypy/interpreter/pyframe.py: self.locals_stack_w. The trick is that it's an attribute of a "frame" class, which is

Re: [pypy-dev] PySide with PyPy

2014-02-23 Thread Armin Rigo
Hi Johan, On 23 February 2014 08:44, Johan Råde wrote: > the installed libraries do not work. Thanks for the instructions! As far as I'm concerned I cannot do anything from "do not work"-kind of descriptions. Please also include a small example of code using the library and tell us exactly wha

Re: [pypy-dev] slow-ish multithreaded primitives

2014-02-23 Thread Armin Rigo
Hi Dima, On 22 February 2014 20:51, Dima Tisnek wrote: > Right, I narrowed it down to condition.wait being much slower with a > timeout than without. Thanks! Fixed. Indeed, I simply took the version of lock.acquire() from the py3k branch (with support for timeout and interrupts), and applied i

Re: [pypy-dev] unaligned raw_load (align_float_cast branch)

2014-02-23 Thread Armin Rigo
Hi Matti, I've checked in some new code in rawstorage.py on default: raw_storage_{get,set}item_unaligned(). It's regular RPython code that checks if the argument is aligned or not, and if not, it falls back to a memcpy(). It should be relatively jit-friendly. Note that I also changed the non-un

Re: [pypy-dev] slow-ish multithreaded primitives

2014-02-23 Thread Armin Rigo
Hi, On 23 February 2014 19:54, Maciej Fijalkowski wrote: > On Sun, Feb 23, 2014 at 6:57 PM, Mark Roberts wrote: >> How hostile would you be to a pypy-2.8 branch with these kinds of >> improvements? > > we don't need a 2.8 branch to do that, we can just commit stuff to > master (that's still pyt

Re: [pypy-dev] unaligned raw_load (align_float_cast branch)

2014-02-23 Thread Armin Rigo
Hi Brian, On 23 February 2014 20:14, Brian Kearns wrote: > I believe all of them in micronumpy are at risk -- any type could be a > subtype of a record type consisting of something like a single char followed > by whatever type. I agree about the ones in the types.py module, but there are more i

Re: [pypy-dev] Virtualizable Frames getting half removed in trace

2014-02-25 Thread Armin Rigo
Hi Maciej, On 25 February 2014 09:09, Maciej Fijalkowski wrote: > ugh that looks really odd, why is p67 not removed escapes my attention Because we do setarrayitem and getarrayitem on non-constant indexes. > On Tue, Feb 25, 2014 at 6:36 AM, Timothy Baldridge > wrote: >> I'm attaching a copy o

Re: [pypy-dev] Virtualizable Frames getting half removed in trace

2014-02-26 Thread Armin Rigo
Hi Timothy, On 25 February 2014 15:06, Timothy Baldridge wrote: > Then I noticed that the trace contained the creation of the argument list, > but that that list was never made. The trace was also making a call out to > some C function so that it could do the array = [None] * argc. I couldn't > g

Re: [pypy-dev] slow-ish multithreaded primitives

2014-02-27 Thread Armin Rigo
Hi Dima, On 25 February 2014 16:45, Dima Tisnek wrote: > Armin, is there really a semantical change? > Consider invocations valid in 2.7, (i.e. without timeout argument), is > it not the same then? It's different: Python 3.x acquire() can be interrupted by signals, whereas Python 2.x acquire() c

Re: [pypy-dev] pypy in python3?

2014-03-02 Thread Armin Rigo
Hi Martin, On 2 March 2014 13:03, Martin Matusiak wrote: > I'm wondering whether there are any plans to port pypy itself to > python 3 at some point. And what the benefits of that might be (other > than having a more recent host language). Is there anything in python > 3 that would make it easier

Re: [pypy-dev] RinohType and PyPy2

2014-03-02 Thread Armin Rigo
Hi Brecht, On 1 March 2014 23:34, Brecht Machiels wrote: > While PyPy2 performs better than PyPy3, it's still much slower than CPython. > Is RinohType hitting a weak spot in PyPy? Any hints on what I can do to > improve performance? It's not really helpful, but the warm-up time is the first is

Re: [pypy-dev] RPython question about the lifetime of global state

2014-03-05 Thread Armin Rigo
Hi Lenard, On 6 March 2014 07:16, Lenard Lindstrom wrote: > The prototype is written in RPython as an interpreter for executing > array copies. The JIT comes automatically from the RPython tool chain, of > course. Cool :-) RPython can certainly be used in this way, although critics might rightf

Re: [pypy-dev] Possibly a PyPy C-API bug

2014-03-08 Thread Armin Rigo
Hi Johan, On 8 March 2014 14:42, Johan Råde wrote: > I think I might have found a bug in the PyPy C-API. > It seems that PyType_Type.tp_new is broken. Indeed. I tried to look, but either I missed something or it looks like it won't be that obvious to fix. For reference, the built-in types like

Re: [pypy-dev] win32 failures on own tests

2014-03-10 Thread Armin Rigo
Hi Matti, On 9 March 2014 23:37, Matti Picus wrote: > id(x) returning a long where an int is expected in rlib\objectmodel.py You're right, both CPython and PyPy return an unsigned integer which may not fit into an "int". A bientôt, Armin. ___ pypy-d

Re: [pypy-dev] Pypy garbage collection

2014-03-13 Thread Armin Rigo
Hi Martin, On 13 March 2014 00:56, Maciej Fijalkowski wrote: > Yes, it totally should. If your pauses are not incremental, we would > like to be able to execute it. Since it's 55G, do you think you can > make us an example that can run on a normal machine? I think the request is not very clear.

Re: [pypy-dev] Rollback interpreter state to fork for unittesting

2014-03-19 Thread Armin Rigo
Hi Anatoly, On 18 March 2014 11:43, anatoly techtonik wrote: > I wonder if it possible to discard run-time changes to interpreter > state and get back to some point in the past? One of the applications > is forking to speed up unit tests - for it after interpreter is > initialized and loaded unit

Re: [pypy-dev] Rollback interpreter state to fork for unittesting

2014-03-19 Thread Armin Rigo
Hi Anatoly, On 19 March 2014 09:47, anatoly techtonik wrote: >> Unsure what you want to do, but isn't os.fork() the answer to your >> first question? > > Yes, but on a interpreter level, independent of underlying platform. What is the motivation for avoiding os.fork()? It's possible to do somet

Re: [pypy-dev] Rollback interpreter state to fork for unittesting

2014-03-19 Thread Armin Rigo
Hi Anatoly, On 19 March 2014 10:42, anatoly techtonik wrote: >> It's possible to do something like that in RPython, if you ignore all >> the additional complications like tracking raw-memory too; it looks >> like an infinite amount of painful work to me, but well, it's not my >> time :-) > > Fair

Re: [pypy-dev] Question about extension support

2014-03-28 Thread Armin Rigo
Hi all, I'd like to point Kevin to the thread "cpyext performance" of July-August 2012, in which we did some explanation of what is slow about cpyext and could potentially be improved. As others have mentioned here again, we can't reasonably hope to get them to the same speed as on CPython, but "

Re: [pypy-dev] Question about extension support

2014-03-28 Thread Armin Rigo
Hi Laura, On 26 March 2014 23:29, Laura Creighton wrote: > really, really hideously slow. You are sometimes _way_ > better off writing python code instead -- pypy with the jit turned off > outperforms CPython purely on the benefits of not doing ref-counting, and > pypy really needs the jit to b

Re: [pypy-dev] Question about extension support

2014-03-29 Thread Armin Rigo
Hi Laura, On 28 March 2014 10:48, Laura Creighton wrote: > Ah, thank you. I actually thought we had found the odd example where > a better gc beat CPython performance even when the jit was off. I am > completely wrong about this? Or is it just that it is so rare it doesn't > matter? Ah, no, y

Re: [pypy-dev] Question about extension support

2014-03-29 Thread Armin Rigo
Hi Sarah, On 28 March 2014 11:08, Sarah Mount wrote: > This is a really interesting discussion, thanks for spelling it out the > details so clearly. Did the measurements you refer to get published > anywhere? Yes, in https://bitbucket.org/pypy/extradoc/raw/tip/eu-report/D07.1_Massive_Parallelis

Re: [pypy-dev] Question about extension support

2014-03-29 Thread Armin Rigo
Hi Laura, On 29 March 2014 09:52, Laura Creighton wrote: > Ok -- the lesson I took from this is 'ref counting hurts performance'. Why > was that the wrong inference to make? No, the lession is "unoptimized refcounting hurts performance". As I've explained above, optimized refcounting like in C

Re: [pypy-dev] JIT not kicking in for callbacks

2014-04-01 Thread Armin Rigo
Hi, On 31 March 2014 20:33, Maciej Fijalkowski wrote: > hi "interpret" includes "in the jit". "In the jit-generated machine code", precisely. Not "in the JIT while building machine code". /me renames this, as it was originally meant indeed to record only interpretation outside machine code.

Re: [pypy-dev] Disabling garbage collection

2014-04-04 Thread Armin Rigo
Hi Martin, On 4 April 2014 15:05, Martin Koch wrote: > Is there a simple way of building a version of pypy where garbage collection > of the old generation is disabled? It should be enough to tweak some environment variables. Try to set PYPY_GC_MIN=99GB A bientôt, Armin. ___

Re: [pypy-dev] Python Execution Contexts Ch.3 - High Level

2014-04-05 Thread Armin Rigo
Hi Anatoly, On 4 April 2014 17:04, anatoly techtonik wrote: > pypy-2.2.1 >>> dir() > ['__builtins__', '__doc__', '__name__'] > > python-2.7.6 >>> dir() > ['__builtins__', '__doc__', '__name__', '__package__'] Please report this as a bug on https://bugs.pypy.org if you feel it's important enough.

Re: [pypy-dev] CPython compatibility in the fractions module

2014-04-10 Thread Armin Rigo
Hi Naftali, On 10 April 2014 21:05, Naftali Harris wrote: > I'd like to report a compatibility issue between CPython and PyPy in the > fractions module. In short, CPython coerces Fraction objects into int's in > strings formatted with "%d", but PyPy throws a TypeError. It seems that "%d" % x

[pypy-dev] OS/X

2014-04-15 Thread Armin Rigo
Hi OS/X'ers, I see in rpython/translator/platform/darwin.py that we use only "clang" as the compiler on OS/X. There was some discussion in #pypy, as well as a proposal from Andrew Dalke to upgrade the gcc on the OS/X buildbot, which go along the lines of "clang is not necessarily always better th

Re: [pypy-dev] OS/X

2014-04-15 Thread Armin Rigo
Hi Kenny, On 15 April 2014 15:22, Kenny Lasse Hoff Levinsen wrote: > The issue is mainly that the bundled GCC is very old (the last GPLv2, IIRC), > but I can install a new GCC and try to translate later tonight, unless > someone else beats me to it. Yes, that's what I meant (sorry if I was not

Re: [pypy-dev] RPython as a separate package

2014-04-16 Thread Armin Rigo
Hi Bogdan, On 16 April 2014 06:59, Bogdan Opanchuk wrote: > it's not even available as a package in the PyPy itself What do you mean? "rpython" is the name of the top-level directory we're talking about, with "__init__.py" and everything. It is a regular package. A bientôt, Armin. _

Re: [pypy-dev] OS/X

2014-04-16 Thread Armin Rigo
Hi, On 15 April 2014 19:21, Kenny Lasse Hoff Levinsen wrote: > I only set CC=gcc-4.9 - no changes required, which is good! Thank you! Armin ___ pypy-dev mailing list pypy-dev@python.org https://mail.python.org/mailman/listinfo/pypy-dev

Re: [pypy-dev] Regression for lxml-cffi install (?)

2014-04-16 Thread Armin Rigo
Hi, On 28 February 2014 17:13, Костя Лопухин wrote: > Maybe I am doing something entirely wrong here (e.g. the install > command may be bogus). > I would appreciate any advice :) Sorry for the delay. It seems that lxml issues don't trigger a lot of enthusiastic responses from our side. I'd rec

Re: [pypy-dev] Alternatives to multiple inheritance

2014-04-17 Thread Armin Rigo
Hi Ryan, On 18 April 2014 01:13, Benjamin Peterson wrote: > On Thu, Apr 17, 2014, at 15:42, Ryan Gonzalez wrote: >> The exception object needs to >> derive from my base class in order for me to use polymorphism inside the >> interpreter. However, it also needs to derive from the Exception class t

Re: [pypy-dev] Blocked Block error

2014-04-22 Thread Armin Rigo
Hi Ryan, On 21 April 2014 20:37, Ryan Gonzalez wrote: > What I want to know is the meaning of the Blocked Block error. I always get > that error at least once. Usually I can solve it myself, but I'm curious as > to what it actually means. When RPython does type inference, it works incrementally.

Re: [pypy-dev] Benchmark that pypy doesn't do well on

2014-04-23 Thread Armin Rigo
Hi Kevin, On 22 April 2014 21:29, Kevin Modzelewski wrote: > I've also tried to extract a part of the program that seemed to run > significantly slower under PyPy, and got this microbenchmark: > https://github.com/dropbox/pyston/blob/master/microbenchmarks/polymorphism.py This suffers from extre

Re: [pypy-dev] 2.3 release is close, please help triage the open bugs

2014-04-23 Thread Armin Rigo
Hi all, On 22 April 2014 20:35, Matti Picus wrote: > For an idea as to what changed, see the release notice > https://bitbucket.org/pypy/pypy/src/20e51c4389ed4469b66bb9d6289ce0ecfc82c4b9/pypy/doc/release-2.3.0.rst?at=release-2.3.x This precisely *fails* to give you any concrete idea about what c

Re: [pypy-dev] Virtualizables in RPython

2014-04-26 Thread Armin Rigo
Hi Anton, On 24 April 2014 12:38, Anton Gulenko wrote: > appreciate your input. I want to collect details about the underlying > concept, and also about the specific implementation in the RPython JIT. For > example, was this concept first introduced in Pypy, or is it an older idea? > How exactly

Re: [pypy-dev] Virtualizables in RPython

2014-04-30 Thread Armin Rigo
Hi Tim, On 29 April 2014 13:22, Tim Felgentreff wrote: > Maybe it's useful to add that even without any changes to the SPy VM, > frame objects in loops are nicely virtualized in the tests (where they > are executing at a stack depth of 1), but already if we execute the > loop at a stack depth of

Re: [pypy-dev] Virtualizables in RPython

2014-04-30 Thread Armin Rigo
Hi Anton, On 30 April 2014 13:11, Anton Gulenko wrote: > Ok, so virtuals and virtualizables are two unrelated mechanisms? > How does the optimizer decide which writes to virtualizable fields it is > able to eliminate? It's not decided by the optimizer. A virtualizable structure has got a static

Re: [pypy-dev] bugs.pypy.org / end of may deadline

2014-05-02 Thread Armin Rigo
Hi Xando, On 2 May 2014 12:26, Sebastian Pawluś wrote: > Problem that we had that kind of stopped the whole process of importing, > bitbucket has an option to update a mailing list when the new issue is > crated though it won't update mailing list when the issue is updated it's > annoying because

Re: [pypy-dev] bugs.pypy.org / end of may deadline

2014-05-02 Thread Armin Rigo
Hi Holger, On 2 May 2014 12:52, holger krekel wrote: > that sounds like a generally useful tool. > My tries to get this implemented at bitbucket level did not yield > results so far (needs more votes i guess): Ok, nice to know. Thanks to the auto-clicking bot hack, it would not turn out to be a

Re: [pypy-dev] PyPy 2.3 alpha release

2014-05-05 Thread Armin Rigo
Hi Matti, On 4 May 2014 13:42, matti picus wrote: > I would also appreciate help with the release notice, the name "Easier Than > Ever" is as lame as this email but that's the best I could do. As this release contains mostly bugfixes and not a lot of new features (outside Numpy), I would suggest

Re: [pypy-dev] 2.3 release candidates available for download

2014-05-08 Thread Armin Rigo
Hi Matti, On 9 May 2014 00:30, Matti Picus wrote: > https://bitbucket.org/pypy/pypy/downloads > Please try them out, let me know if anything seems wrong. Thanks again for doing this release! Trying out now, but no problem found so far. A bientôt, Armin. __

Re: [pypy-dev] Heads up, remap_file_pages() possibly slated for removal from Linux

2014-05-09 Thread Armin Rigo
Hi Jake, On 8 May 2014 02:50, Jake Edge wrote: > http://lwn.net/SubscriberLink/597632/6f444e69b9931d1a/ > > If you folks are still using remap_file_pages(), you may want to speak > up in the thread on linux-kernel ... Thank you for the notice! I've explained the PyPy situation, and it looks now

Re: [pypy-dev] pypy IDLE on windows

2014-05-11 Thread Armin Rigo
Hi Yaacov, On 11 May 2014 17:04, Yaacov Finkelman wrote: > C:\pypy\pypy.exe -i C:\pypy\lib-python\2.7\idlelib\idle.py > ** IDLE can't import Tkinter. Your Python may not be configured for Tk. ** This is a regression in PyPy 2.3. It's due to an unfortunate combination of issues around the impor

[pypy-dev] Virtualenv

2014-05-12 Thread Armin Rigo
Hi all, We talked about making pip and virtualenv available by default on PyPy. I think it's a good idea but we never did it. If anyone feels like doing it and proposing it as a pull request, it would be even greater! A bientôt, Armin. ___ pypy-dev

Re: [pypy-dev] Virtualenv

2014-05-13 Thread Armin Rigo
Hi Donald, On 12 May 2014 18:39, Donald Stufft wrote: > I have a half written patch to backport ensurepip to PyPy, I just got confused > trying to test it and task switched to cover some other things. > > As far as virtualenv goes, instead of virtualenv I’d much rather that you > backport > the

<    3   4   5   6   7   8   9   10   11   12   >