Author: Armin Rigo
Branch: extradoc
Changeset: r5597:a7b5322ad0b4
Date: 2016-01-29 21:51 +0100
http://bitbucket.org/pypy/extradoc/changeset/a7b5322ad0b4/
Log:Slides
diff --git a/talk/fosdem2016/slides b/talk/fosdem2016/slides
new file mode 100644
--- /dev/null
+++ b/talk/fosdem2016/slides
@@ -0,0 +1,405 @@
+=
+CFFI and PyPy
+=
+
+
+CFFI
+
+
+* successful project according to PyPI
+
+* 3.4 million downloads last month
+
+* total 19.2 millions, 27th place on `pypi-ranking.info`
+
+ - Django is 28th
+
+* some high-visibility projects have switched to it (Cryptography)
+
+
+PyPy
+
+
+* harder to say, but probably not so successful
+
+* more later
+
+
+CFFI
+
+
+
+
+CFFI
+
+
+* call C from Python
+
+* CFFI = C Foreign Function Interface
+
+* shares ideas from Cython, ctypes, and LuaJIT's FFI
+
+
+CFFI demo
+=
+
+::
+
+ $ man getpwuid
+
+ SYNOPSIS
+ #include
+ #include
+
+ struct passwd *getpwnam(const char *name);
+
+
+CFFI demo
+=
+
+::
+
+ .
+ .
+ .
+ The passwd structure is defined in as follows:
+
+ struct passwd {
+ char *pw_name; /* username */
+ char *pw_passwd; /* user password */
+ uid_t pw_uid;/* user ID */
+ .
+ .
+ .
+
+
+CFFI demo
+=
+
+::
+
+ from cffi import FFI
+ ffi = cffi.FFI()
+
+ ffi.cdef("""
+ typedef int... uid_t;
+ struct passwd {
+ uid_t pw_uid;
+ ...;
+ };
+ struct passwd *getpwnam(const char *name);
+ """)
+
+
+CFFI demo
+=
+
+::
+
+ ffi.set_source("_pwuid_cffi", """
+ #include
+ #include
+ """)
+
+ ffi.compile()
+
+--- ^^ put that in pwuid_build.py
+
+
+CFFI demo
+=
+
+::
+
+ python pwuid_build.py
+
+creates ``_pwuid_cffi.so``
+
+
+CFFI demo
+=
+
+::
+
+ from _pwuid_cffi import lib
+
+ print lib.getpwnam("arigo").pw_uid
+
+
+CFFI demo
+=
+
+::
+
+ from _pwuid_cffi import ffi, lib
+
+* ``lib`` gives access to all functions from the cdef
+
+* ``ffi`` gives access to a few general helpers, e.g.
+
+ - ``ffi.cast("float", 42)``
+
+ - ``p = ffi.new("struct passwd *")``
+
+ - ``p = ffi.new("char[10]"); p[0] = 'X'; s = lib.getpwnam(p)``
+
+ - ``p = ffi.new_handle(random_obj); ...; random_obj = ffi.from_handle(p)``
+
+
+CFFI
+
+
+* supports more or less the whole C
+
+* there is more than my short explanation suggests
+
+* read the docs: http://cffi.readthedocs.org/
+
+
+
+PyPy
+
+
+
+PyPy
+
+
+* a Python interpreter
+
+* different from the standard, which is CPython
+
+* main goal of PyPy: speed
+
+
+PyPy
+
+
+::
+
+$ pypy
+
+Python 2.7.10 (5f8302b8bf9f, Nov 18 2015, 10:46:46)
+[PyPy 4.0.1 with GCC 4.8.4] on linux2
+Type "help", "copyright", "credits" or "license" for more information.
+ 2+3
+5
+
+
+
+PyPy
+
+
+* run ``pypy my_program.py``
+
+* starts working like an interpreter
+
+* then a Just-in-Time Compiler kicks in
+
+* generate and execute machine code from the Python program
+
+* good or great speed-ups for the majority of long-running code
+
+
+PyPy
+
+
+* different techniques than CPython also for "garbage collection"
+
+* works very well (arguably better than CPython's reference counting)
+
+
+PyPy: Garbage Collection
+
+
+* "**moving,** generational, incremental GC"
+
+* objects don't have reference counters
+
+* allocated in a "nursery"
+
+* when nursery full, find surviving nursery objects and move them out
+
+* usually work on nursery objects only (fast), but rarely also perform
+ a full GC
+
+
+PyPy: C extensions
+==
+
+* PyPy works great for running Python
+
+* less great when there are CPython C extension modules involved
+
+
+PyPy: C extensions
+==
+
+* not directly possible: we have moving, non-reference-counted objects,
+ and the C code expects non-moving, reference-counted objects
+
+
+PyPy: C extensions
+==
+
+* PyPy has still some support for them, called its ``cpyext`` module
+
+* similar to IronPython's Ironclad
+
+* emulate all objects for C extensions with a shadow, non-movable,
+ reference-counted object
+
+
+PyPy: C extensions
+==
+
+* ``cpyext`` is slow
+
+* ``cpyext`` is actually *really, really* slow
+
+ - but we're working on making it *only* slow
+
+
+PyPy: C extensions
+==
+
+* ``cpyext`` will "often" work, but there are a some high-profile C
+ extension modules that are not supported so far
+
+* notably, ``numpy``
+
+* (it is future work)
+
+
+PyPy: ad
+
+
+* but, hey, if you need performance out of Python and don't rely
+ critically on C extension modules, then give PyPy a try
+
+ - typical area where it works well: web services
+
+
+CPython C API: the problem
+==
+
+* CPython comes with a C API
+
+* very large number of functions
+
+* as
