On 7/31/2015 2:14 PM, Trent Nelson wrote:
Hi folks,
Bit off-topic, but just wanted to let people know about an experimental
proof-of-concept fork of Python 3 I've been working on for the past
couple of years called PyParallel: http://pyparallel.org. It essentially
gets around the GIL limitations and allows Python code to run simultaneously
in multiple threads from within a single interpreter/process.
It's Windows only -- so I figured it might be of interest to this list.
It exclusively uses the threadpool APIs that got introduced in Vista,
and has been built from the ground up to leverage the "Windows-way" of
achieving high-performance socket I/O (using overlapped I/O *and*
multiple cores to service completions -- not just polling GQCS() in a
single-threaded event loop).
The performance is pretty phenomenal and it's appearing to scale very
linearly with CPU cores and I/O bandwidth, which is neat. The installer
includes a PyParallel-compatible version of NumPy and pyodbc, so you can
access large NumPy arrays or connect to databases in parallel callbacks.
It's an experimental project though at heart -- don't go using it in
production yet or anything.
Outstanding, Trent. Python's horrible multithreading support is something
that has really kept it from being used in serious environments. Your work
may not cover all platforms yet, but this is a great first step!
Thanks for your efforts.
_______________________________________________
python-win32 mailing list
python-win32@python.org
https://mail.python.org/mailman/listinfo/python-win32
